2024-04-26T09:37:16.886 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T09:37:16.886 DEBUG:teuthology.run:Teuthology command: teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health} --verbose --name teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084 -- /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/orig.config.yaml 2024-04-26T09:37:16.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T09:37:17.006 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674084' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: reef ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: dc093b5e41f728edab6e0330295fdf9156d31664 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: dc093b5e41f728edab6e0330295fdf9156d31664 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 1136 sha1: dc093b5e41f728edab6e0330295fdf9156d31664 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 targets: smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxIbIPilTtG+AtYDBevscLexB1UKWUxmmz8/ZkLNUvidYUne+9M6upUldVJSeSJkvoU/tEe/W2556v7evaF5Xw= smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBz/DhbbGD+wY9rzSAPOlFYnv+1Cj5qQExVw310VsUbRrb04t8831wHH8T5+1muw+c30p5RjQWSOTSWwM/ngv+w= smithi186.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLnxr1WfVQumC5l0O/SK9VEoJB/VQCT3/VNFXvi46W0F9xBjHGsk7beRjhBOiKOiDiph8GNF0s3uGNrSlTYeUMs= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOhok7z7mgz1lImo0ScBP+naf9c5a/s3209el8pYkHo+30lG//26omdlo1lBsCDiX8JWy2uMX2LjBcdVD7kJZgM= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T09:37:17.007 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa; will attempt to use it 2024-04-26T09:37:17.007 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa/tasks 2024-04-26T09:37:17.008 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T09:37:17.009 INFO:teuthology.task.internal:Checking packages... 2024-04-26T09:37:17.036 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'dc093b5e41f728edab6e0330295fdf9156d31664' 2024-04-26T09:37:17.037 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T09:37:17.037 INFO:teuthology.packaging:ref: None 2024-04-26T09:37:17.037 INFO:teuthology.packaging:tag: None 2024-04-26T09:37:17.037 INFO:teuthology.packaging:branch: reef 2024-04-26T09:37:17.037 INFO:teuthology.packaging:sha1: dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T09:37:17.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-26T09:37:17.261 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1258.g7d2137f0 2024-04-26T09:37:17.262 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T09:37:17.268 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T09:37:17.268 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T09:37:17.313 INFO:teuthology.task.internal:Saving configuration 2024-04-26T09:37:17.326 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T09:37:17.345 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T09:37:17.369 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 09:31:58.654863', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxIbIPilTtG+AtYDBevscLexB1UKWUxmmz8/ZkLNUvidYUne+9M6upUldVJSeSJkvoU/tEe/W2556v7evaF5Xw='} 2024-04-26T09:37:17.389 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 09:31:58.656094', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBz/DhbbGD+wY9rzSAPOlFYnv+1Cj5qQExVw310VsUbRrb04t8831wHH8T5+1muw+c30p5RjQWSOTSWwM/ngv+w='} 2024-04-26T09:37:17.410 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 09:31:58.653283', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLnxr1WfVQumC5l0O/SK9VEoJB/VQCT3/VNFXvi46W0F9xBjHGsk7beRjhBOiKOiDiph8GNF0s3uGNrSlTYeUMs='} 2024-04-26T09:37:17.429 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 09:31:58.657250', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOhok7z7mgz1lImo0ScBP+naf9c5a/s3209el8pYkHo+30lG//26omdlo1lBsCDiX8JWy2uMX2LjBcdVD7kJZgM='} 2024-04-26T09:37:17.429 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T09:37:17.435 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-26T09:37:17.435 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['osd.0'] 2024-04-26T09:37:17.435 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['osd.1'] 2024-04-26T09:37:17.435 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['osd.2'] 2024-04-26T09:37:17.435 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T09:37:17.591 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f27182ad0d0>, signals=[15]) 2024-04-26T09:37:17.592 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T09:37:17.597 INFO:teuthology.task.internal:Opening connections... 2024-04-26T09:37:17.598 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-04-26T09:37:17.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:37:17.677 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T09:37:17.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:37:17.755 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2024-04-26T09:37:17.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:37:17.869 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2024-04-26T09:37:17.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:37:17.944 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T09:37:17.950 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-04-26T09:37:17.974 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-04-26T09:37:17.974 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-04-26T09:37:18.037 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-04-26T09:37:18.037 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8" 2024-04-26T09:37:18.037 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-04-26T09:37:18.037 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-04-26T09:37:18.037 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8" 2024-04-26T09:37:18.037 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2024-04-26T09:37:18.037 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T09:37:18.037 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-04-26T09:37:18.037 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T09:37:18.037 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-04-26T09:37:18.037 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T09:37:18.037 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T09:37:18.038 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T09:37:18.038 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-04-26T09:37:18.066 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-04-26T09:37:18.088 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-04-26T09:37:18.089 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-04-26T09:37:18.149 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-04-26T09:37:18.150 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8" 2024-04-26T09:37:18.150 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-04-26T09:37:18.150 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-04-26T09:37:18.150 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8" 2024-04-26T09:37:18.150 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8" 2024-04-26T09:37:18.150 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T09:37:18.150 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-04-26T09:37:18.150 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T09:37:18.150 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-04-26T09:37:18.150 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T09:37:18.150 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T09:37:18.150 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T09:37:18.151 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-04-26T09:37:18.166 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2024-04-26T09:37:18.188 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2024-04-26T09:37:18.189 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2024-04-26T09:37:18.250 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2024-04-26T09:37:18.250 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2024-04-26T09:37:18.250 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2024-04-26T09:37:18.250 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2024-04-26T09:37:18.251 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2024-04-26T09:37:18.251 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2024-04-26T09:37:18.251 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T09:37:18.251 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2024-04-26T09:37:18.251 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T09:37:18.251 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2024-04-26T09:37:18.251 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T09:37:18.251 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T09:37:18.251 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T09:37:18.251 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2024-04-26T09:37:18.266 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-04-26T09:37:18.288 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-04-26T09:37:18.288 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-04-26T09:37:18.349 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-04-26T09:37:18.349 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2024-04-26T09:37:18.349 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-04-26T09:37:18.349 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-04-26T09:37:18.349 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2024-04-26T09:37:18.349 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2024-04-26T09:37:18.349 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-26T09:37:18.349 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-04-26T09:37:18.349 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-26T09:37:18.349 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-04-26T09:37:18.349 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T09:37:18.349 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-26T09:37:18.350 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T09:37:18.350 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-04-26T09:37:18.374 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T09:37:18.384 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T09:37:18.403 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T09:37:18.403 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-04-26T09:37:18.406 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-04-26T09:37:18.408 DEBUG:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2024-04-26T09:37:18.410 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2024-04-26T09:37:18.429 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T09:37:18.436 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T09:37:18.436 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-04-26T09:37:18.468 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-04-26T09:37:18.470 DEBUG:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2024-04-26T09:37:18.472 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2024-04-26T09:37:18.536 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T09:37:18.631 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T09:37:18.646 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T09:37:18.646 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T09:37:18.647 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T09:37:18.647 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T09:37:18.648 DEBUG:teuthology.orchestra.run.smithi186:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T09:37:18.648 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T09:37:18.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T09:37:18.668 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-04-26T09:37:18.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T09:37:18.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T09:37:18.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T09:37:18.671 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-04-26T09:37:18.672 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2024-04-26T09:37:18.672 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-04-26T09:37:18.728 INFO:teuthology.orchestra.run.smithi187.stdout:4.18.0-489.el8.x86_64 2024-04-26T09:37:18.729 INFO:teuthology.task.kernel:Running kernel on smithi187: 4.18.0-489.el8.x86_64 2024-04-26T09:37:18.729 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum install -y kernel 2024-04-26T09:37:18.732 INFO:teuthology.orchestra.run.smithi112.stdout:4.18.0-489.el8.x86_64 2024-04-26T09:37:18.732 INFO:teuthology.task.kernel:Running kernel on smithi112: 4.18.0-489.el8.x86_64 2024-04-26T09:37:18.732 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum install -y kernel 2024-04-26T09:37:18.734 INFO:teuthology.orchestra.run.smithi186.stdout:4.18.0-489.el8.x86_64 2024-04-26T09:37:18.734 INFO:teuthology.orchestra.run.smithi043.stdout:4.18.0-489.el8.x86_64 2024-04-26T09:37:18.734 INFO:teuthology.task.kernel:Running kernel on smithi186: 4.18.0-489.el8.x86_64 2024-04-26T09:37:18.734 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum install -y kernel 2024-04-26T09:37:18.735 INFO:teuthology.task.kernel:Running kernel on smithi043: 4.18.0-489.el8.x86_64 2024-04-26T09:37:18.735 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum install -y kernel 2024-04-26T09:42:30.606 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - AppStream 93 kB/s | 28 MB 05:09 2024-04-26T09:42:36.048 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 10 MB 00:00 2024-04-26T09:42:37.981 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - Extras 55 kB/s | 18 kB 00:00 2024-04-26T09:42:38.465 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 7.7 kB 00:00 2024-04-26T09:42:38.700 INFO:teuthology.orchestra.run.smithi112.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-04-26T09:42:40.084 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2024-04-26T09:42:43.901 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 441 kB/s | 24 kB 00:00 2024-04-26T09:42:46.906 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T09:42:46.906 INFO:teuthology.orchestra.run.smithi112.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T09:42:47.019 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-26T09:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-26T09:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout: Package Architecture Version Repository Size 2024-04-26T09:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-26T09:42:47.020 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-26T09:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T09:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-04-26T09:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T09:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T09:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T09:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-26T09:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout:================================================================================ 2024-04-26T09:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout:Install 3 Packages 2024-04-26T09:42:47.021 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T09:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 90 M 2024-04-26T09:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout:Installed size: 96 M 2024-04-26T09:42:47.022 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-26T09:42:48.661 INFO:teuthology.orchestra.run.smithi112.stdout:(1/3): kernel-core-4.18.0-552.el8.x86_64.rpm 30 MB/s | 44 MB 00:01 2024-04-26T09:42:48.819 INFO:teuthology.orchestra.run.smithi112.stdout:(2/3): kernel-4.18.0-552.el8.x86_64.rpm 6.5 MB/s | 10 MB 00:01 2024-04-26T09:42:49.440 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - AppStream 87 kB/s | 28 MB 05:28 2024-04-26T09:42:49.661 INFO:teuthology.orchestra.run.smithi112.stdout:(3/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 15 MB/s | 36 MB 00:02 2024-04-26T09:42:49.662 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-26T09:42:49.662 INFO:teuthology.orchestra.run.smithi112.stdout:Total 34 MB/s | 90 MB 00:02 2024-04-26T09:42:50.343 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-26T09:42:50.765 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-26T09:42:50.765 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-26T09:42:52.021 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-26T09:42:52.050 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-26T09:42:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-26T09:42:55.132 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - BaseOS 20 MB/s | 10 MB 00:00 2024-04-26T09:42:55.353 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T09:42:56.932 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - Extras 115 kB/s | 18 kB 00:00 2024-04-26T09:42:57.366 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - Extras common packages 23 kB/s | 7.7 kB 00:00 2024-04-26T09:42:57.601 INFO:teuthology.orchestra.run.smithi187.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-04-26T09:42:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T09:42:58.993 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-04-26T09:42:59.328 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T09:43:00.190 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - AppStream 84 kB/s | 28 MB 05:38 2024-04-26T09:43:02.763 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T09:43:02.843 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 402 kB/s | 24 kB 00:00 2024-04-26T09:43:03.034 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:05.865 INFO:teuthology.orchestra.run.smithi187.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T09:43:05.865 INFO:teuthology.orchestra.run.smithi187.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T09:43:05.983 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-04-26T09:43:05.983 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-04-26T09:43:05.984 INFO:teuthology.orchestra.run.smithi187.stdout: Package Architecture Version Repository Size 2024-04-26T09:43:05.984 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-04-26T09:43:05.984 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-04-26T09:43:05.984 INFO:teuthology.orchestra.run.smithi187.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T09:43:05.984 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-04-26T09:43:05.984 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T09:43:05.984 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T09:43:05.984 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T09:43:05.984 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-04-26T09:43:05.984 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2024-04-26T09:43:05.984 INFO:teuthology.orchestra.run.smithi187.stdout:Install 3 Packages 2024-04-26T09:43:05.984 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T09:43:05.985 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 90 M 2024-04-26T09:43:05.985 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 96 M 2024-04-26T09:43:05.985 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-04-26T09:43:06.165 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 10 MB 00:00 2024-04-26T09:43:06.786 INFO:teuthology.orchestra.run.smithi187.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 14 MB/s | 10 MB 00:00 2024-04-26T09:43:07.545 INFO:teuthology.orchestra.run.smithi187.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 24 MB/s | 36 MB 00:01 2024-04-26T09:43:08.198 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - Extras 59 kB/s | 18 kB 00:00 2024-04-26T09:43:08.212 INFO:teuthology.orchestra.run.smithi187.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 20 MB/s | 44 MB 00:02 2024-04-26T09:43:08.212 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-04-26T09:43:08.212 INFO:teuthology.orchestra.run.smithi187.stdout:Total 41 MB/s | 90 MB 00:02 2024-04-26T09:43:08.682 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 7.7 kB 00:00 2024-04-26T09:43:08.902 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-04-26T09:43:08.934 INFO:teuthology.orchestra.run.smithi043.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-04-26T09:43:09.330 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-04-26T09:43:09.330 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-04-26T09:43:10.023 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - AppStream 82 kB/s | 28 MB 05:48 2024-04-26T09:43:10.253 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2024-04-26T09:43:10.597 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-04-26T09:43:10.599 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-04-26T09:43:13.485 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-04-26T09:43:13.996 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T09:43:14.343 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 420 kB/s | 24 kB 00:00 2024-04-26T09:43:16.065 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - BaseOS 9.7 MB/s | 10 MB 00:01 2024-04-26T09:43:17.573 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T09:43:17.574 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T09:43:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T09:43:17.691 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-04-26T09:43:17.692 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-26T09:43:17.692 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-04-26T09:43:17.692 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-26T09:43:17.693 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-04-26T09:43:17.693 INFO:teuthology.orchestra.run.smithi043.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T09:43:17.693 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-04-26T09:43:17.693 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T09:43:17.693 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T09:43:17.693 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T09:43:17.693 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-04-26T09:43:17.693 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-04-26T09:43:17.693 INFO:teuthology.orchestra.run.smithi043.stdout:Install 3 Packages 2024-04-26T09:43:17.693 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T09:43:17.694 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 90 M 2024-04-26T09:43:17.694 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 96 M 2024-04-26T09:43:17.694 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-04-26T09:43:17.857 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - Extras 92 kB/s | 18 kB 00:00 2024-04-26T09:43:18.089 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T09:43:18.291 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - Extras common packages 24 kB/s | 7.7 kB 00:00 2024-04-26T09:43:18.337 INFO:teuthology.orchestra.run.smithi043.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 18 MB/s | 10 MB 00:00 2024-04-26T09:43:18.639 INFO:teuthology.orchestra.run.smithi186.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2024-04-26T09:43:19.128 INFO:teuthology.orchestra.run.smithi043.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 26 MB/s | 36 MB 00:01 2024-04-26T09:43:19.703 INFO:teuthology.orchestra.run.smithi043.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 22 MB/s | 44 MB 00:01 2024-04-26T09:43:19.703 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-04-26T09:43:19.704 INFO:teuthology.orchestra.run.smithi043.stdout:Total 45 MB/s | 90 MB 00:02 2024-04-26T09:43:19.912 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-04-26T09:43:20.422 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-04-26T09:43:20.877 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-04-26T09:43:20.877 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-04-26T09:43:21.533 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T09:43:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:22.174 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-04-26T09:43:22.200 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-04-26T09:43:23.668 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 461 kB/s | 24 kB 00:00 2024-04-26T09:43:25.004 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:25.151 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-04-26T09:43:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T09:43:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T09:43:25.684 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T09:43:25.891 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:25.891 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T09:43:25.891 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-26T09:43:25.891 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T09:43:25.891 INFO:teuthology.orchestra.run.smithi112.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T09:43:25.891 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T09:43:25.891 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-26T09:43:26.053 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T09:43:26.312 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T09:43:26.313 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T09:43:26.313 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T09:43:26.313 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T09:43:26.313 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T09:43:26.313 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-26T09:43:26.313 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T09:43:26.313 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T09:43:26.525 INFO:teuthology.orchestra.run.smithi112.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T09:43:26.526 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T09:43:26.526 DEBUG:teuthology.orchestra.run.smithi112:> sudo rpm -qi grub2-tools 2024-04-26T09:43:26.559 INFO:teuthology.orchestra.run.smithi112.stdout:Name : grub2-tools 2024-04-26T09:43:26.559 INFO:teuthology.orchestra.run.smithi112.stdout:Epoch : 1 2024-04-26T09:43:26.559 INFO:teuthology.orchestra.run.smithi112.stdout:Version : 2.02 2024-04-26T09:43:26.559 INFO:teuthology.orchestra.run.smithi112.stdout:Release : 129.el8 2024-04-26T09:43:26.559 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: x86_64 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:Group : System Environment/Base 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:Size : 9265586 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:License : GPLv3+ 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:Relocations : (not relocatable) 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:Packager : CentOS BuildSystem 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:Vendor : CentOS 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:Summary : Support tools for GRUB. 2024-04-26T09:43:26.560 INFO:teuthology.orchestra.run.smithi112.stdout:Description : 2024-04-26T09:43:26.561 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T09:43:26.561 INFO:teuthology.orchestra.run.smithi112.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T09:43:26.561 INFO:teuthology.orchestra.run.smithi112.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T09:43:26.561 INFO:teuthology.orchestra.run.smithi112.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T09:43:26.561 INFO:teuthology.orchestra.run.smithi112.stdout:hardware devices. 2024-04-26T09:43:26.561 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T09:43:26.561 INFO:teuthology.orchestra.run.smithi112.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T09:43:26.562 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T09:43:26.562 INFO:teuthology.task.kernel:Updating grub on smithi112 to boot 4.18.0-552.el8.x86_64 2024-04-26T09:43:26.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T09:43:26.715 INFO:teuthology.orchestra.run.smithi186.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-26T09:43:26.715 INFO:teuthology.orchestra.run.smithi186.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-26T09:43:26.830 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-26T09:43:26.831 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-26T09:43:26.831 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-04-26T09:43:26.831 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-26T09:43:26.831 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-26T09:43:26.831 INFO:teuthology.orchestra.run.smithi186.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-26T09:43:26.831 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2024-04-26T09:43:26.831 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-26T09:43:26.832 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-26T09:43:26.832 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T09:43:26.832 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-26T09:43:26.832 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-26T09:43:26.832 INFO:teuthology.orchestra.run.smithi186.stdout:Install 3 Packages 2024-04-26T09:43:26.832 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T09:43:26.832 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 90 M 2024-04-26T09:43:26.833 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 96 M 2024-04-26T09:43:26.833 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-26T09:43:28.126 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-04-26T09:43:28.336 INFO:teuthology.orchestra.run.smithi186.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 8.0 MB/s | 10 MB 00:01 2024-04-26T09:43:29.220 INFO:teuthology.orchestra.run.smithi186.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 17 MB/s | 36 MB 00:02 2024-04-26T09:43:29.422 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T09:43:29.825 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T09:43:29.965 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-04-26T09:43:29.967 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-04-26T09:43:29.993 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.GIhyvQ0BJV 2024-04-26T09:43:29.994 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GIhyvQ0BJV 2024-04-26T09:43:30.066 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.GIhyvQ0BJV 2024-04-26T09:43:30.219 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.GIhyvQ0BJV is 6KB 2024-04-26T09:43:30.267 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.GIhyvQ0BJV 2024-04-26T09:43:30.285 DEBUG:teuthology.orchestra.run.smithi112:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T09:43:30.345 INFO:teuthology.orchestra.run.smithi186.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 13 MB/s | 44 MB 00:03 2024-04-26T09:43:30.346 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-26T09:43:30.346 INFO:teuthology.orchestra.run.smithi186.stdout:Total 26 MB/s | 90 MB 00:03 2024-04-26T09:43:30.352 INFO:teuthology.orchestra.run.smithi112.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T09:43:30.352 INFO:teuthology.orchestra.run.smithi112.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T09:43:30.352 INFO:teuthology.orchestra.run.smithi112.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T09:43:30.353 INFO:teuthology.orchestra.run.smithi112.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T09:43:30.354 DEBUG:teuthology.orchestra.run.smithi112:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T09:43:30.515 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-04-26T09:43:31.029 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-26T09:43:31.453 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-26T09:43:31.453 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-26T09:43:32.715 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-26T09:43:32.726 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-26T09:43:33.511 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T09:43:33.819 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:35.491 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-26T09:43:36.003 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T09:43:39.606 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-26T09:43:39.994 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T09:43:43.424 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-26T09:43:43.710 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:44.094 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:44.094 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T09:43:44.094 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T09:43:44.587 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:44.587 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T09:43:44.587 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-04-26T09:43:44.587 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T09:43:44.588 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T09:43:44.588 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T09:43:44.588 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-04-26T09:43:44.717 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T09:43:44.932 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T09:43:44.933 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T09:43:44.933 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T09:43:44.933 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T09:43:44.933 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T09:43:44.933 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-26T09:43:44.933 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T09:43:44.934 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T09:43:45.145 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T09:43:45.145 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T09:43:45.145 DEBUG:teuthology.orchestra.run.smithi187:> sudo rpm -qi grub2-tools 2024-04-26T09:43:45.179 INFO:teuthology.orchestra.run.smithi187.stdout:Name : grub2-tools 2024-04-26T09:43:45.179 INFO:teuthology.orchestra.run.smithi187.stdout:Epoch : 1 2024-04-26T09:43:45.179 INFO:teuthology.orchestra.run.smithi187.stdout:Version : 2.02 2024-04-26T09:43:45.179 INFO:teuthology.orchestra.run.smithi187.stdout:Release : 129.el8 2024-04-26T09:43:45.179 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: x86_64 2024-04-26T09:43:45.179 INFO:teuthology.orchestra.run.smithi187.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T09:43:45.180 INFO:teuthology.orchestra.run.smithi187.stdout:Group : System Environment/Base 2024-04-26T09:43:45.180 INFO:teuthology.orchestra.run.smithi187.stdout:Size : 9265586 2024-04-26T09:43:45.180 INFO:teuthology.orchestra.run.smithi187.stdout:License : GPLv3+ 2024-04-26T09:43:45.180 INFO:teuthology.orchestra.run.smithi187.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T09:43:45.180 INFO:teuthology.orchestra.run.smithi187.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T09:43:45.180 INFO:teuthology.orchestra.run.smithi187.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T09:43:45.180 INFO:teuthology.orchestra.run.smithi187.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T09:43:45.180 INFO:teuthology.orchestra.run.smithi187.stdout:Relocations : (not relocatable) 2024-04-26T09:43:45.180 INFO:teuthology.orchestra.run.smithi187.stdout:Packager : CentOS BuildSystem 2024-04-26T09:43:45.180 INFO:teuthology.orchestra.run.smithi187.stdout:Vendor : CentOS 2024-04-26T09:43:45.180 INFO:teuthology.orchestra.run.smithi187.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T09:43:45.180 INFO:teuthology.orchestra.run.smithi187.stdout:Summary : Support tools for GRUB. 2024-04-26T09:43:45.180 INFO:teuthology.orchestra.run.smithi187.stdout:Description : 2024-04-26T09:43:45.181 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T09:43:45.181 INFO:teuthology.orchestra.run.smithi187.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T09:43:45.181 INFO:teuthology.orchestra.run.smithi187.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T09:43:45.181 INFO:teuthology.orchestra.run.smithi187.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T09:43:45.181 INFO:teuthology.orchestra.run.smithi187.stdout:hardware devices. 2024-04-26T09:43:45.181 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T09:43:45.181 INFO:teuthology.orchestra.run.smithi187.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T09:43:45.182 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T09:43:45.182 INFO:teuthology.task.kernel:Updating grub on smithi187 to boot 4.18.0-552.el8.x86_64 2024-04-26T09:43:45.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T09:43:46.837 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2024-04-26T09:43:48.624 INFO:teuthology.orchestra.run.smithi187.stderr:done 2024-04-26T09:43:48.626 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2024-04-26T09:43:48.653 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.q09MaLmq2O 2024-04-26T09:43:48.653 DEBUG:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.q09MaLmq2O 2024-04-26T09:43:48.726 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.q09MaLmq2O 2024-04-26T09:43:48.865 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.q09MaLmq2O is 6KB 2024-04-26T09:43:48.916 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.q09MaLmq2O 2024-04-26T09:43:48.936 DEBUG:teuthology.orchestra.run.smithi187:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T09:43:49.030 INFO:teuthology.orchestra.run.smithi187.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T09:43:49.073 INFO:teuthology.orchestra.run.smithi187.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T09:43:49.074 INFO:teuthology.orchestra.run.smithi187.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T09:43:49.074 INFO:teuthology.orchestra.run.smithi187.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T09:43:49.075 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T09:43:49.220 DEBUG:teuthology.orchestra.run.smithi187:> sudo shutdown -r now 2024-04-26T09:43:57.287 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:57.311 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:57.677 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T09:43:57.678 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T09:43:58.522 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:43:58.522 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T09:43:58.522 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-04-26T09:43:58.522 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T09:43:58.522 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T09:43:58.522 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T09:43:58.522 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-04-26T09:43:58.666 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T09:43:58.898 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T09:43:58.899 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T09:43:58.899 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T09:43:58.899 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T09:43:58.899 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T09:43:58.899 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-26T09:43:58.899 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T09:43:58.899 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T09:43:59.120 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T09:43:59.120 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T09:43:59.120 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -qi grub2-tools 2024-04-26T09:43:59.155 INFO:teuthology.orchestra.run.smithi043.stdout:Name : grub2-tools 2024-04-26T09:43:59.155 INFO:teuthology.orchestra.run.smithi043.stdout:Epoch : 1 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:Version : 2.02 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:Release : 129.el8 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: x86_64 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:Group : System Environment/Base 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:Size : 9265586 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:License : GPLv3+ 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:Relocations : (not relocatable) 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:Packager : CentOS BuildSystem 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:Vendor : CentOS 2024-04-26T09:43:59.156 INFO:teuthology.orchestra.run.smithi043.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T09:43:59.157 INFO:teuthology.orchestra.run.smithi043.stdout:Summary : Support tools for GRUB. 2024-04-26T09:43:59.157 INFO:teuthology.orchestra.run.smithi043.stdout:Description : 2024-04-26T09:43:59.157 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T09:43:59.157 INFO:teuthology.orchestra.run.smithi043.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T09:43:59.157 INFO:teuthology.orchestra.run.smithi043.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T09:43:59.157 INFO:teuthology.orchestra.run.smithi043.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T09:43:59.157 INFO:teuthology.orchestra.run.smithi043.stdout:hardware devices. 2024-04-26T09:43:59.157 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T09:43:59.157 INFO:teuthology.orchestra.run.smithi043.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T09:43:59.158 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T09:43:59.158 INFO:teuthology.task.kernel:Updating grub on smithi043 to boot 4.18.0-552.el8.x86_64 2024-04-26T09:43:59.158 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T09:44:00.416 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2024-04-26T09:44:00.517 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-26T09:44:00.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T09:44:00.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:44:02.477 INFO:teuthology.orchestra.run.smithi043.stderr:done 2024-04-26T09:44:02.479 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-04-26T09:44:02.499 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.nolDpCVPwD 2024-04-26T09:44:02.499 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nolDpCVPwD 2024-04-26T09:44:02.572 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.nolDpCVPwD 2024-04-26T09:44:02.727 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.nolDpCVPwD is 6KB 2024-04-26T09:44:02.776 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.nolDpCVPwD 2024-04-26T09:44:02.794 DEBUG:teuthology.orchestra.run.smithi043:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T09:44:02.868 INFO:teuthology.orchestra.run.smithi043.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T09:44:02.869 INFO:teuthology.orchestra.run.smithi043.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T09:44:02.869 INFO:teuthology.orchestra.run.smithi043.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T09:44:02.869 INFO:teuthology.orchestra.run.smithi043.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T09:44:02.870 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T09:44:03.032 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2024-04-26T09:44:06.060 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:44:06.084 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:44:06.517 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:44:06.518 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-26T09:44:06.518 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-26T09:44:07.025 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-26T09:44:07.025 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T09:44:07.025 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-26T09:44:07.025 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-26T09:44:07.025 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-26T09:44:07.025 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T09:44:07.025 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-26T09:44:07.178 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T09:44:07.455 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T09:44:07.455 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T09:44:07.456 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-26T09:44:07.456 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T09:44:07.456 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T09:44:07.456 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-26T09:44:07.456 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi186.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T09:44:07.456 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T09:44:07.668 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-26T09:44:07.668 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-26T09:44:07.668 DEBUG:teuthology.orchestra.run.smithi186:> sudo rpm -qi grub2-tools 2024-04-26T09:44:07.702 INFO:teuthology.orchestra.run.smithi186.stdout:Name : grub2-tools 2024-04-26T09:44:07.702 INFO:teuthology.orchestra.run.smithi186.stdout:Epoch : 1 2024-04-26T09:44:07.702 INFO:teuthology.orchestra.run.smithi186.stdout:Version : 2.02 2024-04-26T09:44:07.702 INFO:teuthology.orchestra.run.smithi186.stdout:Release : 129.el8 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:Architecture: x86_64 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:Group : System Environment/Base 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:Size : 9265586 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:License : GPLv3+ 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:Relocations : (not relocatable) 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:Packager : CentOS BuildSystem 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:Vendor : CentOS 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:Summary : Support tools for GRUB. 2024-04-26T09:44:07.703 INFO:teuthology.orchestra.run.smithi186.stdout:Description : 2024-04-26T09:44:07.704 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T09:44:07.704 INFO:teuthology.orchestra.run.smithi186.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-26T09:44:07.704 INFO:teuthology.orchestra.run.smithi186.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-26T09:44:07.704 INFO:teuthology.orchestra.run.smithi186.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-26T09:44:07.704 INFO:teuthology.orchestra.run.smithi186.stdout:hardware devices. 2024-04-26T09:44:07.704 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T09:44:07.704 INFO:teuthology.orchestra.run.smithi186.stdout:This subpackage provides tools for support of all platforms. 2024-04-26T09:44:07.705 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-26T09:44:07.705 INFO:teuthology.task.kernel:Updating grub on smithi186 to boot 4.18.0-552.el8.x86_64 2024-04-26T09:44:07.705 DEBUG:teuthology.orchestra.run.smithi186:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-26T09:44:09.058 INFO:teuthology.orchestra.run.smithi186.stderr:Generating grub configuration file ... 2024-04-26T09:44:11.291 INFO:teuthology.orchestra.run.smithi186.stderr:done 2024-04-26T09:44:11.292 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2024-04-26T09:44:11.315 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.PUPVdkqlDq 2024-04-26T09:44:11.315 DEBUG:teuthology.orchestra.run.smithi186:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PUPVdkqlDq 2024-04-26T09:44:11.388 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.PUPVdkqlDq 2024-04-26T09:44:11.535 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.PUPVdkqlDq is 6KB 2024-04-26T09:44:11.584 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.PUPVdkqlDq 2024-04-26T09:44:11.602 DEBUG:teuthology.orchestra.run.smithi186:> sudo /bin/ls /boot/loader/entries || true 2024-04-26T09:44:11.674 INFO:teuthology.orchestra.run.smithi186.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-26T09:44:11.674 INFO:teuthology.orchestra.run.smithi186.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-26T09:44:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-26T09:44:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-26T09:44:11.676 DEBUG:teuthology.orchestra.run.smithi186:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-26T09:44:11.820 DEBUG:teuthology.orchestra.run.smithi186:> sudo shutdown -r now 2024-04-26T09:44:18.978 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-26T09:44:19.226 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-26T09:44:19.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-26T09:44:19.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:44:27.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T09:44:27.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:44:31.038 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-26T09:44:33.037 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T09:44:33.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-26T09:44:33.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:44:37.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-26T09:44:41.826 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-26T09:44:41.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-26T09:44:41.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:44:43.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T09:44:43.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:44:46.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-26T09:44:46.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:44:49.730 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-26T09:44:51.490 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-26T09:45:00.190 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-04-26T09:45:00.491 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-26T09:45:00.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:45:01.470 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-26T09:45:01.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-26T09:45:01.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:45:09.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-26T09:45:09.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:45:12.254 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-04-26T09:45:16.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T09:45:16.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:45:17.258 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-04-26T09:45:17.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T09:45:17.788 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "4.18.0-552.el8.x86_64"... 2024-04-26T09:45:17.788 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-04-26T09:45:17.805 INFO:teuthology.orchestra.run.smithi112.stdout:4.18.0-552.el8.x86_64 2024-04-26T09:45:17.806 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T09:45:17.806 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T09:45:17.806 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T09:45:18.807 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-26T09:45:18.808 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T09:45:18.869 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-04-26T09:45:18.880 DEBUG:teuthology.parallel:result is None 2024-04-26T09:45:24.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-26T09:45:24.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:45:33.884 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-04-26T09:45:34.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-26T09:45:34.388 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "4.18.0-552.el8.x86_64"... 2024-04-26T09:45:34.388 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2024-04-26T09:45:34.447 INFO:teuthology.orchestra.run.smithi187.stdout:4.18.0-552.el8.x86_64 2024-04-26T09:45:34.447 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T09:45:34.447 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T09:45:34.448 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T09:45:35.448 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-26T09:45:35.449 DEBUG:teuthology.orchestra.run.smithi187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T09:45:35.517 INFO:teuthology.orchestra.run.smithi187.stdout:ttyS1 2024-04-26T09:45:35.530 DEBUG:teuthology.parallel:result is None 2024-04-26T09:45:42.686 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-04-26T09:45:57.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-26T09:45:57.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:45:57.994 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-04-26T09:45:58.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-26T09:45:58.257 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "4.18.0-552.el8.x86_64"... 2024-04-26T09:45:58.257 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2024-04-26T09:45:58.274 INFO:teuthology.orchestra.run.smithi186.stdout:4.18.0-552.el8.x86_64 2024-04-26T09:45:58.275 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T09:45:58.275 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T09:45:58.275 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T09:45:59.276 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-26T09:45:59.277 DEBUG:teuthology.orchestra.run.smithi186:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T09:45:59.351 INFO:teuthology.orchestra.run.smithi186.stdout:ttyS1 2024-04-26T09:45:59.363 DEBUG:teuthology.parallel:result is None 2024-04-26T09:46:00.495 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T09:46:12.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-26T09:46:12.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:46:12.892 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-04-26T09:46:13.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-26T09:46:13.162 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-552.el8.x86_64"... 2024-04-26T09:46:13.162 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-04-26T09:46:13.224 INFO:teuthology.orchestra.run.smithi043.stdout:4.18.0-552.el8.x86_64 2024-04-26T09:46:13.224 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-26T09:46:13.224 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T09:46:13.224 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-26T09:46:14.225 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T09:46:14.225 DEBUG:teuthology.orchestra.run.smithi043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T09:46:14.324 INFO:teuthology.orchestra.run.smithi043.stdout:ttyS1 2024-04-26T09:46:14.338 DEBUG:teuthology.parallel:result is None 2024-04-26T09:46:14.338 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T09:46:14.345 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T09:46:14.346 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T09:46:14.348 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T09:46:14.350 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T09:46:14.354 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T09:46:14.376 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T09:46:14.388 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T09:46:14.439 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T09:46:14.439 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T09:46:14.442 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T09:46:14.444 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T09:46:14.446 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T09:46:14.497 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T09:46:14.504 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T09:46:14.504 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T09:46:14.513 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T09:46:14.521 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T09:46:14.523 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T09:46:14.552 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T09:46:14.559 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T09:46:14.559 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T09:46:14.562 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T09:46:14.563 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T09:46:14.569 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T09:46:14.574 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T09:46:14.575 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T09:46:14.576 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T09:46:14.587 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T09:46:14.587 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T09:46:14.608 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T09:46:14.616 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T09:46:14.618 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T09:46:14.649 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T09:46:14.659 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T09:46:14.660 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T09:46:14.681 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T09:46:14.686 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T09:46:14.689 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T09:46:14.709 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T09:46:14.786 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T09:46:14.845 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T09:46:14.893 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T09:46:14.935 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T09:46:14.936 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T09:46:15.004 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T09:46:15.080 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T09:46:15.119 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T09:46:15.206 DEBUG:teuthology.orchestra.run.smithi112:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T09:46:15.251 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T09:46:15.251 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T09:46:15.319 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T09:46:15.362 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T09:46:15.433 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T09:46:15.482 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T09:46:15.526 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-26T09:46:15.526 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T09:46:15.595 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T09:46:15.639 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T09:46:15.701 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T09:46:15.787 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T09:46:15.831 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-26T09:46:15.831 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T09:46:15.899 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-04-26T09:46:15.902 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-04-26T09:46:15.904 DEBUG:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2024-04-26T09:46:15.906 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2024-04-26T09:46:15.967 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T09:46:15.972 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T09:46:15.981 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T09:46:16.007 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T09:46:16.448 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T09:46:16.456 INFO:teuthology.task.internal:Starting timer... 2024-04-26T09:46:16.456 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T09:46:16.500 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T09:46:16.549 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-26T09:46:16.549 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2024-04-26T09:46:16.628 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2024-04-26T09:46:16.630 DEBUG:teuthology.orchestra.run.smithi112:> sudo service auditd rotate 2024-04-26T09:46:16.715 INFO:teuthology.orchestra.run.smithi112.stdout:Rotating logs: 2024-04-26T09:46:16.717 DEBUG:teuthology.orchestra.run.smithi186:> sudo service auditd rotate 2024-04-26T09:46:16.791 INFO:teuthology.orchestra.run.smithi186.stdout:Rotating logs: 2024-04-26T09:46:16.793 DEBUG:teuthology.orchestra.run.smithi187:> sudo service auditd rotate 2024-04-26T09:46:16.860 INFO:teuthology.orchestra.run.smithi187.stdout:Rotating logs: 2024-04-26T09:46:16.862 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T09:46:16.862 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2024-04-26T09:46:16.885 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2024-04-26T09:46:16.885 DEBUG:teuthology.orchestra.run.smithi112:> /usr/sbin/getenforce 2024-04-26T09:46:16.934 INFO:teuthology.orchestra.run.smithi112.stdout:Permissive 2024-04-26T09:46:16.934 DEBUG:teuthology.orchestra.run.smithi186:> /usr/sbin/getenforce 2024-04-26T09:46:16.975 INFO:teuthology.orchestra.run.smithi186.stdout:Permissive 2024-04-26T09:46:16.975 DEBUG:teuthology.orchestra.run.smithi187:> /usr/sbin/getenforce 2024-04-26T09:46:17.033 INFO:teuthology.orchestra.run.smithi187.stdout:Permissive 2024-04-26T09:46:17.034 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi043.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi112.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi186.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi187.front.sepia.ceph.com': 'permissive'} 2024-04-26T09:46:17.034 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T09:46:17.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T09:46:17.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T09:46:17.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T09:46:17.092 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T09:46:17.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T09:46:17.122 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T09:46:17.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T09:46:17.149 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T09:46:17.149 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2024-04-26T09:46:17.182 DEBUG:teuthology.orchestra.run.smithi112:> sudo /usr/sbin/setenforce permissive 2024-04-26T09:46:17.210 DEBUG:teuthology.orchestra.run.smithi186:> sudo /usr/sbin/setenforce permissive 2024-04-26T09:46:17.243 DEBUG:teuthology.orchestra.run.smithi187:> sudo /usr/sbin/setenforce permissive 2024-04-26T09:46:17.269 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T09:46:17.280 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T09:46:17.299 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T09:46:17.300 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi112.front.sepia.ceph.com,smithi186.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T09:58:21.792 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2024-04-26T09:58:21.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-26T09:58:21.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:58:21.871 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-04-26T09:58:21.950 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-26T09:58:21.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T09:58:21.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:58:22.034 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-04-26T09:58:22.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T09:58:22.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-26T09:58:22.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:58:22.182 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-04-26T09:58:22.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-26T09:58:22.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-26T09:58:22.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T09:58:22.341 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-04-26T09:58:22.419 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-26T09:58:22.421 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T09:58:22.434 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T09:58:22.434 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T09:58:22.435 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T09:58:22.437 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T09:58:22.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T09:58:22.440 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T09:58:22.440 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T09:58:22.443 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T09:58:22.443 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T09:58:22.474 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T09:58:22.475 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T09:58:22.475 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T09:58:22.490 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T09:58:22.490 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T09:58:22.491 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T09:58:22.495 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T09:58:22.510 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T09:58:22.552 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2024-04-26T09:58:22.561 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: ntpd: command not found 2024-04-26T09:58:22.564 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2024-04-26T09:58:22.573 INFO:teuthology.orchestra.run.smithi186.stdout:506 Cannot talk to daemon 2024-04-26T09:58:22.579 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: ntpd: command not found 2024-04-26T09:58:22.579 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T09:58:22.588 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T09:58:22.591 INFO:teuthology.orchestra.run.smithi112.stdout:506 Cannot talk to daemon 2024-04-26T09:58:22.593 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T09:58:22.600 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: ntpd: command not found 2024-04-26T09:58:22.601 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T09:58:22.605 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T09:58:22.612 INFO:teuthology.orchestra.run.smithi187.stdout:506 Cannot talk to daemon 2024-04-26T09:58:22.619 INFO:teuthology.orchestra.run.smithi112.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T09:58:22.626 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T09:58:22.639 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T09:58:22.657 INFO:teuthology.orchestra.run.smithi043.stderr:bash: ntpq: command not found 2024-04-26T09:58:22.661 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T09:58:22.662 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-04-26T09:58:22.662 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.662 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.662 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.662 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.670 INFO:teuthology.orchestra.run.smithi186.stderr:bash: ntpq: command not found 2024-04-26T09:58:22.673 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T09:58:22.673 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-04-26T09:58:22.673 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.673 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.673 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.674 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.693 INFO:teuthology.orchestra.run.smithi112.stderr:bash: ntpq: command not found 2024-04-26T09:58:22.697 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T09:58:22.697 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-04-26T09:58:22.697 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.697 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.697 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.697 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.701 INFO:teuthology.orchestra.run.smithi187.stderr:bash: ntpq: command not found 2024-04-26T09:58:22.706 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T09:58:22.706 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2024-04-26T09:58:22.706 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.706 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.706 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.706 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T09:58:22.707 INFO:teuthology.run_tasks:Running task install... 2024-04-26T09:58:22.717 DEBUG:teuthology.task.install:project ceph 2024-04-26T09:58:22.717 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}} 2024-04-26T09:58:22.718 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'} 2024-04-26T09:58:22.718 INFO:teuthology.task.install:Using flavor: default 2024-04-26T09:58:22.724 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T09:58:22.724 INFO:teuthology.task.install:extra packages: [] 2024-04-26T09:58:22.724 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T09:58:22.724 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T09:58:22.726 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T09:58:22.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T09:58:22.727 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T09:58:22.728 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T09:58:22.728 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'tag': None, 'wait_for_package': False} 2024-04-26T09:58:22.729 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T09:58:22.873 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T09:58:22.873 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T09:58:22.890 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T09:58:22.890 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T09:58:22.952 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T09:58:22.953 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T09:58:22.969 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/ 2024-04-26T09:58:22.969 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1256.gdc093b5e 2024-04-26T09:58:22.986 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T09:58:22.986 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-26T09:58:22.986 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T09:58:22.994 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T09:58:22.995 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T09:58:22.995 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T09:58:23.020 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T09:58:23.021 DEBUG:teuthology.orchestra.run.smithi187:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T09:58:23.022 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T09:58:23.022 DEBUG:teuthology.orchestra.run.smithi112:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T09:58:23.059 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T09:58:23.059 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T09:58:23.059 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T09:58:23.090 DEBUG:teuthology.orchestra.run.smithi112:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T09:58:23.091 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T09:58:23.092 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T09:58:23.092 DEBUG:teuthology.orchestra.run.smithi187:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T09:58:23.145 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T09:58:23.146 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-26T09:58:23.146 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T09:58:23.164 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T09:58:23.166 DEBUG:teuthology.orchestra.run.smithi112:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T09:58:23.169 DEBUG:teuthology.orchestra.run.smithi187:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T09:58:23.174 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-26T09:58:23.174 DEBUG:teuthology.orchestra.run.smithi186:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/dc093b5e41f728edab6e0330295fdf9156d31664/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T09:58:23.232 INFO:teuthology.orchestra.run.smithi112.stdout:check_obsoletes = 1 2024-04-26T09:58:23.234 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum clean all 2024-04-26T09:58:23.236 INFO:teuthology.orchestra.run.smithi187.stdout:check_obsoletes = 1 2024-04-26T09:58:23.237 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum clean all 2024-04-26T09:58:23.243 DEBUG:teuthology.orchestra.run.smithi186:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T09:58:23.246 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T09:58:23.315 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2024-04-26T09:58:23.316 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2024-04-26T09:58:23.320 DEBUG:teuthology.orchestra.run.smithi186:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T09:58:23.386 INFO:teuthology.orchestra.run.smithi186.stdout:check_obsoletes = 1 2024-04-26T09:58:23.388 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum clean all 2024-04-26T09:58:23.500 INFO:teuthology.orchestra.run.smithi112.stdout:78 files removed 2024-04-26T09:58:23.500 INFO:teuthology.orchestra.run.smithi187.stdout:78 files removed 2024-04-26T09:58:23.528 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T09:58:23.529 DEBUG:teuthology.orchestra.run.smithi112:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T09:58:23.605 INFO:teuthology.orchestra.run.smithi043.stdout:78 files removed 2024-04-26T09:58:23.636 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T09:58:23.670 INFO:teuthology.orchestra.run.smithi186.stdout:78 files removed 2024-04-26T09:58:23.698 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-26T09:58:24.299 INFO:teuthology.orchestra.run.smithi187.stdout:ceph packages for x86_64 219 kB/s | 80 kB 00:00 2024-04-26T09:58:24.367 INFO:teuthology.orchestra.run.smithi112.stdout:ceph packages for x86_64 187 kB/s | 80 kB 00:00 2024-04-26T09:58:24.485 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 192 kB/s | 80 kB 00:00 2024-04-26T09:58:24.491 INFO:teuthology.orchestra.run.smithi186.stdout:ceph packages for x86_64 209 kB/s | 80 kB 00:00 2024-04-26T09:58:24.558 INFO:teuthology.orchestra.run.smithi187.stdout:ceph noarch packages 52 kB/s | 11 kB 00:00 2024-04-26T09:58:24.651 INFO:teuthology.orchestra.run.smithi112.stdout:ceph noarch packages 47 kB/s | 11 kB 00:00 2024-04-26T09:58:24.834 INFO:teuthology.orchestra.run.smithi186.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-04-26T09:58:24.846 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-04-26T09:58:24.993 INFO:teuthology.orchestra.run.smithi112.stdout:ceph source packages 4.7 kB/s | 1.5 kB 00:00 2024-04-26T09:58:25.068 INFO:teuthology.orchestra.run.smithi187.stdout:ceph source packages 3.1 kB/s | 1.5 kB 00:00 2024-04-26T09:58:25.151 INFO:teuthology.orchestra.run.smithi186.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2024-04-26T09:58:25.286 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 3.6 kB/s | 1.5 kB 00:00 2024-04-26T10:16:33.956 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - AppStream 26 kB/s | 28 MB 18:08 2024-04-26T10:16:39.548 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 10 MB 00:00 2024-04-26T10:16:41.390 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - Extras 73 kB/s | 18 kB 00:00 2024-04-26T10:16:41.716 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - Extras common packages 35 kB/s | 7.7 kB 00:00 2024-04-26T10:16:42.475 INFO:teuthology.orchestra.run.smithi112.stdout:CentOS Stream 8 - PowerTools 7.4 MB/s | 5.0 MB 00:00 2024-04-26T10:16:43.535 INFO:teuthology.orchestra.run.smithi112.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-26T10:16:44.630 INFO:teuthology.orchestra.run.smithi112.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2024-04-26T10:16:48.478 INFO:teuthology.orchestra.run.smithi112.stdout:lab-extras 201 kB/s | 24 kB 00:00 2024-04-26T10:16:52.091 INFO:teuthology.orchestra.run.smithi112.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T10:16:52.091 INFO:teuthology.orchestra.run.smithi112.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T10:16:52.171 INFO:teuthology.orchestra.run.smithi112.stdout:Dependencies resolved. 2024-04-26T10:16:52.183 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================================ 2024-04-26T10:16:52.183 INFO:teuthology.orchestra.run.smithi112.stdout: Package Arch Version Repository Size 2024-04-26T10:16:52.183 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================================ 2024-04-26T10:16:52.183 INFO:teuthology.orchestra.run.smithi112.stdout:Installing: 2024-04-26T10:16:52.183 INFO:teuthology.orchestra.run.smithi112.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-26T10:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T10:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T10:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T10:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T10:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T10:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T10:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T10:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T10:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T10:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T10:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T10:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T10:16:52.184 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T10:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-26T10:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-26T10:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-26T10:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T10:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T10:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T10:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-26T10:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-26T10:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-26T10:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T10:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T10:16:52.185 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T10:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T10:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T10:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T10:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T10:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-26T10:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrading: 2024-04-26T10:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-26T10:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-26T10:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-26T10:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-26T10:16:52.186 INFO:teuthology.orchestra.run.smithi112.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-26T10:16:52.187 INFO:teuthology.orchestra.run.smithi112.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-26T10:16:52.187 INFO:teuthology.orchestra.run.smithi112.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T10:16:52.187 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T10:16:52.187 INFO:teuthology.orchestra.run.smithi112.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-26T10:16:52.187 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-26T10:16:52.187 INFO:teuthology.orchestra.run.smithi112.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-26T10:16:52.187 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-26T10:16:52.187 INFO:teuthology.orchestra.run.smithi112.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-26T10:16:52.187 INFO:teuthology.orchestra.run.smithi112.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-26T10:16:52.187 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-26T10:16:52.187 INFO:teuthology.orchestra.run.smithi112.stdout:Installing dependencies: 2024-04-26T10:16:52.187 INFO:teuthology.orchestra.run.smithi112.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-26T10:16:52.187 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T10:16:52.188 INFO:teuthology.orchestra.run.smithi112.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T10:16:52.189 INFO:teuthology.orchestra.run.smithi112.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-26T10:16:52.190 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-26T10:16:52.190 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-26T10:16:52.190 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-26T10:16:52.190 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-26T10:16:52.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T10:16:52.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-26T10:16:52.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T10:16:52.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T10:16:52.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T10:16:52.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T10:16:52.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T10:16:52.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T10:16:52.190 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T10:16:52.191 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-26T10:16:52.192 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T10:16:52.193 INFO:teuthology.orchestra.run.smithi112.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T10:16:52.194 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T10:16:52.194 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-26T10:16:52.194 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:16:52.194 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction Summary 2024-04-26T10:16:52.194 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================================ 2024-04-26T10:16:52.194 INFO:teuthology.orchestra.run.smithi112.stdout:Install 122 Packages 2024-04-26T10:16:52.194 INFO:teuthology.orchestra.run.smithi112.stdout:Upgrade 15 Packages 2024-04-26T10:16:52.194 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:16:52.195 INFO:teuthology.orchestra.run.smithi112.stdout:Total download size: 207 M 2024-04-26T10:16:52.195 INFO:teuthology.orchestra.run.smithi112.stdout:Downloading Packages: 2024-04-26T10:16:52.428 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - AppStream 26 kB/s | 28 MB 18:27 2024-04-26T10:16:53.462 INFO:teuthology.orchestra.run.smithi112.stdout:(1/137): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2024-04-26T10:16:53.754 INFO:teuthology.orchestra.run.smithi112.stdout:(2/137): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 2.9 MB/s | 859 kB 00:00 2024-04-26T10:16:53.846 INFO:teuthology.orchestra.run.smithi112.stdout:(3/137): ceph-immutable-object-cache-18.2.2-125 1.8 MB/s | 165 kB 00:00 2024-04-26T10:16:54.055 INFO:teuthology.orchestra.run.smithi112.stdout:(4/137): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 5.9 MB/s | 5.5 MB 00:00 2024-04-26T10:16:54.188 INFO:teuthology.orchestra.run.smithi112.stdout:(5/137): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 6.6 MB/s | 2.3 MB 00:00 2024-04-26T10:16:54.280 INFO:teuthology.orchestra.run.smithi112.stdout:(6/137): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 6.9 MB/s | 1.6 MB 00:00 2024-04-26T10:16:54.947 INFO:teuthology.orchestra.run.smithi112.stdout:(7/137): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 6.4 MB/s | 4.8 MB 00:00 2024-04-26T10:16:55.481 INFO:teuthology.orchestra.run.smithi112.stdout:(8/137): ceph-common-18.2.2-1256.gdc093b5e.el8. 9.2 MB/s | 22 MB 00:02 2024-04-26T10:16:55.565 INFO:teuthology.orchestra.run.smithi112.stdout:(9/137): ceph-selinux-18.2.2-1256.gdc093b5e.el8 292 kB/s | 24 kB 00:00 2024-04-26T10:16:56.507 INFO:teuthology.orchestra.run.smithi112.stdout:(10/137): ceph-radosgw-18.2.2-1256.gdc093b5e.el 8.4 MB/s | 13 MB 00:01 2024-04-26T10:16:56.690 INFO:teuthology.orchestra.run.smithi112.stdout:(11/137): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 7.6 MB/s | 18 MB 00:02 2024-04-26T10:16:56.707 INFO:teuthology.orchestra.run.smithi112.stdout:(12/137): libcephfs-devel-18.2.2-1256.gdc093b5e 154 kB/s | 31 kB 00:00 2024-04-26T10:16:56.774 INFO:teuthology.orchestra.run.smithi112.stdout:(13/137): libcephsqlite-18.2.2-1256.gdc093b5e.e 2.1 MB/s | 142 kB 00:00 2024-04-26T10:16:56.816 INFO:teuthology.orchestra.run.smithi112.stdout:(14/137): libcephfs2-18.2.2-1256.gdc093b5e.el8. 6.1 MB/s | 781 kB 00:00 2024-04-26T10:16:56.849 INFO:teuthology.orchestra.run.smithi112.stdout:(15/137): librados-devel-18.2.2-1256.gdc093b5e. 1.8 MB/s | 139 kB 00:00 2024-04-26T10:16:56.908 INFO:teuthology.orchestra.run.smithi112.stdout:(16/137): libradosstriper1-18.2.2-1256.gdc093b5 5.0 MB/s | 474 kB 00:00 2024-04-26T10:16:56.983 INFO:teuthology.orchestra.run.smithi112.stdout:(17/137): python3-ceph-argparse-18.2.2-1256.gdc 597 kB/s | 45 kB 00:00 2024-04-26T10:16:57.067 INFO:teuthology.orchestra.run.smithi112.stdout:(18/137): python3-ceph-common-18.2.2-1256.gdc09 1.5 MB/s | 129 kB 00:00 2024-04-26T10:16:57.151 INFO:teuthology.orchestra.run.smithi112.stdout:(19/137): python3-cephfs-18.2.2-1256.gdc093b5e. 2.3 MB/s | 197 kB 00:00 2024-04-26T10:16:57.243 INFO:teuthology.orchestra.run.smithi112.stdout:(20/137): python3-rados-18.2.2-1256.gdc093b5e.e 4.0 MB/s | 371 kB 00:00 2024-04-26T10:16:57.334 INFO:teuthology.orchestra.run.smithi112.stdout:(21/137): python3-rbd-18.2.2-1256.gdc093b5e.el8 3.9 MB/s | 364 kB 00:00 2024-04-26T10:16:57.418 INFO:teuthology.orchestra.run.smithi112.stdout:(22/137): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.3 MB/s | 107 kB 00:00 2024-04-26T10:16:57.560 INFO:teuthology.orchestra.run.smithi112.stdout:(23/137): librgw2-18.2.2-1256.gdc093b5e.el8.x86 9.2 MB/s | 6.6 MB 00:00 2024-04-26T10:16:57.585 INFO:teuthology.orchestra.run.smithi112.stdout:(24/137): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 568 kB/s | 95 kB 00:00 2024-04-26T10:16:57.677 INFO:teuthology.orchestra.run.smithi112.stdout:(25/137): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 1.9 MB/s | 181 kB 00:00 2024-04-26T10:16:57.761 INFO:teuthology.orchestra.run.smithi112.stdout:(26/137): ceph-grafana-dashboards-18.2.2-1256.g 291 kB/s | 24 kB 00:00 2024-04-26T10:16:57.853 INFO:teuthology.orchestra.run.smithi112.stdout:(27/137): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.5 MB/s | 138 kB 00:00 2024-04-26T10:16:57.953 INFO:teuthology.orchestra.run.smithi112.stdout:(28/137): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 8.8 MB/s | 3.5 MB 00:00 2024-04-26T10:16:58.020 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 10 MB 00:00 2024-04-26T10:16:58.437 INFO:teuthology.orchestra.run.smithi112.stdout:(29/137): ceph-mgr-dashboard-18.2.2-1256.gdc093 6.0 MB/s | 3.5 MB 00:00 2024-04-26T10:16:58.538 INFO:teuthology.orchestra.run.smithi112.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1256.gdc 2.4 MB/s | 246 kB 00:00 2024-04-26T10:16:58.637 INFO:teuthology.orchestra.run.smithi112.stdout:(31/137): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 493 kB/s | 49 kB 00:00 2024-04-26T10:16:58.729 INFO:teuthology.orchestra.run.smithi112.stdout:(32/137): ceph-prometheus-alerts-18.2.2-1256.gd 166 kB/s | 15 kB 00:00 2024-04-26T10:16:58.838 INFO:teuthology.orchestra.run.smithi112.stdout:(33/137): ceph-mgr-diskprediction-local-18.2.2- 8.4 MB/s | 7.4 MB 00:00 2024-04-26T10:16:58.864 INFO:teuthology.orchestra.run.smithi112.stdout:(34/137): ceph-volume-18.2.2-1256.gdc093b5e.el8 1.9 MB/s | 263 kB 00:00 2024-04-26T10:16:59.314 INFO:teuthology.orchestra.run.smithi112.stdout:(35/137): ceph-test-18.2.2-1256.gdc093b5e.el8.x 13 MB/s | 47 MB 00:03 2024-04-26T10:16:59.339 INFO:teuthology.orchestra.run.smithi112.stdout:(36/137): cephadm-18.2.2-1256.gdc093b5e.el8.noa 345 kB/s | 173 kB 00:00 2024-04-26T10:16:59.762 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - Extras 109 kB/s | 18 kB 00:00 2024-04-26T10:17:00.312 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 7.7 kB 00:00 2024-04-26T10:17:02.147 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - PowerTools 2.8 MB/s | 5.0 MB 00:01 2024-04-26T10:17:03.240 INFO:teuthology.orchestra.run.smithi186.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2024-04-26T10:17:04.101 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2024-04-26T10:17:08.066 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 93 kB/s | 24 kB 00:00 2024-04-26T10:17:11.572 INFO:teuthology.orchestra.run.smithi112.stdout:(37/137): flex-2.6.1-9.el8.x86_64.rpm 26 kB/s | 320 kB 00:12 2024-04-26T10:17:11.697 INFO:teuthology.orchestra.run.smithi186.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T10:17:11.698 INFO:teuthology.orchestra.run.smithi186.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T10:17:11.776 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-26T10:17:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================================ 2024-04-26T10:17:11.789 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repository Size 2024-04-26T10:17:11.789 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================================ 2024-04-26T10:17:11.789 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-26T10:17:11.789 INFO:teuthology.orchestra.run.smithi186.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-26T10:17:11.789 INFO:teuthology.orchestra.run.smithi186.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T10:17:11.789 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T10:17:11.789 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T10:17:11.789 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T10:17:11.789 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T10:17:11.789 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T10:17:11.789 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T10:17:11.789 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T10:17:11.790 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T10:17:11.790 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T10:17:11.790 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T10:17:11.790 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T10:17:11.790 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T10:17:11.790 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-26T10:17:11.790 INFO:teuthology.orchestra.run.smithi186.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-26T10:17:11.790 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-26T10:17:11.790 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T10:17:11.790 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T10:17:11.790 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T10:17:11.790 INFO:teuthology.orchestra.run.smithi186.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrading: 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-26T10:17:11.791 INFO:teuthology.orchestra.run.smithi186.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-26T10:17:11.792 INFO:teuthology.orchestra.run.smithi186.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-26T10:17:11.792 INFO:teuthology.orchestra.run.smithi186.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-26T10:17:11.792 INFO:teuthology.orchestra.run.smithi186.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T10:17:11.792 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T10:17:11.792 INFO:teuthology.orchestra.run.smithi186.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-26T10:17:11.792 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-26T10:17:11.792 INFO:teuthology.orchestra.run.smithi186.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-26T10:17:11.792 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-26T10:17:11.792 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-26T10:17:11.792 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-26T10:17:11.792 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-26T10:17:11.792 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2024-04-26T10:17:11.792 INFO:teuthology.orchestra.run.smithi186.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-26T10:17:11.793 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T10:17:11.794 INFO:teuthology.orchestra.run.smithi186.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-26T10:17:11.794 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-04-26T10:17:11.794 INFO:teuthology.orchestra.run.smithi186.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T10:17:11.794 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-04-26T10:17:11.794 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T10:17:11.794 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T10:17:11.794 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T10:17:11.794 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T10:17:11.794 INFO:teuthology.orchestra.run.smithi186.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-26T10:17:11.794 INFO:teuthology.orchestra.run.smithi186.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-26T10:17:11.794 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T10:17:11.794 INFO:teuthology.orchestra.run.smithi186.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-26T10:17:11.795 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-26T10:17:11.795 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T10:17:11.795 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T10:17:11.795 INFO:teuthology.orchestra.run.smithi186.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-26T10:17:11.795 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-26T10:17:11.795 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-26T10:17:11.795 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-26T10:17:11.795 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-26T10:17:11.795 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T10:17:11.795 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-26T10:17:11.795 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T10:17:11.795 INFO:teuthology.orchestra.run.smithi186.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T10:17:11.795 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T10:17:11.796 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T10:17:11.796 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T10:17:11.796 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T10:17:11.796 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T10:17:11.796 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T10:17:11.796 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T10:17:11.796 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T10:17:11.796 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T10:17:11.796 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T10:17:11.796 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T10:17:11.796 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-26T10:17:11.796 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-26T10:17:11.797 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-26T10:17:11.797 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-26T10:17:11.797 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T10:17:11.797 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T10:17:11.797 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T10:17:11.797 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T10:17:11.797 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T10:17:11.797 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T10:17:11.797 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-26T10:17:11.797 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-26T10:17:11.797 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-26T10:17:11.797 INFO:teuthology.orchestra.run.smithi186.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-26T10:17:11.797 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T10:17:11.798 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T10:17:11.798 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T10:17:11.798 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T10:17:11.798 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-26T10:17:11.798 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-26T10:17:11.798 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T10:17:11.798 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T10:17:11.798 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T10:17:11.798 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-26T10:17:11.798 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T10:17:11.798 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T10:17:11.798 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T10:17:11.799 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-26T10:17:11.800 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:17:11.800 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-26T10:17:11.800 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================================ 2024-04-26T10:17:11.800 INFO:teuthology.orchestra.run.smithi186.stdout:Install 122 Packages 2024-04-26T10:17:11.800 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrade 15 Packages 2024-04-26T10:17:11.800 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:17:11.800 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 207 M 2024-04-26T10:17:11.801 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-26T10:17:22.626 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - AppStream 25 kB/s | 28 MB 18:57 2024-04-26T10:17:23.104 INFO:teuthology.orchestra.run.smithi112.stdout:(38/137): jq-1.6-8.el8.x86_64.rpm 18 kB/s | 203 kB 00:11 2024-04-26T10:17:23.211 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - AppStream 25 kB/s | 28 MB 18:58 2024-04-26T10:17:26.199 INFO:teuthology.orchestra.run.smithi186.stdout:(1/137): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 51 kB/s | 6.4 kB 00:00 2024-04-26T10:17:26.383 INFO:teuthology.orchestra.run.smithi186.stdout:(2/137): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 4.6 MB/s | 859 kB 00:00 2024-04-26T10:17:26.450 INFO:teuthology.orchestra.run.smithi186.stdout:(3/137): ceph-immutable-object-cache-18.2.2-125 2.4 MB/s | 165 kB 00:00 2024-04-26T10:17:26.775 INFO:teuthology.orchestra.run.smithi186.stdout:(4/137): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 7.0 MB/s | 2.3 MB 00:00 2024-04-26T10:17:26.992 INFO:teuthology.orchestra.run.smithi186.stdout:(5/137): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 7.2 MB/s | 1.6 MB 00:00 2024-04-26T10:17:27.151 INFO:teuthology.orchestra.run.smithi186.stdout:(6/137): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 5.1 MB/s | 5.5 MB 00:01 2024-04-26T10:17:27.651 INFO:teuthology.orchestra.run.smithi186.stdout:(7/137): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 7.3 MB/s | 4.8 MB 00:00 2024-04-26T10:17:27.876 INFO:teuthology.orchestra.run.smithi186.stdout:(8/137): ceph-common-18.2.2-1256.gdc093b5e.el8. 12 MB/s | 22 MB 00:01 2024-04-26T10:17:27.943 INFO:teuthology.orchestra.run.smithi186.stdout:(9/137): ceph-selinux-18.2.2-1256.gdc093b5e.el8 366 kB/s | 24 kB 00:00 2024-04-26T10:17:28.827 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - BaseOS 11 MB/s | 10 MB 00:00 2024-04-26T10:17:29.136 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - BaseOS 11 MB/s | 10 MB 00:00 2024-04-26T10:17:29.243 INFO:teuthology.orchestra.run.smithi186.stdout:(10/137): ceph-radosgw-18.2.2-1256.gdc093b5e.el 8.2 MB/s | 13 MB 00:01 2024-04-26T10:17:29.335 INFO:teuthology.orchestra.run.smithi186.stdout:(11/137): libcephfs-devel-18.2.2-1256.gdc093b5e 338 kB/s | 31 kB 00:00 2024-04-26T10:17:29.494 INFO:teuthology.orchestra.run.smithi186.stdout:(12/137): libcephfs2-18.2.2-1256.gdc093b5e.el8. 4.8 MB/s | 781 kB 00:00 2024-04-26T10:17:29.577 INFO:teuthology.orchestra.run.smithi186.stdout:(13/137): libcephsqlite-18.2.2-1256.gdc093b5e.e 1.7 MB/s | 142 kB 00:00 2024-04-26T10:17:29.652 INFO:teuthology.orchestra.run.smithi186.stdout:(14/137): librados-devel-18.2.2-1256.gdc093b5e. 1.8 MB/s | 139 kB 00:00 2024-04-26T10:17:29.886 INFO:teuthology.orchestra.run.smithi186.stdout:(15/137): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 6.7 MB/s | 18 MB 00:02 2024-04-26T10:17:29.911 INFO:teuthology.orchestra.run.smithi186.stdout:(16/137): libradosstriper1-18.2.2-1256.gdc093b5 1.8 MB/s | 474 kB 00:00 2024-04-26T10:17:29.953 INFO:teuthology.orchestra.run.smithi186.stdout:(17/137): python3-ceph-argparse-18.2.2-1256.gdc 1.0 MB/s | 45 kB 00:00 2024-04-26T10:17:30.029 INFO:teuthology.orchestra.run.smithi186.stdout:(18/137): python3-ceph-common-18.2.2-1256.gdc09 1.7 MB/s | 129 kB 00:00 2024-04-26T10:17:30.096 INFO:teuthology.orchestra.run.smithi186.stdout:(19/137): python3-cephfs-18.2.2-1256.gdc093b5e. 2.9 MB/s | 197 kB 00:00 2024-04-26T10:17:30.179 INFO:teuthology.orchestra.run.smithi186.stdout:(20/137): python3-rados-18.2.2-1256.gdc093b5e.e 4.3 MB/s | 371 kB 00:00 2024-04-26T10:17:30.286 INFO:teuthology.orchestra.run.smithi186.stdout:(21/137): python3-rbd-18.2.2-1256.gdc093b5e.el8 3.3 MB/s | 364 kB 00:00 2024-04-26T10:17:30.372 INFO:teuthology.orchestra.run.smithi186.stdout:(22/137): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.2 MB/s | 107 kB 00:00 2024-04-26T10:17:30.447 INFO:teuthology.orchestra.run.smithi186.stdout:(23/137): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.2 MB/s | 95 kB 00:00 2024-04-26T10:17:30.860 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - Extras 51 kB/s | 18 kB 00:00 2024-04-26T10:17:30.971 INFO:teuthology.orchestra.run.smithi112.stdout:(39/137): bison-3.0.4-10.el8.x86_64.rpm 22 kB/s | 688 kB 00:31 2024-04-26T10:17:31.086 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - Extras 51 kB/s | 18 kB 00:00 2024-04-26T10:17:31.247 INFO:teuthology.orchestra.run.smithi186.stdout:(24/137): ceph-test-18.2.2-1256.gdc093b5e.el8.x 14 MB/s | 47 MB 00:03 2024-04-26T10:17:31.331 INFO:teuthology.orchestra.run.smithi186.stdout:(25/137): librgw2-18.2.2-1256.gdc093b5e.el8.x86 4.5 MB/s | 6.6 MB 00:01 2024-04-26T10:17:31.356 INFO:teuthology.orchestra.run.smithi186.stdout:(26/137): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 1.6 MB/s | 181 kB 00:00 2024-04-26T10:17:31.415 INFO:teuthology.orchestra.run.smithi186.stdout:(27/137): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 3.6 MB/s | 3.5 MB 00:00 2024-04-26T10:17:31.432 INFO:teuthology.orchestra.run.smithi186.stdout:(28/137): ceph-grafana-dashboards-18.2.2-1256.g 242 kB/s | 24 kB 00:00 2024-04-26T10:17:31.435 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 7.7 kB 00:00 2024-04-26T10:17:31.457 INFO:teuthology.orchestra.run.smithi186.stdout:(29/137): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.3 MB/s | 138 kB 00:00 2024-04-26T10:17:31.516 INFO:teuthology.orchestra.run.smithi186.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1256.gdc 4.1 MB/s | 246 kB 00:00 2024-04-26T10:17:31.583 INFO:teuthology.orchestra.run.smithi186.stdout:(31/137): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 740 kB/s | 49 kB 00:00 2024-04-26T10:17:31.612 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 7.7 kB 00:00 2024-04-26T10:17:31.641 INFO:teuthology.orchestra.run.smithi186.stdout:(32/137): ceph-prometheus-alerts-18.2.2-1256.gd 261 kB/s | 15 kB 00:00 2024-04-26T10:17:31.733 INFO:teuthology.orchestra.run.smithi186.stdout:(33/137): ceph-mgr-dashboard-18.2.2-1256.gdc093 11 MB/s | 3.5 MB 00:00 2024-04-26T10:17:31.759 INFO:teuthology.orchestra.run.smithi186.stdout:(34/137): ceph-volume-18.2.2-1256.gdc093b5e.el8 2.2 MB/s | 263 kB 00:00 2024-04-26T10:17:31.785 INFO:teuthology.orchestra.run.smithi186.stdout:(35/137): cephadm-18.2.2-1256.gdc093b5e.el8.noa 3.4 MB/s | 173 kB 00:00 2024-04-26T10:17:32.093 INFO:teuthology.orchestra.run.smithi186.stdout:(36/137): ceph-mgr-diskprediction-local-18.2.2- 11 MB/s | 7.4 MB 00:00 2024-04-26T10:17:32.953 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 8 - PowerTools 3.5 MB/s | 5.0 MB 00:01 2024-04-26T10:17:33.838 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - PowerTools 2.3 MB/s | 5.0 MB 00:02 2024-04-26T10:17:34.142 INFO:teuthology.orchestra.run.smithi043.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2024-04-26T10:17:34.929 INFO:teuthology.orchestra.run.smithi112.stdout:(40/137): automake-1.16.1-8.el8.noarch.rpm 21 kB/s | 740 kB 00:36 2024-04-26T10:17:34.939 INFO:teuthology.orchestra.run.smithi187.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-04-26T10:17:36.141 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 16 MB 00:01 2024-04-26T10:17:36.559 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-04-26T10:17:40.280 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 435 kB/s | 24 kB 00:00 2024-04-26T10:17:40.401 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 256 kB/s | 24 kB 00:00 2024-04-26T10:17:44.023 INFO:teuthology.orchestra.run.smithi187.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T10:17:44.023 INFO:teuthology.orchestra.run.smithi187.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T10:17:44.101 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2024-04-26T10:17:44.114 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================================ 2024-04-26T10:17:44.114 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2024-04-26T10:17:44.114 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================================ 2024-04-26T10:17:44.114 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2024-04-26T10:17:44.114 INFO:teuthology.orchestra.run.smithi187.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-26T10:17:44.114 INFO:teuthology.orchestra.run.smithi187.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T10:17:44.114 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T10:17:44.114 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T10:17:44.114 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T10:17:44.115 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T10:17:44.115 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T10:17:44.115 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T10:17:44.115 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T10:17:44.115 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T10:17:44.115 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T10:17:44.115 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T10:17:44.115 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T10:17:44.115 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T10:17:44.115 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-26T10:17:44.115 INFO:teuthology.orchestra.run.smithi187.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-26T10:17:44.116 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-26T10:17:44.116 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T10:17:44.116 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T10:17:44.116 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T10:17:44.116 INFO:teuthology.orchestra.run.smithi187.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-26T10:17:44.116 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-26T10:17:44.116 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-26T10:17:44.116 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T10:17:44.116 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T10:17:44.116 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T10:17:44.116 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T10:17:44.116 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T10:17:44.117 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T10:17:44.117 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T10:17:44.117 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-26T10:17:44.117 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrading: 2024-04-26T10:17:44.117 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-26T10:17:44.117 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-26T10:17:44.117 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-26T10:17:44.117 INFO:teuthology.orchestra.run.smithi187.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-26T10:17:44.117 INFO:teuthology.orchestra.run.smithi187.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-26T10:17:44.117 INFO:teuthology.orchestra.run.smithi187.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-26T10:17:44.117 INFO:teuthology.orchestra.run.smithi187.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T10:17:44.117 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T10:17:44.117 INFO:teuthology.orchestra.run.smithi187.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-26T10:17:44.118 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-26T10:17:44.118 INFO:teuthology.orchestra.run.smithi187.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-26T10:17:44.118 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-26T10:17:44.118 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-26T10:17:44.118 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-26T10:17:44.118 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-26T10:17:44.118 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2024-04-26T10:17:44.118 INFO:teuthology.orchestra.run.smithi187.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-26T10:17:44.118 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T10:17:44.118 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T10:17:44.118 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T10:17:44.118 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T10:17:44.119 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-04-26T10:17:44.120 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T10:17:44.120 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T10:17:44.120 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T10:17:44.120 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T10:17:44.120 INFO:teuthology.orchestra.run.smithi187.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-26T10:17:44.120 INFO:teuthology.orchestra.run.smithi187.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-26T10:17:44.120 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T10:17:44.120 INFO:teuthology.orchestra.run.smithi187.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-26T10:17:44.120 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-26T10:17:44.120 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T10:17:44.120 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T10:17:44.120 INFO:teuthology.orchestra.run.smithi187.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T10:17:44.121 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T10:17:44.122 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T10:17:44.122 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T10:17:44.122 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T10:17:44.122 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T10:17:44.122 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T10:17:44.122 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-26T10:17:44.122 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-26T10:17:44.122 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-26T10:17:44.122 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-26T10:17:44.122 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T10:17:44.122 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T10:17:44.122 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T10:17:44.123 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T10:17:44.123 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T10:17:44.123 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T10:17:44.123 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-26T10:17:44.123 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-26T10:17:44.123 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-26T10:17:44.123 INFO:teuthology.orchestra.run.smithi187.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-26T10:17:44.123 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T10:17:44.123 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T10:17:44.123 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T10:17:44.123 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T10:17:44.123 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-26T10:17:44.123 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-26T10:17:44.124 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T10:17:44.124 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T10:17:44.124 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T10:17:44.124 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-26T10:17:44.124 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T10:17:44.124 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T10:17:44.124 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-26T10:17:44.124 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T10:17:44.124 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T10:17:44.124 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T10:17:44.124 INFO:teuthology.orchestra.run.smithi187.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T10:17:44.124 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T10:17:44.124 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================================ 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout:Install 122 Packages 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrade 15 Packages 2024-04-26T10:17:44.125 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:17:44.126 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T10:17:44.126 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-26T10:17:44.127 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 207 M 2024-04-26T10:17:44.127 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2024-04-26T10:17:44.203 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-04-26T10:17:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:============================================================================================ 2024-04-26T10:17:44.217 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-04-26T10:17:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:============================================================================================ 2024-04-26T10:17:44.217 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-04-26T10:17:44.217 INFO:teuthology.orchestra.run.smithi043.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-04-26T10:17:44.217 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.4 k 2024-04-26T10:17:44.217 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 5.5 M 2024-04-26T10:17:44.217 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 859 k 2024-04-26T10:17:44.218 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 165 k 2024-04-26T10:17:44.218 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 1.6 M 2024-04-26T10:17:44.218 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 138 k 2024-04-26T10:17:44.218 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 3.5 M 2024-04-26T10:17:44.218 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 7.4 M 2024-04-26T10:17:44.218 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 49 k 2024-04-26T10:17:44.218 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 13 M 2024-04-26T10:17:44.218 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 47 M 2024-04-26T10:17:44.218 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 263 k 2024-04-26T10:17:44.218 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 173 k 2024-04-26T10:17:44.219 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-04-26T10:17:44.219 INFO:teuthology.orchestra.run.smithi043.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-04-26T10:17:44.219 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-04-26T10:17:44.219 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 31 k 2024-04-26T10:17:44.219 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 781 k 2024-04-26T10:17:44.219 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 139 k 2024-04-26T10:17:44.219 INFO:teuthology.orchestra.run.smithi043.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-04-26T10:17:44.219 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-04-26T10:17:44.219 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-04-26T10:17:44.219 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 197 k 2024-04-26T10:17:44.219 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 371 k 2024-04-26T10:17:44.219 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 364 k 2024-04-26T10:17:44.219 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 107 k 2024-04-26T10:17:44.220 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 95 k 2024-04-26T10:17:44.220 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.5 M 2024-04-26T10:17:44.220 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 181 k 2024-04-26T10:17:44.220 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-04-26T10:17:44.220 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-04-26T10:17:44.220 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-04-26T10:17:44.220 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-04-26T10:17:44.220 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-04-26T10:17:44.220 INFO:teuthology.orchestra.run.smithi043.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-04-26T10:17:44.220 INFO:teuthology.orchestra.run.smithi043.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-04-26T10:17:44.220 INFO:teuthology.orchestra.run.smithi043.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-04-26T10:17:44.221 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.7 M 2024-04-26T10:17:44.221 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 3.6 M 2024-04-26T10:17:44.221 INFO:teuthology.orchestra.run.smithi043.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-04-26T10:17:44.221 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-04-26T10:17:44.221 INFO:teuthology.orchestra.run.smithi043.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-04-26T10:17:44.221 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-04-26T10:17:44.221 INFO:teuthology.orchestra.run.smithi043.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-04-26T10:17:44.221 INFO:teuthology.orchestra.run.smithi043.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-04-26T10:17:44.221 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-04-26T10:17:44.221 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-04-26T10:17:44.221 INFO:teuthology.orchestra.run.smithi043.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-04-26T10:17:44.221 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 22 M 2024-04-26T10:17:44.222 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 24 k 2024-04-26T10:17:44.222 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 2.3 M 2024-04-26T10:17:44.222 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 246 k 2024-04-26T10:17:44.222 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 4.8 M 2024-04-26T10:17:44.222 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 18 M 2024-04-26T10:17:44.222 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1256.gdc093b5e.el8 ceph-noarch 15 k 2024-04-26T10:17:44.222 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 24 k 2024-04-26T10:17:44.222 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-26T10:17:44.222 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-26T10:17:44.222 INFO:teuthology.orchestra.run.smithi043.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-26T10:17:44.222 INFO:teuthology.orchestra.run.smithi043.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-04-26T10:17:44.223 INFO:teuthology.orchestra.run.smithi043.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-04-26T10:17:44.223 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 142 k 2024-04-26T10:17:44.223 INFO:teuthology.orchestra.run.smithi043.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-04-26T10:17:44.223 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-04-26T10:17:44.223 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-26T10:17:44.223 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-04-26T10:17:44.223 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-26T10:17:44.223 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 474 k 2024-04-26T10:17:44.223 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-26T10:17:44.223 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 6.6 M 2024-04-26T10:17:44.223 INFO:teuthology.orchestra.run.smithi043.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-04-26T10:17:44.224 INFO:teuthology.orchestra.run.smithi043.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-04-26T10:17:44.224 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-26T10:17:44.224 INFO:teuthology.orchestra.run.smithi043.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-04-26T10:17:44.224 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-04-26T10:17:44.224 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-26T10:17:44.224 INFO:teuthology.orchestra.run.smithi043.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-26T10:17:44.224 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-04-26T10:17:44.224 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-04-26T10:17:44.224 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-04-26T10:17:44.224 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-04-26T10:17:44.224 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-04-26T10:17:44.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-26T10:17:44.224 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-04-26T10:17:44.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-26T10:17:44.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-26T10:17:44.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-26T10:17:44.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 45 k 2024-04-26T10:17:44.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:18.2.2-1256.gdc093b5e.el8 ceph 129 k 2024-04-26T10:17:44.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-26T10:17:44.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-26T10:17:44.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-26T10:17:44.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-26T10:17:44.225 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-26T10:17:44.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-26T10:17:44.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-26T10:17:44.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-26T10:17:44.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-04-26T10:17:44.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-04-26T10:17:44.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-04-26T10:17:44.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-04-26T10:17:44.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-26T10:17:44.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-26T10:17:44.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-26T10:17:44.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-26T10:17:44.226 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-26T10:17:44.227 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-26T10:17:44.227 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-04-26T10:17:44.227 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-04-26T10:17:44.227 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-04-26T10:17:44.227 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-04-26T10:17:44.227 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-26T10:17:44.227 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-26T10:17:44.227 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-26T10:17:44.227 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-26T10:17:44.227 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-04-26T10:17:44.227 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-04-26T10:17:44.227 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-26T10:17:44.228 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-26T10:17:44.228 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-26T10:17:44.228 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-04-26T10:17:44.228 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-26T10:17:44.228 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-26T10:17:44.228 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-04-26T10:17:44.228 INFO:teuthology.orchestra.run.smithi043.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-26T10:17:44.228 INFO:teuthology.orchestra.run.smithi043.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-26T10:17:44.228 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-26T10:17:44.228 INFO:teuthology.orchestra.run.smithi043.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-26T10:17:44.228 INFO:teuthology.orchestra.run.smithi043.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-26T10:17:44.229 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-26T10:17:44.229 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-26T10:17:44.229 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-26T10:17:44.229 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-26T10:17:44.229 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-26T10:17:44.229 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-26T10:17:44.229 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-26T10:17:44.229 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-26T10:17:44.229 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-04-26T10:17:44.229 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:17:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-04-26T10:17:44.229 INFO:teuthology.orchestra.run.smithi043.stdout:============================================================================================ 2024-04-26T10:17:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:Install 122 Packages 2024-04-26T10:17:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 15 Packages 2024-04-26T10:17:44.230 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:17:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 207 M 2024-04-26T10:17:44.230 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-04-26T10:17:44.883 INFO:teuthology.orchestra.run.smithi187.stdout:(1/137): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 33 kB/s | 6.4 kB 00:00 2024-04-26T10:17:44.940 INFO:teuthology.orchestra.run.smithi043.stdout:(1/137): ceph-18.2.2-1256.gdc093b5e.el8.x86_64. 34 kB/s | 6.4 kB 00:00 2024-04-26T10:17:45.350 INFO:teuthology.orchestra.run.smithi187.stdout:(2/137): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.8 MB/s | 859 kB 00:00 2024-04-26T10:17:45.458 INFO:teuthology.orchestra.run.smithi187.stdout:(3/137): ceph-immutable-object-cache-18.2.2-125 1.5 MB/s | 165 kB 00:00 2024-04-26T10:17:45.565 INFO:teuthology.orchestra.run.smithi043.stdout:(2/137): ceph-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.3 MB/s | 859 kB 00:00 2024-04-26T10:17:45.642 INFO:teuthology.orchestra.run.smithi186.stdout:(37/137): flex-2.6.1-9.el8.x86_64.rpm 24 kB/s | 320 kB 00:13 2024-04-26T10:17:45.773 INFO:teuthology.orchestra.run.smithi043.stdout:(3/137): ceph-immutable-object-cache-18.2.2-125 795 kB/s | 165 kB 00:00 2024-04-26T10:17:45.926 INFO:teuthology.orchestra.run.smithi187.stdout:(4/137): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 4.5 MB/s | 5.5 MB 00:01 2024-04-26T10:17:46.251 INFO:teuthology.orchestra.run.smithi187.stdout:(5/137): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 4.8 MB/s | 1.6 MB 00:00 2024-04-26T10:17:46.293 INFO:teuthology.orchestra.run.smithi187.stdout:(6/137): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 2.7 MB/s | 2.3 MB 00:00 2024-04-26T10:17:46.524 INFO:teuthology.orchestra.run.smithi043.stdout:(4/137): ceph-base-18.2.2-1256.gdc093b5e.el8.x8 3.1 MB/s | 5.5 MB 00:01 2024-04-26T10:17:46.699 INFO:teuthology.orchestra.run.smithi043.stdout:(5/137): ceph-mds-18.2.2-1256.gdc093b5e.el8.x86 2.5 MB/s | 2.3 MB 00:00 2024-04-26T10:17:46.899 INFO:teuthology.orchestra.run.smithi043.stdout:(6/137): ceph-mgr-18.2.2-1256.gdc093b5e.el8.x86 4.2 MB/s | 1.6 MB 00:00 2024-04-26T10:17:47.203 INFO:teuthology.orchestra.run.smithi112.stdout:(41/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 21 kB/s | 259 kB 00:12 2024-04-26T10:17:47.301 INFO:teuthology.orchestra.run.smithi187.stdout:(7/137): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 4.6 MB/s | 4.8 MB 00:01 2024-04-26T10:17:47.926 INFO:teuthology.orchestra.run.smithi043.stdout:(7/137): ceph-mon-18.2.2-1256.gdc093b5e.el8.x86 3.9 MB/s | 4.8 MB 00:01 2024-04-26T10:17:48.867 INFO:teuthology.orchestra.run.smithi043.stdout:(8/137): ceph-common-18.2.2-1256.gdc093b5e.el8. 5.3 MB/s | 22 MB 00:04 2024-04-26T10:17:48.917 INFO:teuthology.orchestra.run.smithi043.stdout:(9/137): ceph-selinux-18.2.2-1256.gdc093b5e.el8 490 kB/s | 24 kB 00:00 2024-04-26T10:17:48.918 INFO:teuthology.orchestra.run.smithi187.stdout:(8/137): ceph-common-18.2.2-1256.gdc093b5e.el8. 5.1 MB/s | 22 MB 00:04 2024-04-26T10:17:49.018 INFO:teuthology.orchestra.run.smithi187.stdout:(9/137): ceph-selinux-18.2.2-1256.gdc093b5e.el8 243 kB/s | 24 kB 00:00 2024-04-26T10:17:49.519 INFO:teuthology.orchestra.run.smithi187.stdout:(10/137): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 5.7 MB/s | 18 MB 00:03 2024-04-26T10:17:49.561 INFO:teuthology.orchestra.run.smithi112.stdout:(42/137): librdkafka-1.6.1-1.el8.x86_64.rpm 26 kB/s | 677 kB 00:26 2024-04-26T10:17:49.594 INFO:teuthology.orchestra.run.smithi187.stdout:(11/137): libcephfs-devel-18.2.2-1256.gdc093b5e 413 kB/s | 31 kB 00:00 2024-04-26T10:17:49.802 INFO:teuthology.orchestra.run.smithi187.stdout:(12/137): libcephfs2-18.2.2-1256.gdc093b5e.el8. 3.7 MB/s | 781 kB 00:00 2024-04-26T10:17:49.850 INFO:teuthology.orchestra.run.smithi043.stdout:(10/137): ceph-radosgw-18.2.2-1256.gdc093b5e.el 6.8 MB/s | 13 MB 00:01 2024-04-26T10:17:49.869 INFO:teuthology.orchestra.run.smithi187.stdout:(13/137): libcephsqlite-18.2.2-1256.gdc093b5e.e 2.1 MB/s | 142 kB 00:00 2024-04-26T10:17:49.900 INFO:teuthology.orchestra.run.smithi043.stdout:(11/137): libcephfs-devel-18.2.2-1256.gdc093b5e 622 kB/s | 31 kB 00:00 2024-04-26T10:17:50.034 INFO:teuthology.orchestra.run.smithi043.stdout:(12/137): libcephfs2-18.2.2-1256.gdc093b5e.el8. 5.7 MB/s | 781 kB 00:00 2024-04-26T10:17:50.045 INFO:teuthology.orchestra.run.smithi187.stdout:(14/137): ceph-radosgw-18.2.2-1256.gdc093b5e.el 4.8 MB/s | 13 MB 00:02 2024-04-26T10:17:50.070 INFO:teuthology.orchestra.run.smithi187.stdout:(15/137): librados-devel-18.2.2-1256.gdc093b5e. 694 kB/s | 139 kB 00:00 2024-04-26T10:17:50.145 INFO:teuthology.orchestra.run.smithi187.stdout:(16/137): libradosstriper1-18.2.2-1256.gdc093b5 4.6 MB/s | 474 kB 00:00 2024-04-26T10:17:50.212 INFO:teuthology.orchestra.run.smithi187.stdout:(17/137): python3-ceph-argparse-18.2.2-1256.gdc 669 kB/s | 45 kB 00:00 2024-04-26T10:17:50.226 INFO:teuthology.orchestra.run.smithi043.stdout:(13/137): ceph-osd-18.2.2-1256.gdc093b5e.el8.x8 5.5 MB/s | 18 MB 00:03 2024-04-26T10:17:50.251 INFO:teuthology.orchestra.run.smithi043.stdout:(14/137): libcephsqlite-18.2.2-1256.gdc093b5e.e 654 kB/s | 142 kB 00:00 2024-04-26T10:17:50.271 INFO:teuthology.orchestra.run.smithi187.stdout:(18/137): python3-ceph-common-18.2.2-1256.gdc09 2.2 MB/s | 129 kB 00:00 2024-04-26T10:17:50.302 INFO:teuthology.orchestra.run.smithi043.stdout:(15/137): librados-devel-18.2.2-1256.gdc093b5e. 1.8 MB/s | 139 kB 00:00 2024-04-26T10:17:50.335 INFO:teuthology.orchestra.run.smithi043.stdout:(16/137): libradosstriper1-18.2.2-1256.gdc093b5 5.5 MB/s | 474 kB 00:00 2024-04-26T10:17:50.388 INFO:teuthology.orchestra.run.smithi187.stdout:(19/137): python3-cephfs-18.2.2-1256.gdc093b5e. 1.6 MB/s | 197 kB 00:00 2024-04-26T10:17:50.402 INFO:teuthology.orchestra.run.smithi043.stdout:(17/137): python3-ceph-argparse-18.2.2-1256.gdc 670 kB/s | 45 kB 00:00 2024-04-26T10:17:50.463 INFO:teuthology.orchestra.run.smithi187.stdout:(20/137): python3-rados-18.2.2-1256.gdc093b5e.e 4.8 MB/s | 371 kB 00:00 2024-04-26T10:17:50.502 INFO:teuthology.orchestra.run.smithi043.stdout:(18/137): python3-ceph-common-18.2.2-1256.gdc09 1.3 MB/s | 129 kB 00:00 2024-04-26T10:17:50.547 INFO:teuthology.orchestra.run.smithi187.stdout:(21/137): python3-rbd-18.2.2-1256.gdc093b5e.el8 4.3 MB/s | 364 kB 00:00 2024-04-26T10:17:50.611 INFO:teuthology.orchestra.run.smithi043.stdout:(19/137): python3-cephfs-18.2.2-1256.gdc093b5e. 1.8 MB/s | 197 kB 00:00 2024-04-26T10:17:50.631 INFO:teuthology.orchestra.run.smithi187.stdout:(22/137): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.3 MB/s | 107 kB 00:00 2024-04-26T10:17:50.703 INFO:teuthology.orchestra.run.smithi043.stdout:(20/137): python3-rados-18.2.2-1256.gdc093b5e.e 3.9 MB/s | 371 kB 00:00 2024-04-26T10:17:50.714 INFO:teuthology.orchestra.run.smithi187.stdout:(23/137): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.1 MB/s | 95 kB 00:00 2024-04-26T10:17:50.795 INFO:teuthology.orchestra.run.smithi043.stdout:(21/137): python3-rbd-18.2.2-1256.gdc093b5e.el8 3.9 MB/s | 364 kB 00:00 2024-04-26T10:17:50.895 INFO:teuthology.orchestra.run.smithi043.stdout:(22/137): python3-rgw-18.2.2-1256.gdc093b5e.el8 1.0 MB/s | 107 kB 00:00 2024-04-26T10:17:50.970 INFO:teuthology.orchestra.run.smithi043.stdout:(23/137): rbd-fuse-18.2.2-1256.gdc093b5e.el8.x8 1.2 MB/s | 95 kB 00:00 2024-04-26T10:17:50.981 INFO:teuthology.orchestra.run.smithi187.stdout:(24/137): librgw2-18.2.2-1256.gdc093b5e.el8.x86 7.2 MB/s | 6.6 MB 00:00 2024-04-26T10:17:51.082 INFO:teuthology.orchestra.run.smithi187.stdout:(25/137): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 1.8 MB/s | 181 kB 00:00 2024-04-26T10:17:51.165 INFO:teuthology.orchestra.run.smithi187.stdout:(26/137): ceph-grafana-dashboards-18.2.2-1256.g 291 kB/s | 24 kB 00:00 2024-04-26T10:17:51.266 INFO:teuthology.orchestra.run.smithi187.stdout:(27/137): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.3 MB/s | 138 kB 00:00 2024-04-26T10:17:51.404 INFO:teuthology.orchestra.run.smithi043.stdout:(24/137): librgw2-18.2.2-1256.gdc093b5e.el8.x86 5.9 MB/s | 6.6 MB 00:01 2024-04-26T10:17:51.405 INFO:teuthology.orchestra.run.smithi187.stdout:(28/137): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 5.0 MB/s | 3.5 MB 00:00 2024-04-26T10:17:51.479 INFO:teuthology.orchestra.run.smithi043.stdout:(25/137): rbd-mirror-18.2.2-1256.gdc093b5e.el8. 6.8 MB/s | 3.5 MB 00:00 2024-04-26T10:17:51.621 INFO:teuthology.orchestra.run.smithi043.stdout:(26/137): rbd-nbd-18.2.2-1256.gdc093b5e.el8.x86 836 kB/s | 181 kB 00:00 2024-04-26T10:17:51.638 INFO:teuthology.orchestra.run.smithi043.stdout:(27/137): ceph-grafana-dashboards-18.2.2-1256.g 153 kB/s | 24 kB 00:00 2024-04-26T10:17:51.722 INFO:teuthology.orchestra.run.smithi043.stdout:(28/137): ceph-mgr-cephadm-18.2.2-1256.gdc093b5 1.3 MB/s | 138 kB 00:00 2024-04-26T10:17:51.758 INFO:teuthology.orchestra.run.smithi187.stdout:(29/137): ceph-mgr-dashboard-18.2.2-1256.gdc093 7.2 MB/s | 3.5 MB 00:00 2024-04-26T10:17:51.850 INFO:teuthology.orchestra.run.smithi187.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1256.gdc 2.6 MB/s | 246 kB 00:00 2024-04-26T10:17:51.986 INFO:teuthology.orchestra.run.smithi187.stdout:(31/137): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 362 kB/s | 49 kB 00:00 2024-04-26T10:17:52.084 INFO:teuthology.orchestra.run.smithi187.stdout:(32/137): ceph-prometheus-alerts-18.2.2-1256.gd 157 kB/s | 15 kB 00:00 2024-04-26T10:17:52.156 INFO:teuthology.orchestra.run.smithi043.stdout:(29/137): ceph-mgr-dashboard-18.2.2-1256.gdc093 6.8 MB/s | 3.5 MB 00:00 2024-04-26T10:17:52.176 INFO:teuthology.orchestra.run.smithi187.stdout:(33/137): ceph-volume-18.2.2-1256.gdc093b5e.el8 2.8 MB/s | 263 kB 00:00 2024-04-26T10:17:52.239 INFO:teuthology.orchestra.run.smithi043.stdout:(30/137): ceph-mgr-modules-core-18.2.2-1256.gdc 2.9 MB/s | 246 kB 00:00 2024-04-26T10:17:52.268 INFO:teuthology.orchestra.run.smithi187.stdout:(34/137): cephadm-18.2.2-1256.gdc093b5e.el8.noa 1.8 MB/s | 173 kB 00:00 2024-04-26T10:17:52.423 INFO:teuthology.orchestra.run.smithi043.stdout:(31/137): ceph-mgr-rook-18.2.2-1256.gdc093b5e.e 268 kB/s | 49 kB 00:00 2024-04-26T10:17:52.529 INFO:teuthology.orchestra.run.smithi043.stdout:(32/137): ceph-prometheus-alerts-18.2.2-1256.gd 143 kB/s | 15 kB 00:00 2024-04-26T10:17:52.568 INFO:teuthology.orchestra.run.smithi187.stdout:(35/137): ceph-mgr-diskprediction-local-18.2.2- 6.4 MB/s | 7.4 MB 00:01 2024-04-26T10:17:52.607 INFO:teuthology.orchestra.run.smithi043.stdout:(33/137): ceph-volume-18.2.2-1256.gdc093b5e.el8 3.3 MB/s | 263 kB 00:00 2024-04-26T10:17:52.682 INFO:teuthology.orchestra.run.smithi043.stdout:(34/137): cephadm-18.2.2-1256.gdc093b5e.el8.noa 2.3 MB/s | 173 kB 00:00 2024-04-26T10:17:52.683 INFO:teuthology.orchestra.run.smithi186.stdout:(38/137): jq-1.6-8.el8.x86_64.rpm 29 kB/s | 203 kB 00:07 2024-04-26T10:17:52.807 INFO:teuthology.orchestra.run.smithi043.stdout:(35/137): ceph-mgr-diskprediction-local-18.2.2- 6.8 MB/s | 7.4 MB 00:01 2024-04-26T10:17:54.560 INFO:teuthology.orchestra.run.smithi112.stdout:(43/137): oniguruma-6.8.2-3.el8.x86_64.rpm 26 kB/s | 188 kB 00:07 2024-04-26T10:17:56.382 INFO:teuthology.orchestra.run.smithi043.stdout:(36/137): ceph-test-18.2.2-1256.gdc093b5e.el8.x 6.3 MB/s | 47 MB 00:07 2024-04-26T10:17:56.634 INFO:teuthology.orchestra.run.smithi187.stdout:(36/137): ceph-test-18.2.2-1256.gdc093b5e.el8.x 6.2 MB/s | 47 MB 00:07 2024-04-26T10:17:56.707 INFO:teuthology.orchestra.run.smithi186.stdout:(39/137): bison-3.0.4-10.el8.x86_64.rpm 28 kB/s | 688 kB 00:24 2024-04-26T10:18:01.407 INFO:teuthology.orchestra.run.smithi186.stdout:(40/137): automake-1.16.1-8.el8.noarch.rpm 25 kB/s | 740 kB 00:29 2024-04-26T10:18:04.926 INFO:teuthology.orchestra.run.smithi112.stdout:(44/137): libtool-2.4.6-25.el8.x86_64.rpm 21 kB/s | 709 kB 00:33 2024-04-26T10:18:13.475 INFO:teuthology.orchestra.run.smithi187.stdout:(37/137): flex-2.6.1-9.el8.x86_64.rpm 19 kB/s | 320 kB 00:16 2024-04-26T10:18:13.974 INFO:teuthology.orchestra.run.smithi043.stdout:(37/137): flex-2.6.1-9.el8.x86_64.rpm 18 kB/s | 320 kB 00:17 2024-04-26T10:18:14.422 INFO:teuthology.orchestra.run.smithi186.stdout:(41/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 20 kB/s | 259 kB 00:13 2024-04-26T10:18:18.364 INFO:teuthology.orchestra.run.smithi186.stdout:(42/137): librdkafka-1.6.1-1.el8.x86_64.rpm 26 kB/s | 677 kB 00:25 2024-04-26T10:18:22.065 INFO:teuthology.orchestra.run.smithi187.stdout:(38/137): bison-3.0.4-10.el8.x86_64.rpm 23 kB/s | 688 kB 00:29 2024-04-26T10:18:22.820 INFO:teuthology.orchestra.run.smithi186.stdout:(43/137): oniguruma-6.8.2-3.el8.x86_64.rpm 22 kB/s | 188 kB 00:08 2024-04-26T10:18:22.855 INFO:teuthology.orchestra.run.smithi043.stdout:(38/137): jq-1.6-8.el8.x86_64.rpm 23 kB/s | 203 kB 00:08 2024-04-26T10:18:24.732 INFO:teuthology.orchestra.run.smithi187.stdout:(39/137): jq-1.6-8.el8.x86_64.rpm 18 kB/s | 203 kB 00:11 2024-04-26T10:18:26.813 INFO:teuthology.orchestra.run.smithi186.stdout:(44/137): libtool-2.4.6-25.el8.x86_64.rpm 24 kB/s | 709 kB 00:30 2024-04-26T10:18:26.922 INFO:teuthology.orchestra.run.smithi043.stdout:(39/137): bison-3.0.4-10.el8.x86_64.rpm 20 kB/s | 688 kB 00:34 2024-04-26T10:18:27.656 INFO:teuthology.orchestra.run.smithi187.stdout:(40/137): automake-1.16.1-8.el8.noarch.rpm 21 kB/s | 740 kB 00:35 2024-04-26T10:18:32.638 INFO:teuthology.orchestra.run.smithi043.stdout:(40/137): automake-1.16.1-8.el8.noarch.rpm 19 kB/s | 740 kB 00:39 2024-04-26T10:18:38.655 INFO:teuthology.orchestra.run.smithi187.stdout:(41/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 24 kB/s | 259 kB 00:10 2024-04-26T10:18:43.770 INFO:teuthology.orchestra.run.smithi043.stdout:(41/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 23 kB/s | 259 kB 00:11 2024-04-26T10:18:45.638 INFO:teuthology.orchestra.run.smithi187.stdout:(42/137): oniguruma-6.8.2-3.el8.x86_64.rpm 27 kB/s | 188 kB 00:06 2024-04-26T10:18:46.888 INFO:teuthology.orchestra.run.smithi187.stdout:(43/137): librdkafka-1.6.1-1.el8.x86_64.rpm 27 kB/s | 677 kB 00:24 2024-04-26T10:18:52.002 INFO:teuthology.orchestra.run.smithi043.stdout:(42/137): librdkafka-1.6.1-1.el8.x86_64.rpm 23 kB/s | 677 kB 00:29 2024-04-26T10:18:53.027 INFO:teuthology.orchestra.run.smithi043.stdout:(43/137): oniguruma-6.8.2-3.el8.x86_64.rpm 20 kB/s | 188 kB 00:09 2024-04-26T10:18:53.377 INFO:teuthology.orchestra.run.smithi043.stdout:(44/137): libtool-2.4.6-25.el8.x86_64.rpm 27 kB/s | 709 kB 00:26 2024-04-26T10:19:04.811 INFO:teuthology.orchestra.run.smithi187.stdout:(44/137): libtool-2.4.6-25.el8.x86_64.rpm 18 kB/s | 709 kB 00:40 2024-04-26T10:21:16.832 INFO:teuthology.orchestra.run.smithi112.stdout:(45/137): openblas-threads-0.3.15-4.el8.x86_64. 25 kB/s | 4.9 MB 03:22 2024-04-26T10:21:24.755 INFO:teuthology.orchestra.run.smithi112.stdout:(46/137): openblas-0.3.15-4.el8.x86_64.rpm 22 kB/s | 4.7 MB 03:35 2024-04-26T10:21:26.597 INFO:teuthology.orchestra.run.smithi112.stdout:(47/137): python3-jsonpatch-1.21-2.el8.noarch.r 14 kB/s | 27 kB 00:01 2024-04-26T10:21:28.505 INFO:teuthology.orchestra.run.smithi112.stdout:(48/137): python3-jsonpointer-1.10-11.el8.noarc 10 kB/s | 20 kB 00:01 2024-04-26T10:21:35.430 INFO:teuthology.orchestra.run.smithi112.stdout:(49/137): python3-babel-2.5.1-7.el8.noarch.rpm 23 kB/s | 4.8 MB 03:30 2024-04-26T10:21:37.113 INFO:teuthology.orchestra.run.smithi112.stdout:(50/137): python3-markupsafe-0.23-19.el8.x86_64 23 kB/s | 39 kB 00:01 2024-04-26T10:21:37.505 INFO:teuthology.orchestra.run.smithi112.stdout:(51/137): python3-mako-1.0.6-14.el8.noarch.rpm 17 kB/s | 157 kB 00:08 2024-04-26T10:21:41.922 INFO:teuthology.orchestra.run.smithi112.stdout:(52/137): python3-jinja2-2.10.1-4.el8.noarch.rp 23 kB/s | 578 kB 00:25 2024-04-26T10:21:44.063 INFO:teuthology.orchestra.run.smithi112.stdout:(53/137): python3-prettytable-0.7.2-14.el8.noar 20 kB/s | 44 kB 00:02 2024-04-26T10:21:46.138 INFO:teuthology.orchestra.run.smithi112.stdout:(54/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 26 kB/s | 225 kB 00:08 2024-04-26T10:21:48.696 INFO:teuthology.orchestra.run.smithi112.stdout:(55/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 22 kB/s | 103 kB 00:04 2024-04-26T10:21:50.804 INFO:teuthology.orchestra.run.smithi186.stdout:(45/137): openblas-threads-0.3.15-4.el8.x86_64. 24 kB/s | 4.9 MB 03:27 2024-04-26T10:21:52.155 INFO:teuthology.orchestra.run.smithi112.stdout:(56/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 21 kB/s | 126 kB 00:06 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi112.stdout:(57/137): python3-pyasn1-modules-0.3.7-6.el8.no 26 kB/s | 110 kB 00:04 2024-04-26T10:21:57.013 INFO:teuthology.orchestra.run.smithi112.stdout:(58/137): python3-pytz-2017.2-11.el8.noarch.rpm 12 kB/s | 57 kB 00:04 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi043.stdout:(45/137): openblas-0.3.15-4.el8.x86_64.rpm 26 kB/s | 4.7 MB 03:09 2024-04-26T10:22:01.720 INFO:teuthology.orchestra.run.smithi186.stdout:(46/137): openblas-0.3.15-4.el8.x86_64.rpm 22 kB/s | 4.7 MB 03:43 2024-04-26T10:22:02.978 INFO:teuthology.orchestra.run.smithi186.stdout:(47/137): python3-jsonpatch-1.21-2.el8.noarch.r 21 kB/s | 27 kB 00:01 2024-04-26T10:22:03.962 INFO:teuthology.orchestra.run.smithi186.stdout:(48/137): python3-jsonpointer-1.10-11.el8.noarc 20 kB/s | 20 kB 00:00 2024-04-26T10:22:06.853 INFO:teuthology.orchestra.run.smithi186.stdout:(49/137): python3-babel-2.5.1-7.el8.noarch.rpm 22 kB/s | 4.8 MB 03:40 2024-04-26T10:22:08.562 INFO:teuthology.orchestra.run.smithi186.stdout:(50/137): python3-markupsafe-0.23-19.el8.x86_64 23 kB/s | 39 kB 00:01 2024-04-26T10:22:09.754 INFO:teuthology.orchestra.run.smithi186.stdout:(51/137): python3-mako-1.0.6-14.el8.noarch.rpm 27 kB/s | 157 kB 00:05 2024-04-26T10:22:13.878 INFO:teuthology.orchestra.run.smithi186.stdout:(52/137): python3-jinja2-2.10.1-4.el8.noarch.rp 25 kB/s | 578 kB 00:23 2024-04-26T10:22:15.887 INFO:teuthology.orchestra.run.smithi186.stdout:(53/137): python3-prettytable-0.7.2-14.el8.noar 22 kB/s | 44 kB 00:02 2024-04-26T10:22:16.806 INFO:teuthology.orchestra.run.smithi187.stdout:(45/137): openblas-threads-0.3.15-4.el8.x86_64. 24 kB/s | 4.9 MB 03:29 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi112.stdout:(59/137): python3-werkzeug-0.12.2-4.el8.noarch. 21 kB/s | 457 kB 00:21 2024-04-26T10:22:20.153 INFO:teuthology.orchestra.run.smithi186.stdout:(54/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 24 kB/s | 103 kB 00:04 2024-04-26T10:22:20.737 INFO:teuthology.orchestra.run.smithi186.stdout:(55/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 20 kB/s | 225 kB 00:10 2024-04-26T10:22:24.370 INFO:teuthology.orchestra.run.smithi186.stdout:(56/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 30 kB/s | 126 kB 00:04 2024-04-26T10:22:25.062 INFO:teuthology.orchestra.run.smithi186.stdout:(57/137): python3-pyasn1-modules-0.3.7-6.el8.no 25 kB/s | 110 kB 00:04 2024-04-26T10:22:26.324 INFO:teuthology.orchestra.run.smithi043.stdout:(46/137): python3-jinja2-2.10.1-4.el8.noarch.rp 23 kB/s | 578 kB 00:25 2024-04-26T10:22:26.612 INFO:teuthology.orchestra.run.smithi186.stdout:(58/137): python3-pytz-2017.2-11.el8.noarch.rpm 25 kB/s | 57 kB 00:02 2024-04-26T10:22:27.032 INFO:teuthology.orchestra.run.smithi043.stdout:(47/137): python3-jsonpatch-1.21-2.el8.noarch.r 37 kB/s | 27 kB 00:00 2024-04-26T10:22:27.857 INFO:teuthology.orchestra.run.smithi043.stdout:(48/137): python3-jsonpointer-1.10-11.el8.noarc 24 kB/s | 20 kB 00:00 2024-04-26T10:22:28.826 INFO:teuthology.orchestra.run.smithi112.stdout:(60/137): socat-1.7.4.1-1.el8.x86_64.rpm 31 kB/s | 323 kB 00:10 2024-04-26T10:22:31.678 INFO:teuthology.orchestra.run.smithi187.stdout:(46/137): python3-babel-2.5.1-7.el8.noarch.rpm 24 kB/s | 4.8 MB 03:26 2024-04-26T10:22:33.087 INFO:teuthology.orchestra.run.smithi187.stdout:(47/137): python3-jsonpatch-1.21-2.el8.noarch.r 19 kB/s | 27 kB 00:01 2024-04-26T10:22:33.343 INFO:teuthology.orchestra.run.smithi112.stdout:(61/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 16 kB/s | 71 kB 00:04 2024-04-26T10:22:33.460 INFO:teuthology.orchestra.run.smithi112.stdout:(62/137): elfutils-libelf-devel-0.190-2.el8.x86 533 kB/s | 62 kB 00:00 2024-04-26T10:22:33.527 INFO:teuthology.orchestra.run.smithi112.stdout:(63/137): fuse-2.9.7-19.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2024-04-26T10:22:33.568 INFO:teuthology.orchestra.run.smithi112.stdout:(64/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2024-04-26T10:22:33.685 INFO:teuthology.orchestra.run.smithi112.stdout:(65/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 4.7 MB/s | 561 kB 00:00 2024-04-26T10:22:33.728 INFO:teuthology.orchestra.run.smithi112.stdout:(66/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 447 kB/s | 19 kB 00:00 2024-04-26T10:22:33.769 INFO:teuthology.orchestra.run.smithi112.stdout:(67/137): libcom_err-devel-1.45.6-5.el8.x86_64. 934 kB/s | 39 kB 00:00 2024-04-26T10:22:33.836 INFO:teuthology.orchestra.run.smithi112.stdout:(68/137): libgfortran-8.5.0-22.el8.x86_64.rpm 9.5 MB/s | 645 kB 00:00 2024-04-26T10:22:33.862 INFO:teuthology.orchestra.run.smithi187.stdout:(48/137): python3-jsonpointer-1.10-11.el8.noarc 26 kB/s | 20 kB 00:00 2024-04-26T10:22:33.886 INFO:teuthology.orchestra.run.smithi112.stdout:(69/137): libquadmath-8.5.0-22.el8.x86_64.rpm 3.4 MB/s | 172 kB 00:00 2024-04-26T10:22:33.929 INFO:teuthology.orchestra.run.smithi112.stdout:(70/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-04-26T10:22:33.979 INFO:teuthology.orchestra.run.smithi112.stdout:(71/137): libselinux-devel-2.9-8.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2024-04-26T10:22:34.029 INFO:teuthology.orchestra.run.smithi112.stdout:(72/137): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-04-26T10:22:34.071 INFO:teuthology.orchestra.run.smithi112.stdout:(73/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 2.4 MB/s | 100 kB 00:00 2024-04-26T10:22:34.121 INFO:teuthology.orchestra.run.smithi112.stdout:(74/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 361 kB/s | 18 kB 00:00 2024-04-26T10:22:34.157 INFO:teuthology.orchestra.run.smithi043.stdout:(49/137): python3-babel-2.5.1-7.el8.noarch.rpm 22 kB/s | 4.8 MB 03:40 2024-04-26T10:22:34.171 INFO:teuthology.orchestra.run.smithi112.stdout:(75/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 881 kB/s | 44 kB 00:00 2024-04-26T10:22:34.380 INFO:teuthology.orchestra.run.smithi112.stdout:(76/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 15 MB/s | 3.2 MB 00:00 2024-04-26T10:22:34.439 INFO:teuthology.orchestra.run.smithi112.stdout:(77/137): pcre2-devel-10.32-3.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2024-04-26T10:22:34.489 INFO:teuthology.orchestra.run.smithi112.stdout:(78/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-04-26T10:22:34.539 INFO:teuthology.orchestra.run.smithi112.stdout:(79/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-04-26T10:22:34.606 INFO:teuthology.orchestra.run.smithi112.stdout:(80/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 3.7 MB/s | 249 kB 00:00 2024-04-26T10:22:34.706 INFO:teuthology.orchestra.run.smithi112.stdout:(81/137): python3-cryptography-3.2.1-7.el8.x86_ 6.3 MB/s | 641 kB 00:00 2024-04-26T10:22:34.782 INFO:teuthology.orchestra.run.smithi112.stdout:(82/137): python3-jwt-1.6.1-2.el8.noarch.rpm 568 kB/s | 43 kB 00:00 2024-04-26T10:22:34.849 INFO:teuthology.orchestra.run.smithi112.stdout:(83/137): python3-oauthlib-2.1.0-1.el8.noarch.r 2.3 MB/s | 155 kB 00:00 2024-04-26T10:22:34.932 INFO:teuthology.orchestra.run.smithi112.stdout:(84/137): python3-pycparser-2.14-14.el8.noarch. 1.3 MB/s | 109 kB 00:00 2024-04-26T10:22:34.982 INFO:teuthology.orchestra.run.smithi112.stdout:(85/137): python3-requests-oauthlib-1.0.0-1.el8 855 kB/s | 43 kB 00:00 2024-04-26T10:22:34.998 INFO:teuthology.orchestra.run.smithi043.stdout:(50/137): openblas-threads-0.3.15-4.el8.x86_64. 22 kB/s | 4.9 MB 03:41 2024-04-26T10:22:35.129 INFO:teuthology.orchestra.run.smithi187.stdout:(49/137): openblas-0.3.15-4.el8.x86_64.rpm 21 kB/s | 4.7 MB 03:49 2024-04-26T10:22:35.349 INFO:teuthology.orchestra.run.smithi112.stdout:(86/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 203 kB/s | 74 kB 00:00 2024-04-26T10:22:35.391 INFO:teuthology.orchestra.run.smithi112.stdout:(87/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-04-26T10:22:35.640 INFO:teuthology.orchestra.run.smithi043.stdout:(51/137): python3-markupsafe-0.23-19.el8.x86_64 26 kB/s | 39 kB 00:01 2024-04-26T10:22:35.916 INFO:teuthology.orchestra.run.smithi112.stdout:(88/137): python3-packaging-16.8-9.el8.noarch.r 92 kB/s | 48 kB 00:00 2024-04-26T10:22:36.425 INFO:teuthology.orchestra.run.smithi112.stdout:(89/137): gperftools-libs-2.7-9.el8.x86_64.rpm 602 kB/s | 306 kB 00:00 2024-04-26T10:22:36.533 INFO:teuthology.orchestra.run.smithi112.stdout:(90/137): liboath-2.6.2-3.el8.x86_64.rpm 544 kB/s | 59 kB 00:00 2024-04-26T10:22:36.642 INFO:teuthology.orchestra.run.smithi112.stdout:(91/137): libunwind-1.3.1-3.el8.x86_64.rpm 693 kB/s | 75 kB 00:00 2024-04-26T10:22:36.818 INFO:teuthology.orchestra.run.smithi112.stdout:(92/137): python3-asyncssh-2.7.0-2.el8.noarch.r 2.7 MB/s | 476 kB 00:00 2024-04-26T10:22:36.918 INFO:teuthology.orchestra.run.smithi112.stdout:(93/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 436 kB/s | 44 kB 00:00 2024-04-26T10:22:37.035 INFO:teuthology.orchestra.run.smithi112.stdout:(94/137): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2024-04-26T10:22:37.054 INFO:teuthology.orchestra.run.smithi187.stdout:(50/137): python3-markupsafe-0.23-19.el8.x86_64 20 kB/s | 39 kB 00:01 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi112.stdout:(95/137): python3-cachetools-3.1.1-4.el8.noarch 330 kB/s | 33 kB 00:00 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi043.stdout:(52/137): python3-mako-1.0.6-14.el8.noarch.rpm 17 kB/s | 157 kB 00:09 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi112.stdout:(96/137): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2024-04-26T10:22:37.344 INFO:teuthology.orchestra.run.smithi112.stdout:(97/137): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2024-04-26T10:22:37.461 INFO:teuthology.orchestra.run.smithi112.stdout:(98/137): python3-cherrypy-18.4.0-1.el8.noarch. 3.2 MB/s | 384 kB 00:00 2024-04-26T10:22:37.561 INFO:teuthology.orchestra.run.smithi112.stdout:(99/137): python3-google-auth-1.1.1-10.el8.noar 812 kB/s | 81 kB 00:00 2024-04-26T10:22:37.670 INFO:teuthology.orchestra.run.smithi112.stdout:(100/137): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2024-04-26T10:22:37.753 INFO:teuthology.orchestra.run.smithi112.stdout:(101/137): python3-jaraco-functools-2.0-4.el8.n 211 kB/s | 18 kB 00:00 2024-04-26T10:22:37.937 INFO:teuthology.orchestra.run.smithi112.stdout:(102/137): python3-kubernetes-11.0.0-6.el8.noar 6.4 MB/s | 1.2 MB 00:00 2024-04-26T10:22:38.029 INFO:teuthology.orchestra.run.smithi112.stdout:(103/137): python3-logutils-0.3.5-11.el8.noarch 531 kB/s | 49 kB 00:00 2024-04-26T10:22:38.138 INFO:teuthology.orchestra.run.smithi112.stdout:(104/137): python3-more-itertools-7.2.0-3.el8.n 542 kB/s | 59 kB 00:00 2024-04-26T10:22:38.230 INFO:teuthology.orchestra.run.smithi112.stdout:(105/137): python3-natsort-7.1.1-2.el8.noarch.r 657 kB/s | 60 kB 00:00 2024-04-26T10:22:38.338 INFO:teuthology.orchestra.run.smithi112.stdout:(106/137): python3-pecan-1.3.2-9.el8.noarch.rpm 2.6 MB/s | 283 kB 00:00 2024-04-26T10:22:38.422 INFO:teuthology.orchestra.run.smithi112.stdout:(107/137): python3-portend-2.6-1.el8.noarch.rpm 187 kB/s | 16 kB 00:00 2024-04-26T10:22:38.506 INFO:teuthology.orchestra.run.smithi112.stdout:(108/137): python3-repoze-lru-0.7-6.el8.noarch. 403 kB/s | 34 kB 00:00 2024-04-26T10:22:38.606 INFO:teuthology.orchestra.run.smithi112.stdout:(109/137): python3-routes-2.4.1-12.el8.noarch.r 1.9 MB/s | 196 kB 00:00 2024-04-26T10:22:38.706 INFO:teuthology.orchestra.run.smithi112.stdout:(110/137): python3-rsa-4.9-2.el8.noarch.rpm 642 kB/s | 64 kB 00:00 2024-04-26T10:22:38.798 INFO:teuthology.orchestra.run.smithi112.stdout:(111/137): python3-simplegeneric-0.8.1-17.el8.n 204 kB/s | 19 kB 00:00 2024-04-26T10:22:38.890 INFO:teuthology.orchestra.run.smithi112.stdout:(112/137): python3-singledispatch-3.4.0.3-18.el 261 kB/s | 24 kB 00:00 2024-04-26T10:22:38.982 INFO:teuthology.orchestra.run.smithi112.stdout:(113/137): python3-tempora-1.14.1-5.el8.noarch. 319 kB/s | 29 kB 00:00 2024-04-26T10:22:39.074 INFO:teuthology.orchestra.run.smithi112.stdout:(114/137): python3-trustme-0.6.0-4.el8.noarch.r 301 kB/s | 27 kB 00:00 2024-04-26T10:22:39.182 INFO:teuthology.orchestra.run.smithi112.stdout:(115/137): python3-waitress-1.4.3-1.el8.noarch. 2.3 MB/s | 255 kB 00:00 2024-04-26T10:22:39.291 INFO:teuthology.orchestra.run.smithi112.stdout:(116/137): python3-webob-1.8.5-1.el8.1.noarch.r 2.3 MB/s | 251 kB 00:00 2024-04-26T10:22:39.391 INFO:teuthology.orchestra.run.smithi112.stdout:(117/137): python3-websocket-client-0.56.0-5.el 612 kB/s | 61 kB 00:00 2024-04-26T10:22:39.492 INFO:teuthology.orchestra.run.smithi112.stdout:(118/137): python3-webtest-2.0.33-1.el8.noarch. 854 kB/s | 85 kB 00:00 2024-04-26T10:22:39.584 INFO:teuthology.orchestra.run.smithi112.stdout:(119/137): python3-zc-lockfile-2.0-2.el8.noarch 250 kB/s | 23 kB 00:00 2024-04-26T10:22:39.776 INFO:teuthology.orchestra.run.smithi112.stdout:(120/137): thrift-0.13.0-2.el8.x86_64.rpm 9.0 MB/s | 1.7 MB 00:00 2024-04-26T10:22:40.226 INFO:teuthology.orchestra.run.smithi112.stdout:(121/137): librados2-18.2.2-1256.gdc093b5e.el8. 8.2 MB/s | 3.7 MB 00:00 2024-04-26T10:22:40.324 INFO:teuthology.orchestra.run.smithi043.stdout:(53/137): python3-prettytable-0.7.2-14.el8.noar 14 kB/s | 44 kB 00:03 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi112.stdout:(122/137): librbd1-18.2.2-1256.gdc093b5e.el8.x8 15 MB/s | 3.6 MB 00:00 2024-04-26T10:22:40.568 INFO:teuthology.orchestra.run.smithi112.stdout:(123/137): elfutils-debuginfod-client-0.190-2.e 708 kB/s | 77 kB 00:00 2024-04-26T10:22:40.635 INFO:teuthology.orchestra.run.smithi112.stdout:(124/137): elfutils-libelf-0.190-2.el8.x86_64.r 3.4 MB/s | 233 kB 00:00 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi112.stdout:(125/137): elfutils-libs-0.190-2.el8.x86_64.rpm 6.0 MB/s | 305 kB 00:00 2024-04-26T10:22:40.736 INFO:teuthology.orchestra.run.smithi112.stdout:(126/137): libblkid-2.32.1-46.el8.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-26T10:22:40.737 INFO:teuthology.orchestra.run.smithi187.stdout:(51/137): python3-mako-1.0.6-14.el8.noarch.rpm 23 kB/s | 157 kB 00:06 2024-04-26T10:22:40.786 INFO:teuthology.orchestra.run.smithi112.stdout:(127/137): libfdisk-2.32.1-46.el8.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-04-26T10:22:40.836 INFO:teuthology.orchestra.run.smithi112.stdout:(128/137): libmount-2.32.1-46.el8.x86_64.rpm 4.6 MB/s | 237 kB 00:00 2024-04-26T10:22:40.886 INFO:teuthology.orchestra.run.smithi112.stdout:(129/137): libsmartcols-2.32.1-46.el8.x86_64.rp 3.5 MB/s | 180 kB 00:00 2024-04-26T10:22:40.936 INFO:teuthology.orchestra.run.smithi112.stdout:(130/137): libuuid-2.32.1-46.el8.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-04-26T10:22:41.012 INFO:teuthology.orchestra.run.smithi112.stdout:(131/137): openssl-1.1.1k-12.el8.x86_64.rpm 9.6 MB/s | 738 kB 00:00 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi112.stdout:(132/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 18 MB/s | 1.5 MB 00:00 2024-04-26T10:22:41.188 INFO:teuthology.orchestra.run.smithi112.stdout:(133/137): util-linux-2.32.1-46.el8.x86_64.rpm 28 MB/s | 2.6 MB 00:00 2024-04-26T10:22:41.238 INFO:teuthology.orchestra.run.smithi112.stdout:(134/137): util-linux-user-2.32.1-46.el8.x86_64 2.0 MB/s | 103 kB 00:00 2024-04-26T10:22:41.305 INFO:teuthology.orchestra.run.smithi112.stdout:(135/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-04-26T10:22:44.287 INFO:teuthology.orchestra.run.smithi187.stdout:(52/137): python3-jinja2-2.10.1-4.el8.noarch.rp 21 kB/s | 578 kB 00:27 2024-04-26T10:22:44.682 INFO:teuthology.orchestra.run.smithi043.stdout:(54/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 25 kB/s | 225 kB 00:09 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi043.stdout:(55/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 20 kB/s | 103 kB 00:05 2024-04-26T10:22:45.912 INFO:teuthology.orchestra.run.smithi187.stdout:(53/137): python3-prettytable-0.7.2-14.el8.noar 27 kB/s | 44 kB 00:01 2024-04-26T10:22:47.421 INFO:teuthology.orchestra.run.smithi186.stdout:(59/137): python3-werkzeug-0.12.2-4.el8.noarch. 22 kB/s | 457 kB 00:20 2024-04-26T10:22:49.328 INFO:teuthology.orchestra.run.smithi187.stdout:(54/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 26 kB/s | 225 kB 00:08 2024-04-26T10:22:50.231 INFO:teuthology.orchestra.run.smithi043.stdout:(56/137): python3-pyasn1-modules-0.3.7-6.el8.no 23 kB/s | 110 kB 00:04 2024-04-26T10:22:50.478 INFO:teuthology.orchestra.run.smithi187.stdout:(55/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 23 kB/s | 103 kB 00:04 2024-04-26T10:22:50.896 INFO:teuthology.orchestra.run.smithi043.stdout:(57/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 20 kB/s | 126 kB 00:06 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi043.stdout:(58/137): python3-pytz-2017.2-11.el8.noarch.rpm 18 kB/s | 57 kB 00:03 2024-04-26T10:22:53.778 INFO:teuthology.orchestra.run.smithi187.stdout:(56/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 28 kB/s | 126 kB 00:04 2024-04-26T10:22:56.078 INFO:teuthology.orchestra.run.smithi187.stdout:(57/137): python3-pytz-2017.2-11.el8.noarch.rpm 25 kB/s | 57 kB 00:02 2024-04-26T10:22:59.303 INFO:teuthology.orchestra.run.smithi187.stdout:(58/137): python3-pyasn1-modules-0.3.7-6.el8.no 12 kB/s | 110 kB 00:08 2024-04-26T10:23:08.757 INFO:teuthology.orchestra.run.smithi186.stdout:(60/137): socat-1.7.4.1-1.el8.x86_64.rpm 15 kB/s | 323 kB 00:21 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi186.stdout:(61/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 21 kB/s | 71 kB 00:03 2024-04-26T10:23:12.282 INFO:teuthology.orchestra.run.smithi186.stdout:(62/137): elfutils-libelf-devel-0.190-2.el8.x86 415 kB/s | 62 kB 00:00 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi186.stdout:(63/137): fuse-2.9.7-19.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2024-04-26T10:23:12.399 INFO:teuthology.orchestra.run.smithi186.stdout:(64/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 963 kB/s | 48 kB 00:00 2024-04-26T10:23:12.650 INFO:teuthology.orchestra.run.smithi186.stdout:(65/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.2 MB/s | 561 kB 00:00 2024-04-26T10:23:12.691 INFO:teuthology.orchestra.run.smithi186.stdout:(66/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 449 kB/s | 19 kB 00:00 2024-04-26T10:23:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:(67/137): libcom_err-devel-1.45.6-5.el8.x86_64. 931 kB/s | 39 kB 00:00 2024-04-26T10:23:12.917 INFO:teuthology.orchestra.run.smithi186.stdout:(68/137): libgfortran-8.5.0-22.el8.x86_64.rpm 3.4 MB/s | 645 kB 00:00 2024-04-26T10:23:13.017 INFO:teuthology.orchestra.run.smithi186.stdout:(69/137): libquadmath-8.5.0-22.el8.x86_64.rpm 1.7 MB/s | 172 kB 00:00 2024-04-26T10:23:13.076 INFO:teuthology.orchestra.run.smithi186.stdout:(70/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-04-26T10:23:13.159 INFO:teuthology.orchestra.run.smithi186.stdout:(71/137): libselinux-devel-2.9-8.el8.x86_64.rpm 2.3 MB/s | 200 kB 00:00 2024-04-26T10:23:13.210 INFO:teuthology.orchestra.run.smithi186.stdout:(72/137): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-04-26T10:23:13.260 INFO:teuthology.orchestra.run.smithi186.stdout:(73/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 2.0 MB/s | 100 kB 00:00 2024-04-26T10:23:13.343 INFO:teuthology.orchestra.run.smithi186.stdout:(74/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 218 kB/s | 18 kB 00:00 2024-04-26T10:23:13.394 INFO:teuthology.orchestra.run.smithi186.stdout:(75/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 872 kB/s | 44 kB 00:00 2024-04-26T10:23:13.827 INFO:teuthology.orchestra.run.smithi186.stdout:(76/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 7.4 MB/s | 3.2 MB 00:00 2024-04-26T10:23:13.902 INFO:teuthology.orchestra.run.smithi186.stdout:(77/137): pcre2-devel-10.32-3.el8.x86_64.rpm 7.9 MB/s | 605 kB 00:00 2024-04-26T10:23:13.953 INFO:teuthology.orchestra.run.smithi186.stdout:(78/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-04-26T10:23:14.003 INFO:teuthology.orchestra.run.smithi186.stdout:(79/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-04-26T10:23:14.053 INFO:teuthology.orchestra.run.smithi186.stdout:(80/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.9 MB/s | 249 kB 00:00 2024-04-26T10:23:14.129 INFO:teuthology.orchestra.run.smithi186.stdout:(81/137): python3-cryptography-3.2.1-7.el8.x86_ 8.3 MB/s | 641 kB 00:00 2024-04-26T10:23:14.179 INFO:teuthology.orchestra.run.smithi186.stdout:(82/137): python3-jwt-1.6.1-2.el8.noarch.rpm 854 kB/s | 43 kB 00:00 2024-04-26T10:23:14.229 INFO:teuthology.orchestra.run.smithi186.stdout:(83/137): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2024-04-26T10:23:14.279 INFO:teuthology.orchestra.run.smithi186.stdout:(84/137): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2024-04-26T10:23:14.330 INFO:teuthology.orchestra.run.smithi186.stdout:(85/137): python3-requests-oauthlib-1.0.0-1.el8 852 kB/s | 43 kB 00:00 2024-04-26T10:23:14.380 INFO:teuthology.orchestra.run.smithi186.stdout:(86/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.5 MB/s | 74 kB 00:00 2024-04-26T10:23:14.430 INFO:teuthology.orchestra.run.smithi186.stdout:(87/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-26T10:23:14.781 INFO:teuthology.orchestra.run.smithi186.stdout:(88/137): python3-packaging-16.8-9.el8.noarch.r 138 kB/s | 48 kB 00:00 2024-04-26T10:23:14.956 INFO:teuthology.orchestra.run.smithi186.stdout:(89/137): gperftools-libs-2.7-9.el8.x86_64.rpm 1.7 MB/s | 306 kB 00:00 2024-04-26T10:23:15.023 INFO:teuthology.orchestra.run.smithi186.stdout:(90/137): liboath-2.6.2-3.el8.x86_64.rpm 883 kB/s | 59 kB 00:00 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi186.stdout:(91/137): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2024-04-26T10:23:15.140 INFO:teuthology.orchestra.run.smithi186.stdout:(92/137): python3-asyncssh-2.7.0-2.el8.noarch.r 7.0 MB/s | 476 kB 00:00 2024-04-26T10:23:15.192 INFO:teuthology.orchestra.run.smithi187.stdout:(59/137): python3-werkzeug-0.12.2-4.el8.noarch. 29 kB/s | 457 kB 00:15 2024-04-26T10:23:15.199 INFO:teuthology.orchestra.run.smithi186.stdout:(93/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 749 kB/s | 44 kB 00:00 2024-04-26T10:23:15.241 INFO:teuthology.orchestra.run.smithi186.stdout:(94/137): python3-beautifulsoup4-4.6.3-2.el8.1. 4.3 MB/s | 185 kB 00:00 2024-04-26T10:23:15.291 INFO:teuthology.orchestra.run.smithi186.stdout:(95/137): python3-cachetools-3.1.1-4.el8.noarch 663 kB/s | 33 kB 00:00 2024-04-26T10:23:15.350 INFO:teuthology.orchestra.run.smithi186.stdout:(96/137): python3-certifi-2018.10.15-7.el8.noar 279 kB/s | 16 kB 00:00 2024-04-26T10:23:15.400 INFO:teuthology.orchestra.run.smithi186.stdout:(97/137): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2024-04-26T10:23:15.450 INFO:teuthology.orchestra.run.smithi186.stdout:(98/137): python3-cherrypy-18.4.0-1.el8.noarch. 7.5 MB/s | 384 kB 00:00 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi186.stdout:(99/137): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi186.stdout:(100/137): python3-jaraco-6.2-6.el8.noarch.rpm 191 kB/s | 11 kB 00:00 2024-04-26T10:23:15.601 INFO:teuthology.orchestra.run.smithi186.stdout:(101/137): python3-jaraco-functools-2.0-4.el8.n 422 kB/s | 18 kB 00:00 2024-04-26T10:23:15.710 INFO:teuthology.orchestra.run.smithi186.stdout:(102/137): python3-kubernetes-11.0.0-6.el8.noar 11 MB/s | 1.2 MB 00:00 2024-04-26T10:23:15.843 INFO:teuthology.orchestra.run.smithi186.stdout:(103/137): python3-logutils-0.3.5-11.el8.noarch 366 kB/s | 49 kB 00:00 2024-04-26T10:23:15.894 INFO:teuthology.orchestra.run.smithi186.stdout:(104/137): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2024-04-26T10:23:15.944 INFO:teuthology.orchestra.run.smithi186.stdout:(105/137): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2024-04-26T10:23:15.994 INFO:teuthology.orchestra.run.smithi186.stdout:(106/137): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi186.stdout:(107/137): python3-portend-2.6-1.el8.noarch.rpm 313 kB/s | 16 kB 00:00 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi186.stdout:(108/137): python3-repoze-lru-0.7-6.el8.noarch. 504 kB/s | 34 kB 00:00 2024-04-26T10:23:16.162 INFO:teuthology.orchestra.run.smithi186.stdout:(109/137): python3-routes-2.4.1-12.el8.noarch.r 3.8 MB/s | 196 kB 00:00 2024-04-26T10:23:16.212 INFO:teuthology.orchestra.run.smithi186.stdout:(110/137): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2024-04-26T10:23:16.262 INFO:teuthology.orchestra.run.smithi186.stdout:(111/137): python3-simplegeneric-0.8.1-17.el8.n 375 kB/s | 19 kB 00:00 2024-04-26T10:23:16.312 INFO:teuthology.orchestra.run.smithi186.stdout:(112/137): python3-singledispatch-3.4.0.3-18.el 478 kB/s | 24 kB 00:00 2024-04-26T10:23:16.388 INFO:teuthology.orchestra.run.smithi186.stdout:(113/137): python3-tempora-1.14.1-5.el8.noarch. 389 kB/s | 29 kB 00:00 2024-04-26T10:23:16.438 INFO:teuthology.orchestra.run.smithi186.stdout:(114/137): python3-trustme-0.6.0-4.el8.noarch.r 551 kB/s | 27 kB 00:00 2024-04-26T10:23:16.497 INFO:teuthology.orchestra.run.smithi186.stdout:(115/137): python3-waitress-1.4.3-1.el8.noarch. 4.3 MB/s | 255 kB 00:00 2024-04-26T10:23:16.547 INFO:teuthology.orchestra.run.smithi186.stdout:(116/137): python3-webob-1.8.5-1.el8.1.noarch.r 4.9 MB/s | 251 kB 00:00 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi186.stdout:(117/137): python3-websocket-client-0.56.0-5.el 1.4 MB/s | 61 kB 00:00 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi186.stdout:(118/137): python3-webtest-2.0.33-1.el8.noarch. 1.7 MB/s | 85 kB 00:00 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi186.stdout:(119/137): python3-zc-lockfile-2.0-2.el8.noarch 551 kB/s | 23 kB 00:00 2024-04-26T10:23:16.765 INFO:teuthology.orchestra.run.smithi186.stdout:(120/137): thrift-0.13.0-2.el8.x86_64.rpm 21 MB/s | 1.7 MB 00:00 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi186.stdout:(121/137): librados2-18.2.2-1256.gdc093b5e.el8. 1.2 MB/s | 3.7 MB 00:02 2024-04-26T10:23:22.248 INFO:teuthology.orchestra.run.smithi186.stdout:(122/137): librbd1-18.2.2-1256.gdc093b5e.el8.x8 1.4 MB/s | 3.6 MB 00:02 2024-04-26T10:23:22.349 INFO:teuthology.orchestra.run.smithi186.stdout:(123/137): elfutils-debuginfod-client-0.190-2.e 769 kB/s | 77 kB 00:00 2024-04-26T10:23:22.415 INFO:teuthology.orchestra.run.smithi186.stdout:(124/137): elfutils-libelf-0.190-2.el8.x86_64.r 3.4 MB/s | 233 kB 00:00 2024-04-26T10:23:22.466 INFO:teuthology.orchestra.run.smithi186.stdout:(125/137): elfutils-libs-0.190-2.el8.x86_64.rpm 6.0 MB/s | 305 kB 00:00 2024-04-26T10:23:22.516 INFO:teuthology.orchestra.run.smithi186.stdout:(126/137): libblkid-2.32.1-46.el8.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-26T10:23:22.566 INFO:teuthology.orchestra.run.smithi186.stdout:(127/137): libfdisk-2.32.1-46.el8.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-04-26T10:23:22.616 INFO:teuthology.orchestra.run.smithi186.stdout:(128/137): libmount-2.32.1-46.el8.x86_64.rpm 4.6 MB/s | 237 kB 00:00 2024-04-26T10:23:22.667 INFO:teuthology.orchestra.run.smithi186.stdout:(129/137): libsmartcols-2.32.1-46.el8.x86_64.rp 3.5 MB/s | 180 kB 00:00 2024-04-26T10:23:22.709 INFO:teuthology.orchestra.run.smithi186.stdout:(130/137): libuuid-2.32.1-46.el8.x86_64.rpm 2.3 MB/s | 99 kB 00:00 2024-04-26T10:23:22.776 INFO:teuthology.orchestra.run.smithi186.stdout:(131/137): openssl-1.1.1k-12.el8.x86_64.rpm 11 MB/s | 738 kB 00:00 2024-04-26T10:23:22.851 INFO:teuthology.orchestra.run.smithi186.stdout:(132/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 20 MB/s | 1.5 MB 00:00 2024-04-26T10:23:22.960 INFO:teuthology.orchestra.run.smithi186.stdout:(133/137): util-linux-2.32.1-46.el8.x86_64.rpm 24 MB/s | 2.6 MB 00:00 2024-04-26T10:23:23.010 INFO:teuthology.orchestra.run.smithi186.stdout:(134/137): util-linux-user-2.32.1-46.el8.x86_64 2.0 MB/s | 103 kB 00:00 2024-04-26T10:23:23.077 INFO:teuthology.orchestra.run.smithi186.stdout:(135/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-04-26T10:23:26.594 INFO:teuthology.orchestra.run.smithi043.stdout:(59/137): python3-werkzeug-0.12.2-4.el8.noarch. 14 kB/s | 457 kB 00:33 2024-04-26T10:23:36.106 INFO:teuthology.orchestra.run.smithi187.stdout:(60/137): socat-1.7.4.1-1.el8.x86_64.rpm 15 kB/s | 323 kB 00:20 2024-04-26T10:23:41.297 INFO:teuthology.orchestra.run.smithi187.stdout:(61/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 14 kB/s | 71 kB 00:05 2024-04-26T10:23:41.414 INFO:teuthology.orchestra.run.smithi187.stdout:(62/137): elfutils-libelf-devel-0.190-2.el8.x86 534 kB/s | 62 kB 00:00 2024-04-26T10:23:41.481 INFO:teuthology.orchestra.run.smithi187.stdout:(63/137): fuse-2.9.7-19.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2024-04-26T10:23:41.531 INFO:teuthology.orchestra.run.smithi187.stdout:(64/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 963 kB/s | 48 kB 00:00 2024-04-26T10:23:41.631 INFO:teuthology.orchestra.run.smithi187.stdout:(65/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 5.5 MB/s | 561 kB 00:00 2024-04-26T10:23:41.682 INFO:teuthology.orchestra.run.smithi187.stdout:(66/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 374 kB/s | 19 kB 00:00 2024-04-26T10:23:41.732 INFO:teuthology.orchestra.run.smithi187.stdout:(67/137): libcom_err-devel-1.45.6-5.el8.x86_64. 774 kB/s | 39 kB 00:00 2024-04-26T10:23:41.791 INFO:teuthology.orchestra.run.smithi187.stdout:(68/137): libgfortran-8.5.0-22.el8.x86_64.rpm 11 MB/s | 645 kB 00:00 2024-04-26T10:23:41.841 INFO:teuthology.orchestra.run.smithi187.stdout:(69/137): libquadmath-8.5.0-22.el8.x86_64.rpm 3.4 MB/s | 172 kB 00:00 2024-04-26T10:23:41.891 INFO:teuthology.orchestra.run.smithi187.stdout:(70/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-04-26T10:23:41.942 INFO:teuthology.orchestra.run.smithi187.stdout:(71/137): libselinux-devel-2.9-8.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2024-04-26T10:23:41.992 INFO:teuthology.orchestra.run.smithi187.stdout:(72/137): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-04-26T10:23:42.042 INFO:teuthology.orchestra.run.smithi187.stdout:(73/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 2.0 MB/s | 100 kB 00:00 2024-04-26T10:23:42.124 INFO:teuthology.orchestra.run.smithi187.stdout:(74/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 221 kB/s | 18 kB 00:00 2024-04-26T10:23:42.185 INFO:teuthology.orchestra.run.smithi187.stdout:(75/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 733 kB/s | 44 kB 00:00 2024-04-26T10:23:42.302 INFO:teuthology.orchestra.run.smithi187.stdout:(76/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 27 MB/s | 3.2 MB 00:00 2024-04-26T10:23:42.360 INFO:teuthology.orchestra.run.smithi187.stdout:(77/137): pcre2-devel-10.32-3.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2024-04-26T10:23:42.392 INFO:teuthology.orchestra.run.smithi043.stdout:(60/137): socat-1.7.4.1-1.el8.x86_64.rpm 20 kB/s | 323 kB 00:15 2024-04-26T10:23:42.410 INFO:teuthology.orchestra.run.smithi187.stdout:(78/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-04-26T10:23:42.461 INFO:teuthology.orchestra.run.smithi187.stdout:(79/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-04-26T10:23:42.511 INFO:teuthology.orchestra.run.smithi187.stdout:(80/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.9 MB/s | 249 kB 00:00 2024-04-26T10:23:42.569 INFO:teuthology.orchestra.run.smithi187.stdout:(81/137): python3-cryptography-3.2.1-7.el8.x86_ 11 MB/s | 641 kB 00:00 2024-04-26T10:23:42.611 INFO:teuthology.orchestra.run.smithi187.stdout:(82/137): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2024-04-26T10:23:42.693 INFO:teuthology.orchestra.run.smithi187.stdout:(83/137): python3-oauthlib-2.1.0-1.el8.noarch.r 1.9 MB/s | 155 kB 00:00 2024-04-26T10:23:42.745 INFO:teuthology.orchestra.run.smithi187.stdout:(84/137): python3-pycparser-2.14-14.el8.noarch. 2.0 MB/s | 109 kB 00:00 2024-04-26T10:23:42.796 INFO:teuthology.orchestra.run.smithi187.stdout:(85/137): python3-requests-oauthlib-1.0.0-1.el8 854 kB/s | 43 kB 00:00 2024-04-26T10:23:42.846 INFO:teuthology.orchestra.run.smithi187.stdout:(86/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.5 MB/s | 74 kB 00:00 2024-04-26T10:23:42.896 INFO:teuthology.orchestra.run.smithi187.stdout:(87/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-26T10:23:43.283 INFO:teuthology.orchestra.run.smithi187.stdout:(88/137): python3-packaging-16.8-9.el8.noarch.r 125 kB/s | 48 kB 00:00 2024-04-26T10:23:44.138 INFO:teuthology.orchestra.run.smithi187.stdout:(89/137): gperftools-libs-2.7-9.el8.x86_64.rpm 358 kB/s | 306 kB 00:00 2024-04-26T10:23:44.381 INFO:teuthology.orchestra.run.smithi187.stdout:(90/137): liboath-2.6.2-3.el8.x86_64.rpm 243 kB/s | 59 kB 00:00 2024-04-26T10:23:44.489 INFO:teuthology.orchestra.run.smithi187.stdout:(91/137): libunwind-1.3.1-3.el8.x86_64.rpm 695 kB/s | 75 kB 00:00 2024-04-26T10:23:44.706 INFO:teuthology.orchestra.run.smithi187.stdout:(92/137): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2024-04-26T10:23:44.814 INFO:teuthology.orchestra.run.smithi187.stdout:(93/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2024-04-26T10:23:44.957 INFO:teuthology.orchestra.run.smithi187.stdout:(94/137): python3-beautifulsoup4-4.6.3-2.el8.1. 1.3 MB/s | 185 kB 00:00 2024-04-26T10:23:45.065 INFO:teuthology.orchestra.run.smithi187.stdout:(95/137): python3-cachetools-3.1.1-4.el8.noarch 305 kB/s | 33 kB 00:00 2024-04-26T10:23:45.190 INFO:teuthology.orchestra.run.smithi187.stdout:(96/137): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2024-04-26T10:23:45.299 INFO:teuthology.orchestra.run.smithi187.stdout:(97/137): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2024-04-26T10:23:45.453 INFO:teuthology.orchestra.run.smithi187.stdout:(98/137): python3-cherrypy-18.4.0-1.el8.noarch. 2.4 MB/s | 384 kB 00:00 2024-04-26T10:23:45.583 INFO:teuthology.orchestra.run.smithi187.stdout:(99/137): python3-google-auth-1.1.1-10.el8.noar 626 kB/s | 81 kB 00:00 2024-04-26T10:23:45.692 INFO:teuthology.orchestra.run.smithi187.stdout:(100/137): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2024-04-26T10:23:45.817 INFO:teuthology.orchestra.run.smithi187.stdout:(101/137): python3-jaraco-functools-2.0-4.el8.n 140 kB/s | 18 kB 00:00 2024-04-26T10:23:46.109 INFO:teuthology.orchestra.run.smithi187.stdout:(102/137): python3-kubernetes-11.0.0-6.el8.noar 4.0 MB/s | 1.2 MB 00:00 2024-04-26T10:23:46.125 INFO:teuthology.orchestra.run.smithi043.stdout:(61/137): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 kB/s | 71 kB 00:03 2024-04-26T10:23:46.226 INFO:teuthology.orchestra.run.smithi187.stdout:(103/137): python3-logutils-0.3.5-11.el8.noarch 417 kB/s | 49 kB 00:00 2024-04-26T10:23:46.242 INFO:teuthology.orchestra.run.smithi043.stdout:(62/137): elfutils-libelf-devel-0.190-2.el8.x86 534 kB/s | 62 kB 00:00 2024-04-26T10:23:46.309 INFO:teuthology.orchestra.run.smithi043.stdout:(63/137): fuse-2.9.7-19.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2024-04-26T10:23:46.335 INFO:teuthology.orchestra.run.smithi187.stdout:(104/137): python3-more-itertools-7.2.0-3.el8.n 541 kB/s | 59 kB 00:00 2024-04-26T10:23:46.359 INFO:teuthology.orchestra.run.smithi043.stdout:(64/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 965 kB/s | 48 kB 00:00 2024-04-26T10:23:46.452 INFO:teuthology.orchestra.run.smithi187.stdout:(105/137): python3-natsort-7.1.1-2.el8.noarch.r 517 kB/s | 60 kB 00:00 2024-04-26T10:23:46.460 INFO:teuthology.orchestra.run.smithi043.stdout:(65/137): krb5-devel-1.18.2-22.el8.x86_64.rpm 5.5 MB/s | 561 kB 00:00 2024-04-26T10:23:46.601 INFO:teuthology.orchestra.run.smithi187.stdout:(106/137): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2024-04-26T10:23:46.602 INFO:teuthology.orchestra.run.smithi043.stdout:(66/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 132 kB/s | 19 kB 00:00 2024-04-26T10:23:46.652 INFO:teuthology.orchestra.run.smithi043.stdout:(67/137): libcom_err-devel-1.45.6-5.el8.x86_64. 773 kB/s | 39 kB 00:00 2024-04-26T10:23:46.719 INFO:teuthology.orchestra.run.smithi043.stdout:(68/137): libgfortran-8.5.0-22.el8.x86_64.rpm 9.5 MB/s | 645 kB 00:00 2024-04-26T10:23:46.719 INFO:teuthology.orchestra.run.smithi187.stdout:(107/137): python3-portend-2.6-1.el8.noarch.rpm 132 kB/s | 16 kB 00:00 2024-04-26T10:23:46.769 INFO:teuthology.orchestra.run.smithi043.stdout:(69/137): libquadmath-8.5.0-22.el8.x86_64.rpm 3.4 MB/s | 172 kB 00:00 2024-04-26T10:23:46.828 INFO:teuthology.orchestra.run.smithi187.stdout:(108/137): python3-repoze-lru-0.7-6.el8.noarch. 310 kB/s | 34 kB 00:00 2024-04-26T10:23:46.861 INFO:teuthology.orchestra.run.smithi043.stdout:(70/137): librabbitmq-0.9.0-5.el8.x86_64.rpm 513 kB/s | 47 kB 00:00 2024-04-26T10:23:46.911 INFO:teuthology.orchestra.run.smithi043.stdout:(71/137): libselinux-devel-2.9-8.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2024-04-26T10:23:46.961 INFO:teuthology.orchestra.run.smithi043.stdout:(72/137): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-04-26T10:23:46.978 INFO:teuthology.orchestra.run.smithi187.stdout:(109/137): python3-routes-2.4.1-12.el8.noarch.r 1.3 MB/s | 196 kB 00:00 2024-04-26T10:23:47.012 INFO:teuthology.orchestra.run.smithi043.stdout:(73/137): libuuid-devel-2.32.1-46.el8.x86_64.rp 2.0 MB/s | 100 kB 00:00 2024-04-26T10:23:47.062 INFO:teuthology.orchestra.run.smithi043.stdout:(74/137): libverto-devel-0.3.2-2.el8.x86_64.rpm 363 kB/s | 18 kB 00:00 2024-04-26T10:23:47.095 INFO:teuthology.orchestra.run.smithi187.stdout:(110/137): python3-rsa-4.9-2.el8.noarch.rpm 551 kB/s | 64 kB 00:00 2024-04-26T10:23:47.112 INFO:teuthology.orchestra.run.smithi043.stdout:(75/137): libzstd-devel-1.4.4-1.el8.x86_64.rpm 875 kB/s | 44 kB 00:00 2024-04-26T10:23:47.212 INFO:teuthology.orchestra.run.smithi187.stdout:(111/137): python3-simplegeneric-0.8.1-17.el8.n 160 kB/s | 19 kB 00:00 2024-04-26T10:23:47.271 INFO:teuthology.orchestra.run.smithi043.stdout:(76/137): openssl-devel-1.1.1k-12.el8.x86_64.rp 20 MB/s | 3.2 MB 00:00 2024-04-26T10:23:47.321 INFO:teuthology.orchestra.run.smithi187.stdout:(112/137): python3-singledispatch-3.4.0.3-18.el 221 kB/s | 24 kB 00:00 2024-04-26T10:23:47.321 INFO:teuthology.orchestra.run.smithi043.stdout:(77/137): pcre2-devel-10.32-3.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2024-04-26T10:23:47.372 INFO:teuthology.orchestra.run.smithi043.stdout:(78/137): pcre2-utf16-10.32-3.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-04-26T10:23:47.422 INFO:teuthology.orchestra.run.smithi043.stdout:(79/137): pcre2-utf32-10.32-3.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-04-26T10:23:47.438 INFO:teuthology.orchestra.run.smithi187.stdout:(113/137): python3-tempora-1.14.1-5.el8.noarch. 250 kB/s | 29 kB 00:00 2024-04-26T10:23:47.472 INFO:teuthology.orchestra.run.smithi043.stdout:(80/137): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.9 MB/s | 249 kB 00:00 2024-04-26T10:23:47.538 INFO:teuthology.orchestra.run.smithi187.stdout:(114/137): python3-trustme-0.6.0-4.el8.noarch.r 275 kB/s | 27 kB 00:00 2024-04-26T10:23:47.539 INFO:teuthology.orchestra.run.smithi043.stdout:(81/137): python3-cryptography-3.2.1-7.el8.x86_ 9.4 MB/s | 641 kB 00:00 2024-04-26T10:23:47.589 INFO:teuthology.orchestra.run.smithi043.stdout:(82/137): python3-jwt-1.6.1-2.el8.noarch.rpm 856 kB/s | 43 kB 00:00 2024-04-26T10:23:47.681 INFO:teuthology.orchestra.run.smithi043.stdout:(83/137): python3-oauthlib-2.1.0-1.el8.noarch.r 1.6 MB/s | 155 kB 00:00 2024-04-26T10:23:47.682 INFO:teuthology.orchestra.run.smithi187.stdout:(115/137): python3-waitress-1.4.3-1.el8.noarch. 1.7 MB/s | 255 kB 00:00 2024-04-26T10:23:47.740 INFO:teuthology.orchestra.run.smithi043.stdout:(84/137): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2024-04-26T10:23:47.790 INFO:teuthology.orchestra.run.smithi043.stdout:(85/137): python3-requests-oauthlib-1.0.0-1.el8 851 kB/s | 43 kB 00:00 2024-04-26T10:23:47.805 INFO:teuthology.orchestra.run.smithi187.stdout:(116/137): python3-webob-1.8.5-1.el8.1.noarch.r 2.0 MB/s | 251 kB 00:00 2024-04-26T10:23:47.841 INFO:teuthology.orchestra.run.smithi043.stdout:(86/137): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.5 MB/s | 74 kB 00:00 2024-04-26T10:23:47.891 INFO:teuthology.orchestra.run.smithi043.stdout:(87/137): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-26T10:23:47.914 INFO:teuthology.orchestra.run.smithi187.stdout:(117/137): python3-websocket-client-0.56.0-5.el 565 kB/s | 61 kB 00:00 2024-04-26T10:23:48.022 INFO:teuthology.orchestra.run.smithi187.stdout:(118/137): python3-webtest-2.0.33-1.el8.noarch. 787 kB/s | 85 kB 00:00 2024-04-26T10:23:48.123 INFO:teuthology.orchestra.run.smithi187.stdout:(119/137): python3-zc-lockfile-2.0-2.el8.noarch 229 kB/s | 23 kB 00:00 2024-04-26T10:23:48.250 INFO:teuthology.orchestra.run.smithi043.stdout:(88/137): python3-packaging-16.8-9.el8.noarch.r 134 kB/s | 48 kB 00:00 2024-04-26T10:23:48.458 INFO:teuthology.orchestra.run.smithi043.stdout:(89/137): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2024-04-26T10:23:48.523 INFO:teuthology.orchestra.run.smithi187.stdout:(120/137): thrift-0.13.0-2.el8.x86_64.rpm 4.3 MB/s | 1.7 MB 00:00 2024-04-26T10:23:48.531 INFO:teuthology.orchestra.run.smithi043.stdout:(90/137): liboath-2.6.2-3.el8.x86_64.rpm 817 kB/s | 59 kB 00:00 2024-04-26T10:23:48.575 INFO:teuthology.orchestra.run.smithi043.stdout:(91/137): libunwind-1.3.1-3.el8.x86_64.rpm 1.6 MB/s | 75 kB 00:00 2024-04-26T10:23:48.626 INFO:teuthology.orchestra.run.smithi043.stdout:(92/137): python3-asyncssh-2.7.0-2.el8.noarch.r 9.3 MB/s | 476 kB 00:00 2024-04-26T10:23:48.659 INFO:teuthology.orchestra.run.smithi043.stdout:(93/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.3 MB/s | 44 kB 00:00 2024-04-26T10:23:48.701 INFO:teuthology.orchestra.run.smithi043.stdout:(94/137): python3-beautifulsoup4-4.6.3-2.el8.1. 4.3 MB/s | 185 kB 00:00 2024-04-26T10:23:48.735 INFO:teuthology.orchestra.run.smithi043.stdout:(95/137): python3-cachetools-3.1.1-4.el8.noarch 990 kB/s | 33 kB 00:00 2024-04-26T10:23:48.768 INFO:teuthology.orchestra.run.smithi043.stdout:(96/137): python3-certifi-2018.10.15-7.el8.noar 490 kB/s | 16 kB 00:00 2024-04-26T10:23:48.802 INFO:teuthology.orchestra.run.smithi043.stdout:(97/137): python3-cheroot-8.5.2-1.el8.noarch.rp 5.1 MB/s | 173 kB 00:00 2024-04-26T10:23:48.853 INFO:teuthology.orchestra.run.smithi043.stdout:(98/137): python3-cherrypy-18.4.0-1.el8.noarch. 7.5 MB/s | 384 kB 00:00 2024-04-26T10:23:48.886 INFO:teuthology.orchestra.run.smithi043.stdout:(99/137): python3-google-auth-1.1.1-10.el8.noar 2.4 MB/s | 81 kB 00:00 2024-04-26T10:23:48.955 INFO:teuthology.orchestra.run.smithi043.stdout:(100/137): python3-jaraco-6.2-6.el8.noarch.rpm 161 kB/s | 11 kB 00:00 2024-04-26T10:23:49.003 INFO:teuthology.orchestra.run.smithi043.stdout:(101/137): python3-jaraco-functools-2.0-4.el8.n 367 kB/s | 18 kB 00:00 2024-04-26T10:23:49.070 INFO:teuthology.orchestra.run.smithi043.stdout:(102/137): python3-kubernetes-11.0.0-6.el8.noar 18 MB/s | 1.2 MB 00:00 2024-04-26T10:23:49.121 INFO:teuthology.orchestra.run.smithi043.stdout:(103/137): python3-logutils-0.3.5-11.el8.noarch 973 kB/s | 49 kB 00:00 2024-04-26T10:23:49.163 INFO:teuthology.orchestra.run.smithi043.stdout:(104/137): python3-more-itertools-7.2.0-3.el8.n 1.4 MB/s | 59 kB 00:00 2024-04-26T10:23:49.196 INFO:teuthology.orchestra.run.smithi043.stdout:(105/137): python3-natsort-7.1.1-2.el8.noarch.r 1.8 MB/s | 60 kB 00:00 2024-04-26T10:23:49.238 INFO:teuthology.orchestra.run.smithi043.stdout:(106/137): python3-pecan-1.3.2-9.el8.noarch.rpm 6.6 MB/s | 283 kB 00:00 2024-04-26T10:23:49.240 INFO:teuthology.orchestra.run.smithi187.stdout:(121/137): librados2-18.2.2-1256.gdc093b5e.el8. 5.2 MB/s | 3.7 MB 00:00 2024-04-26T10:23:49.272 INFO:teuthology.orchestra.run.smithi043.stdout:(107/137): python3-portend-2.6-1.el8.noarch.rpm 468 kB/s | 16 kB 00:00 2024-04-26T10:23:49.306 INFO:teuthology.orchestra.run.smithi043.stdout:(108/137): python3-repoze-lru-0.7-6.el8.noarch. 1.0 MB/s | 34 kB 00:00 2024-04-26T10:23:49.372 INFO:teuthology.orchestra.run.smithi043.stdout:(109/137): python3-routes-2.4.1-12.el8.noarch.r 2.9 MB/s | 196 kB 00:00 2024-04-26T10:23:49.414 INFO:teuthology.orchestra.run.smithi043.stdout:(110/137): python3-rsa-4.9-2.el8.noarch.rpm 1.5 MB/s | 64 kB 00:00 2024-04-26T10:23:49.448 INFO:teuthology.orchestra.run.smithi043.stdout:(111/137): python3-simplegeneric-0.8.1-17.el8.n 561 kB/s | 19 kB 00:00 2024-04-26T10:23:49.482 INFO:teuthology.orchestra.run.smithi043.stdout:(112/137): python3-singledispatch-3.4.0.3-18.el 711 kB/s | 24 kB 00:00 2024-04-26T10:23:49.516 INFO:teuthology.orchestra.run.smithi187.stdout:(122/137): librbd1-18.2.2-1256.gdc093b5e.el8.x8 13 MB/s | 3.6 MB 00:00 2024-04-26T10:23:49.516 INFO:teuthology.orchestra.run.smithi043.stdout:(113/137): python3-tempora-1.14.1-5.el8.noarch. 879 kB/s | 29 kB 00:00 2024-04-26T10:23:49.549 INFO:teuthology.orchestra.run.smithi043.stdout:(114/137): python3-trustme-0.6.0-4.el8.noarch.r 824 kB/s | 27 kB 00:00 2024-04-26T10:23:49.583 INFO:teuthology.orchestra.run.smithi043.stdout:(115/137): python3-waitress-1.4.3-1.el8.noarch. 7.5 MB/s | 255 kB 00:00 2024-04-26T10:23:49.617 INFO:teuthology.orchestra.run.smithi043.stdout:(116/137): python3-webob-1.8.5-1.el8.1.noarch.r 7.4 MB/s | 251 kB 00:00 2024-04-26T10:23:49.641 INFO:teuthology.orchestra.run.smithi187.stdout:(123/137): elfutils-debuginfod-client-0.190-2.e 615 kB/s | 77 kB 00:00 2024-04-26T10:23:49.642 INFO:teuthology.orchestra.run.smithi043.stdout:(117/137): python3-websocket-client-0.56.0-5.el 2.4 MB/s | 61 kB 00:00 2024-04-26T10:23:49.676 INFO:teuthology.orchestra.run.smithi043.stdout:(118/137): python3-webtest-2.0.33-1.el8.noarch. 2.5 MB/s | 85 kB 00:00 2024-04-26T10:23:49.701 INFO:teuthology.orchestra.run.smithi043.stdout:(119/137): python3-zc-lockfile-2.0-2.el8.noarch 923 kB/s | 23 kB 00:00 2024-04-26T10:23:49.733 INFO:teuthology.orchestra.run.smithi187.stdout:(124/137): elfutils-libelf-0.190-2.el8.x86_64.r 2.5 MB/s | 233 kB 00:00 2024-04-26T10:23:49.809 INFO:teuthology.orchestra.run.smithi043.stdout:(120/137): thrift-0.13.0-2.el8.x86_64.rpm 16 MB/s | 1.7 MB 00:00 2024-04-26T10:23:49.817 INFO:teuthology.orchestra.run.smithi187.stdout:(125/137): elfutils-libs-0.190-2.el8.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-04-26T10:23:49.867 INFO:teuthology.orchestra.run.smithi187.stdout:(126/137): libblkid-2.32.1-46.el8.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-26T10:23:49.917 INFO:teuthology.orchestra.run.smithi187.stdout:(127/137): libfdisk-2.32.1-46.el8.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-04-26T10:23:49.967 INFO:teuthology.orchestra.run.smithi187.stdout:(128/137): libmount-2.32.1-46.el8.x86_64.rpm 4.6 MB/s | 237 kB 00:00 2024-04-26T10:23:50.018 INFO:teuthology.orchestra.run.smithi187.stdout:(129/137): libsmartcols-2.32.1-46.el8.x86_64.rp 3.5 MB/s | 180 kB 00:00 2024-04-26T10:23:50.068 INFO:teuthology.orchestra.run.smithi187.stdout:(130/137): libuuid-2.32.1-46.el8.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-04-26T10:23:50.152 INFO:teuthology.orchestra.run.smithi187.stdout:(131/137): openssl-1.1.1k-12.el8.x86_64.rpm 8.6 MB/s | 738 kB 00:00 2024-04-26T10:23:50.235 INFO:teuthology.orchestra.run.smithi187.stdout:(132/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 18 MB/s | 1.5 MB 00:00 2024-04-26T10:23:50.260 INFO:teuthology.orchestra.run.smithi043.stdout:(121/137): librados2-18.2.2-1256.gdc093b5e.el8. 8.2 MB/s | 3.7 MB 00:00 2024-04-26T10:23:50.360 INFO:teuthology.orchestra.run.smithi187.stdout:(133/137): util-linux-2.32.1-46.el8.x86_64.rpm 21 MB/s | 2.6 MB 00:00 2024-04-26T10:23:50.411 INFO:teuthology.orchestra.run.smithi187.stdout:(134/137): util-linux-user-2.32.1-46.el8.x86_64 2.0 MB/s | 103 kB 00:00 2024-04-26T10:23:50.451 INFO:teuthology.orchestra.run.smithi043.stdout:(122/137): librbd1-18.2.2-1256.gdc093b5e.el8.x8 19 MB/s | 3.6 MB 00:00 2024-04-26T10:23:50.470 INFO:teuthology.orchestra.run.smithi187.stdout:(135/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 19 MB/s | 1.1 MB 00:00 2024-04-26T10:23:50.543 INFO:teuthology.orchestra.run.smithi043.stdout:(123/137): elfutils-debuginfod-client-0.190-2.e 838 kB/s | 77 kB 00:00 2024-04-26T10:23:50.610 INFO:teuthology.orchestra.run.smithi043.stdout:(124/137): elfutils-libelf-0.190-2.el8.x86_64.r 3.4 MB/s | 233 kB 00:00 2024-04-26T10:23:50.677 INFO:teuthology.orchestra.run.smithi043.stdout:(125/137): elfutils-libs-0.190-2.el8.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-04-26T10:23:50.728 INFO:teuthology.orchestra.run.smithi043.stdout:(126/137): libblkid-2.32.1-46.el8.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-26T10:23:50.778 INFO:teuthology.orchestra.run.smithi043.stdout:(127/137): libfdisk-2.32.1-46.el8.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-04-26T10:23:50.828 INFO:teuthology.orchestra.run.smithi043.stdout:(128/137): libmount-2.32.1-46.el8.x86_64.rpm 4.6 MB/s | 237 kB 00:00 2024-04-26T10:23:50.878 INFO:teuthology.orchestra.run.smithi043.stdout:(129/137): libsmartcols-2.32.1-46.el8.x86_64.rp 3.5 MB/s | 180 kB 00:00 2024-04-26T10:23:50.929 INFO:teuthology.orchestra.run.smithi043.stdout:(130/137): libuuid-2.32.1-46.el8.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-04-26T10:23:51.004 INFO:teuthology.orchestra.run.smithi043.stdout:(131/137): openssl-1.1.1k-12.el8.x86_64.rpm 9.6 MB/s | 738 kB 00:00 2024-04-26T10:23:51.113 INFO:teuthology.orchestra.run.smithi043.stdout:(132/137): openssl-libs-1.1.1k-12.el8.x86_64.rp 14 MB/s | 1.5 MB 00:00 2024-04-26T10:23:51.205 INFO:teuthology.orchestra.run.smithi043.stdout:(133/137): util-linux-2.32.1-46.el8.x86_64.rpm 28 MB/s | 2.6 MB 00:00 2024-04-26T10:23:51.246 INFO:teuthology.orchestra.run.smithi043.stdout:(134/137): util-linux-user-2.32.1-46.el8.x86_64 2.4 MB/s | 103 kB 00:00 2024-04-26T10:23:51.313 INFO:teuthology.orchestra.run.smithi043.stdout:(135/137): xfsprogs-5.0.0-12.el8.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-04-26T10:24:05.171 INFO:teuthology.orchestra.run.smithi112.stdout:(136/137): python3-numpy-1.14.3-10.el8.x86_64.r 26 kB/s | 3.7 MB 02:28 2024-04-26T10:24:37.827 INFO:teuthology.orchestra.run.smithi186.stdout:(136/137): python3-numpy-1.14.3-10.el8.x86_64.r 26 kB/s | 3.7 MB 02:29 2024-04-26T10:25:11.224 INFO:teuthology.orchestra.run.smithi187.stdout:(136/137): python3-numpy-1.14.3-10.el8.x86_64.r 25 kB/s | 3.7 MB 02:34 2024-04-26T10:25:11.704 INFO:teuthology.orchestra.run.smithi043.stdout:(136/137): python3-numpy-1.14.3-10.el8.x86_64.r 24 kB/s | 3.7 MB 02:36 2024-04-26T10:30:08.169 INFO:teuthology.orchestra.run.smithi112.stdout:(137/137): python3-scipy-1.0.0-21.module_el8+76 29 kB/s | 14 MB 08:15 2024-04-26T10:30:08.170 INFO:teuthology.orchestra.run.smithi112.stdout:-------------------------------------------------------------------------------- 2024-04-26T10:30:08.170 INFO:teuthology.orchestra.run.smithi112.stdout:Total 267 kB/s | 207 MB 13:15 2024-04-26T10:30:08.963 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction check 2024-04-26T10:30:09.412 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction check succeeded. 2024-04-26T10:30:09.413 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction test 2024-04-26T10:30:10.916 INFO:teuthology.orchestra.run.smithi112.stdout:Transaction test succeeded. 2024-04-26T10:30:10.920 INFO:teuthology.orchestra.run.smithi112.stdout:Running transaction 2024-04-26T10:30:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: Preparing : 1/1 2024-04-26T10:30:16.043 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-26T10:30:16.260 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T10:30:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T10:30:16.708 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-26T10:30:16.857 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T10:30:16.943 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T10:30:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T10:30:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T10:30:17.424 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-26T10:30:17.620 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-26T10:30:17.818 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-26T10:30:18.007 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T10:30:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T10:30:18.606 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T10:30:18.995 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T10:30:19.182 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T10:30:19.305 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T10:30:19.473 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T10:30:19.567 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T10:30:19.770 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T10:30:19.968 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-26T10:30:20.185 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-26T10:30:20.419 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-26T10:30:20.557 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T10:30:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T10:30:20.806 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T10:30:20.990 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T10:30:21.223 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T10:30:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T10:30:21.579 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-26T10:30:21.749 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-26T10:30:21.889 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T10:30:22.024 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T10:30:22.206 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T10:30:22.797 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T10:30:22.998 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T10:30:23.609 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T10:30:23.848 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T10:30:24.525 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T10:30:24.874 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-26T10:30:25.086 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-26T10:30:25.251 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-26T10:30:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-26T10:30:25.662 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/152 2024-04-26T10:30:25.834 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/152 2024-04-26T10:30:26.049 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/152 2024-04-26T10:30:27.331 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-26T10:30:27.703 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-26T10:30:28.001 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-26T10:30:28.189 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T10:30:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T10:30:30.267 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-26T10:30:30.464 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-26T10:30:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-26T10:30:30.880 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-26T10:30:31.080 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-26T10:30:31.252 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 41/152 2024-04-26T10:30:31.465 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 42/152 2024-04-26T10:30:31.663 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T10:30:31.747 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T10:30:31.930 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T10:30:31.998 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T10:30:32.176 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-26T10:30:32.375 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-26T10:30:32.571 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T10:30:33.062 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T10:30:33.339 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T10:30:33.353 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T10:30:33.532 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-26T10:30:33.780 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-26T10:30:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-26T10:30:34.159 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-26T10:30:34.323 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-26T10:30:34.503 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-26T10:30:34.732 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-26T10:30:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-26T10:30:35.091 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-26T10:30:35.155 INFO:teuthology.orchestra.run.smithi187.stdout:(137/137): python3-scipy-1.0.0-21.module_el8+76 32 kB/s | 14 MB 07:39 2024-04-26T10:30:35.157 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2024-04-26T10:30:35.158 INFO:teuthology.orchestra.run.smithi187.stdout:Total 275 kB/s | 207 MB 12:51 2024-04-26T10:30:35.252 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-26T10:30:35.427 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-26T10:30:35.467 INFO:teuthology.orchestra.run.smithi043.stdout:(137/137): python3-scipy-1.0.0-21.module_el8+76 31 kB/s | 14 MB 07:44 2024-04-26T10:30:35.468 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-04-26T10:30:35.468 INFO:teuthology.orchestra.run.smithi043.stdout:Total 275 kB/s | 207 MB 12:51 2024-04-26T10:30:35.594 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-26T10:30:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-26T10:30:35.946 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-26T10:30:35.977 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2024-04-26T10:30:36.040 INFO:teuthology.orchestra.run.smithi186.stdout:(137/137): python3-scipy-1.0.0-21.module_el8+76 30 kB/s | 14 MB 08:10 2024-04-26T10:30:36.043 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-26T10:30:36.043 INFO:teuthology.orchestra.run.smithi186.stdout:Total 264 kB/s | 207 MB 13:24 2024-04-26T10:30:36.154 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-26T10:30:36.288 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-04-26T10:30:36.385 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-26T10:30:36.432 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2024-04-26T10:30:36.432 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2024-04-26T10:30:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-26T10:30:36.775 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-04-26T10:30:36.775 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-04-26T10:30:36.836 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-26T10:30:36.895 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-26T10:30:37.146 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-26T10:30:37.290 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-26T10:30:37.290 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-26T10:30:37.350 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-26T10:30:37.820 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2024-04-26T10:30:37.823 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2024-04-26T10:30:38.146 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-26T10:30:38.251 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-04-26T10:30:38.255 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-04-26T10:30:38.320 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T10:30:38.393 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T10:30:38.580 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 71/152 2024-04-26T10:30:38.679 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-26T10:30:38.683 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-26T10:30:38.792 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-26T10:30:39.015 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-26T10:30:39.360 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-26T10:30:39.616 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-26T10:30:39.789 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-26T10:30:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-26T10:30:40.275 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-26T10:30:41.310 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-26T10:30:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-26T10:30:41.911 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-26T10:30:42.171 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-26T10:30:42.450 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-26T10:30:42.671 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-26T10:30:42.931 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-26T10:30:43.111 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2024-04-26T10:30:43.173 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-26T10:30:43.296 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-26T10:30:43.508 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-26T10:30:43.523 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T10:30:43.714 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-26T10:30:43.716 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-26T10:30:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T10:30:43.788 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-04-26T10:30:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-26T10:30:43.880 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-26T10:30:44.001 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-26T10:30:44.074 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-26T10:30:44.078 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-04-26T10:30:44.085 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T10:30:44.140 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T10:30:44.203 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T10:30:44.311 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T10:30:44.320 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T10:30:44.374 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-26T10:30:44.441 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T10:30:44.510 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T10:30:44.539 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-26T10:30:44.582 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-26T10:30:44.592 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/152 2024-04-26T10:30:44.715 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T10:30:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-26T10:30:44.758 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-26T10:30:44.805 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T10:30:44.894 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/152 2024-04-26T10:30:44.975 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-26T10:30:44.978 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T10:30:44.995 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-26T10:30:45.047 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T10:30:45.054 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T10:30:45.124 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/152 2024-04-26T10:30:45.178 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-26T10:30:45.196 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-26T10:30:45.272 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-26T10:30:45.356 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T10:30:45.357 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T10:30:45.404 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-26T10:30:45.414 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/152 2024-04-26T10:30:45.458 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-26T10:30:45.612 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-26T10:30:45.654 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/152 2024-04-26T10:30:45.657 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-26T10:30:45.753 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-26T10:30:45.791 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T10:30:45.828 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T10:30:45.836 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/152 2024-04-26T10:30:46.031 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/152 2024-04-26T10:30:46.065 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T10:30:46.228 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T10:30:46.247 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T10:30:46.420 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T10:30:46.449 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T10:30:46.690 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T10:30:46.691 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/152 2024-04-26T10:30:46.810 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T10:30:46.820 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T10:30:46.915 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T10:30:46.970 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T10:30:47.007 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T10:30:47.096 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T10:30:47.098 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T10:30:47.295 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T10:30:47.339 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T10:30:47.376 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T10:30:47.391 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T10:30:47.589 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T10:30:47.609 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-26T10:30:47.638 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T10:30:47.771 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T10:30:47.797 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-26T10:30:47.877 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-26T10:30:47.938 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T10:30:48.006 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-26T10:30:48.035 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T10:30:48.094 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-26T10:30:48.274 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T10:30:48.286 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T10:30:48.290 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T10:30:48.384 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T10:30:48.467 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-26T10:30:48.485 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 13/152 2024-04-26T10:30:48.495 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T10:30:48.548 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T10:30:48.569 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T10:30:48.670 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T10:30:48.716 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T10:30:48.744 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/152 2024-04-26T10:30:48.786 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T10:30:48.961 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/152 2024-04-26T10:30:48.963 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T10:30:49.006 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T10:30:49.099 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T10:30:49.122 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T10:30:49.126 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T10:30:49.178 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T10:30:49.215 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 16/152 2024-04-26T10:30:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T10:30:49.355 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T10:30:49.370 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-26T10:30:49.388 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T10:30:49.482 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T10:30:49.509 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-26T10:30:49.522 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-26T10:30:49.593 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T10:30:49.661 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T10:30:49.664 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T10:30:49.702 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-26T10:30:49.796 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T10:30:49.836 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T10:30:49.888 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T10:30:49.966 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T10:30:49.981 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T10:30:50.011 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 18/152 2024-04-26T10:30:50.128 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T10:30:50.203 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/152 2024-04-26T10:30:50.436 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/152 2024-04-26T10:30:50.568 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T10:30:50.571 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T10:30:50.704 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 21/152 2024-04-26T10:30:50.729 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T10:30:50.781 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T10:30:50.913 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T10:30:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T10:30:51.475 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T10:30:51.531 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 22/152 2024-04-26T10:30:51.558 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T10:30:51.672 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T10:30:51.738 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T10:30:51.752 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T10:30:52.351 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T10:30:52.374 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/152 2024-04-26T10:30:52.441 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T10:30:52.571 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T10:30:52.706 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-26T10:30:52.769 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-26T10:30:52.911 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-26T10:30:52.983 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-26T10:30:53.051 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-26T10:30:53.133 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-26T10:30:53.291 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-26T10:30:53.297 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/152 2024-04-26T10:30:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-26T10:30:53.495 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/152 2024-04-26T10:30:53.583 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/152 2024-04-26T10:30:53.636 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/152 2024-04-26T10:30:53.712 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/152 2024-04-26T10:30:53.755 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/152 2024-04-26T10:30:53.836 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/152 2024-04-26T10:30:53.918 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/152 2024-04-26T10:30:54.006 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/152 2024-04-26T10:30:54.012 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/152 2024-04-26T10:30:54.269 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/152 2024-04-26T10:30:54.519 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 29/152 2024-04-26T10:30:54.683 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 30/152 2024-04-26T10:30:54.941 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-26T10:30:55.015 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-26T10:30:55.067 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 31/152 2024-04-26T10:30:55.286 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-26T10:30:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-26T10:30:55.559 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-26T10:30:55.614 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-26T10:30:55.738 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T10:30:55.835 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T10:30:56.158 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/152 2024-04-26T10:30:56.534 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/152 2024-04-26T10:30:56.921 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 34/152 2024-04-26T10:30:57.129 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T10:30:57.513 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T10:30:57.617 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T10:30:57.816 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-26T10:30:57.896 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-26T10:30:58.030 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-26T10:30:58.068 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-26T10:30:58.244 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-26T10:30:58.308 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-26T10:30:58.477 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-26T10:30:58.489 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-26T10:30:58.670 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-26T10:30:58.683 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-26T10:30:58.856 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 41/152 2024-04-26T10:30:58.893 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 41/152 2024-04-26T10:30:59.029 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/152 2024-04-26T10:30:59.043 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 42/152 2024-04-26T10:30:59.083 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 42/152 2024-04-26T10:30:59.243 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T10:30:59.279 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T10:30:59.306 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T10:30:59.369 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 36/152 2024-04-26T10:30:59.384 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T10:30:59.518 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T10:30:59.571 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T10:30:59.582 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T10:30:59.602 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/152 2024-04-26T10:30:59.623 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T10:30:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-26T10:30:59.794 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-26T10:30:59.821 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/152 2024-04-26T10:30:59.921 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-26T10:31:00.016 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-26T10:31:00.039 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 39/152 2024-04-26T10:31:00.109 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T10:31:00.197 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T10:31:00.232 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 40/152 2024-04-26T10:31:00.469 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 41/152 2024-04-26T10:31:00.641 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 42/152 2024-04-26T10:31:00.644 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T10:31:00.730 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T10:31:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T10:31:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T10:31:00.903 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T10:31:00.983 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 43/152 2024-04-26T10:31:00.988 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T10:31:01.002 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T10:31:01.061 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-26T10:31:01.178 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T10:31:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-26T10:31:01.277 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-26T10:31:01.288 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 44/152 2024-04-26T10:31:01.438 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-26T10:31:01.474 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-26T10:31:01.505 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 45/152 2024-04-26T10:31:01.630 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-26T10:31:01.669 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-26T10:31:01.732 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/152 2024-04-26T10:31:01.769 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-26T10:31:01.825 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-26T10:31:01.928 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T10:31:01.972 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-26T10:31:01.975 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-26T10:31:02.170 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-26T10:31:02.221 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-26T10:31:02.361 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-26T10:31:02.466 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-26T10:31:02.501 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 47/152 2024-04-26T10:31:02.521 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-26T10:31:02.665 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-26T10:31:02.673 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-26T10:31:02.803 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T10:31:02.818 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 48/152 2024-04-26T10:31:02.830 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-26T10:31:02.857 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-26T10:31:02.998 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-26T10:31:03.001 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-26T10:31:03.067 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/152 2024-04-26T10:31:03.157 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-26T10:31:03.183 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-26T10:31:03.320 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/152 2024-04-26T10:31:03.350 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-26T10:31:03.368 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-26T10:31:03.528 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-26T10:31:03.551 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-26T10:31:03.579 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/152 2024-04-26T10:31:03.733 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-26T10:31:03.758 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/152 2024-04-26T10:31:03.774 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-26T10:31:03.945 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-26T10:31:03.973 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/152 2024-04-26T10:31:03.977 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-26T10:31:04.161 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-26T10:31:04.173 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/152 2024-04-26T10:31:04.285 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-26T10:31:04.397 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-26T10:31:04.426 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/152 2024-04-26T10:31:04.526 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-26T10:31:04.652 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/152 2024-04-26T10:31:04.710 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-26T10:31:04.726 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-26T10:31:04.823 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/152 2024-04-26T10:31:04.951 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/152 2024-04-26T10:31:04.996 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-26T10:31:05.158 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/152 2024-04-26T10:31:05.191 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-26T10:31:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/152 2024-04-26T10:31:05.510 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-26T10:31:05.544 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/152 2024-04-26T10:31:05.667 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T10:31:05.736 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T10:31:05.737 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/152 2024-04-26T10:31:05.926 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 71/152 2024-04-26T10:31:05.997 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/152 2024-04-26T10:31:06.018 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-26T10:31:06.146 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-26T10:31:06.195 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T10:31:06.222 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/152 2024-04-26T10:31:06.335 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T10:31:06.361 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-26T10:31:06.449 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/152 2024-04-26T10:31:06.562 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 71/152 2024-04-26T10:31:06.709 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-26T10:31:06.781 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/152 2024-04-26T10:31:06.791 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-26T10:31:06.980 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-26T10:31:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-26T10:31:07.045 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/152 2024-04-26T10:31:07.143 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-26T10:31:07.292 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/152 2024-04-26T10:31:07.334 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-26T10:31:07.370 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-26T10:31:07.588 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-26T10:31:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-26T10:31:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-26T10:31:08.100 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/152 2024-04-26T10:31:08.128 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-26T10:31:08.269 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T10:31:08.329 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 70/152 2024-04-26T10:31:08.382 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-26T10:31:08.563 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 71/152 2024-04-26T10:31:08.615 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-26T10:31:08.777 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-packaging-16.8-9.el8.noarch 72/152 2024-04-26T10:31:08.786 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T10:31:08.786 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /sys 2024-04-26T10:31:08.786 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /proc 2024-04-26T10:31:08.787 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2024-04-26T10:31:08.787 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /run 2024-04-26T10:31:08.787 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /mnt 2024-04-26T10:31:08.787 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /var/tmp 2024-04-26T10:31:08.787 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /home 2024-04-26T10:31:08.787 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /tmp 2024-04-26T10:31:08.787 INFO:teuthology.orchestra.run.smithi112.stdout:skipping the directory /dev 2024-04-26T10:31:08.787 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:31:08.957 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-26T10:31:09.035 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 73/152 2024-04-26T10:31:09.175 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T10:31:09.216 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-26T10:31:09.416 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-26T10:31:09.453 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 74/152 2024-04-26T10:31:09.460 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-26T10:31:09.722 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-26T10:31:09.764 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 75/152 2024-04-26T10:31:09.869 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-26T10:31:09.955 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 76/152 2024-04-26T10:31:09.967 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-26T10:31:10.102 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-26T10:31:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-26T10:31:10.264 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 77/152 2024-04-26T10:31:10.344 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-26T10:31:10.453 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-26T10:31:10.560 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 78/152 2024-04-26T10:31:10.642 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-26T10:31:10.773 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-26T10:31:10.810 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T10:31:10.928 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-26T10:31:10.946 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-26T10:31:11.002 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T10:31:11.093 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-26T10:31:11.196 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-26T10:31:11.220 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T10:31:11.270 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-26T10:31:11.408 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T10:31:11.489 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-26T10:31:11.556 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-26T10:31:11.676 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 79/152 2024-04-26T10:31:11.802 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-26T10:31:11.820 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-26T10:31:11.883 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T10:31:11.953 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-26T10:31:12.015 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-26T10:31:12.086 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 80/152 2024-04-26T10:31:12.108 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T10:31:12.131 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T10:31:12.146 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-26T10:31:12.162 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-26T10:31:12.332 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-26T10:31:12.359 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-26T10:31:12.360 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 81/152 2024-04-26T10:31:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-26T10:31:12.551 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-26T10:31:12.557 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 82/152 2024-04-26T10:31:12.569 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-26T10:31:12.686 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-26T10:31:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T10:31:12.732 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-26T10:31:12.792 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T10:31:12.891 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-26T10:31:12.898 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 83/152 2024-04-26T10:31:12.906 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-26T10:31:13.073 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-26T10:31:13.097 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-26T10:31:13.153 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/152 2024-04-26T10:31:13.300 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-26T10:31:13.316 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-26T10:31:13.390 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 85/152 2024-04-26T10:31:13.570 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-26T10:31:13.641 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 86/152 2024-04-26T10:31:13.779 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-26T10:31:13.811 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T10:31:13.960 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-26T10:31:13.975 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 87/152 2024-04-26T10:31:13.996 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T10:31:14.107 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 112/152 2024-04-26T10:31:14.135 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-26T10:31:14.156 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 88/152 2024-04-26T10:31:14.304 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 113/152 2024-04-26T10:31:14.370 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 89/152 2024-04-26T10:31:14.507 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T10:31:14.520 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 90/152 2024-04-26T10:31:14.872 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 91/152 2024-04-26T10:31:15.080 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 92/152 2024-04-26T10:31:15.290 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 93/152 2024-04-26T10:31:15.435 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T10:31:15.523 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 94/152 2024-04-26T10:31:15.531 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T10:31:15.658 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T10:31:15.793 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T10:31:15.812 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 95/152 2024-04-26T10:31:16.004 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.7-19.el8.x86_64 96/152 2024-04-26T10:31:16.235 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 97/152 2024-04-26T10:31:16.253 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T10:31:16.543 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 98/152 2024-04-26T10:31:16.606 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T10:31:16.697 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T10:31:16.717 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T10:31:16.756 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T10:31:16.899 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T10:31:16.949 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T10:31:17.041 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T10:31:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T10:31:17.414 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 117/152 2024-04-26T10:31:17.627 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T10:31:17.664 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T10:31:17.741 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T10:31:17.840 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T10:31:17.851 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T10:31:18.034 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 120/152 2024-04-26T10:31:18.101 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T10:31:18.207 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T10:31:18.208 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T10:31:18.468 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T10:31:19.252 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T10:31:19.492 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T10:31:20.140 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 99/152 2024-04-26T10:31:20.464 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T10:31:20.579 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 100/152 2024-04-26T10:31:20.800 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T10:31:22.671 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T10:31:24.093 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/152 2024-04-26T10:31:24.284 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T10:31:24.317 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T10:31:24.523 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T10:31:24.873 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T10:31:25.065 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T10:31:25.158 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T10:31:26.049 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/152 2024-04-26T10:31:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-26T10:31:26.520 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-26T10:31:26.717 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-26T10:31:26.893 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-26T10:31:27.106 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 131/152 2024-04-26T10:31:27.323 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/152 2024-04-26T10:31:27.609 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 133/152 2024-04-26T10:31:27.865 INFO:teuthology.orchestra.run.smithi112.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-26T10:31:28.039 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-26T10:31:28.247 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T10:31:28.331 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T10:31:28.564 INFO:teuthology.orchestra.run.smithi112.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T10:31:28.583 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T10:31:28.749 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-26T10:31:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-26T10:31:29.134 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-26T10:31:29.134 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T10:31:29.383 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T10:31:29.383 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T10:31:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T10:31:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T10:31:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T10:31:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-26T10:31:30.249 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-26T10:31:30.250 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T10:31:30.458 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T10:31:30.459 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T10:31:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T10:31:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T10:31:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T10:31:30.875 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T10:31:31.108 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T10:31:31.108 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T10:31:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T10:31:31.292 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T10:31:31.585 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T10:31:31.773 INFO:teuthology.orchestra.run.smithi112.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T10:31:32.352 INFO:teuthology.orchestra.run.smithi112.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T10:31:32.352 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/152 2024-04-26T10:31:32.352 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/152 2024-04-26T10:31:32.353 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/152 2024-04-26T10:31:32.354 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T10:31:32.354 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/152 2024-04-26T10:31:32.354 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/152 2024-04-26T10:31:32.354 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/152 2024-04-26T10:31:32.354 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/152 2024-04-26T10:31:32.354 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/152 2024-04-26T10:31:32.354 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/152 2024-04-26T10:31:32.354 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/152 2024-04-26T10:31:32.354 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/152 2024-04-26T10:31:32.354 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/152 2024-04-26T10:31:32.354 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/152 2024-04-26T10:31:32.354 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-26T10:31:32.355 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-26T10:31:32.356 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-26T10:31:32.357 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 70/152 2024-04-26T10:31:32.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 71/152 2024-04-26T10:31:32.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-26T10:31:32.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-26T10:31:32.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-26T10:31:32.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-26T10:31:32.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-26T10:31:32.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-26T10:31:32.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-26T10:31:32.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-26T10:31:32.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-26T10:31:32.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-26T10:31:32.358 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-26T10:31:32.359 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-26T10:31:32.360 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-26T10:31:32.361 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T10:31:32.362 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-26T10:31:32.362 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-26T10:31:32.362 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-26T10:31:32.362 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-26T10:31:32.362 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-26T10:31:32.362 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-26T10:31:32.362 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-26T10:31:32.362 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-26T10:31:32.362 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-26T10:31:32.362 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-26T10:31:32.362 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-26T10:31:32.362 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-26T10:31:32.363 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-26T10:31:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-26T10:31:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:31:34.135 INFO:teuthology.orchestra.run.smithi112.stdout:Upgraded: 2024-04-26T10:31:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-26T10:31:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-26T10:31:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-26T10:31:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-26T10:31:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-26T10:31:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-26T10:31:34.135 INFO:teuthology.orchestra.run.smithi112.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout:Installed: 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.136 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.137 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:31:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:31:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-26T10:31:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T10:31:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-26T10:31:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T10:31:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: jq-1.6-8.el8.x86_64 2024-04-26T10:31:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T10:31:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-26T10:31:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T10:31:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.138 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T10:31:34.139 INFO:teuthology.orchestra.run.smithi112.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T10:31:34.140 INFO:teuthology.orchestra.run.smithi112.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-26T10:31:34.141 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T10:31:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T10:31:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T10:31:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T10:31:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T10:31:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T10:31:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T10:31:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T10:31:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T10:31:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T10:31:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T10:31:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T10:31:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T10:31:34.142 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T10:31:34.143 INFO:teuthology.orchestra.run.smithi112.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:31:34.144 INFO:teuthology.orchestra.run.smithi112.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T10:31:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T10:31:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T10:31:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T10:31:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-26T10:31:34.145 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:31:34.145 INFO:teuthology.orchestra.run.smithi112.stdout:Complete! 2024-04-26T10:31:34.355 DEBUG:teuthology.parallel:result is None 2024-04-26T10:31:36.246 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T10:31:36.247 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /sys 2024-04-26T10:31:36.247 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /proc 2024-04-26T10:31:36.247 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /dev 2024-04-26T10:31:36.247 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /run 2024-04-26T10:31:36.247 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /mnt 2024-04-26T10:31:36.247 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /var/tmp 2024-04-26T10:31:36.247 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /home 2024-04-26T10:31:36.247 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /tmp 2024-04-26T10:31:36.247 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /dev 2024-04-26T10:31:36.247 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:31:36.596 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T10:31:37.950 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T10:31:37.950 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /sys 2024-04-26T10:31:37.950 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /proc 2024-04-26T10:31:37.950 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /dev 2024-04-26T10:31:37.950 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /run 2024-04-26T10:31:37.950 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /mnt 2024-04-26T10:31:37.950 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /var/tmp 2024-04-26T10:31:37.951 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /home 2024-04-26T10:31:37.951 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /tmp 2024-04-26T10:31:37.951 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /dev 2024-04-26T10:31:37.951 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:31:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T10:31:38.298 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T10:31:38.419 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T10:31:38.638 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T10:31:38.813 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T10:31:39.288 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T10:31:39.487 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T10:31:39.511 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T10:31:39.719 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-26T10:31:39.932 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T10:31:39.948 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-26T10:31:40.087 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T10:31:40.155 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T10:31:40.163 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T10:31:40.371 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T10:31:40.414 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-26T10:31:40.556 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T10:31:40.612 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-26T10:31:41.027 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T10:31:41.066 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 101/152 2024-04-26T10:31:41.066 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2024-04-26T10:31:41.066 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2024-04-26T10:31:41.066 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /dev 2024-04-26T10:31:41.066 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /run 2024-04-26T10:31:41.066 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2024-04-26T10:31:41.066 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2024-04-26T10:31:41.066 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2024-04-26T10:31:41.066 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2024-04-26T10:31:41.066 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /dev 2024-04-26T10:31:41.066 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:31:41.144 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T10:31:41.222 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T10:31:41.246 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T10:31:41.321 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T10:31:41.399 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T10:31:41.443 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 112/152 2024-04-26T10:31:41.521 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-26T10:31:41.630 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 113/152 2024-04-26T10:31:41.741 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-26T10:31:41.837 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T10:31:41.930 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T10:31:42.011 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T10:31:42.278 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-26T10:31:42.547 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-26T10:31:42.859 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T10:31:43.051 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T10:31:43.093 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T10:31:43.140 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 102/152 2024-04-26T10:31:43.232 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T10:31:43.318 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T10:31:43.344 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 112/152 2024-04-26T10:31:43.548 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 103/152 2024-04-26T10:31:43.591 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 113/152 2024-04-26T10:31:43.713 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T10:31:43.804 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T10:31:44.060 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T10:31:44.216 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 104/152 2024-04-26T10:31:44.245 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T10:31:44.337 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T10:31:44.422 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T10:31:44.446 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 105/152 2024-04-26T10:31:44.647 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 106/152 2024-04-26T10:31:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 117/152 2024-04-26T10:31:44.822 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T10:31:44.850 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 107/152 2024-04-26T10:31:44.893 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T10:31:44.930 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T10:31:44.996 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T10:31:45.073 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 108/152 2024-04-26T10:31:45.079 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T10:31:45.094 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T10:31:45.105 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T10:31:45.282 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 120/152 2024-04-26T10:31:45.340 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : jq-1.6-8.el8.x86_64 109/152 2024-04-26T10:31:45.428 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T10:31:45.538 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : automake-1.16.1-8.el8.noarch 110/152 2024-04-26T10:31:46.031 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T10:31:46.038 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T10:31:46.196 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 111/152 2024-04-26T10:31:46.254 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T10:31:46.312 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 112/152 2024-04-26T10:31:46.347 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T10:31:46.508 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 113/152 2024-04-26T10:31:46.724 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 117/152 2024-04-26T10:31:46.737 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T10:31:46.954 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T10:31:46.991 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T10:31:47.162 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T10:31:47.173 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T10:31:47.427 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 120/152 2024-04-26T10:31:47.595 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T10:31:47.824 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 114/152 2024-04-26T10:31:48.075 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T10:31:49.101 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 115/152 2024-04-26T10:31:49.273 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T10:31:49.371 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 116/152 2024-04-26T10:31:49.746 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 117/152 2024-04-26T10:31:49.911 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T10:31:49.959 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T10:31:49.998 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 118/152 2024-04-26T10:31:50.170 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T10:31:50.181 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 119/152 2024-04-26T10:31:50.365 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 120/152 2024-04-26T10:31:50.529 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T10:31:51.293 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/152 2024-04-26T10:31:51.484 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T10:31:51.517 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T10:31:51.711 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T10:31:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T10:31:52.060 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T10:31:52.252 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T10:31:52.344 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T10:31:53.217 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/152 2024-04-26T10:31:53.481 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/152 2024-04-26T10:31:53.506 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-26T10:31:53.707 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-26T10:31:53.719 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T10:31:53.753 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T10:31:53.912 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-26T10:31:53.970 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T10:31:54.081 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-26T10:31:54.260 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 131/152 2024-04-26T10:31:54.313 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T10:31:54.493 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/152 2024-04-26T10:31:54.528 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T10:31:54.620 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T10:31:54.788 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 133/152 2024-04-26T10:31:55.044 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-26T10:31:55.226 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-26T10:31:55.281 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 121/152 2024-04-26T10:31:55.418 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T10:31:55.500 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T10:31:55.536 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/152 2024-04-26T10:31:55.760 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T10:31:55.772 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T10:31:55.890 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-26T10:31:55.928 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-26T10:31:56.066 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-26T10:31:56.078 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-26T10:31:56.263 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-26T10:31:56.288 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-26T10:31:56.288 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T10:31:56.490 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-26T10:31:56.512 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T10:31:56.513 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T10:31:56.678 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 131/152 2024-04-26T10:31:56.721 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T10:31:56.721 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T10:31:56.758 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 122/152 2024-04-26T10:31:56.916 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/152 2024-04-26T10:31:56.979 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T10:31:57.025 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T10:31:57.059 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T10:31:57.119 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-26T10:31:57.239 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 133/152 2024-04-26T10:31:57.269 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T10:31:57.328 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-26T10:31:57.328 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T10:31:57.537 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-26T10:31:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T10:31:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T10:31:57.636 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1256.gdc093 124/152 2024-04-26T10:31:57.729 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T10:31:57.729 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T10:31:57.735 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-26T10:31:57.819 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T10:31:57.917 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T10:31:57.943 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T10:31:57.954 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T10:31:57.954 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T10:31:58.027 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T10:31:58.187 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T10:31:58.187 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T10:31:58.311 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T10:31:58.324 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T10:31:58.363 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T10:31:58.363 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T10:31:58.487 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-26T10:31:58.610 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T10:31:58.698 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-26T10:31:58.785 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T10:31:58.857 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 126/152 2024-04-26T10:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-26T10:31:58.882 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T10:31:59.159 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 127/152 2024-04-26T10:31:59.180 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T10:31:59.180 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T10:31:59.325 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 128/152 2024-04-26T10:31:59.378 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T10:31:59.378 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/152 2024-04-26T10:31:59.378 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/152 2024-04-26T10:31:59.378 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/152 2024-04-26T10:31:59.378 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/152 2024-04-26T10:31:59.378 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/152 2024-04-26T10:31:59.378 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/152 2024-04-26T10:31:59.379 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/152 2024-04-26T10:31:59.379 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/152 2024-04-26T10:31:59.379 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T10:31:59.379 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T10:31:59.379 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T10:31:59.379 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T10:31:59.379 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/152 2024-04-26T10:31:59.379 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/152 2024-04-26T10:31:59.379 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/152 2024-04-26T10:31:59.379 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/152 2024-04-26T10:31:59.379 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T10:31:59.379 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/152 2024-04-26T10:31:59.379 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/152 2024-04-26T10:31:59.380 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/152 2024-04-26T10:31:59.381 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/152 2024-04-26T10:31:59.381 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/152 2024-04-26T10:31:59.381 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/152 2024-04-26T10:31:59.381 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-26T10:31:59.381 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-26T10:31:59.381 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-26T10:31:59.381 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-26T10:31:59.381 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-26T10:31:59.381 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-26T10:31:59.381 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-26T10:31:59.381 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-26T10:31:59.381 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-26T10:31:59.381 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-26T10:31:59.382 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-26T10:31:59.382 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-26T10:31:59.382 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-26T10:31:59.382 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-26T10:31:59.382 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-26T10:31:59.382 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-26T10:31:59.382 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-26T10:31:59.382 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-26T10:31:59.382 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-26T10:31:59.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-26T10:31:59.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-26T10:31:59.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-26T10:31:59.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-26T10:31:59.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-26T10:31:59.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-26T10:31:59.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-26T10:31:59.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-26T10:31:59.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-26T10:31:59.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-26T10:31:59.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-26T10:31:59.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-26T10:31:59.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 70/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 71/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-26T10:31:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-26T10:31:59.385 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-26T10:31:59.385 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-26T10:31:59.385 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-26T10:31:59.385 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-26T10:31:59.385 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-26T10:31:59.385 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-26T10:31:59.385 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-26T10:31:59.385 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-26T10:31:59.385 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-26T10:31:59.385 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-26T10:31:59.385 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-26T10:31:59.386 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-26T10:31:59.386 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-26T10:31:59.386 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-26T10:31:59.386 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-26T10:31:59.386 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-26T10:31:59.386 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-26T10:31:59.386 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-26T10:31:59.386 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-26T10:31:59.386 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-26T10:31:59.386 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-26T10:31:59.386 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-26T10:31:59.386 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-26T10:31:59.386 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-26T10:31:59.387 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-26T10:31:59.387 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-26T10:31:59.387 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-26T10:31:59.387 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-26T10:31:59.387 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-26T10:31:59.387 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-26T10:31:59.387 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-26T10:31:59.387 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-26T10:31:59.387 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-26T10:31:59.387 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-26T10:31:59.387 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-26T10:31:59.387 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-26T10:31:59.387 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-26T10:31:59.388 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-26T10:31:59.388 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-26T10:31:59.388 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T10:31:59.388 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-26T10:31:59.388 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T10:31:59.388 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-26T10:31:59.388 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-26T10:31:59.388 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-26T10:31:59.388 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-26T10:31:59.388 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-26T10:31:59.388 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-26T10:31:59.388 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-26T10:31:59.388 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-26T10:31:59.389 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-26T10:31:59.389 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-26T10:31:59.389 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-26T10:31:59.389 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-26T10:31:59.389 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-26T10:31:59.389 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-26T10:31:59.389 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-26T10:31:59.389 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-26T10:31:59.389 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-26T10:31:59.389 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-26T10:31:59.389 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-26T10:31:59.389 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-26T10:31:59.390 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-26T10:31:59.390 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-26T10:31:59.390 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-26T10:31:59.390 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-26T10:31:59.390 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-26T10:31:59.390 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-26T10:31:59.422 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T10:31:59.423 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T10:31:59.522 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 129/152 2024-04-26T10:31:59.663 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T10:31:59.698 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 130/152 2024-04-26T10:31:59.873 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-26T10:31:59.887 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 131/152 2024-04-26T10:32:00.096 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-26T10:32:00.096 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T10:32:00.105 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 132/152 2024-04-26T10:32:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T10:32:00.356 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T10:32:00.405 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 133/152 2024-04-26T10:32:00.546 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T10:32:00.546 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T10:32:00.653 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 134/152 2024-04-26T10:32:00.738 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T10:32:00.738 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T10:32:00.852 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/152 2024-04-26T10:32:00.979 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T10:32:00.980 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T10:32:01.027 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T10:32:01.120 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/152 2024-04-26T10:32:01.189 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T10:32:01.189 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T10:32:01.213 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-26T10:32:01.213 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:01.213 INFO:teuthology.orchestra.run.smithi186.stdout:Upgraded: 2024-04-26T10:32:01.213 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-26T10:32:01.213 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-26T10:32:01.213 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-26T10:32:01.213 INFO:teuthology.orchestra.run.smithi186.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-26T10:32:01.213 INFO:teuthology.orchestra.run.smithi186.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-26T10:32:01.213 INFO:teuthology.orchestra.run.smithi186.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-26T10:32:01.214 INFO:teuthology.orchestra.run.smithi186.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.214 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.214 INFO:teuthology.orchestra.run.smithi186.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-26T10:32:01.214 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-26T10:32:01.214 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-26T10:32:01.214 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-26T10:32:01.214 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-26T10:32:01.214 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-26T10:32:01.214 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T10:32:01.214 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-26T10:32:01.214 INFO:teuthology.orchestra.run.smithi186.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T10:32:01.214 INFO:teuthology.orchestra.run.smithi186.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T10:32:01.215 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.215 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.215 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.215 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.215 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:01.215 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.215 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.215 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.215 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:01.215 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:01.215 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:01.215 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:01.215 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:01.216 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.216 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.216 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:01.216 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.216 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.216 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.216 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:01.216 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:01.216 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-26T10:32:01.216 INFO:teuthology.orchestra.run.smithi186.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T10:32:01.216 INFO:teuthology.orchestra.run.smithi186.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-26T10:32:01.216 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T10:32:01.216 INFO:teuthology.orchestra.run.smithi186.stdout: jq-1.6-8.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.217 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T10:32:01.218 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.218 INFO:teuthology.orchestra.run.smithi186.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-26T10:32:01.218 INFO:teuthology.orchestra.run.smithi186.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T10:32:01.218 INFO:teuthology.orchestra.run.smithi186.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T10:32:01.218 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T10:32:01.218 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-26T10:32:01.218 INFO:teuthology.orchestra.run.smithi186.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-26T10:32:01.218 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T10:32:01.218 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T10:32:01.218 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-26T10:32:01.218 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-26T10:32:01.218 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-26T10:32:01.218 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-26T10:32:01.219 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-26T10:32:01.219 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-26T10:32:01.219 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-26T10:32:01.219 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T10:32:01.219 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T10:32:01.219 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T10:32:01.219 INFO:teuthology.orchestra.run.smithi186.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T10:32:01.219 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T10:32:01.219 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.219 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.219 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.219 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T10:32:01.220 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T10:32:01.220 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T10:32:01.220 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T10:32:01.220 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T10:32:01.220 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T10:32:01.220 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T10:32:01.220 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T10:32:01.220 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-26T10:32:01.220 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T10:32:01.220 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T10:32:01.221 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T10:32:01.222 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T10:32:01.222 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T10:32:01.222 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T10:32:01.222 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T10:32:01.222 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T10:32:01.222 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.222 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.222 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T10:32:01.222 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T10:32:01.222 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.222 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T10:32:01.222 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T10:32:01.222 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:01.223 INFO:teuthology.orchestra.run.smithi186.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T10:32:01.224 INFO:teuthology.orchestra.run.smithi186.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T10:32:01.224 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T10:32:01.224 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T10:32:01.224 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-26T10:32:01.224 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:01.224 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-26T10:32:01.354 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T10:32:01.367 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/152 2024-04-26T10:32:01.419 DEBUG:teuthology.parallel:result is None 2024-04-26T10:32:01.504 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T10:32:01.545 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/152 2024-04-26T10:32:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T10:32:01.712 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 139/152 2024-04-26T10:32:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 140/152 2024-04-26T10:32:01.932 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T10:32:02.157 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 141/152 2024-04-26T10:32:02.157 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T10:32:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T10:32:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/152 2024-04-26T10:32:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/152 2024-04-26T10:32:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/152 2024-04-26T10:32:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/152 2024-04-26T10:32:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/152 2024-04-26T10:32:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/152 2024-04-26T10:32:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/152 2024-04-26T10:32:02.275 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/152 2024-04-26T10:32:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T10:32:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T10:32:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T10:32:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T10:32:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/152 2024-04-26T10:32:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/152 2024-04-26T10:32:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/152 2024-04-26T10:32:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/152 2024-04-26T10:32:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T10:32:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/152 2024-04-26T10:32:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/152 2024-04-26T10:32:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/152 2024-04-26T10:32:02.276 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/152 2024-04-26T10:32:02.277 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/152 2024-04-26T10:32:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/152 2024-04-26T10:32:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-26T10:32:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-26T10:32:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-26T10:32:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-26T10:32:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-26T10:32:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-26T10:32:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-26T10:32:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-26T10:32:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-26T10:32:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-26T10:32:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-26T10:32:02.278 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-26T10:32:02.279 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 70/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 71/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-26T10:32:02.280 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-26T10:32:02.281 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-26T10:32:02.282 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-26T10:32:02.283 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-26T10:32:02.284 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-26T10:32:02.285 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-26T10:32:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-26T10:32:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-26T10:32:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-26T10:32:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-26T10:32:02.286 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-26T10:32:02.366 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 142/152 2024-04-26T10:32:02.366 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T10:32:02.596 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 143/152 2024-04-26T10:32:02.784 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 144/152 2024-04-26T10:32:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 145/152 2024-04-26T10:32:03.004 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T10:32:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 146/152 2024-04-26T10:32:03.206 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T10:32:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 147/152 2024-04-26T10:32:03.421 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T10:32:03.621 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 148/152 2024-04-26T10:32:03.622 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T10:32:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 149/152 2024-04-26T10:32:03.829 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T10:32:03.999 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 150/152 2024-04-26T10:32:04.000 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T10:32:04.232 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-26T10:32:04.232 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:04.232 INFO:teuthology.orchestra.run.smithi187.stdout:Upgraded: 2024-04-26T10:32:04.232 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-26T10:32:04.232 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-26T10:32:04.232 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-26T10:32:04.232 INFO:teuthology.orchestra.run.smithi187.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-26T10:32:04.232 INFO:teuthology.orchestra.run.smithi187.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-26T10:32:04.232 INFO:teuthology.orchestra.run.smithi187.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-26T10:32:04.232 INFO:teuthology.orchestra.run.smithi187.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.233 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.233 INFO:teuthology.orchestra.run.smithi187.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-26T10:32:04.233 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-26T10:32:04.233 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-26T10:32:04.233 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-26T10:32:04.233 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-26T10:32:04.233 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-26T10:32:04.233 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T10:32:04.233 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2024-04-26T10:32:04.233 INFO:teuthology.orchestra.run.smithi187.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T10:32:04.233 INFO:teuthology.orchestra.run.smithi187.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T10:32:04.233 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.233 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.234 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.234 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.234 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:04.234 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.234 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.234 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.234 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:04.234 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:04.234 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:04.234 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:04.234 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:04.234 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.234 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: jq-1.6-8.el8.x86_64 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-26T10:32:04.235 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-26T10:32:04.236 INFO:teuthology.orchestra.run.smithi187.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-26T10:32:04.237 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T10:32:04.238 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T10:32:04.238 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T10:32:04.238 INFO:teuthology.orchestra.run.smithi187.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T10:32:04.238 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T10:32:04.238 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.238 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.238 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.238 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T10:32:04.238 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T10:32:04.238 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T10:32:04.238 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T10:32:04.238 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T10:32:04.238 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T10:32:04.239 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T10:32:04.240 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T10:32:04.241 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T10:32:04.242 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.242 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.242 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:04.242 INFO:teuthology.orchestra.run.smithi187.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T10:32:04.242 INFO:teuthology.orchestra.run.smithi187.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T10:32:04.242 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T10:32:04.242 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T10:32:04.242 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-26T10:32:04.243 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:04.243 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2024-04-26T10:32:04.251 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 151/152 2024-04-26T10:32:04.437 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T10:32:04.475 DEBUG:teuthology.parallel:result is None 2024-04-26T10:32:05.061 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 152/152 2024-04-26T10:32:05.061 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 1/152 2024-04-26T10:32:05.061 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2/152 2024-04-26T10:32:05.061 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 3/152 2024-04-26T10:32:05.062 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 4/152 2024-04-26T10:32:05.062 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1256.gdc093 5/152 2024-04-26T10:32:05.062 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 6/152 2024-04-26T10:32:05.062 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 7/152 2024-04-26T10:32:05.062 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 8/152 2024-04-26T10:32:05.062 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 9/152 2024-04-26T10:32:05.062 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 10/152 2024-04-26T10:32:05.062 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 11/152 2024-04-26T10:32:05.062 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 12/152 2024-04-26T10:32:05.062 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_ 13/152 2024-04-26T10:32:05.062 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 14/152 2024-04-26T10:32:05.062 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 15/152 2024-04-26T10:32:05.062 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_6 16/152 2024-04-26T10:32:05.063 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86 17/152 2024-04-26T10:32:05.063 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 18/152 2024-04-26T10:32:05.063 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el 19/152 2024-04-26T10:32:05.063 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8. 20/152 2024-04-26T10:32:05.063 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_6 21/152 2024-04-26T10:32:05.063 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 22/152 2024-04-26T10:32:05.063 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 23/152 2024-04-26T10:32:05.063 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 24/152 2024-04-26T10:32:05.063 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 25/152 2024-04-26T10:32:05.063 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 26/152 2024-04-26T10:32:05.063 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 27/152 2024-04-26T10:32:05.063 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e. 28/152 2024-04-26T10:32:05.064 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noa 29/152 2024-04-26T10:32:05.064 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.n 30/152 2024-04-26T10:32:05.064 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc0 31/152 2024-04-26T10:32:05.064 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el 32/152 2024-04-26T10:32:05.064 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 33/152 2024-04-26T10:32:05.064 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.e 34/152 2024-04-26T10:32:05.064 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 35/152 2024-04-26T10:32:05.064 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 36/152 2024-04-26T10:32:05.064 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : automake-1.16.1-8.el8.noarch 37/152 2024-04-26T10:32:05.064 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : bison-3.0.4-10.el8.x86_64 38/152 2024-04-26T10:32:05.064 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flex-2.6.1-9.el8.x86_64 39/152 2024-04-26T10:32:05.065 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : jq-1.6-8.el8.x86_64 40/152 2024-04-26T10:32:05.065 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 41/152 2024-04-26T10:32:05.065 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 42/152 2024-04-26T10:32:05.065 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 43/152 2024-04-26T10:32:05.065 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 44/152 2024-04-26T10:32:05.065 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 45/152 2024-04-26T10:32:05.065 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 46/152 2024-04-26T10:32:05.065 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 47/152 2024-04-26T10:32:05.065 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 48/152 2024-04-26T10:32:05.065 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 49/152 2024-04-26T10:32:05.066 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 50/152 2024-04-26T10:32:05.066 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 51/152 2024-04-26T10:32:05.066 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 52/152 2024-04-26T10:32:05.066 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 53/152 2024-04-26T10:32:05.066 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 54/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 55/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 56/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 57/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 58/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 59/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 60/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 61/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 62/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 63/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 64/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 65/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 66/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 67/152 2024-04-26T10:32:05.067 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 68/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 69/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 70/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 71/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 72/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 73/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 75/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 76/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 77/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 78/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 79/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 80/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 81/152 2024-04-26T10:32:05.068 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 82/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 83/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 85/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 86/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 87/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 88/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 89/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 90/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 91/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 92/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 93/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 94/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 95/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 96/152 2024-04-26T10:32:05.069 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 97/152 2024-04-26T10:32:05.070 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 98/152 2024-04-26T10:32:05.070 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 99/152 2024-04-26T10:32:05.070 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 100/152 2024-04-26T10:32:05.070 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 101/152 2024-04-26T10:32:05.070 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 102/152 2024-04-26T10:32:05.070 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 103/152 2024-04-26T10:32:05.070 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 104/152 2024-04-26T10:32:05.070 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 105/152 2024-04-26T10:32:05.070 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 106/152 2024-04-26T10:32:05.070 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 107/152 2024-04-26T10:32:05.070 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 108/152 2024-04-26T10:32:05.070 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-2.6-1.el8.noarch 109/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 110/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 111/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 112/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 113/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 114/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 115/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 116/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 117/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 118/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 119/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 120/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 121/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 122/152 2024-04-26T10:32:05.071 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 123/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 124/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 125/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 126/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 127/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 128/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 129/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 130/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 131/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 132/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 133/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 134/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 135/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 136/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 137/152 2024-04-26T10:32:05.072 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 138/152 2024-04-26T10:32:05.073 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 139/152 2024-04-26T10:32:05.073 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 140/152 2024-04-26T10:32:05.073 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 141/152 2024-04-26T10:32:05.073 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 142/152 2024-04-26T10:32:05.073 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 143/152 2024-04-26T10:32:05.073 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 144/152 2024-04-26T10:32:05.073 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 145/152 2024-04-26T10:32:05.073 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 146/152 2024-04-26T10:32:05.073 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 147/152 2024-04-26T10:32:05.073 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 148/152 2024-04-26T10:32:05.073 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 149/152 2024-04-26T10:32:05.073 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 150/152 2024-04-26T10:32:05.073 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 151/152 2024-04-26T10:32:06.834 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 152/152 2024-04-26T10:32:06.834 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:06.834 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-04-26T10:32:06.835 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-04-26T10:32:06.835 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-04-26T10:32:06.835 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-04-26T10:32:06.835 INFO:teuthology.orchestra.run.smithi043.stdout: libblkid-2.32.1-46.el8.x86_64 2024-04-26T10:32:06.835 INFO:teuthology.orchestra.run.smithi043.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-04-26T10:32:06.835 INFO:teuthology.orchestra.run.smithi043.stdout: libmount-2.32.1-46.el8.x86_64 2024-04-26T10:32:06.835 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.835 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.835 INFO:teuthology.orchestra.run.smithi043.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-04-26T10:32:06.835 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-2.32.1-46.el8.x86_64 2024-04-26T10:32:06.835 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-04-26T10:32:06.835 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-04-26T10:32:06.835 INFO:teuthology.orchestra.run.smithi043.stdout: util-linux-2.32.1-46.el8.x86_64 2024-04-26T10:32:06.836 INFO:teuthology.orchestra.run.smithi043.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-04-26T10:32:06.836 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-26T10:32:06.836 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-04-26T10:32:06.836 INFO:teuthology.orchestra.run.smithi043.stdout: automake-1.16.1-8.el8.noarch 2024-04-26T10:32:06.836 INFO:teuthology.orchestra.run.smithi043.stdout: bison-3.0.4-10.el8.x86_64 2024-04-26T10:32:06.836 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.836 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.836 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.836 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.836 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:06.836 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.836 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.837 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.837 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:06.837 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:06.837 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:06.837 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:06.837 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:06.837 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.837 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.837 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:06.837 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.837 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.837 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.838 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:06.838 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:18.2.2-1256.gdc093b5e.el8.noarch 2024-04-26T10:32:06.838 INFO:teuthology.orchestra.run.smithi043.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-04-26T10:32:06.838 INFO:teuthology.orchestra.run.smithi043.stdout: flex-2.6.1-9.el8.x86_64 2024-04-26T10:32:06.838 INFO:teuthology.orchestra.run.smithi043.stdout: fuse-2.9.7-19.el8.x86_64 2024-04-26T10:32:06.838 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-26T10:32:06.838 INFO:teuthology.orchestra.run.smithi043.stdout: jq-1.6-8.el8.x86_64 2024-04-26T10:32:06.838 INFO:teuthology.orchestra.run.smithi043.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-26T10:32:06.838 INFO:teuthology.orchestra.run.smithi043.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-04-26T10:32:06.838 INFO:teuthology.orchestra.run.smithi043.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-26T10:32:06.838 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.838 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.838 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-26T10:32:06.839 INFO:teuthology.orchestra.run.smithi043.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.15-4.el8.x86_64 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-26T10:32:06.840 INFO:teuthology.orchestra.run.smithi043.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-26T10:32:06.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-26T10:32:06.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-26T10:32:06.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-26T10:32:06.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-26T10:32:06.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-26T10:32:06.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-26T10:32:06.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-26T10:32:06.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-26T10:32:06.841 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-26T10:32:06.842 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-04-26T10:32:06.842 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-26T10:32:06.842 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-26T10:32:06.842 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-26T10:32:06.842 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-26T10:32:06.842 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-26T10:32:06.842 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-26T10:32:06.842 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-26T10:32:06.842 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-26T10:32:06.842 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-26T10:32:06.842 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-26T10:32:06.843 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-26T10:32:06.843 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-26T10:32:06.843 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-26T10:32:06.843 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-26T10:32:06.843 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-2.6-1.el8.noarch 2024-04-26T10:32:06.843 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-26T10:32:06.843 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-26T10:32:06.843 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-26T10:32:06.843 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-26T10:32:06.843 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-26T10:32:06.843 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-26T10:32:06.843 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.843 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-26T10:32:06.844 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-26T10:32:06.845 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-26T10:32:06.845 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.845 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.845 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:18.2.2-1256.gdc093b5e.el8.x86_64 2024-04-26T10:32:06.845 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-26T10:32:06.845 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-26T10:32:06.845 INFO:teuthology.orchestra.run.smithi043.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-26T10:32:06.845 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-26T10:32:06.845 INFO:teuthology.orchestra.run.smithi043.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-04-26T10:32:06.846 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:06.846 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-04-26T10:32:07.048 DEBUG:teuthology.parallel:result is None 2024-04-26T10:32:07.048 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:32:07.193 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T10:32:07.217 INFO:teuthology.orchestra.run.smithi043.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T10:32:07.217 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T10:32:07.217 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T10:32:07.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:32:07.357 DEBUG:teuthology.orchestra.run.smithi112:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T10:32:07.386 INFO:teuthology.orchestra.run.smithi112.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T10:32:07.386 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T10:32:07.387 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T10:32:07.388 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:32:07.600 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T10:32:07.629 INFO:teuthology.orchestra.run.smithi186.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T10:32:07.629 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T10:32:07.629 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T10:32:07.631 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:32:07.769 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T10:32:07.797 INFO:teuthology.orchestra.run.smithi187.stdout:18.2.2-1256.gdc093b5e.el8 2024-04-26T10:32:07.798 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256.gdc093b5e.el8 2024-04-26T10:32:07.798 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256.gdc093b5e is installed. 2024-04-26T10:32:07.799 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T10:32:07.800 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T10:32:07.800 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T10:32:07.832 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T10:32:07.832 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T10:32:07.869 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-26T10:32:07.869 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T10:32:07.905 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-26T10:32:07.905 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T10:32:07.942 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T10:32:07.943 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T10:32:07.943 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T10:32:07.971 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T10:32:08.040 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T10:32:08.041 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T10:32:08.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T10:32:08.141 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-26T10:32:08.142 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T10:32:08.173 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T10:32:08.246 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-26T10:32:08.246 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T10:32:08.278 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T10:32:08.349 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T10:32:08.349 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T10:32:08.349 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T10:32:08.377 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T10:32:08.445 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T10:32:08.445 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T10:32:08.475 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T10:32:08.545 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-26T10:32:08.546 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T10:32:08.578 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T10:32:08.648 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-26T10:32:08.648 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T10:32:08.681 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T10:32:08.751 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T10:32:08.751 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T10:32:08.752 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T10:32:08.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T10:32:08.848 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T10:32:08.848 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T10:32:08.880 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T10:32:08.950 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-26T10:32:08.951 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T10:32:08.983 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T10:32:09.054 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-26T10:32:09.055 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T10:32:09.085 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T10:32:09.155 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T10:32:09.239 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T10:32:09.239 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /var/log/ceph 2024-04-26T10:32:09.242 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2024-04-26T10:32:09.244 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 777 /var/log/ceph 2024-04-26T10:32:09.247 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /var/log/ceph 2024-04-26T10:32:09.277 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T10:32:09.277 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T10:32:09.313 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T10:32:09.316 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T10:32:09.318 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T10:32:09.348 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T10:32:09.348 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T10:32:09.384 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T10:32:09.387 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T10:32:09.389 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T10:32:09.428 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T10:32:09.428 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T10:32:09.428 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674084', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 1136, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6', 'targets': {'smithi043.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxIbIPilTtG+AtYDBevscLexB1UKWUxmmz8/ZkLNUvidYUne+9M6upUldVJSeSJkvoU/tEe/W2556v7evaF5Xw=', 'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBz/DhbbGD+wY9rzSAPOlFYnv+1Cj5qQExVw310VsUbRrb04t8831wHH8T5+1muw+c30p5RjQWSOTSWwM/ngv+w=', 'smithi186.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLnxr1WfVQumC5l0O/SK9VEoJB/VQCT3/VNFXvi46W0F9xBjHGsk7beRjhBOiKOiDiph8GNF0s3uGNrSlTYeUMs=', 'smithi187.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOhok7z7mgz1lImo0ScBP+naf9c5a/s3209el8pYkHo+30lG//26omdlo1lBsCDiX8JWy2uMX2LjBcdVD7kJZgM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T10:32:09.429 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T10:32:09.454 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T10:32:09.457 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T10:32:09.459 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T10:32:09.478 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:32:09.513 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:32:09.516 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:32:09.518 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:32:09.546 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T10:32:09.546 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T10:32:09.602 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T10:32:09.602 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-04-26T10:32:09.660 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T10:32:09.660 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:32:09.660 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 168456 Links: 1 2024-04-26T10:32:09.661 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:32:09.661 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:32:09.661 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-26 10:31:31.991738180 +0000 2024-04-26T10:32:09.661 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-26 09:52:55.294669401 +0000 2024-04-26T10:32:09.661 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-26 09:52:55.294669401 +0000 2024-04-26T10:32:09.661 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-04-26T10:32:09.661 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T10:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-26T10:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-26T10:32:09.727 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000217108 s, 2.4 MB/s 2024-04-26T10:32:09.728 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T10:32:09.788 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-04-26T10:32:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T10:32:09.846 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:32:09.846 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 160659 Links: 1 2024-04-26T10:32:09.846 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:32:09.846 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:32:09.847 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-26 10:31:31.991738180 +0000 2024-04-26T10:32:09.847 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-26 09:52:55.645660032 +0000 2024-04-26T10:32:09.847 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-26 09:52:55.645660032 +0000 2024-04-26T10:32:09.847 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-04-26T10:32:09.847 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T10:32:09.913 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-26T10:32:09.913 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-26T10:32:09.913 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000214541 s, 2.4 MB/s 2024-04-26T10:32:09.915 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T10:32:09.973 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-04-26T10:32:10.031 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T10:32:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:32:10.032 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 169171 Links: 1 2024-04-26T10:32:10.032 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:32:10.032 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:32:10.032 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-26 10:31:31.992738153 +0000 2024-04-26T10:32:10.032 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-26 09:52:55.990650824 +0000 2024-04-26T10:32:10.032 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-26 09:52:55.990650824 +0000 2024-04-26T10:32:10.032 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-04-26T10:32:10.032 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T10:32:10.098 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-26T10:32:10.098 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-26T10:32:10.098 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000163378 s, 3.1 MB/s 2024-04-26T10:32:10.099 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T10:32:10.158 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-04-26T10:32:10.216 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T10:32:10.216 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:32:10.216 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 6h/6d Inode: 171236 Links: 1 2024-04-26T10:32:10.216 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:32:10.217 INFO:teuthology.orchestra.run.smithi112.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:32:10.217 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-04-26 10:31:31.992738153 +0000 2024-04-26T10:32:10.217 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-04-26 09:52:56.337641562 +0000 2024-04-26T10:32:10.217 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-04-26 09:52:56.337641562 +0000 2024-04-26T10:32:10.217 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-04-26T10:32:10.217 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T10:32:10.281 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-04-26T10:32:10.281 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-04-26T10:32:10.282 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000208236 s, 2.5 MB/s 2024-04-26T10:32:10.283 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T10:32:10.341 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T10:32:10.341 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-26T10:32:10.341 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T10:32:10.363 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T10:32:10.363 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_1 2024-04-26T10:32:10.424 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T10:32:10.425 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:32:10.425 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 171070 Links: 1 2024-04-26T10:32:10.425 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:32:10.425 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:32:10.425 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-26 10:31:58.995960457 +0000 2024-04-26T10:32:10.425 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-26 09:52:53.905263727 +0000 2024-04-26T10:32:10.425 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-26 09:52:53.905263727 +0000 2024-04-26T10:32:10.425 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2024-04-26T10:32:10.425 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T10:32:10.496 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-26T10:32:10.496 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-26T10:32:10.497 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000321873 s, 1.6 MB/s 2024-04-26T10:32:10.498 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T10:32:10.561 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_2 2024-04-26T10:32:10.622 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T10:32:10.622 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:32:10.622 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 170283 Links: 1 2024-04-26T10:32:10.622 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:32:10.623 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:32:10.623 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-26 10:31:58.995960457 +0000 2024-04-26T10:32:10.623 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-26 09:52:54.243257667 +0000 2024-04-26T10:32:10.623 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-26 09:52:54.243257667 +0000 2024-04-26T10:32:10.623 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2024-04-26T10:32:10.623 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T10:32:10.692 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-26T10:32:10.692 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-26T10:32:10.692 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000248726 s, 2.1 MB/s 2024-04-26T10:32:10.693 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T10:32:10.754 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_3 2024-04-26T10:32:10.814 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T10:32:10.814 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:32:10.814 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 170356 Links: 1 2024-04-26T10:32:10.814 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:32:10.814 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:32:10.814 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-26 10:31:58.995960457 +0000 2024-04-26T10:32:10.814 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-26 09:52:54.615250996 +0000 2024-04-26T10:32:10.814 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-26 09:52:54.615250996 +0000 2024-04-26T10:32:10.814 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2024-04-26T10:32:10.815 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T10:32:10.881 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-26T10:32:10.881 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-26T10:32:10.882 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000192075 s, 2.7 MB/s 2024-04-26T10:32:10.882 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T10:32:10.943 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_4 2024-04-26T10:32:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T10:32:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:32:11.002 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 172110 Links: 1 2024-04-26T10:32:11.002 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:32:11.002 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:32:11.002 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-26 10:31:58.995960457 +0000 2024-04-26T10:32:11.002 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-26 09:52:54.953244935 +0000 2024-04-26T10:32:11.003 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-26 09:52:54.953244935 +0000 2024-04-26T10:32:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2024-04-26T10:32:11.003 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T10:32:11.068 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-26T10:32:11.069 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-26T10:32:11.069 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000234478 s, 2.2 MB/s 2024-04-26T10:32:11.070 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T10:32:11.129 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T10:32:11.129 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-26T10:32:11.129 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T10:32:11.151 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T10:32:11.151 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2024-04-26T10:32:11.212 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T10:32:11.212 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:32:11.212 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 168347 Links: 1 2024-04-26T10:32:11.212 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:32:11.212 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:32:11.212 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-04-26 10:32:01.912019079 +0000 2024-04-26T10:32:11.212 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-04-26 09:53:02.609136482 +0000 2024-04-26T10:32:11.212 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-04-26 09:53:02.609136482 +0000 2024-04-26T10:32:11.212 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-04-26T10:32:11.212 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T10:32:11.281 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-04-26T10:32:11.281 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-04-26T10:32:11.281 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000214651 s, 2.4 MB/s 2024-04-26T10:32:11.282 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T10:32:11.342 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2024-04-26T10:32:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T10:32:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:32:11.401 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 168435 Links: 1 2024-04-26T10:32:11.401 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:32:11.401 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:32:11.401 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-04-26 10:32:01.912019079 +0000 2024-04-26T10:32:11.401 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-04-26 09:53:02.955131039 +0000 2024-04-26T10:32:11.401 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-04-26 09:53:02.955131039 +0000 2024-04-26T10:32:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-04-26T10:32:11.401 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T10:32:11.469 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-04-26T10:32:11.469 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-04-26T10:32:11.469 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000223693 s, 2.3 MB/s 2024-04-26T10:32:11.470 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T10:32:11.530 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2024-04-26T10:32:11.589 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T10:32:11.589 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:32:11.589 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 171207 Links: 1 2024-04-26T10:32:11.589 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:32:11.589 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:32:11.589 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-04-26 10:32:01.912019079 +0000 2024-04-26T10:32:11.589 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-04-26 09:53:03.325125220 +0000 2024-04-26T10:32:11.590 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-04-26 09:53:03.325125220 +0000 2024-04-26T10:32:11.590 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-04-26T10:32:11.590 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T10:32:11.656 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-04-26T10:32:11.656 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-04-26T10:32:11.656 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000193015 s, 2.7 MB/s 2024-04-26T10:32:11.657 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T10:32:11.715 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2024-04-26T10:32:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T10:32:11.773 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:32:11.773 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 6h/6d Inode: 171274 Links: 1 2024-04-26T10:32:11.773 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:32:11.774 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T10:32:11.774 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2024-04-26 10:32:01.913019063 +0000 2024-04-26T10:32:11.774 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2024-04-26 09:53:03.648120138 +0000 2024-04-26T10:32:11.774 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2024-04-26 09:53:03.648120138 +0000 2024-04-26T10:32:11.774 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: - 2024-04-26T10:32:11.774 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T10:32:11.839 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2024-04-26T10:32:11.839 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2024-04-26T10:32:11.840 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000206618 s, 2.5 MB/s 2024-04-26T10:32:11.841 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T10:32:11.899 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T10:32:11.899 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T10:32:11.899 INFO:tasks.ceph:Generating config... 2024-04-26T10:32:11.900 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T10:32:11.900 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T10:32:11.900 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T10:32:11.901 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T10:32:11.901 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T10:32:11.901 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T10:32:11.901 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T10:32:11.901 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T10:32:11.901 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T10:32:11.901 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T10:32:11.901 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T10:32:11.901 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T10:32:11.901 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T10:32:11.901 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T10:32:11.901 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T10:32:11.901 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T10:32:11.901 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T10:32:11.901 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T10:32:11.902 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T10:32:11.902 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T10:32:11.902 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T10:32:11.902 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T10:32:11.902 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T10:32:11.902 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T10:32:11.902 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T10:32:11.961 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T10:32:11.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T10:32:12.015 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:32:12.046 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.43'), ('mon.b', '[v2:172.21.15.43:3301,v1:172.21.15.43:6790]'), ('mon.c', '[v2:172.21.15.43:3302,v1:172.21.15.43:6791]')] 2024-04-26T10:32:12.046 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-04-26T10:32:12.047 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T10:32:12.047 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T10:32:12.105 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.43 --addv b '[v2:172.21.15.43:3301,v1:172.21.15.43:6790]' --addv c '[v2:172.21.15.43:3302,v1:172.21.15.43:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:32:12.197 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:32:12.197 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: generated fsid 6d35b773-83ef-4e54-be62-89cec0b09327 2024-04-26T10:32:12.197 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = pacific 2024-04-26T10:32:12.197 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 0 2024-04-26T10:32:12.197 INFO:teuthology.orchestra.run.smithi043.stdout:fsid 6d35b773-83ef-4e54-be62-89cec0b09327 2024-04-26T10:32:12.197 INFO:teuthology.orchestra.run.smithi043.stdout:last_changed 2024-04-26T10:32:12.196870+0000 2024-04-26T10:32:12.198 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-04-26T10:32:12.196870+0000 2024-04-26T10:32:12.198 INFO:teuthology.orchestra.run.smithi043.stdout:min_mon_release 16 (pacific) 2024-04-26T10:32:12.198 INFO:teuthology.orchestra.run.smithi043.stdout:election_strategy: 1 2024-04-26T10:32:12.198 INFO:teuthology.orchestra.run.smithi043.stdout:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-04-26T10:32:12.198 INFO:teuthology.orchestra.run.smithi043.stdout:1: [v2:172.21.15.43:3301/0,v1:172.21.15.43:6790/0] mon.b 2024-04-26T10:32:12.198 INFO:teuthology.orchestra.run.smithi043.stdout:2: [v2:172.21.15.43:3302/0,v1:172.21.15.43:6791/0] mon.c 2024-04-26T10:32:12.198 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T10:32:12.199 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T10:32:12.217 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6d35b773-83ef-4e54-be62-89cec0b09327... 2024-04-26T10:32:12.218 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T10:32:12.260 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T10:32:12.262 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T10:32:12.265 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T10:32:12.303 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-04-26T10:32:12.303 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-04-26T10:32:12.303 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T10:32:12.303 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-04-26T10:32:12.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.303 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-04-26T10:32:12.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.303 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-04-26T10:32:12.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.303 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-04-26T10:32:12.303 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-04-26T10:32:12.303 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-04-26T10:32:12.304 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.305 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]" 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = 6d35b773-83ef-4e54-be62-89cec0b09327 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-04-26T10:32:12.306 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.307 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: bdev async discard = True 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: bdev enable discard = True 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore allocator = bitmap 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 1/20 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 1/20 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-04-26T10:32:12.308 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 4/10 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: osd blocked scrub grace period = 3600 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: osd max markdown count = 1000 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-04-26T10:32:12.309 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:32:12.310 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:12.311 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-04-26T10:32:12.312 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-04-26T10:32:12.312 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-04-26T10:32:12.312 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-04-26T10:32:12.312 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T10:32:12.312 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T10:32:12.312 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-04-26T10:32:12.312 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.b] 2024-04-26T10:32:12.312 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.c] 2024-04-26T10:32:12.312 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-04-26T10:32:12.312 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-04-26T10:32:12.312 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T10:32:12.313 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-04-26T10:32:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-04-26T10:32:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T10:32:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-04-26T10:32:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-04-26T10:32:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-04-26T10:32:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-04-26T10:32:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]" 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = 6d35b773-83ef-4e54-be62-89cec0b09327 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-04-26T10:32:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-04-26T10:32:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: bdev async discard = True 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: bdev enable discard = True 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore allocator = bitmap 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 1/20 2024-04-26T10:32:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 1/20 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 4/10 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: osd blocked scrub grace period = 3600 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: osd max markdown count = 1000 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-26T10:32:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:32:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi112.stdout:[mds.a] 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T10:32:12.322 INFO:teuthology.orchestra.run.smithi187.stdout:[global] 2024-04-26T10:32:12.323 INFO:teuthology.orchestra.run.smithi187.stdout: chdir = "" 2024-04-26T10:32:12.323 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T10:32:12.323 INFO:teuthology.orchestra.run.smithi187.stdout: auth supported = cephx 2024-04-26T10:32:12.323 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.323 INFO:teuthology.orchestra.run.smithi187.stdout: filestore xattr use omap = true 2024-04-26T10:32:12.323 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.323 INFO:teuthology.orchestra.run.smithi187.stdout: mon clock drift allowed = 1.000 2024-04-26T10:32:12.323 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.323 INFO:teuthology.orchestra.run.smithi187.stdout: osd crush chooseleaf type = 0 2024-04-26T10:32:12.323 INFO:teuthology.orchestra.run.smithi187.stdout: auth debug = true 2024-04-26T10:32:12.323 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.323 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on old message = true 2024-04-26T10:32:12.323 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on bug = true 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: mon pg warn max object skew = 0 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default size = 2 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow primary affinity = true 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow pg remap = true 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on legacy crush tunables = false 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on crush straw calc version zero = false 2024-04-26T10:32:12.324 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on no sortbitwise = false 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on osd down out interval zero = false 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on too few osds = false 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: mon_allow_pool_size_one = true 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: osd default data pool replay window = 5 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: mon allow pool delete = true 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: mon cluster log file level = debug 2024-04-26T10:32:12.325 INFO:teuthology.orchestra.run.smithi187.stdout: debug asserts on shutdown = true 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: mon health detail to clog = false 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]" 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: fsid = 6d35b773-83ef-4e54-be62-89cec0b09327 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout:[osd] 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: osd journal size = 100 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub load threshold = 5.0 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub max interval = 600 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: osd mclock profile = high_recovery_ops 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: osd recover clone overlap = true 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: osd recovery max chunk = 1048576 2024-04-26T10:32:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug shutdown = true 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug op order = true 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug verify stray on activate = true 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: osd open classes on start = true 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug pg log writeout = true 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: osd deep scrub update digest min age = 30 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: osd map max advance = 10 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: journal zero on create = true 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: filestore ondisk finisher threads = 3 2024-04-26T10:32:12.327 INFO:teuthology.orchestra.run.smithi187.stdout: filestore apply finisher threads = 3 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: bdev debug aio = true 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug misdirected ops = true 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: bdev async discard = True 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: bdev enable discard = True 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore allocator = bitmap 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore block size = 96636764160 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore fsck on mount = True 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluefs = 1/20 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluestore = 1/20 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: debug osd = 20 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: debug rocksdb = 4/10 2024-04-26T10:32:12.328 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.9 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.8 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: osd blocked scrub grace period = 3600 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: osd failsafe full ratio = 0.95 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: osd max markdown count = 1000 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: osd objectstore = bluestore 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr] 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: debug mgr = 20 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:32:12.329 INFO:teuthology.orchestra.run.smithi187.stdout: mgr/telemetry/nag = false 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout:[mon] 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout: debug paxos = 20 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout: mon data avail warn = 5 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout: mon mgr mkfs grace = 240 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd reporter subtree level = osd 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd prime pg temp = true 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.330 INFO:teuthology.orchestra.run.smithi187.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: # 1m isn't quite enough 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: mon_down_mkfs_grace = 2m 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_filestore_osds = false 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout:[client] 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: rgw cache enabled = true 2024-04-26T10:32:12.331 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable ops log = true 2024-04-26T10:32:12.332 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable usage log = true 2024-04-26T10:32:12.332 INFO:teuthology.orchestra.run.smithi187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T10:32:12.332 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T10:32:12.332 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.a] 2024-04-26T10:32:12.332 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.b] 2024-04-26T10:32:12.332 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.c] 2024-04-26T10:32:12.332 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2024-04-26T10:32:12.332 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2024-04-26T10:32:12.332 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T10:32:12.334 INFO:teuthology.orchestra.run.smithi186.stdout:[global] 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: chdir = "" 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: auth supported = cephx 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: filestore xattr use omap = true 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: mon clock drift allowed = 1.000 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: osd crush chooseleaf type = 0 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: auth debug = true 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on old message = true 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on bug = true 2024-04-26T10:32:12.335 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: mon pg warn max object skew = 0 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default size = 2 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow primary affinity = true 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow pg remap = true 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on legacy crush tunables = false 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on crush straw calc version zero = false 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on no sortbitwise = false 2024-04-26T10:32:12.336 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on osd down out interval zero = false 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on too few osds = false 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: mon_allow_pool_size_one = true 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: osd default data pool replay window = 5 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: mon allow pool delete = true 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: mon cluster log file level = debug 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: debug asserts on shutdown = true 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: mon health detail to clog = false 2024-04-26T10:32:12.337 INFO:teuthology.orchestra.run.smithi186.stdout: mon host = "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]" 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout: fsid = 6d35b773-83ef-4e54-be62-89cec0b09327 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout:[osd] 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout: osd journal size = 100 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub load threshold = 5.0 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub max interval = 600 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout: osd mclock profile = high_recovery_ops 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout: osd recover clone overlap = true 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout: osd recovery max chunk = 1048576 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug shutdown = true 2024-04-26T10:32:12.338 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug op order = true 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug verify stray on activate = true 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: osd open classes on start = true 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug pg log writeout = true 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: osd deep scrub update digest min age = 30 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: osd map max advance = 10 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: journal zero on create = true 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: filestore ondisk finisher threads = 3 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: filestore apply finisher threads = 3 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.339 INFO:teuthology.orchestra.run.smithi186.stdout: bdev debug aio = true 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug misdirected ops = true 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: bdev async discard = True 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: bdev enable discard = True 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore allocator = bitmap 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore block size = 96636764160 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore fsck on mount = True 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluefs = 1/20 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluestore = 1/20 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: debug osd = 20 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: debug rocksdb = 4/10 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd full ratio = 0.9 2024-04-26T10:32:12.340 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd nearfull ratio = 0.8 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: osd blocked scrub grace period = 3600 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: osd failsafe full ratio = 0.95 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: osd max markdown count = 1000 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: osd objectstore = bluestore 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr] 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: debug mgr = 20 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: mgr/telemetry/nag = false 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout:[mon] 2024-04-26T10:32:12.341 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: debug paxos = 20 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: mon data avail warn = 5 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: mon mgr mkfs grace = 240 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd reporter subtree level = osd 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd prime pg temp = true 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T10:32:12.342 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: # 1m isn't quite enough 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: mon_down_mkfs_grace = 2m 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_filestore_osds = false 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout:[client] 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: rgw cache enabled = true 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable ops log = true 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable usage log = true 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T10:32:12.343 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.a] 2024-04-26T10:32:12.344 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.b] 2024-04-26T10:32:12.344 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.c] 2024-04-26T10:32:12.344 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.a] 2024-04-26T10:32:12.344 INFO:teuthology.orchestra.run.smithi186.stdout:[client.0] 2024-04-26T10:32:12.344 INFO:teuthology.orchestra.run.smithi186.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T10:32:12.344 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T10:32:12.344 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T10:32:12.433 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T10:32:12.433 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T10:32:12.433 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T10:32:12.451 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T10:32:12.451 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T10:32:12.509 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2024-04-26T10:32:12.509 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T10:32:12.509 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T10:32:12.509 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:32:12.586 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T10:32:12.586 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:32:12.644 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T10:32:12.644 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T10:32:12.644 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T10:32:12.644 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:32:12.686 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T10:32:12.686 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:32:12.745 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi186.front.sepia.ceph.com 2024-04-26T10:32:12.745 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-26T10:32:12.745 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T10:32:12.746 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:32:12.788 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-26T10:32:12.789 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:32:12.849 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi187.front.sepia.ceph.com 2024-04-26T10:32:12.849 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-26T10:32:12.850 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T10:32:12.850 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:32:12.892 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-26T10:32:12.892 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:32:12.983 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T10:32:12.983 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T10:32:12.984 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T10:32:13.040 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T10:32:13.042 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T10:32:13.096 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T10:32:13.099 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T10:32:13.099 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T10:32:13.153 INFO:teuthology.orchestra.run.smithi043.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T10:32:13.156 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T10:32:13.183 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T10:32:13.183 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T10:32:13.267 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T10:32:13.280 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T10:32:13.280 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T10:32:13.280 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T10:32:13.312 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T10:32:13.312 INFO:tasks.ceph:role: osd.0 2024-04-26T10:32:13.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T10:32:13.312 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T10:32:13.390 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T10:32:13.391 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T10:32:13.391 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T10:32:13.391 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T10:32:13.391 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T10:32:13.391 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-04-26T10:32:13.391 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T10:32:13.391 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T10:32:13.391 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T10:32:13.391 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T10:32:13.819 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-04-26T10:32:13.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-04-26T10:32:13.821 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T10:32:13.991 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T10:32:14.029 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:32:14.134 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T10:32:14.132+0000 7ff3b0111800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T10:32:14.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T10:32:14.134+0000 7ff3b0111800 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T10:32:14.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T10:32:14.134+0000 7ff3b0111800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T10:32:14.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T10:32:14.134+0000 7ff3b0111800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T10:32:14.136 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T10:32:14.134+0000 7ff3b0111800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T10:32:14.143 INFO:teuthology.orchestra.run.smithi112.stderr:2024-04-26T10:32:14.141+0000 7ff3b0111800 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T10:32:17.000 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T10:32:17.031 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T10:32:17.064 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T10:32:17.064 INFO:tasks.ceph:role: osd.1 2024-04-26T10:32:17.064 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-26T10:32:17.064 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T10:32:17.143 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T10:32:17.143 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T10:32:17.143 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T10:32:17.143 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T10:32:17.143 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T10:32:17.143 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2024-04-26T10:32:17.143 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T10:32:17.143 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T10:32:17.144 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T10:32:17.144 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T10:32:17.576 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2024-04-26T10:32:17.578 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2024-04-26T10:32:17.579 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T10:32:17.761 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T10:32:17.798 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:32:18.176 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-26T10:32:18.175+0000 7ffbeff6e800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T10:32:18.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-26T10:32:18.175+0000 7ffbeff6e800 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T10:32:18.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-26T10:32:18.175+0000 7ffbeff6e800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T10:32:18.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-26T10:32:18.175+0000 7ffbeff6e800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T10:32:18.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-26T10:32:18.175+0000 7ffbeff6e800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T10:32:18.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-26T10:32:18.176+0000 7ffbeff6e800 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T10:32:21.025 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T10:32:21.057 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T10:32:21.090 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T10:32:21.090 INFO:tasks.ceph:role: osd.2 2024-04-26T10:32:21.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com 2024-04-26T10:32:21.091 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T10:32:21.169 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T10:32:21.170 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T10:32:21.170 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T10:32:21.170 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T10:32:21.170 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T10:32:21.170 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2024-04-26T10:32:21.170 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T10:32:21.170 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T10:32:21.170 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T10:32:21.170 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T10:32:21.611 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2024-04-26T10:32:21.613 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2024-04-26T10:32:21.613 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-26T10:32:21.790 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T10:32:21.827 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:32:21.924 INFO:teuthology.orchestra.run.smithi187.stderr:2024-04-26T10:32:21.922+0000 7f4efe7ef800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T10:32:21.925 INFO:teuthology.orchestra.run.smithi187.stderr:2024-04-26T10:32:21.923+0000 7f4efe7ef800 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T10:32:21.925 INFO:teuthology.orchestra.run.smithi187.stderr:2024-04-26T10:32:21.923+0000 7f4efe7ef800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T10:32:21.925 INFO:teuthology.orchestra.run.smithi187.stderr:2024-04-26T10:32:21.923+0000 7f4efe7ef800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T10:32:21.925 INFO:teuthology.orchestra.run.smithi187.stderr:2024-04-26T10:32:21.923+0000 7f4efe7ef800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T10:32:21.932 INFO:teuthology.orchestra.run.smithi187.stderr:2024-04-26T10:32:21.930+0000 7f4efe7ef800 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T10:32:24.790 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T10:32:24.821 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T10:32:24.822 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T10:32:24.822 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T10:32:24.855 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T10:32:24.855 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T10:32:24.931 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T10:32:24.931 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T10:32:25.005 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T10:32:25.005 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T10:32:25.038 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-26T10:32:25.039 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T10:32:25.072 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-26T10:32:25.073 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T10:32:25.105 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-04-26T10:32:25.105 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T10:32:25.127 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T10:32:25.127 DEBUG:teuthology.orchestra.run.smithi043:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T10:32:25.199 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.x] 2024-04-26T10:32:25.199 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCtgitmUnlcAhAA85xu06UPGp1hBaq68mDpng== 2024-04-26T10:32:25.199 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.y] 2024-04-26T10:32:25.199 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCtgitm1Q7ABRAAimhPeaD/yFznyEWqrV0ngQ== 2024-04-26T10:32:25.199 INFO:teuthology.orchestra.run.smithi043.stdout:[mds.a] 2024-04-26T10:32:25.199 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCtgitmFKQjCRAAU7WdxFF1fXVHGafykQNR+Q== 2024-04-26T10:32:25.199 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.0] 2024-04-26T10:32:25.200 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCugitmV/oDCBAArpKVZAf+WvKODs+7yp8YVQ== 2024-04-26T10:32:25.200 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.1] 2024-04-26T10:32:25.200 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCygitmm1iBChAA/jmktpid83yyoY6H3WTLJQ== 2024-04-26T10:32:25.200 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.2] 2024-04-26T10:32:25.200 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQC1gitmCzkWNxAAJEp1csUxIP4q0r1nyk8Frw== 2024-04-26T10:32:25.200 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-04-26T10:32:25.200 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCtgitm7DftDxAASHlt7xwYZlWObT9GAWX31A== 2024-04-26T10:32:25.201 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T10:32:25.303 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T10:32:25.360 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T10:32:25.419 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T10:32:25.473 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T10:32:25.527 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T10:32:25.581 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T10:32:25.638 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T10:32:25.639 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T10:32:25.665 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T10:32:25.775 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T10:32:25.803 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T10:32:25.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T10:32:25.969 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T10:32:25.998 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T10:32:26.071 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T10:32:26.172 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T10:32:26.200 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:32:26.259 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T10:32:26.260 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T10:32:26.260 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T10:32:26.302 INFO:tasks.ceph.mon.a:Started 2024-04-26T10:32:26.302 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T10:32:26.302 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T10:32:26.308 INFO:tasks.ceph.mon.b:Started 2024-04-26T10:32:26.308 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T10:32:26.308 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T10:32:26.310 INFO:tasks.ceph.mon.c:Started 2024-04-26T10:32:26.311 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T10:32:26.311 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T10:32:26.311 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T10:32:26.313 INFO:tasks.ceph.mgr.x:Started 2024-04-26T10:32:26.313 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T10:32:26.314 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T10:32:26.316 INFO:tasks.ceph.mgr.y:Started 2024-04-26T10:32:26.316 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T10:32:26.316 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T10:32:36.775 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2024-04-26T10:32:36.788 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T10:32:36.789 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T10:32:36.789 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-04-26T10:32:36.789 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T10:32:36.816 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:36.815+0000 7f8fbdc22240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T10:32:36.817 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:36.815+0000 7fba26d60240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T10:32:36.821 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-26T10:32:36.821 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T10:32:36.855 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2024-04-26T10:32:36.855 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T10:32:36.888 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 32399f03-8160-43f7-a69f-1db73f105676 0 2024-04-26T10:32:37.032 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:37.030+0000 7f8fbdc22240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T10:32:37.032 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:37.030+0000 7fba26d60240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T10:32:37.149 INFO:teuthology.orchestra.run.smithi187.stdout:0 2024-04-26T10:32:37.162 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 89e46a83-bfff-458f-bbac-258edb6ddad2 1 2024-04-26T10:32:37.369 INFO:teuthology.orchestra.run.smithi187.stdout:1 2024-04-26T10:32:37.381 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 24c9e06d-1386-4075-b64e-d6c1d57c57bb 2 2024-04-26T10:32:37.422 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:37.419+0000 7fba26d60240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T10:32:37.423 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:37.419+0000 7f8fbdc22240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T10:32:37.591 INFO:teuthology.orchestra.run.smithi187.stdout:2 2024-04-26T10:32:37.603 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T10:32:37.603 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T10:32:37.606 INFO:tasks.ceph.osd.0:Started 2024-04-26T10:32:37.606 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T10:32:37.607 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T10:32:37.609 INFO:tasks.ceph.osd.1:Started 2024-04-26T10:32:37.609 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T10:32:37.609 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T10:32:37.611 INFO:tasks.ceph.osd.2:Started 2024-04-26T10:32:37.612 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:32:37.825 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:37.825 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:32:37.588200+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:32:37.838 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T10:32:37.838 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T10:32:37.939 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:37.937+0000 7fba26d60240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T10:32:37.939 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:37.938+0000 7f8fbdc22240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T10:32:38.140 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T10:32:38.172 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:38.170+0000 7fba26d60240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T10:32:38.174 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:38.173+0000 7f8fbdc22240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T10:32:38.199 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:32:38.198+0000 7f62538f6800 -1 Falling back to public interface 2024-04-26T10:32:38.205 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:32:38.204+0000 7f86bcf3b800 -1 Falling back to public interface 2024-04-26T10:32:38.210 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:32:38.209+0000 7f7296592800 -1 Falling back to public interface 2024-04-26T10:32:38.348 INFO:teuthology.misc.health.smithi043.stdout: 2024-04-26T10:32:38.348 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":5,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:32:37.588200+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:32:38.360 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T10:32:38.581 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:38.579+0000 7f8fbdc22240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T10:32:38.581 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:38.580+0000 7fba26d60240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T10:32:39.304 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:39.302+0000 7fba26d60240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T10:32:39.304 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:39.302+0000 7f8fbdc22240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T10:32:39.381 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:39.380+0000 7f8fbdc22240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T10:32:39.382 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:39.380+0000 7fba26d60240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T10:32:39.525 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:39.523+0000 7fba26d60240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T10:32:39.525 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:39.524+0000 7f8fbdc22240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T10:32:39.715 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:39.712+0000 7fba26d60240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T10:32:39.715 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:39.713+0000 7f8fbdc22240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T10:32:39.793 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:39.791+0000 7fba26d60240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T10:32:39.793 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:39.791+0000 7f8fbdc22240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T10:32:39.877 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:39.875+0000 7f8fbdc22240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T10:32:39.877 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:39.875+0000 7fba26d60240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T10:32:39.959 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:39.958+0000 7fba26d60240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T10:32:39.960 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:39.958+0000 7f8fbdc22240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T10:32:40.056 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:40.055+0000 7fba26d60240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T10:32:40.057 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:40.055+0000 7f8fbdc22240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T10:32:40.279 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:40.279+0000 7fba26d60240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T10:32:40.280 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:40.279+0000 7f8fbdc22240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T10:32:40.545 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:40.544+0000 7fba26d60240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T10:32:40.545 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:40.545+0000 7f8fbdc22240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T10:32:40.725 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:40.725+0000 7fba26d60240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T10:32:40.726 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:40.725+0000 7f8fbdc22240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T10:32:40.801 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:40.800+0000 7f8fbdc22240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T10:32:40.801 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:40.800+0000 7fba26d60240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T10:32:41.525 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:41.524+0000 7fba26d60240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T10:32:41.525 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:41.524+0000 7f8fbdc22240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T10:32:41.627 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:32:41.624+0000 7f86bcf3b800 -1 osd.0 0 log_to_monitors true 2024-04-26T10:32:41.638 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:32:41.636+0000 7f62538f6800 -1 osd.2 0 log_to_monitors true 2024-04-26T10:32:41.644 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:32:41.642+0000 7f7296592800 -1 osd.1 0 log_to_monitors true 2024-04-26T10:32:41.705 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:41.704+0000 7fba26d60240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T10:32:41.706 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:41.705+0000 7f8fbdc22240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T10:32:41.876 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:41.874+0000 7fba26d60240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T10:32:41.876 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:41.875+0000 7f8fbdc22240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T10:32:42.305 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:42.304+0000 7fba26d60240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T10:32:42.305 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:42.304+0000 7f8fbdc22240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T10:32:42.478 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:42.477+0000 7fba26d60240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T10:32:42.478 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:42.477+0000 7f8fbdc22240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T10:32:42.868 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:42.868+0000 7fba26d60240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T10:32:42.869 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:42.868+0000 7f8fbdc22240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T10:32:42.976 INFO:tasks.ceph.mgr.x.smithi043.stderr:2024-04-26T10:32:42.975+0000 7fba26d60240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T10:32:42.976 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:42.976+0000 7f8fbdc22240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T10:32:43.535 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:32:43.534+0000 7f728a132700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T10:32:43.540 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:32:43.539+0000 7f86b0adb700 -1 osd.0 0 waiting for initial osdmap 2024-04-26T10:32:43.543 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:32:43.542+0000 7f6247496700 -1 osd.2 0 waiting for initial osdmap 2024-04-26T10:32:43.546 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:32:43.545+0000 7f728250d700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T10:32:43.550 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:32:43.549+0000 7f86a8eb6700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T10:32:43.562 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:32:43.561+0000 7f623f871700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T10:32:43.994 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:43.993+0000 7f8f7f011700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T10:32:43.994 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:32:43.994+0000 7f8f7f011700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T10:32:44.662 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T10:32:45.010 INFO:teuthology.misc.health.smithi043.stdout: 2024-04-26T10:32:45.011 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":8,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:32:44.545583+0000","last_up_change":"2024-04-26T10:32:44.545583+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":41771},{"type":"v1","addr":"172.21.15.112:6801","nonce":41771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":41771},{"type":"v1","addr":"172.21.15.112:6803","nonce":41771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":41771},{"type":"v1","addr":"172.21.15.112:6807","nonce":41771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":41771},{"type":"v1","addr":"172.21.15.112:6805","nonce":41771}]},"public_addr":"172.21.15.112:6801/41771","cluster_addr":"172.21.15.112:6803/41771","heartbeat_back_addr":"172.21.15.112:6807/41771","heartbeat_front_addr":"172.21.15.112:6805/41771","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:32:45.023 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-26T10:32:45.024 INFO:tasks.ceph:Creating RBD pool 2024-04-26T10:32:45.024 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T10:32:45.554 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'rbd' created 2024-04-26T10:32:45.565 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T10:32:46.557 INFO:teuthology.orchestra.run.smithi043.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T10:32:46.571 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T10:32:46.571 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T10:32:46.571 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T10:32:46.573 INFO:tasks.ceph.mds.a:Started 2024-04-26T10:32:46.573 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T10:32:46.574 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:32:46.660 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2024-04-26T10:32:46.929 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:46.929 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":10,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:32:46.548081+0000","last_up_change":"2024-04-26T10:32:44.545583+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":41771},{"type":"v1","addr":"172.21.15.112:6801","nonce":41771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":41771},{"type":"v1","addr":"172.21.15.112:6803","nonce":41771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":41771},{"type":"v1","addr":"172.21.15.112:6807","nonce":41771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":41771},{"type":"v1","addr":"172.21.15.112:6805","nonce":41771}]},"public_addr":"172.21.15.112:6801/41771","cluster_addr":"172.21.15.112:6803/41771","heartbeat_back_addr":"172.21.15.112:6807/41771","heartbeat_front_addr":"172.21.15.112:6805/41771","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:32:46.943 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:32:45.037545+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:32:45.393201+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:32:46.944 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:32:47.293 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-26T10:32:47.308 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:32:47.651 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2024-04-26T10:32:47.665 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:32:48.053 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:48.053 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.43:6803/3548002075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3548002075},{"type":"v1","addr":"172.21.15.43:6803","nonce":3548002075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-26T10:32:48.056 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 2 2024-04-26T10:32:48.067 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:32:48.404 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:48.404 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":11,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:32:47.549123+0000","last_up_change":"2024-04-26T10:32:44.545583+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":41771},{"type":"v1","addr":"172.21.15.112:6801","nonce":41771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":41771},{"type":"v1","addr":"172.21.15.112:6803","nonce":41771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":41771},{"type":"v1","addr":"172.21.15.112:6807","nonce":41771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":41771},{"type":"v1","addr":"172.21.15.112:6805","nonce":41771}]},"public_addr":"172.21.15.112:6801/41771","cluster_addr":"172.21.15.112:6803/41771","heartbeat_back_addr":"172.21.15.112:6807/41771","heartbeat_front_addr":"172.21.15.112:6805/41771","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:32:48.418 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:32:45.037545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:32:45.393201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:32:48.418 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:32:48.761 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-26T10:32:48.775 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:32:49.118 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2024-04-26T10:32:49.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T10:32:49.471 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:49.471 INFO:teuthology.orchestra.run.smithi043.stdout:[ 2024-04-26T10:32:49.471 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:32:49.471 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 1, 2024-04-26T10:32:49.471 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": ".mgr" 2024-04-26T10:32:49.471 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:32:49.471 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:32:49.471 INFO:teuthology.orchestra.run.smithi043.stdout: "poolnum": 2, 2024-04-26T10:32:49.471 INFO:teuthology.orchestra.run.smithi043.stdout: "poolname": "rbd" 2024-04-26T10:32:49.471 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:32:49.472 INFO:teuthology.orchestra.run.smithi043.stdout:] 2024-04-26T10:32:49.485 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T10:32:49.485 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T10:32:50.573 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' created 2024-04-26T10:32:50.587 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T10:32:51.579 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' created 2024-04-26T10:32:51.593 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T10:32:51.996 INFO:teuthology.orchestra.run.smithi043.stderr:new fs with metadata pool 3 and data pool 4 2024-04-26T10:32:52.008 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:32:52.459 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:52.459 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":14,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:32:51.987802+0000","last_up_change":"2024-04-26T10:32:44.545583+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:32:49.859710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:32:50.968196+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":41771},{"type":"v1","addr":"172.21.15.112:6801","nonce":41771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":41771},{"type":"v1","addr":"172.21.15.112:6803","nonce":41771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":41771},{"type":"v1","addr":"172.21.15.112:6807","nonce":41771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":41771},{"type":"v1","addr":"172.21.15.112:6805","nonce":41771}]},"public_addr":"172.21.15.112:6801/41771","cluster_addr":"172.21.15.112:6803/41771","heartbeat_back_addr":"172.21.15.112:6807/41771","heartbeat_front_addr":"172.21.15.112:6805/41771","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:32:52.473 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:32:52.817 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:52.817 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":14,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:32:51.987802+0000","last_up_change":"2024-04-26T10:32:44.545583+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:32:49.859710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:32:50.968196+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":41771},{"type":"v1","addr":"172.21.15.112:6801","nonce":41771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":41771},{"type":"v1","addr":"172.21.15.112:6803","nonce":41771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":41771},{"type":"v1","addr":"172.21.15.112:6807","nonce":41771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":41771},{"type":"v1","addr":"172.21.15.112:6805","nonce":41771}]},"public_addr":"172.21.15.112:6801/41771","cluster_addr":"172.21.15.112:6803/41771","heartbeat_back_addr":"172.21.15.112:6807/41771","heartbeat_front_addr":"172.21.15.112:6805/41771","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:32:52.832 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T10:32:54.014 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T10:32:54.014 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T10:32:55.015 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T10:32:55.016 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:32:55.404 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:55.404 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:32:51.988112+0000","modified":"2024-04-26T10:32:54.993485+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6803/3548002075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3548002075},{"type":"v1","addr":"172.21.15.43:6803","nonce":3548002075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:32:55.406 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-26T10:32:55.418 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:32:55.760 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:55.760 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":15,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:32:52.989368+0000","last_up_change":"2024-04-26T10:32:44.545583+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:32:49.859710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:32:50.968196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":41771},{"type":"v1","addr":"172.21.15.112:6801","nonce":41771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":41771},{"type":"v1","addr":"172.21.15.112:6803","nonce":41771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":41771},{"type":"v1","addr":"172.21.15.112:6807","nonce":41771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":41771},{"type":"v1","addr":"172.21.15.112:6805","nonce":41771}]},"public_addr":"172.21.15.112:6801/41771","cluster_addr":"172.21.15.112:6803/41771","heartbeat_back_addr":"172.21.15.112:6807/41771","heartbeat_front_addr":"172.21.15.112:6805/41771","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:32:55.774 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T10:32:55.774 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:32:56.119 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:56.121 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:32:56.130 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-04-26T10:32:54.984688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":83636,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283031884,"statfs":{"total":289910292480,"available":289824649216,"internally_reserved":0,"allocated":1482752,"data_stored":1263980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.417728"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:48.030967+0000","last_change":"2024-04-26T10:32:46.555353+0000","last_active":"2024-04-26T10:32:48.030967+0000","last_peered":"2024-04-26T10:32:48.030967+0000","last_clean":"2024-04-26T10:32:48.030967+0000","last_became_active":"2024-04-26T10:32:46.555005+0000","last_became_peered":"2024-04-26T10:32:46.555005+0000","last_unstale":"2024-04-26T10:32:48.030967+0000","last_undegraded":"2024-04-26T10:32:48.030967+0000","last_fullsized":"2024-04-26T10:32:48.030967+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552175+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:32:47.552175+0000","last_peered":"2024-04-26T10:32:47.552175+0000","last_clean":"2024-04-26T10:32:47.552175+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:32:47.552175+0000","last_undegraded":"2024-04-26T10:32:47.552175+0000","last_fullsized":"2024-04-26T10:32:47.552175+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:48.030941+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:32:48.030941+0000","last_peered":"2024-04-26T10:32:48.030941+0000","last_clean":"2024-04-26T10:32:48.030941+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:32:48.030941+0000","last_undegraded":"2024-04-26T10:32:48.030941+0000","last_fullsized":"2024-04-26T10:32:48.030941+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552191+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:32:47.552191+0000","last_peered":"2024-04-26T10:32:47.552191+0000","last_clean":"2024-04-26T10:32:47.552191+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:32:47.552191+0000","last_undegraded":"2024-04-26T10:32:47.552191+0000","last_fullsized":"2024-04-26T10:32:47.552191+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552202+0000","last_change":"2024-04-26T10:32:46.555694+0000","last_active":"2024-04-26T10:32:47.552202+0000","last_peered":"2024-04-26T10:32:47.552202+0000","last_clean":"2024-04-26T10:32:47.552202+0000","last_became_active":"2024-04-26T10:32:46.555391+0000","last_became_peered":"2024-04-26T10:32:46.555391+0000","last_unstale":"2024-04-26T10:32:47.552202+0000","last_undegraded":"2024-04-26T10:32:47.552202+0000","last_fullsized":"2024-04-26T10:32:47.552202+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552177+0000","last_change":"2024-04-26T10:32:46.555501+0000","last_active":"2024-04-26T10:32:47.552177+0000","last_peered":"2024-04-26T10:32:47.552177+0000","last_clean":"2024-04-26T10:32:47.552177+0000","last_became_active":"2024-04-26T10:32:46.555252+0000","last_became_peered":"2024-04-26T10:32:46.555252+0000","last_unstale":"2024-04-26T10:32:47.552177+0000","last_undegraded":"2024-04-26T10:32:47.552177+0000","last_fullsized":"2024-04-26T10:32:47.552177+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552453+0000","last_change":"2024-04-26T10:32:46.556007+0000","last_active":"2024-04-26T10:32:47.552453+0000","last_peered":"2024-04-26T10:32:47.552453+0000","last_clean":"2024-04-26T10:32:47.552453+0000","last_became_active":"2024-04-26T10:32:46.555738+0000","last_became_peered":"2024-04-26T10:32:46.555738+0000","last_unstale":"2024-04-26T10:32:47.552453+0000","last_undegraded":"2024-04-26T10:32:47.552453+0000","last_fullsized":"2024-04-26T10:32:47.552453+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:04.230186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:48.030941+0000","last_change":"2024-04-26T10:32:46.555394+0000","last_active":"2024-04-26T10:32:48.030941+0000","last_peered":"2024-04-26T10:32:48.030941+0000","last_clean":"2024-04-26T10:32:48.030941+0000","last_became_active":"2024-04-26T10:32:46.555053+0000","last_became_peered":"2024-04-26T10:32:46.555053+0000","last_unstale":"2024-04-26T10:32:48.030941+0000","last_undegraded":"2024-04-26T10:32:48.030941+0000","last_fullsized":"2024-04-26T10:32:48.030941+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552219+0000","last_change":"2024-04-26T10:32:46.555191+0000","last_active":"2024-04-26T10:32:47.552219+0000","last_peered":"2024-04-26T10:32:47.552219+0000","last_clean":"2024-04-26T10:32:47.552219+0000","last_became_active":"2024-04-26T10:32:46.554892+0000","last_became_peered":"2024-04-26T10:32:46.554892+0000","last_unstale":"2024-04-26T10:32:47.552219+0000","last_undegraded":"2024-04-26T10:32:47.552219+0000","last_fullsized":"2024-04-26T10:32:47.552219+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738370,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:32:56.135 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:32:56.515 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:56.518 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:32:56.526 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-04-26T10:32:54.984688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":83636,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283031884,"statfs":{"total":289910292480,"available":289824649216,"internally_reserved":0,"allocated":1482752,"data_stored":1263980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.417728"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:48.030967+0000","last_change":"2024-04-26T10:32:46.555353+0000","last_active":"2024-04-26T10:32:48.030967+0000","last_peered":"2024-04-26T10:32:48.030967+0000","last_clean":"2024-04-26T10:32:48.030967+0000","last_became_active":"2024-04-26T10:32:46.555005+0000","last_became_peered":"2024-04-26T10:32:46.555005+0000","last_unstale":"2024-04-26T10:32:48.030967+0000","last_undegraded":"2024-04-26T10:32:48.030967+0000","last_fullsized":"2024-04-26T10:32:48.030967+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552175+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:32:47.552175+0000","last_peered":"2024-04-26T10:32:47.552175+0000","last_clean":"2024-04-26T10:32:47.552175+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:32:47.552175+0000","last_undegraded":"2024-04-26T10:32:47.552175+0000","last_fullsized":"2024-04-26T10:32:47.552175+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:48.030941+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:32:48.030941+0000","last_peered":"2024-04-26T10:32:48.030941+0000","last_clean":"2024-04-26T10:32:48.030941+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:32:48.030941+0000","last_undegraded":"2024-04-26T10:32:48.030941+0000","last_fullsized":"2024-04-26T10:32:48.030941+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552191+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:32:47.552191+0000","last_peered":"2024-04-26T10:32:47.552191+0000","last_clean":"2024-04-26T10:32:47.552191+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:32:47.552191+0000","last_undegraded":"2024-04-26T10:32:47.552191+0000","last_fullsized":"2024-04-26T10:32:47.552191+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552202+0000","last_change":"2024-04-26T10:32:46.555694+0000","last_active":"2024-04-26T10:32:47.552202+0000","last_peered":"2024-04-26T10:32:47.552202+0000","last_clean":"2024-04-26T10:32:47.552202+0000","last_became_active":"2024-04-26T10:32:46.555391+0000","last_became_peered":"2024-04-26T10:32:46.555391+0000","last_unstale":"2024-04-26T10:32:47.552202+0000","last_undegraded":"2024-04-26T10:32:47.552202+0000","last_fullsized":"2024-04-26T10:32:47.552202+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552177+0000","last_change":"2024-04-26T10:32:46.555501+0000","last_active":"2024-04-26T10:32:47.552177+0000","last_peered":"2024-04-26T10:32:47.552177+0000","last_clean":"2024-04-26T10:32:47.552177+0000","last_became_active":"2024-04-26T10:32:46.555252+0000","last_became_peered":"2024-04-26T10:32:46.555252+0000","last_unstale":"2024-04-26T10:32:47.552177+0000","last_undegraded":"2024-04-26T10:32:47.552177+0000","last_fullsized":"2024-04-26T10:32:47.552177+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552453+0000","last_change":"2024-04-26T10:32:46.556007+0000","last_active":"2024-04-26T10:32:47.552453+0000","last_peered":"2024-04-26T10:32:47.552453+0000","last_clean":"2024-04-26T10:32:47.552453+0000","last_became_active":"2024-04-26T10:32:46.555738+0000","last_became_peered":"2024-04-26T10:32:46.555738+0000","last_unstale":"2024-04-26T10:32:47.552453+0000","last_undegraded":"2024-04-26T10:32:47.552453+0000","last_fullsized":"2024-04-26T10:32:47.552453+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:04.230186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:48.030941+0000","last_change":"2024-04-26T10:32:46.555394+0000","last_active":"2024-04-26T10:32:48.030941+0000","last_peered":"2024-04-26T10:32:48.030941+0000","last_clean":"2024-04-26T10:32:48.030941+0000","last_became_active":"2024-04-26T10:32:46.555053+0000","last_became_peered":"2024-04-26T10:32:46.555053+0000","last_unstale":"2024-04-26T10:32:48.030941+0000","last_undegraded":"2024-04-26T10:32:48.030941+0000","last_fullsized":"2024-04-26T10:32:48.030941+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552219+0000","last_change":"2024-04-26T10:32:46.555191+0000","last_active":"2024-04-26T10:32:47.552219+0000","last_peered":"2024-04-26T10:32:47.552219+0000","last_clean":"2024-04-26T10:32:47.552219+0000","last_became_active":"2024-04-26T10:32:46.554892+0000","last_became_peered":"2024-04-26T10:32:46.554892+0000","last_unstale":"2024-04-26T10:32:47.552219+0000","last_undegraded":"2024-04-26T10:32:47.552219+0000","last_fullsized":"2024-04-26T10:32:47.552219+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738370,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:32:56.532 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:32:56.681 INFO:tasks.ceph.mds.a.smithi043.stderr:2024-04-26T10:32:56.679+0000 7f122f14a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T10:32:56.909 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:56.911 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:32:56.921 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2024-04-26T10:32:54.984688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":83636,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283031884,"statfs":{"total":289910292480,"available":289824649216,"internally_reserved":0,"allocated":1482752,"data_stored":1263980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.417728"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:48.030967+0000","last_change":"2024-04-26T10:32:46.555353+0000","last_active":"2024-04-26T10:32:48.030967+0000","last_peered":"2024-04-26T10:32:48.030967+0000","last_clean":"2024-04-26T10:32:48.030967+0000","last_became_active":"2024-04-26T10:32:46.555005+0000","last_became_peered":"2024-04-26T10:32:46.555005+0000","last_unstale":"2024-04-26T10:32:48.030967+0000","last_undegraded":"2024-04-26T10:32:48.030967+0000","last_fullsized":"2024-04-26T10:32:48.030967+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552175+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:32:47.552175+0000","last_peered":"2024-04-26T10:32:47.552175+0000","last_clean":"2024-04-26T10:32:47.552175+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:32:47.552175+0000","last_undegraded":"2024-04-26T10:32:47.552175+0000","last_fullsized":"2024-04-26T10:32:47.552175+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:48.030941+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:32:48.030941+0000","last_peered":"2024-04-26T10:32:48.030941+0000","last_clean":"2024-04-26T10:32:48.030941+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:32:48.030941+0000","last_undegraded":"2024-04-26T10:32:48.030941+0000","last_fullsized":"2024-04-26T10:32:48.030941+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552191+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:32:47.552191+0000","last_peered":"2024-04-26T10:32:47.552191+0000","last_clean":"2024-04-26T10:32:47.552191+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:32:47.552191+0000","last_undegraded":"2024-04-26T10:32:47.552191+0000","last_fullsized":"2024-04-26T10:32:47.552191+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":206,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552202+0000","last_change":"2024-04-26T10:32:46.555694+0000","last_active":"2024-04-26T10:32:47.552202+0000","last_peered":"2024-04-26T10:32:47.552202+0000","last_clean":"2024-04-26T10:32:47.552202+0000","last_became_active":"2024-04-26T10:32:46.555391+0000","last_became_peered":"2024-04-26T10:32:46.555391+0000","last_unstale":"2024-04-26T10:32:47.552202+0000","last_undegraded":"2024-04-26T10:32:47.552202+0000","last_fullsized":"2024-04-26T10:32:47.552202+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552177+0000","last_change":"2024-04-26T10:32:46.555501+0000","last_active":"2024-04-26T10:32:47.552177+0000","last_peered":"2024-04-26T10:32:47.552177+0000","last_clean":"2024-04-26T10:32:47.552177+0000","last_became_active":"2024-04-26T10:32:46.555252+0000","last_became_peered":"2024-04-26T10:32:46.555252+0000","last_unstale":"2024-04-26T10:32:47.552177+0000","last_undegraded":"2024-04-26T10:32:47.552177+0000","last_fullsized":"2024-04-26T10:32:47.552177+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552453+0000","last_change":"2024-04-26T10:32:46.556007+0000","last_active":"2024-04-26T10:32:47.552453+0000","last_peered":"2024-04-26T10:32:47.552453+0000","last_clean":"2024-04-26T10:32:47.552453+0000","last_became_active":"2024-04-26T10:32:46.555738+0000","last_became_peered":"2024-04-26T10:32:46.555738+0000","last_unstale":"2024-04-26T10:32:47.552453+0000","last_undegraded":"2024-04-26T10:32:47.552453+0000","last_fullsized":"2024-04-26T10:32:47.552453+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:04.230186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:48.030941+0000","last_change":"2024-04-26T10:32:46.555394+0000","last_active":"2024-04-26T10:32:48.030941+0000","last_peered":"2024-04-26T10:32:48.030941+0000","last_clean":"2024-04-26T10:32:48.030941+0000","last_became_active":"2024-04-26T10:32:46.555053+0000","last_became_peered":"2024-04-26T10:32:46.555053+0000","last_unstale":"2024-04-26T10:32:48.030941+0000","last_undegraded":"2024-04-26T10:32:48.030941+0000","last_fullsized":"2024-04-26T10:32:48.030941+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-26T10:32:47.552219+0000","last_change":"2024-04-26T10:32:46.555191+0000","last_active":"2024-04-26T10:32:47.552219+0000","last_peered":"2024-04-26T10:32:47.552219+0000","last_clean":"2024-04-26T10:32:47.552219+0000","last_became_active":"2024-04-26T10:32:46.554892+0000","last_became_peered":"2024-04-26T10:32:46.554892+0000","last_unstale":"2024-04-26T10:32:47.552219+0000","last_undegraded":"2024-04-26T10:32:47.552219+0000","last_fullsized":"2024-04-26T10:32:47.552219+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:50.561227+0000","last_change":"2024-04-26T10:32:50.561227+0000","last_active":"2024-04-26T10:32:50.561227+0000","last_peered":"2024-04-26T10:32:50.561227+0000","last_clean":"2024-04-26T10:32:50.561227+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:50.561227+0000","last_undegraded":"2024-04-26T10:32:50.561227+0000","last_fullsized":"2024-04-26T10:32:50.561227+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:32:51.566457+0000","last_change":"2024-04-26T10:32:51.566457+0000","last_active":"2024-04-26T10:32:51.566457+0000","last_peered":"2024-04-26T10:32:51.566457+0000","last_clean":"2024-04-26T10:32:51.566457+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:32:51.566457+0000","last_undegraded":"2024-04-26T10:32:51.566457+0000","last_fullsized":"2024-04-26T10:32:51.566457+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":98304,"data_stored":27748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28320,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343520,"statfs":{"total":96636764160,"available":96607764480,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738370,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28200,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343640,"statfs":{"total":96636764160,"available":96607887360,"internally_reserved":0,"allocated":692224,"data_stored":618116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:32:56.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-26T10:32:56.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-26T10:32:56.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-26T10:32:56.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-26T10:32:56.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-26T10:32:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-26T10:32:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-26T10:32:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-26T10:32:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-26T10:32:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-26T10:32:56.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-26T10:32:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-26T10:32:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-26T10:32:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-26T10:32:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-26T10:32:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-26T10:32:56.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-26T10:32:56.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-26T10:32:56.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-26T10:32:56.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-26T10:32:56.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-26T10:32:56.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-26T10:32:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-26T10:32:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-26T10:32:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-26T10:32:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-26T10:32:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-26T10:32:56.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-26T10:32:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-26T10:32:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-26T10:32:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-26T10:32:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-26T10:32:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-26T10:32:56.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-26T10:32:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-26T10:32:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-26T10:32:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-26T10:32:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-26T10:32:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-26T10:32:56.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-26T10:32:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-26T10:32:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-26T10:32:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-26T10:32:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-26T10:32:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-26T10:32:56.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-26T10:32:56.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-26T10:32:56.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-26T10:32:56.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-26T10:32:56.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-26T10:32:56.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-26T10:32:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-26T10:32:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-26T10:32:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-26T10:32:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-26T10:32:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-26T10:32:56.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-26T10:32:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-26T10:32:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-26T10:32:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-26T10:32:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-26T10:32:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-26T10:32:56.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-26T10:32:56.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-26T10:32:56.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-26T10:32:56.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-26T10:32:56.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-26T10:32:56.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-26T10:32:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-26T10:32:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-26T10:32:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-26T10:32:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-26T10:32:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-26T10:32:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-26T10:32:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-26T10:32:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-26T10:32:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-26T10:32:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-26T10:32:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-26T10:32:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-26T10:32:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-26T10:32:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-26T10:32:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-26T10:32:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-26T10:32:56.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-26T10:32:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-26T10:32:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-26T10:32:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-26T10:32:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-26T10:32:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-26T10:32:56.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:50.561227+0000', 'last_change': '2024-04-26T10:32:50.561227+0000', 'last_active': '2024-04-26T10:32:50.561227+0000', 'last_peered': '2024-04-26T10:32:50.561227+0000', 'last_clean': '2024-04-26T10:32:50.561227+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:50.561227+0000', 'last_undegraded': '2024-04-26T10:32:50.561227+0000', 'last_fullsized': '2024-04-26T10:32:50.561227+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:50.561227+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-26T10:32:56.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-26T10:32:56.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-26T10:32:56.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-26T10:32:56.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-26T10:32:56.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-26T10:32:56.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T10:32:51.566457+0000', 'last_change': '2024-04-26T10:32:51.566457+0000', 'last_active': '2024-04-26T10:32:51.566457+0000', 'last_peered': '2024-04-26T10:32:51.566457+0000', 'last_clean': '2024-04-26T10:32:51.566457+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T10:32:51.566457+0000', 'last_undegraded': '2024-04-26T10:32:51.566457+0000', 'last_fullsized': '2024-04-26T10:32:51.566457+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'last_clean_scrub_stamp': '2024-04-26T10:32:51.566457+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T10:32:56.943 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T10:32:57.385 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:57.385 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":20,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":15,"num_osds":3,"num_up_osds":3,"osd_up_since":1714127564,"num_in_osds":3,"osd_in_since":1714127557,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":84668416,"bytes_avail":289825624064,"bytes_total":289910292480,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4186}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-26T10:32:36.652868+0000","services":{}},"progress_events":{}} 2024-04-26T10:32:57.399 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T10:32:57.399 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:32:57.742 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:32:57.744 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:32:57.753 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-26T10:32:56.985044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82684,"kb_used_data":1600,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032836,"statfs":{"total":289910292480,"available":289825624064,"internally_reserved":0,"allocated":1638400,"data_stored":1318998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001155"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996155+0000","last_change":"2024-04-26T10:32:51.998840+0000","last_active":"2024-04-26T10:32:52.996155+0000","last_peered":"2024-04-26T10:32:52.996155+0000","last_clean":"2024-04-26T10:32:52.996155+0000","last_became_active":"2024-04-26T10:32:51.998236+0000","last_became_peered":"2024-04-26T10:32:51.998236+0000","last_unstale":"2024-04-26T10:32:52.996155+0000","last_undegraded":"2024-04-26T10:32:52.996155+0000","last_fullsized":"2024-04-26T10:32:52.996155+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995759+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:32:52.995759+0000","last_peered":"2024-04-26T10:32:52.995759+0000","last_clean":"2024-04-26T10:32:52.995759+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:32:52.995759+0000","last_undegraded":"2024-04-26T10:32:52.995759+0000","last_fullsized":"2024-04-26T10:32:52.995759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996256+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:32:52.996256+0000","last_peered":"2024-04-26T10:32:52.996256+0000","last_clean":"2024-04-26T10:32:52.996256+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:32:52.996256+0000","last_undegraded":"2024-04-26T10:32:52.996256+0000","last_fullsized":"2024-04-26T10:32:52.996256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996029+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:32:52.996029+0000","last_peered":"2024-04-26T10:32:52.996029+0000","last_clean":"2024-04-26T10:32:52.996029+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:32:52.996029+0000","last_undegraded":"2024-04-26T10:32:52.996029+0000","last_fullsized":"2024-04-26T10:32:52.996029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995460+0000","last_change":"2024-04-26T10:32:51.999420+0000","last_active":"2024-04-26T10:32:52.995460+0000","last_peered":"2024-04-26T10:32:52.995460+0000","last_clean":"2024-04-26T10:32:52.995460+0000","last_became_active":"2024-04-26T10:32:51.999046+0000","last_became_peered":"2024-04-26T10:32:51.999046+0000","last_unstale":"2024-04-26T10:32:52.995460+0000","last_undegraded":"2024-04-26T10:32:52.995460+0000","last_fullsized":"2024-04-26T10:32:52.995460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:10.442986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995344+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:32:52.995344+0000","last_peered":"2024-04-26T10:32:52.995344+0000","last_clean":"2024-04-26T10:32:52.995344+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:32:52.995344+0000","last_undegraded":"2024-04-26T10:32:52.995344+0000","last_fullsized":"2024-04-26T10:32:52.995344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995441+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:32:52.995441+0000","last_peered":"2024-04-26T10:32:52.995441+0000","last_clean":"2024-04-26T10:32:52.995441+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:32:52.995441+0000","last_undegraded":"2024-04-26T10:32:52.995441+0000","last_fullsized":"2024-04-26T10:32:52.995441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995369+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:32:52.995369+0000","last_peered":"2024-04-26T10:32:52.995369+0000","last_clean":"2024-04-26T10:32:52.995369+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:32:52.995369+0000","last_undegraded":"2024-04-26T10:32:52.995369+0000","last_fullsized":"2024-04-26T10:32:52.995369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698360+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:32:54.698360+0000","last_peered":"2024-04-26T10:32:54.698360+0000","last_clean":"2024-04-26T10:32:54.698360+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:32:54.698360+0000","last_undegraded":"2024-04-26T10:32:54.698360+0000","last_fullsized":"2024-04-26T10:32:54.698360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995967+0000","last_change":"2024-04-26T10:32:52.000612+0000","last_active":"2024-04-26T10:32:52.995967+0000","last_peered":"2024-04-26T10:32:52.995967+0000","last_clean":"2024-04-26T10:32:52.995967+0000","last_became_active":"2024-04-26T10:32:51.998958+0000","last_became_peered":"2024-04-26T10:32:51.998958+0000","last_unstale":"2024-04-26T10:32:52.995967+0000","last_undegraded":"2024-04-26T10:32:52.995967+0000","last_fullsized":"2024-04-26T10:32:52.995967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996112+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:32:52.996112+0000","last_peered":"2024-04-26T10:32:52.996112+0000","last_clean":"2024-04-26T10:32:52.996112+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:32:52.996112+0000","last_undegraded":"2024-04-26T10:32:52.996112+0000","last_fullsized":"2024-04-26T10:32:52.996112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995621+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:32:52.995621+0000","last_peered":"2024-04-26T10:32:52.995621+0000","last_clean":"2024-04-26T10:32:52.995621+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:32:52.995621+0000","last_undegraded":"2024-04-26T10:32:52.995621+0000","last_fullsized":"2024-04-26T10:32:52.995621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995312+0000","last_change":"2024-04-26T10:32:52.000261+0000","last_active":"2024-04-26T10:32:52.995312+0000","last_peered":"2024-04-26T10:32:52.995312+0000","last_clean":"2024-04-26T10:32:52.995312+0000","last_became_active":"2024-04-26T10:32:51.999284+0000","last_became_peered":"2024-04-26T10:32:51.999284+0000","last_unstale":"2024-04-26T10:32:52.995312+0000","last_undegraded":"2024-04-26T10:32:52.995312+0000","last_fullsized":"2024-04-26T10:32:52.995312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995910+0000","last_change":"2024-04-26T10:32:52.003123+0000","last_active":"2024-04-26T10:32:52.995910+0000","last_peered":"2024-04-26T10:32:52.995910+0000","last_clean":"2024-04-26T10:32:52.995910+0000","last_became_active":"2024-04-26T10:32:52.001353+0000","last_became_peered":"2024-04-26T10:32:52.001353+0000","last_unstale":"2024-04-26T10:32:52.995910+0000","last_undegraded":"2024-04-26T10:32:52.995910+0000","last_fullsized":"2024-04-26T10:32:52.995910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:59:49.869670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995298+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:32:52.995298+0000","last_peered":"2024-04-26T10:32:52.995298+0000","last_clean":"2024-04-26T10:32:52.995298+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:32:52.995298+0000","last_undegraded":"2024-04-26T10:32:52.995298+0000","last_fullsized":"2024-04-26T10:32:52.995298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995391+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:32:52.995391+0000","last_peered":"2024-04-26T10:32:52.995391+0000","last_clean":"2024-04-26T10:32:52.995391+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:32:52.995391+0000","last_undegraded":"2024-04-26T10:32:52.995391+0000","last_fullsized":"2024-04-26T10:32:52.995391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698457+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:32:54.698457+0000","last_peered":"2024-04-26T10:32:54.698457+0000","last_clean":"2024-04-26T10:32:54.698457+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:32:54.698457+0000","last_undegraded":"2024-04-26T10:32:54.698457+0000","last_fullsized":"2024-04-26T10:32:54.698457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996082+0000","last_change":"2024-04-26T10:32:52.000693+0000","last_active":"2024-04-26T10:32:52.996082+0000","last_peered":"2024-04-26T10:32:52.996082+0000","last_clean":"2024-04-26T10:32:52.996082+0000","last_became_active":"2024-04-26T10:32:51.999406+0000","last_became_peered":"2024-04-26T10:32:51.999406+0000","last_unstale":"2024-04-26T10:32:52.996082+0000","last_undegraded":"2024-04-26T10:32:52.996082+0000","last_fullsized":"2024-04-26T10:32:52.996082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698211+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:32:54.698211+0000","last_peered":"2024-04-26T10:32:54.698211+0000","last_clean":"2024-04-26T10:32:54.698211+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:32:54.698211+0000","last_undegraded":"2024-04-26T10:32:54.698211+0000","last_fullsized":"2024-04-26T10:32:54.698211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996035+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:32:52.996035+0000","last_peered":"2024-04-26T10:32:52.996035+0000","last_clean":"2024-04-26T10:32:52.996035+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:32:52.996035+0000","last_undegraded":"2024-04-26T10:32:52.996035+0000","last_fullsized":"2024-04-26T10:32:52.996035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995635+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:32:52.995635+0000","last_peered":"2024-04-26T10:32:52.995635+0000","last_clean":"2024-04-26T10:32:52.995635+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:32:52.995635+0000","last_undegraded":"2024-04-26T10:32:52.995635+0000","last_fullsized":"2024-04-26T10:32:52.995635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995342+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:32:52.995342+0000","last_peered":"2024-04-26T10:32:52.995342+0000","last_clean":"2024-04-26T10:32:52.995342+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:32:52.995342+0000","last_undegraded":"2024-04-26T10:32:52.995342+0000","last_fullsized":"2024-04-26T10:32:52.995342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697661+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:32:54.697661+0000","last_peered":"2024-04-26T10:32:54.697661+0000","last_clean":"2024-04-26T10:32:54.697661+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:32:54.697661+0000","last_undegraded":"2024-04-26T10:32:54.697661+0000","last_fullsized":"2024-04-26T10:32:54.697661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995428+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:32:52.995428+0000","last_peered":"2024-04-26T10:32:52.995428+0000","last_clean":"2024-04-26T10:32:52.995428+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:32:52.995428+0000","last_undegraded":"2024-04-26T10:32:52.995428+0000","last_fullsized":"2024-04-26T10:32:52.995428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996100+0000","last_change":"2024-04-26T10:32:52.004089+0000","last_active":"2024-04-26T10:32:52.996100+0000","last_peered":"2024-04-26T10:32:52.996100+0000","last_clean":"2024-04-26T10:32:52.996100+0000","last_became_active":"2024-04-26T10:32:52.003802+0000","last_became_peered":"2024-04-26T10:32:52.003802+0000","last_unstale":"2024-04-26T10:32:52.996100+0000","last_undegraded":"2024-04-26T10:32:52.996100+0000","last_fullsized":"2024-04-26T10:32:52.996100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698384+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:32:54.698384+0000","last_peered":"2024-04-26T10:32:54.698384+0000","last_clean":"2024-04-26T10:32:54.698384+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:32:54.698384+0000","last_undegraded":"2024-04-26T10:32:54.698384+0000","last_fullsized":"2024-04-26T10:32:54.698384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996122+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:32:52.996122+0000","last_peered":"2024-04-26T10:32:52.996122+0000","last_clean":"2024-04-26T10:32:52.996122+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:32:52.996122+0000","last_undegraded":"2024-04-26T10:32:52.996122+0000","last_fullsized":"2024-04-26T10:32:52.996122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995270+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:32:52.995270+0000","last_peered":"2024-04-26T10:32:52.995270+0000","last_clean":"2024-04-26T10:32:52.995270+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:32:52.995270+0000","last_undegraded":"2024-04-26T10:32:52.995270+0000","last_fullsized":"2024-04-26T10:32:52.995270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996297+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:32:52.996297+0000","last_peered":"2024-04-26T10:32:52.996297+0000","last_clean":"2024-04-26T10:32:52.996297+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:32:52.996297+0000","last_undegraded":"2024-04-26T10:32:52.996297+0000","last_fullsized":"2024-04-26T10:32:52.996297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697734+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:32:54.697734+0000","last_peered":"2024-04-26T10:32:54.697734+0000","last_clean":"2024-04-26T10:32:54.697734+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:32:54.697734+0000","last_undegraded":"2024-04-26T10:32:54.697734+0000","last_fullsized":"2024-04-26T10:32:54.697734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698491+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:32:54.698491+0000","last_peered":"2024-04-26T10:32:54.698491+0000","last_clean":"2024-04-26T10:32:54.698491+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:32:54.698491+0000","last_undegraded":"2024-04-26T10:32:54.698491+0000","last_fullsized":"2024-04-26T10:32:54.698491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697582+0000","last_change":"2024-04-26T10:32:51.588353+0000","last_active":"2024-04-26T10:32:54.697582+0000","last_peered":"2024-04-26T10:32:54.697582+0000","last_clean":"2024-04-26T10:32:54.697582+0000","last_became_active":"2024-04-26T10:32:51.587981+0000","last_became_peered":"2024-04-26T10:32:51.587981+0000","last_unstale":"2024-04-26T10:32:54.697582+0000","last_undegraded":"2024-04-26T10:32:54.697582+0000","last_fullsized":"2024-04-26T10:32:54.697582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:20.810803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996039+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:32:52.996039+0000","last_peered":"2024-04-26T10:32:52.996039+0000","last_clean":"2024-04-26T10:32:52.996039+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:32:52.996039+0000","last_undegraded":"2024-04-26T10:32:52.996039+0000","last_fullsized":"2024-04-26T10:32:52.996039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698553+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:32:54.698553+0000","last_peered":"2024-04-26T10:32:54.698553+0000","last_clean":"2024-04-26T10:32:54.698553+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:32:54.698553+0000","last_undegraded":"2024-04-26T10:32:54.698553+0000","last_fullsized":"2024-04-26T10:32:54.698553+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697438+0000","last_change":"2024-04-26T10:32:52.008030+0000","last_active":"2024-04-26T10:32:54.697438+0000","last_peered":"2024-04-26T10:32:54.697438+0000","last_clean":"2024-04-26T10:32:54.697438+0000","last_became_active":"2024-04-26T10:32:52.007158+0000","last_became_peered":"2024-04-26T10:32:52.007158+0000","last_unstale":"2024-04-26T10:32:54.697438+0000","last_undegraded":"2024-04-26T10:32:54.697438+0000","last_fullsized":"2024-04-26T10:32:54.697438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996258+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:32:52.996258+0000","last_peered":"2024-04-26T10:32:52.996258+0000","last_clean":"2024-04-26T10:32:52.996258+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:32:52.996258+0000","last_undegraded":"2024-04-26T10:32:52.996258+0000","last_fullsized":"2024-04-26T10:32:52.996258+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697790+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:32:54.697790+0000","last_peered":"2024-04-26T10:32:54.697790+0000","last_clean":"2024-04-26T10:32:54.697790+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:32:54.697790+0000","last_undegraded":"2024-04-26T10:32:54.697790+0000","last_fullsized":"2024-04-26T10:32:54.697790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996094+0000","last_change":"2024-04-26T10:32:51.586732+0000","last_active":"2024-04-26T10:32:52.996094+0000","last_peered":"2024-04-26T10:32:52.996094+0000","last_clean":"2024-04-26T10:32:52.996094+0000","last_became_active":"2024-04-26T10:32:51.586533+0000","last_became_peered":"2024-04-26T10:32:51.586533+0000","last_unstale":"2024-04-26T10:32:52.996094+0000","last_undegraded":"2024-04-26T10:32:52.996094+0000","last_fullsized":"2024-04-26T10:32:52.996094+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697696+0000","last_change":"2024-04-26T10:32:52.007650+0000","last_active":"2024-04-26T10:32:54.697696+0000","last_peered":"2024-04-26T10:32:54.697696+0000","last_clean":"2024-04-26T10:32:54.697696+0000","last_became_active":"2024-04-26T10:32:52.007261+0000","last_became_peered":"2024-04-26T10:32:52.007261+0000","last_unstale":"2024-04-26T10:32:54.697696+0000","last_undegraded":"2024-04-26T10:32:54.697696+0000","last_fullsized":"2024-04-26T10:32:54.697696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995900+0000","last_change":"2024-04-26T10:32:51.584497+0000","last_active":"2024-04-26T10:32:52.995900+0000","last_peered":"2024-04-26T10:32:52.995900+0000","last_clean":"2024-04-26T10:32:52.995900+0000","last_became_active":"2024-04-26T10:32:51.583460+0000","last_became_peered":"2024-04-26T10:32:51.583460+0000","last_unstale":"2024-04-26T10:32:52.995900+0000","last_undegraded":"2024-04-26T10:32:52.995900+0000","last_fullsized":"2024-04-26T10:32:52.995900+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995887+0000","last_change":"2024-04-26T10:32:52.001738+0000","last_active":"2024-04-26T10:32:52.995887+0000","last_peered":"2024-04-26T10:32:52.995887+0000","last_clean":"2024-04-26T10:32:52.995887+0000","last_became_active":"2024-04-26T10:32:51.999263+0000","last_became_peered":"2024-04-26T10:32:51.999263+0000","last_unstale":"2024-04-26T10:32:52.995887+0000","last_undegraded":"2024-04-26T10:32:52.995887+0000","last_fullsized":"2024-04-26T10:32:52.995887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:14.966669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995874+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:32:52.995874+0000","last_peered":"2024-04-26T10:32:52.995874+0000","last_clean":"2024-04-26T10:32:52.995874+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:32:52.995874+0000","last_undegraded":"2024-04-26T10:32:52.995874+0000","last_fullsized":"2024-04-26T10:32:52.995874+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995839+0000","last_change":"2024-04-26T10:32:52.000043+0000","last_active":"2024-04-26T10:32:52.995839+0000","last_peered":"2024-04-26T10:32:52.995839+0000","last_clean":"2024-04-26T10:32:52.995839+0000","last_became_active":"2024-04-26T10:32:51.999069+0000","last_became_peered":"2024-04-26T10:32:51.999069+0000","last_unstale":"2024-04-26T10:32:52.995839+0000","last_undegraded":"2024-04-26T10:32:52.995839+0000","last_fullsized":"2024-04-26T10:32:52.995839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697777+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:32:54.697777+0000","last_peered":"2024-04-26T10:32:54.697777+0000","last_clean":"2024-04-26T10:32:54.697777+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:32:54.697777+0000","last_undegraded":"2024-04-26T10:32:54.697777+0000","last_fullsized":"2024-04-26T10:32:54.697777+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996289+0000","last_change":"2024-04-26T10:32:52.000628+0000","last_active":"2024-04-26T10:32:52.996289+0000","last_peered":"2024-04-26T10:32:52.996289+0000","last_clean":"2024-04-26T10:32:52.996289+0000","last_became_active":"2024-04-26T10:32:51.998121+0000","last_became_peered":"2024-04-26T10:32:51.998121+0000","last_unstale":"2024-04-26T10:32:52.996289+0000","last_undegraded":"2024-04-26T10:32:52.996289+0000","last_fullsized":"2024-04-26T10:32:52.996289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.293526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995394+0000","last_change":"2024-04-26T10:32:51.584210+0000","last_active":"2024-04-26T10:32:52.995394+0000","last_peered":"2024-04-26T10:32:52.995394+0000","last_clean":"2024-04-26T10:32:52.995394+0000","last_became_active":"2024-04-26T10:32:51.583823+0000","last_became_peered":"2024-04-26T10:32:51.583823+0000","last_unstale":"2024-04-26T10:32:52.995394+0000","last_undegraded":"2024-04-26T10:32:52.995394+0000","last_fullsized":"2024-04-26T10:32:52.995394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.121333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698492+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:32:54.698492+0000","last_peered":"2024-04-26T10:32:54.698492+0000","last_clean":"2024-04-26T10:32:54.698492+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:32:54.698492+0000","last_undegraded":"2024-04-26T10:32:54.698492+0000","last_fullsized":"2024-04-26T10:32:54.698492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995640+0000","last_change":"2024-04-26T10:32:51.584088+0000","last_active":"2024-04-26T10:32:52.995640+0000","last_peered":"2024-04-26T10:32:52.995640+0000","last_clean":"2024-04-26T10:32:52.995640+0000","last_became_active":"2024-04-26T10:32:51.583020+0000","last_became_peered":"2024-04-26T10:32:51.583020+0000","last_unstale":"2024-04-26T10:32:52.995640+0000","last_undegraded":"2024-04-26T10:32:52.995640+0000","last_fullsized":"2024-04-26T10:32:52.995640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698660+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:32:54.698660+0000","last_peered":"2024-04-26T10:32:54.698660+0000","last_clean":"2024-04-26T10:32:54.698660+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:32:54.698660+0000","last_undegraded":"2024-04-26T10:32:54.698660+0000","last_fullsized":"2024-04-26T10:32:54.698660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996288+0000","last_change":"2024-04-26T10:32:51.583791+0000","last_active":"2024-04-26T10:32:52.996288+0000","last_peered":"2024-04-26T10:32:52.996288+0000","last_clean":"2024-04-26T10:32:52.996288+0000","last_became_active":"2024-04-26T10:32:51.583103+0000","last_became_peered":"2024-04-26T10:32:51.583103+0000","last_unstale":"2024-04-26T10:32:52.996288+0000","last_undegraded":"2024-04-26T10:32:52.996288+0000","last_fullsized":"2024-04-26T10:32:52.996288+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.994938+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:32:52.994938+0000","last_peered":"2024-04-26T10:32:52.994938+0000","last_clean":"2024-04-26T10:32:52.994938+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:32:52.994938+0000","last_undegraded":"2024-04-26T10:32:52.994938+0000","last_fullsized":"2024-04-26T10:32:52.994938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995812+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:32:52.995812+0000","last_peered":"2024-04-26T10:32:52.995812+0000","last_clean":"2024-04-26T10:32:52.995812+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:32:52.995812+0000","last_undegraded":"2024-04-26T10:32:52.995812+0000","last_fullsized":"2024-04-26T10:32:52.995812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995440+0000","last_change":"2024-04-26T10:32:51.997516+0000","last_active":"2024-04-26T10:32:52.995440+0000","last_peered":"2024-04-26T10:32:52.995440+0000","last_clean":"2024-04-26T10:32:52.995440+0000","last_became_active":"2024-04-26T10:32:51.996896+0000","last_became_peered":"2024-04-26T10:32:51.996896+0000","last_unstale":"2024-04-26T10:32:52.995440+0000","last_undegraded":"2024-04-26T10:32:52.995440+0000","last_fullsized":"2024-04-26T10:32:52.995440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:51.552418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996431+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:32:52.996431+0000","last_peered":"2024-04-26T10:32:52.996431+0000","last_clean":"2024-04-26T10:32:52.996431+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:32:52.996431+0000","last_undegraded":"2024-04-26T10:32:52.996431+0000","last_fullsized":"2024-04-26T10:32:52.996431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995565+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:32:52.995565+0000","last_peered":"2024-04-26T10:32:52.995565+0000","last_clean":"2024-04-26T10:32:52.995565+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:32:52.995565+0000","last_undegraded":"2024-04-26T10:32:52.995565+0000","last_fullsized":"2024-04-26T10:32:52.995565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995674+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:32:52.995674+0000","last_peered":"2024-04-26T10:32:52.995674+0000","last_clean":"2024-04-26T10:32:52.995674+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:32:52.995674+0000","last_undegraded":"2024-04-26T10:32:52.995674+0000","last_fullsized":"2024-04-26T10:32:52.995674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697950+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:32:54.697950+0000","last_peered":"2024-04-26T10:32:54.697950+0000","last_clean":"2024-04-26T10:32:54.697950+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:32:54.697950+0000","last_undegraded":"2024-04-26T10:32:54.697950+0000","last_fullsized":"2024-04-26T10:32:54.697950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697966+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:32:54.697966+0000","last_peered":"2024-04-26T10:32:54.697966+0000","last_clean":"2024-04-26T10:32:54.697966+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:32:54.697966+0000","last_undegraded":"2024-04-26T10:32:54.697966+0000","last_fullsized":"2024-04-26T10:32:54.697966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995743+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:32:52.995743+0000","last_peered":"2024-04-26T10:32:52.995743+0000","last_clean":"2024-04-26T10:32:52.995743+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:32:52.995743+0000","last_undegraded":"2024-04-26T10:32:52.995743+0000","last_fullsized":"2024-04-26T10:32:52.995743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995417+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:32:52.995417+0000","last_peered":"2024-04-26T10:32:52.995417+0000","last_clean":"2024-04-26T10:32:52.995417+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:32:52.995417+0000","last_undegraded":"2024-04-26T10:32:52.995417+0000","last_fullsized":"2024-04-26T10:32:52.995417+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996362+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:32:52.996362+0000","last_peered":"2024-04-26T10:32:52.996362+0000","last_clean":"2024-04-26T10:32:52.996362+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:32:52.996362+0000","last_undegraded":"2024-04-26T10:32:52.996362+0000","last_fullsized":"2024-04-26T10:32:52.996362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995012+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:32:52.995012+0000","last_peered":"2024-04-26T10:32:52.995012+0000","last_clean":"2024-04-26T10:32:52.995012+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:32:52.995012+0000","last_undegraded":"2024-04-26T10:32:52.995012+0000","last_fullsized":"2024-04-26T10:32:52.995012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996322+0000","last_change":"2024-04-26T10:32:52.004444+0000","last_active":"2024-04-26T10:32:52.996322+0000","last_peered":"2024-04-26T10:32:52.996322+0000","last_clean":"2024-04-26T10:32:52.996322+0000","last_became_active":"2024-04-26T10:32:52.003360+0000","last_became_peered":"2024-04-26T10:32:52.003360+0000","last_unstale":"2024-04-26T10:32:52.996322+0000","last_undegraded":"2024-04-26T10:32:52.996322+0000","last_fullsized":"2024-04-26T10:32:52.996322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:20.180213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995117+0000","last_change":"2024-04-26T10:32:51.584385+0000","last_active":"2024-04-26T10:32:52.995117+0000","last_peered":"2024-04-26T10:32:52.995117+0000","last_clean":"2024-04-26T10:32:52.995117+0000","last_became_active":"2024-04-26T10:32:51.584025+0000","last_became_peered":"2024-04-26T10:32:51.584025+0000","last_unstale":"2024-04-26T10:32:52.995117+0000","last_undegraded":"2024-04-26T10:32:52.995117+0000","last_fullsized":"2024-04-26T10:32:52.995117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:57.247011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698499+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:32:54.698499+0000","last_peered":"2024-04-26T10:32:54.698499+0000","last_clean":"2024-04-26T10:32:54.698499+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:32:54.698499+0000","last_undegraded":"2024-04-26T10:32:54.698499+0000","last_fullsized":"2024-04-26T10:32:54.698499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.999504+0000","last_change":"2024-04-26T10:32:46.555353+0000","last_active":"2024-04-26T10:32:51.999504+0000","last_peered":"2024-04-26T10:32:51.999504+0000","last_clean":"2024-04-26T10:32:51.999504+0000","last_became_active":"2024-04-26T10:32:46.555005+0000","last_became_peered":"2024-04-26T10:32:46.555005+0000","last_unstale":"2024-04-26T10:32:51.999504+0000","last_undegraded":"2024-04-26T10:32:51.999504+0000","last_fullsized":"2024-04-26T10:32:51.999504+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996229+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:32:52.996229+0000","last_peered":"2024-04-26T10:32:52.996229+0000","last_clean":"2024-04-26T10:32:52.996229+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:32:52.996229+0000","last_undegraded":"2024-04-26T10:32:52.996229+0000","last_fullsized":"2024-04-26T10:32:52.996229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995425+0000","last_change":"2024-04-26T10:32:52.004199+0000","last_active":"2024-04-26T10:32:52.995425+0000","last_peered":"2024-04-26T10:32:52.995425+0000","last_clean":"2024-04-26T10:32:52.995425+0000","last_became_active":"2024-04-26T10:32:52.003894+0000","last_became_peered":"2024-04-26T10:32:52.003894+0000","last_unstale":"2024-04-26T10:32:52.995425+0000","last_undegraded":"2024-04-26T10:32:52.995425+0000","last_fullsized":"2024-04-26T10:32:52.995425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.000379+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:32:52.000379+0000","last_peered":"2024-04-26T10:32:52.000379+0000","last_clean":"2024-04-26T10:32:52.000379+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:32:52.000379+0000","last_undegraded":"2024-04-26T10:32:52.000379+0000","last_fullsized":"2024-04-26T10:32:52.000379+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995781+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:32:52.995781+0000","last_peered":"2024-04-26T10:32:52.995781+0000","last_clean":"2024-04-26T10:32:52.995781+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:32:52.995781+0000","last_undegraded":"2024-04-26T10:32:52.995781+0000","last_fullsized":"2024-04-26T10:32:52.995781+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698151+0000","last_change":"2024-04-26T10:32:52.007589+0000","last_active":"2024-04-26T10:32:54.698151+0000","last_peered":"2024-04-26T10:32:54.698151+0000","last_clean":"2024-04-26T10:32:54.698151+0000","last_became_active":"2024-04-26T10:32:52.007289+0000","last_became_peered":"2024-04-26T10:32:52.007289+0000","last_unstale":"2024-04-26T10:32:54.698151+0000","last_undegraded":"2024-04-26T10:32:54.698151+0000","last_fullsized":"2024-04-26T10:32:54.698151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.998883+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:32:51.998883+0000","last_peered":"2024-04-26T10:32:51.998883+0000","last_clean":"2024-04-26T10:32:51.998883+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:32:51.998883+0000","last_undegraded":"2024-04-26T10:32:51.998883+0000","last_fullsized":"2024-04-26T10:32:51.998883+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995047+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:32:52.995047+0000","last_peered":"2024-04-26T10:32:52.995047+0000","last_clean":"2024-04-26T10:32:52.995047+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:32:52.995047+0000","last_undegraded":"2024-04-26T10:32:52.995047+0000","last_fullsized":"2024-04-26T10:32:52.995047+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698612+0000","last_change":"2024-04-26T10:32:52.009270+0000","last_active":"2024-04-26T10:32:54.698612+0000","last_peered":"2024-04-26T10:32:54.698612+0000","last_clean":"2024-04-26T10:32:54.698612+0000","last_became_active":"2024-04-26T10:32:52.008599+0000","last_became_peered":"2024-04-26T10:32:52.008599+0000","last_unstale":"2024-04-26T10:32:54.698612+0000","last_undegraded":"2024-04-26T10:32:54.698612+0000","last_fullsized":"2024-04-26T10:32:54.698612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.000550+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:32:52.000550+0000","last_peered":"2024-04-26T10:32:52.000550+0000","last_clean":"2024-04-26T10:32:52.000550+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:32:52.000550+0000","last_undegraded":"2024-04-26T10:32:52.000550+0000","last_fullsized":"2024-04-26T10:32:52.000550+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.997944+0000","last_change":"2024-04-26T10:32:46.555694+0000","last_active":"2024-04-26T10:32:51.997944+0000","last_peered":"2024-04-26T10:32:51.997944+0000","last_clean":"2024-04-26T10:32:51.997944+0000","last_became_active":"2024-04-26T10:32:46.555391+0000","last_became_peered":"2024-04-26T10:32:46.555391+0000","last_unstale":"2024-04-26T10:32:51.997944+0000","last_undegraded":"2024-04-26T10:32:51.997944+0000","last_fullsized":"2024-04-26T10:32:51.997944+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697661+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:32:54.697661+0000","last_peered":"2024-04-26T10:32:54.697661+0000","last_clean":"2024-04-26T10:32:54.697661+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:32:54.697661+0000","last_undegraded":"2024-04-26T10:32:54.697661+0000","last_fullsized":"2024-04-26T10:32:54.697661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996350+0000","last_change":"2024-04-26T10:32:52.006765+0000","last_active":"2024-04-26T10:32:52.996350+0000","last_peered":"2024-04-26T10:32:52.996350+0000","last_clean":"2024-04-26T10:32:52.996350+0000","last_became_active":"2024-04-26T10:32:52.004110+0000","last_became_peered":"2024-04-26T10:32:52.004110+0000","last_unstale":"2024-04-26T10:32:52.996350+0000","last_undegraded":"2024-04-26T10:32:52.996350+0000","last_fullsized":"2024-04-26T10:32:52.996350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:47.156703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.998516+0000","last_change":"2024-04-26T10:32:46.555501+0000","last_active":"2024-04-26T10:32:51.998516+0000","last_peered":"2024-04-26T10:32:51.998516+0000","last_clean":"2024-04-26T10:32:51.998516+0000","last_became_active":"2024-04-26T10:32:46.555252+0000","last_became_peered":"2024-04-26T10:32:46.555252+0000","last_unstale":"2024-04-26T10:32:51.998516+0000","last_undegraded":"2024-04-26T10:32:51.998516+0000","last_fullsized":"2024-04-26T10:32:51.998516+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697491+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:32:54.697491+0000","last_peered":"2024-04-26T10:32:54.697491+0000","last_clean":"2024-04-26T10:32:54.697491+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:32:54.697491+0000","last_undegraded":"2024-04-26T10:32:54.697491+0000","last_fullsized":"2024-04-26T10:32:54.697491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995980+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:32:52.995980+0000","last_peered":"2024-04-26T10:32:52.995980+0000","last_clean":"2024-04-26T10:32:52.995980+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:32:52.995980+0000","last_undegraded":"2024-04-26T10:32:52.995980+0000","last_fullsized":"2024-04-26T10:32:52.995980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.993416+0000","last_change":"2024-04-26T10:32:46.556007+0000","last_active":"2024-04-26T10:32:51.993416+0000","last_peered":"2024-04-26T10:32:51.993416+0000","last_clean":"2024-04-26T10:32:51.993416+0000","last_became_active":"2024-04-26T10:32:46.555738+0000","last_became_peered":"2024-04-26T10:32:46.555738+0000","last_unstale":"2024-04-26T10:32:51.993416+0000","last_undegraded":"2024-04-26T10:32:51.993416+0000","last_fullsized":"2024-04-26T10:32:51.993416+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:04.230186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698307+0000","last_change":"2024-04-26T10:32:51.589352+0000","last_active":"2024-04-26T10:32:54.698307+0000","last_peered":"2024-04-26T10:32:54.698307+0000","last_clean":"2024-04-26T10:32:54.698307+0000","last_became_active":"2024-04-26T10:32:51.589006+0000","last_became_peered":"2024-04-26T10:32:51.589006+0000","last_unstale":"2024-04-26T10:32:54.698307+0000","last_undegraded":"2024-04-26T10:32:54.698307+0000","last_fullsized":"2024-04-26T10:32:54.698307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995503+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:32:52.995503+0000","last_peered":"2024-04-26T10:32:52.995503+0000","last_clean":"2024-04-26T10:32:52.995503+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:32:52.995503+0000","last_undegraded":"2024-04-26T10:32:52.995503+0000","last_fullsized":"2024-04-26T10:32:52.995503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698429+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:32:54.698429+0000","last_peered":"2024-04-26T10:32:54.698429+0000","last_clean":"2024-04-26T10:32:54.698429+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:32:54.698429+0000","last_undegraded":"2024-04-26T10:32:54.698429+0000","last_fullsized":"2024-04-26T10:32:54.698429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.001757+0000","last_change":"2024-04-26T10:32:46.555394+0000","last_active":"2024-04-26T10:32:52.001757+0000","last_peered":"2024-04-26T10:32:52.001757+0000","last_clean":"2024-04-26T10:32:52.001757+0000","last_became_active":"2024-04-26T10:32:46.555053+0000","last_became_peered":"2024-04-26T10:32:46.555053+0000","last_unstale":"2024-04-26T10:32:52.001757+0000","last_undegraded":"2024-04-26T10:32:52.001757+0000","last_fullsized":"2024-04-26T10:32:52.001757+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697328+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:32:54.697328+0000","last_peered":"2024-04-26T10:32:54.697328+0000","last_clean":"2024-04-26T10:32:54.697328+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:32:54.697328+0000","last_undegraded":"2024-04-26T10:32:54.697328+0000","last_fullsized":"2024-04-26T10:32:54.697328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.002371+0000","last_change":"2024-04-26T10:32:46.555191+0000","last_active":"2024-04-26T10:32:52.002371+0000","last_peered":"2024-04-26T10:32:52.002371+0000","last_clean":"2024-04-26T10:32:52.002371+0000","last_became_active":"2024-04-26T10:32:46.554892+0000","last_became_peered":"2024-04-26T10:32:46.554892+0000","last_unstale":"2024-04-26T10:32:52.002371+0000","last_undegraded":"2024-04-26T10:32:52.002371+0000","last_fullsized":"2024-04-26T10:32:52.002371+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698390+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:32:54.698390+0000","last_peered":"2024-04-26T10:32:54.698390+0000","last_clean":"2024-04-26T10:32:54.698390+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:32:54.698390+0000","last_undegraded":"2024-04-26T10:32:54.698390+0000","last_fullsized":"2024-04-26T10:32:54.698390+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995288+0000","last_change":"2024-04-26T10:32:52.001408+0000","last_active":"2024-04-26T10:32:52.995288+0000","last_peered":"2024-04-26T10:32:52.995288+0000","last_clean":"2024-04-26T10:32:52.995288+0000","last_became_active":"2024-04-26T10:32:52.000668+0000","last_became_peered":"2024-04-26T10:32:52.000668+0000","last_unstale":"2024-04-26T10:32:52.995288+0000","last_undegraded":"2024-04-26T10:32:52.995288+0000","last_fullsized":"2024-04-26T10:32:52.995288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995353+0000","last_change":"2024-04-26T10:32:51.586234+0000","last_active":"2024-04-26T10:32:52.995353+0000","last_peered":"2024-04-26T10:32:52.995353+0000","last_clean":"2024-04-26T10:32:52.995353+0000","last_became_active":"2024-04-26T10:32:51.586004+0000","last_became_peered":"2024-04-26T10:32:51.586004+0000","last_unstale":"2024-04-26T10:32:52.995353+0000","last_undegraded":"2024-04-26T10:32:52.995353+0000","last_fullsized":"2024-04-26T10:32:52.995353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:03.977752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995947+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:32:52.995947+0000","last_peered":"2024-04-26T10:32:52.995947+0000","last_clean":"2024-04-26T10:32:52.995947+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:32:52.995947+0000","last_undegraded":"2024-04-26T10:32:52.995947+0000","last_fullsized":"2024-04-26T10:32:52.995947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995869+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:32:52.995869+0000","last_peered":"2024-04-26T10:32:52.995869+0000","last_clean":"2024-04-26T10:32:52.995869+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:32:52.995869+0000","last_undegraded":"2024-04-26T10:32:52.995869+0000","last_fullsized":"2024-04-26T10:32:52.995869+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995676+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:32:52.995676+0000","last_peered":"2024-04-26T10:32:52.995676+0000","last_clean":"2024-04-26T10:32:52.995676+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:32:52.995676+0000","last_undegraded":"2024-04-26T10:32:52.995676+0000","last_fullsized":"2024-04-26T10:32:52.995676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996240+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:32:52.996240+0000","last_peered":"2024-04-26T10:32:52.996240+0000","last_clean":"2024-04-26T10:32:52.996240+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:32:52.996240+0000","last_undegraded":"2024-04-26T10:32:52.996240+0000","last_fullsized":"2024-04-26T10:32:52.996240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995491+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:32:52.995491+0000","last_peered":"2024-04-26T10:32:52.995491+0000","last_clean":"2024-04-26T10:32:52.995491+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:32:52.995491+0000","last_undegraded":"2024-04-26T10:32:52.995491+0000","last_fullsized":"2024-04-26T10:32:52.995491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698596+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:32:54.698596+0000","last_peered":"2024-04-26T10:32:54.698596+0000","last_clean":"2024-04-26T10:32:54.698596+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:32:54.698596+0000","last_undegraded":"2024-04-26T10:32:54.698596+0000","last_fullsized":"2024-04-26T10:32:54.698596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995567+0000","last_change":"2024-04-26T10:32:51.999341+0000","last_active":"2024-04-26T10:32:52.995567+0000","last_peered":"2024-04-26T10:32:52.995567+0000","last_clean":"2024-04-26T10:32:52.995567+0000","last_became_active":"2024-04-26T10:32:51.998256+0000","last_became_peered":"2024-04-26T10:32:51.998256+0000","last_unstale":"2024-04-26T10:32:52.995567+0000","last_undegraded":"2024-04-26T10:32:52.995567+0000","last_fullsized":"2024-04-26T10:32:52.995567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698554+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:32:54.698554+0000","last_peered":"2024-04-26T10:32:54.698554+0000","last_clean":"2024-04-26T10:32:54.698554+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:32:54.698554+0000","last_undegraded":"2024-04-26T10:32:54.698554+0000","last_fullsized":"2024-04-26T10:32:54.698554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995762+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:32:52.995762+0000","last_peered":"2024-04-26T10:32:52.995762+0000","last_clean":"2024-04-26T10:32:52.995762+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:32:52.995762+0000","last_undegraded":"2024-04-26T10:32:52.995762+0000","last_fullsized":"2024-04-26T10:32:52.995762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995699+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:32:52.995699+0000","last_peered":"2024-04-26T10:32:52.995699+0000","last_clean":"2024-04-26T10:32:52.995699+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:32:52.995699+0000","last_undegraded":"2024-04-26T10:32:52.995699+0000","last_fullsized":"2024-04-26T10:32:52.995699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697606+0000","last_change":"2024-04-26T10:32:52.004844+0000","last_active":"2024-04-26T10:32:54.697606+0000","last_peered":"2024-04-26T10:32:54.697606+0000","last_clean":"2024-04-26T10:32:54.697606+0000","last_became_active":"2024-04-26T10:32:52.004484+0000","last_became_peered":"2024-04-26T10:32:52.004484+0000","last_unstale":"2024-04-26T10:32:54.697606+0000","last_undegraded":"2024-04-26T10:32:54.697606+0000","last_fullsized":"2024-04-26T10:32:54.697606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995521+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:32:52.995521+0000","last_peered":"2024-04-26T10:32:52.995521+0000","last_clean":"2024-04-26T10:32:52.995521+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:32:52.995521+0000","last_undegraded":"2024-04-26T10:32:52.995521+0000","last_fullsized":"2024-04-26T10:32:52.995521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698146+0000","last_change":"2024-04-26T10:32:52.007818+0000","last_active":"2024-04-26T10:32:54.698146+0000","last_peered":"2024-04-26T10:32:54.698146+0000","last_clean":"2024-04-26T10:32:54.698146+0000","last_became_active":"2024-04-26T10:32:52.007552+0000","last_became_peered":"2024-04-26T10:32:52.007552+0000","last_unstale":"2024-04-26T10:32:54.698146+0000","last_undegraded":"2024-04-26T10:32:54.698146+0000","last_fullsized":"2024-04-26T10:32:54.698146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995977+0000","last_change":"2024-04-26T10:32:52.010309+0000","last_active":"2024-04-26T10:32:52.995977+0000","last_peered":"2024-04-26T10:32:52.995977+0000","last_clean":"2024-04-26T10:32:52.995977+0000","last_became_active":"2024-04-26T10:32:52.009152+0000","last_became_peered":"2024-04-26T10:32:52.009152+0000","last_unstale":"2024-04-26T10:32:52.995977+0000","last_undegraded":"2024-04-26T10:32:52.995977+0000","last_fullsized":"2024-04-26T10:32:52.995977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":131072,"data_stored":42060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:33:00.758 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:33:01.116 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:01.118 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:33:01.128 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-26T10:33:00.986145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82684,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032836,"statfs":{"total":289910292480,"available":289825624064,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.996205"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996155+0000","last_change":"2024-04-26T10:32:51.998840+0000","last_active":"2024-04-26T10:32:52.996155+0000","last_peered":"2024-04-26T10:32:52.996155+0000","last_clean":"2024-04-26T10:32:52.996155+0000","last_became_active":"2024-04-26T10:32:51.998236+0000","last_became_peered":"2024-04-26T10:32:51.998236+0000","last_unstale":"2024-04-26T10:32:52.996155+0000","last_undegraded":"2024-04-26T10:32:52.996155+0000","last_fullsized":"2024-04-26T10:32:52.996155+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995759+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:32:52.995759+0000","last_peered":"2024-04-26T10:32:52.995759+0000","last_clean":"2024-04-26T10:32:52.995759+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:32:52.995759+0000","last_undegraded":"2024-04-26T10:32:52.995759+0000","last_fullsized":"2024-04-26T10:32:52.995759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996256+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:32:52.996256+0000","last_peered":"2024-04-26T10:32:52.996256+0000","last_clean":"2024-04-26T10:32:52.996256+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:32:52.996256+0000","last_undegraded":"2024-04-26T10:32:52.996256+0000","last_fullsized":"2024-04-26T10:32:52.996256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996029+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:32:52.996029+0000","last_peered":"2024-04-26T10:32:52.996029+0000","last_clean":"2024-04-26T10:32:52.996029+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:32:52.996029+0000","last_undegraded":"2024-04-26T10:32:52.996029+0000","last_fullsized":"2024-04-26T10:32:52.996029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995460+0000","last_change":"2024-04-26T10:32:51.999420+0000","last_active":"2024-04-26T10:32:52.995460+0000","last_peered":"2024-04-26T10:32:52.995460+0000","last_clean":"2024-04-26T10:32:52.995460+0000","last_became_active":"2024-04-26T10:32:51.999046+0000","last_became_peered":"2024-04-26T10:32:51.999046+0000","last_unstale":"2024-04-26T10:32:52.995460+0000","last_undegraded":"2024-04-26T10:32:52.995460+0000","last_fullsized":"2024-04-26T10:32:52.995460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:10.442986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995344+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:32:52.995344+0000","last_peered":"2024-04-26T10:32:52.995344+0000","last_clean":"2024-04-26T10:32:52.995344+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:32:52.995344+0000","last_undegraded":"2024-04-26T10:32:52.995344+0000","last_fullsized":"2024-04-26T10:32:52.995344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995441+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:32:52.995441+0000","last_peered":"2024-04-26T10:32:52.995441+0000","last_clean":"2024-04-26T10:32:52.995441+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:32:52.995441+0000","last_undegraded":"2024-04-26T10:32:52.995441+0000","last_fullsized":"2024-04-26T10:32:52.995441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995369+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:32:52.995369+0000","last_peered":"2024-04-26T10:32:52.995369+0000","last_clean":"2024-04-26T10:32:52.995369+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:32:52.995369+0000","last_undegraded":"2024-04-26T10:32:52.995369+0000","last_fullsized":"2024-04-26T10:32:52.995369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698360+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:32:54.698360+0000","last_peered":"2024-04-26T10:32:54.698360+0000","last_clean":"2024-04-26T10:32:54.698360+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:32:54.698360+0000","last_undegraded":"2024-04-26T10:32:54.698360+0000","last_fullsized":"2024-04-26T10:32:54.698360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995967+0000","last_change":"2024-04-26T10:32:52.000612+0000","last_active":"2024-04-26T10:32:52.995967+0000","last_peered":"2024-04-26T10:32:52.995967+0000","last_clean":"2024-04-26T10:32:52.995967+0000","last_became_active":"2024-04-26T10:32:51.998958+0000","last_became_peered":"2024-04-26T10:32:51.998958+0000","last_unstale":"2024-04-26T10:32:52.995967+0000","last_undegraded":"2024-04-26T10:32:52.995967+0000","last_fullsized":"2024-04-26T10:32:52.995967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996112+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:32:52.996112+0000","last_peered":"2024-04-26T10:32:52.996112+0000","last_clean":"2024-04-26T10:32:52.996112+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:32:52.996112+0000","last_undegraded":"2024-04-26T10:32:52.996112+0000","last_fullsized":"2024-04-26T10:32:52.996112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995621+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:32:52.995621+0000","last_peered":"2024-04-26T10:32:52.995621+0000","last_clean":"2024-04-26T10:32:52.995621+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:32:52.995621+0000","last_undegraded":"2024-04-26T10:32:52.995621+0000","last_fullsized":"2024-04-26T10:32:52.995621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995312+0000","last_change":"2024-04-26T10:32:52.000261+0000","last_active":"2024-04-26T10:32:52.995312+0000","last_peered":"2024-04-26T10:32:52.995312+0000","last_clean":"2024-04-26T10:32:52.995312+0000","last_became_active":"2024-04-26T10:32:51.999284+0000","last_became_peered":"2024-04-26T10:32:51.999284+0000","last_unstale":"2024-04-26T10:32:52.995312+0000","last_undegraded":"2024-04-26T10:32:52.995312+0000","last_fullsized":"2024-04-26T10:32:52.995312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995910+0000","last_change":"2024-04-26T10:32:52.003123+0000","last_active":"2024-04-26T10:32:52.995910+0000","last_peered":"2024-04-26T10:32:52.995910+0000","last_clean":"2024-04-26T10:32:52.995910+0000","last_became_active":"2024-04-26T10:32:52.001353+0000","last_became_peered":"2024-04-26T10:32:52.001353+0000","last_unstale":"2024-04-26T10:32:52.995910+0000","last_undegraded":"2024-04-26T10:32:52.995910+0000","last_fullsized":"2024-04-26T10:32:52.995910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:59:49.869670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995298+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:32:52.995298+0000","last_peered":"2024-04-26T10:32:52.995298+0000","last_clean":"2024-04-26T10:32:52.995298+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:32:52.995298+0000","last_undegraded":"2024-04-26T10:32:52.995298+0000","last_fullsized":"2024-04-26T10:32:52.995298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995391+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:32:52.995391+0000","last_peered":"2024-04-26T10:32:52.995391+0000","last_clean":"2024-04-26T10:32:52.995391+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:32:52.995391+0000","last_undegraded":"2024-04-26T10:32:52.995391+0000","last_fullsized":"2024-04-26T10:32:52.995391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698457+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:32:54.698457+0000","last_peered":"2024-04-26T10:32:54.698457+0000","last_clean":"2024-04-26T10:32:54.698457+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:32:54.698457+0000","last_undegraded":"2024-04-26T10:32:54.698457+0000","last_fullsized":"2024-04-26T10:32:54.698457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996082+0000","last_change":"2024-04-26T10:32:52.000693+0000","last_active":"2024-04-26T10:32:52.996082+0000","last_peered":"2024-04-26T10:32:52.996082+0000","last_clean":"2024-04-26T10:32:52.996082+0000","last_became_active":"2024-04-26T10:32:51.999406+0000","last_became_peered":"2024-04-26T10:32:51.999406+0000","last_unstale":"2024-04-26T10:32:52.996082+0000","last_undegraded":"2024-04-26T10:32:52.996082+0000","last_fullsized":"2024-04-26T10:32:52.996082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698211+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:32:54.698211+0000","last_peered":"2024-04-26T10:32:54.698211+0000","last_clean":"2024-04-26T10:32:54.698211+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:32:54.698211+0000","last_undegraded":"2024-04-26T10:32:54.698211+0000","last_fullsized":"2024-04-26T10:32:54.698211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996035+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:32:52.996035+0000","last_peered":"2024-04-26T10:32:52.996035+0000","last_clean":"2024-04-26T10:32:52.996035+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:32:52.996035+0000","last_undegraded":"2024-04-26T10:32:52.996035+0000","last_fullsized":"2024-04-26T10:32:52.996035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995635+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:32:52.995635+0000","last_peered":"2024-04-26T10:32:52.995635+0000","last_clean":"2024-04-26T10:32:52.995635+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:32:52.995635+0000","last_undegraded":"2024-04-26T10:32:52.995635+0000","last_fullsized":"2024-04-26T10:32:52.995635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995342+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:32:52.995342+0000","last_peered":"2024-04-26T10:32:52.995342+0000","last_clean":"2024-04-26T10:32:52.995342+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:32:52.995342+0000","last_undegraded":"2024-04-26T10:32:52.995342+0000","last_fullsized":"2024-04-26T10:32:52.995342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697661+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:32:54.697661+0000","last_peered":"2024-04-26T10:32:54.697661+0000","last_clean":"2024-04-26T10:32:54.697661+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:32:54.697661+0000","last_undegraded":"2024-04-26T10:32:54.697661+0000","last_fullsized":"2024-04-26T10:32:54.697661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995428+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:32:52.995428+0000","last_peered":"2024-04-26T10:32:52.995428+0000","last_clean":"2024-04-26T10:32:52.995428+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:32:52.995428+0000","last_undegraded":"2024-04-26T10:32:52.995428+0000","last_fullsized":"2024-04-26T10:32:52.995428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996100+0000","last_change":"2024-04-26T10:32:52.004089+0000","last_active":"2024-04-26T10:32:52.996100+0000","last_peered":"2024-04-26T10:32:52.996100+0000","last_clean":"2024-04-26T10:32:52.996100+0000","last_became_active":"2024-04-26T10:32:52.003802+0000","last_became_peered":"2024-04-26T10:32:52.003802+0000","last_unstale":"2024-04-26T10:32:52.996100+0000","last_undegraded":"2024-04-26T10:32:52.996100+0000","last_fullsized":"2024-04-26T10:32:52.996100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698384+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:32:54.698384+0000","last_peered":"2024-04-26T10:32:54.698384+0000","last_clean":"2024-04-26T10:32:54.698384+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:32:54.698384+0000","last_undegraded":"2024-04-26T10:32:54.698384+0000","last_fullsized":"2024-04-26T10:32:54.698384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996122+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:32:52.996122+0000","last_peered":"2024-04-26T10:32:52.996122+0000","last_clean":"2024-04-26T10:32:52.996122+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:32:52.996122+0000","last_undegraded":"2024-04-26T10:32:52.996122+0000","last_fullsized":"2024-04-26T10:32:52.996122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995270+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:32:52.995270+0000","last_peered":"2024-04-26T10:32:52.995270+0000","last_clean":"2024-04-26T10:32:52.995270+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:32:52.995270+0000","last_undegraded":"2024-04-26T10:32:52.995270+0000","last_fullsized":"2024-04-26T10:32:52.995270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996297+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:32:52.996297+0000","last_peered":"2024-04-26T10:32:52.996297+0000","last_clean":"2024-04-26T10:32:52.996297+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:32:52.996297+0000","last_undegraded":"2024-04-26T10:32:52.996297+0000","last_fullsized":"2024-04-26T10:32:52.996297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697734+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:32:54.697734+0000","last_peered":"2024-04-26T10:32:54.697734+0000","last_clean":"2024-04-26T10:32:54.697734+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:32:54.697734+0000","last_undegraded":"2024-04-26T10:32:54.697734+0000","last_fullsized":"2024-04-26T10:32:54.697734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698491+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:32:54.698491+0000","last_peered":"2024-04-26T10:32:54.698491+0000","last_clean":"2024-04-26T10:32:54.698491+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:32:54.698491+0000","last_undegraded":"2024-04-26T10:32:54.698491+0000","last_fullsized":"2024-04-26T10:32:54.698491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697582+0000","last_change":"2024-04-26T10:32:51.588353+0000","last_active":"2024-04-26T10:32:54.697582+0000","last_peered":"2024-04-26T10:32:54.697582+0000","last_clean":"2024-04-26T10:32:54.697582+0000","last_became_active":"2024-04-26T10:32:51.587981+0000","last_became_peered":"2024-04-26T10:32:51.587981+0000","last_unstale":"2024-04-26T10:32:54.697582+0000","last_undegraded":"2024-04-26T10:32:54.697582+0000","last_fullsized":"2024-04-26T10:32:54.697582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:20.810803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996039+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:32:52.996039+0000","last_peered":"2024-04-26T10:32:52.996039+0000","last_clean":"2024-04-26T10:32:52.996039+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:32:52.996039+0000","last_undegraded":"2024-04-26T10:32:52.996039+0000","last_fullsized":"2024-04-26T10:32:52.996039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698553+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:32:54.698553+0000","last_peered":"2024-04-26T10:32:54.698553+0000","last_clean":"2024-04-26T10:32:54.698553+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:32:54.698553+0000","last_undegraded":"2024-04-26T10:32:54.698553+0000","last_fullsized":"2024-04-26T10:32:54.698553+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697438+0000","last_change":"2024-04-26T10:32:52.008030+0000","last_active":"2024-04-26T10:32:54.697438+0000","last_peered":"2024-04-26T10:32:54.697438+0000","last_clean":"2024-04-26T10:32:54.697438+0000","last_became_active":"2024-04-26T10:32:52.007158+0000","last_became_peered":"2024-04-26T10:32:52.007158+0000","last_unstale":"2024-04-26T10:32:54.697438+0000","last_undegraded":"2024-04-26T10:32:54.697438+0000","last_fullsized":"2024-04-26T10:32:54.697438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996258+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:32:52.996258+0000","last_peered":"2024-04-26T10:32:52.996258+0000","last_clean":"2024-04-26T10:32:52.996258+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:32:52.996258+0000","last_undegraded":"2024-04-26T10:32:52.996258+0000","last_fullsized":"2024-04-26T10:32:52.996258+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697790+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:32:54.697790+0000","last_peered":"2024-04-26T10:32:54.697790+0000","last_clean":"2024-04-26T10:32:54.697790+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:32:54.697790+0000","last_undegraded":"2024-04-26T10:32:54.697790+0000","last_fullsized":"2024-04-26T10:32:54.697790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996094+0000","last_change":"2024-04-26T10:32:51.586732+0000","last_active":"2024-04-26T10:32:52.996094+0000","last_peered":"2024-04-26T10:32:52.996094+0000","last_clean":"2024-04-26T10:32:52.996094+0000","last_became_active":"2024-04-26T10:32:51.586533+0000","last_became_peered":"2024-04-26T10:32:51.586533+0000","last_unstale":"2024-04-26T10:32:52.996094+0000","last_undegraded":"2024-04-26T10:32:52.996094+0000","last_fullsized":"2024-04-26T10:32:52.996094+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697696+0000","last_change":"2024-04-26T10:32:52.007650+0000","last_active":"2024-04-26T10:32:54.697696+0000","last_peered":"2024-04-26T10:32:54.697696+0000","last_clean":"2024-04-26T10:32:54.697696+0000","last_became_active":"2024-04-26T10:32:52.007261+0000","last_became_peered":"2024-04-26T10:32:52.007261+0000","last_unstale":"2024-04-26T10:32:54.697696+0000","last_undegraded":"2024-04-26T10:32:54.697696+0000","last_fullsized":"2024-04-26T10:32:54.697696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995900+0000","last_change":"2024-04-26T10:32:51.584497+0000","last_active":"2024-04-26T10:32:52.995900+0000","last_peered":"2024-04-26T10:32:52.995900+0000","last_clean":"2024-04-26T10:32:52.995900+0000","last_became_active":"2024-04-26T10:32:51.583460+0000","last_became_peered":"2024-04-26T10:32:51.583460+0000","last_unstale":"2024-04-26T10:32:52.995900+0000","last_undegraded":"2024-04-26T10:32:52.995900+0000","last_fullsized":"2024-04-26T10:32:52.995900+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995887+0000","last_change":"2024-04-26T10:32:52.001738+0000","last_active":"2024-04-26T10:32:52.995887+0000","last_peered":"2024-04-26T10:32:52.995887+0000","last_clean":"2024-04-26T10:32:52.995887+0000","last_became_active":"2024-04-26T10:32:51.999263+0000","last_became_peered":"2024-04-26T10:32:51.999263+0000","last_unstale":"2024-04-26T10:32:52.995887+0000","last_undegraded":"2024-04-26T10:32:52.995887+0000","last_fullsized":"2024-04-26T10:32:52.995887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:14.966669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995874+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:32:52.995874+0000","last_peered":"2024-04-26T10:32:52.995874+0000","last_clean":"2024-04-26T10:32:52.995874+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:32:52.995874+0000","last_undegraded":"2024-04-26T10:32:52.995874+0000","last_fullsized":"2024-04-26T10:32:52.995874+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995839+0000","last_change":"2024-04-26T10:32:52.000043+0000","last_active":"2024-04-26T10:32:52.995839+0000","last_peered":"2024-04-26T10:32:52.995839+0000","last_clean":"2024-04-26T10:32:52.995839+0000","last_became_active":"2024-04-26T10:32:51.999069+0000","last_became_peered":"2024-04-26T10:32:51.999069+0000","last_unstale":"2024-04-26T10:32:52.995839+0000","last_undegraded":"2024-04-26T10:32:52.995839+0000","last_fullsized":"2024-04-26T10:32:52.995839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697777+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:32:54.697777+0000","last_peered":"2024-04-26T10:32:54.697777+0000","last_clean":"2024-04-26T10:32:54.697777+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:32:54.697777+0000","last_undegraded":"2024-04-26T10:32:54.697777+0000","last_fullsized":"2024-04-26T10:32:54.697777+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996289+0000","last_change":"2024-04-26T10:32:52.000628+0000","last_active":"2024-04-26T10:32:52.996289+0000","last_peered":"2024-04-26T10:32:52.996289+0000","last_clean":"2024-04-26T10:32:52.996289+0000","last_became_active":"2024-04-26T10:32:51.998121+0000","last_became_peered":"2024-04-26T10:32:51.998121+0000","last_unstale":"2024-04-26T10:32:52.996289+0000","last_undegraded":"2024-04-26T10:32:52.996289+0000","last_fullsized":"2024-04-26T10:32:52.996289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.293526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995394+0000","last_change":"2024-04-26T10:32:51.584210+0000","last_active":"2024-04-26T10:32:52.995394+0000","last_peered":"2024-04-26T10:32:52.995394+0000","last_clean":"2024-04-26T10:32:52.995394+0000","last_became_active":"2024-04-26T10:32:51.583823+0000","last_became_peered":"2024-04-26T10:32:51.583823+0000","last_unstale":"2024-04-26T10:32:52.995394+0000","last_undegraded":"2024-04-26T10:32:52.995394+0000","last_fullsized":"2024-04-26T10:32:52.995394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.121333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698492+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:32:54.698492+0000","last_peered":"2024-04-26T10:32:54.698492+0000","last_clean":"2024-04-26T10:32:54.698492+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:32:54.698492+0000","last_undegraded":"2024-04-26T10:32:54.698492+0000","last_fullsized":"2024-04-26T10:32:54.698492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995640+0000","last_change":"2024-04-26T10:32:51.584088+0000","last_active":"2024-04-26T10:32:52.995640+0000","last_peered":"2024-04-26T10:32:52.995640+0000","last_clean":"2024-04-26T10:32:52.995640+0000","last_became_active":"2024-04-26T10:32:51.583020+0000","last_became_peered":"2024-04-26T10:32:51.583020+0000","last_unstale":"2024-04-26T10:32:52.995640+0000","last_undegraded":"2024-04-26T10:32:52.995640+0000","last_fullsized":"2024-04-26T10:32:52.995640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698660+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:32:54.698660+0000","last_peered":"2024-04-26T10:32:54.698660+0000","last_clean":"2024-04-26T10:32:54.698660+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:32:54.698660+0000","last_undegraded":"2024-04-26T10:32:54.698660+0000","last_fullsized":"2024-04-26T10:32:54.698660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996288+0000","last_change":"2024-04-26T10:32:51.583791+0000","last_active":"2024-04-26T10:32:52.996288+0000","last_peered":"2024-04-26T10:32:52.996288+0000","last_clean":"2024-04-26T10:32:52.996288+0000","last_became_active":"2024-04-26T10:32:51.583103+0000","last_became_peered":"2024-04-26T10:32:51.583103+0000","last_unstale":"2024-04-26T10:32:52.996288+0000","last_undegraded":"2024-04-26T10:32:52.996288+0000","last_fullsized":"2024-04-26T10:32:52.996288+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.994938+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:32:52.994938+0000","last_peered":"2024-04-26T10:32:52.994938+0000","last_clean":"2024-04-26T10:32:52.994938+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:32:52.994938+0000","last_undegraded":"2024-04-26T10:32:52.994938+0000","last_fullsized":"2024-04-26T10:32:52.994938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995812+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:32:52.995812+0000","last_peered":"2024-04-26T10:32:52.995812+0000","last_clean":"2024-04-26T10:32:52.995812+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:32:52.995812+0000","last_undegraded":"2024-04-26T10:32:52.995812+0000","last_fullsized":"2024-04-26T10:32:52.995812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995440+0000","last_change":"2024-04-26T10:32:51.997516+0000","last_active":"2024-04-26T10:32:52.995440+0000","last_peered":"2024-04-26T10:32:52.995440+0000","last_clean":"2024-04-26T10:32:52.995440+0000","last_became_active":"2024-04-26T10:32:51.996896+0000","last_became_peered":"2024-04-26T10:32:51.996896+0000","last_unstale":"2024-04-26T10:32:52.995440+0000","last_undegraded":"2024-04-26T10:32:52.995440+0000","last_fullsized":"2024-04-26T10:32:52.995440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:51.552418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996431+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:32:52.996431+0000","last_peered":"2024-04-26T10:32:52.996431+0000","last_clean":"2024-04-26T10:32:52.996431+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:32:52.996431+0000","last_undegraded":"2024-04-26T10:32:52.996431+0000","last_fullsized":"2024-04-26T10:32:52.996431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995565+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:32:52.995565+0000","last_peered":"2024-04-26T10:32:52.995565+0000","last_clean":"2024-04-26T10:32:52.995565+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:32:52.995565+0000","last_undegraded":"2024-04-26T10:32:52.995565+0000","last_fullsized":"2024-04-26T10:32:52.995565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995674+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:32:52.995674+0000","last_peered":"2024-04-26T10:32:52.995674+0000","last_clean":"2024-04-26T10:32:52.995674+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:32:52.995674+0000","last_undegraded":"2024-04-26T10:32:52.995674+0000","last_fullsized":"2024-04-26T10:32:52.995674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697950+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:32:54.697950+0000","last_peered":"2024-04-26T10:32:54.697950+0000","last_clean":"2024-04-26T10:32:54.697950+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:32:54.697950+0000","last_undegraded":"2024-04-26T10:32:54.697950+0000","last_fullsized":"2024-04-26T10:32:54.697950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697966+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:32:54.697966+0000","last_peered":"2024-04-26T10:32:54.697966+0000","last_clean":"2024-04-26T10:32:54.697966+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:32:54.697966+0000","last_undegraded":"2024-04-26T10:32:54.697966+0000","last_fullsized":"2024-04-26T10:32:54.697966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995743+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:32:52.995743+0000","last_peered":"2024-04-26T10:32:52.995743+0000","last_clean":"2024-04-26T10:32:52.995743+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:32:52.995743+0000","last_undegraded":"2024-04-26T10:32:52.995743+0000","last_fullsized":"2024-04-26T10:32:52.995743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995417+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:32:52.995417+0000","last_peered":"2024-04-26T10:32:52.995417+0000","last_clean":"2024-04-26T10:32:52.995417+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:32:52.995417+0000","last_undegraded":"2024-04-26T10:32:52.995417+0000","last_fullsized":"2024-04-26T10:32:52.995417+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996362+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:32:52.996362+0000","last_peered":"2024-04-26T10:32:52.996362+0000","last_clean":"2024-04-26T10:32:52.996362+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:32:52.996362+0000","last_undegraded":"2024-04-26T10:32:52.996362+0000","last_fullsized":"2024-04-26T10:32:52.996362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995012+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:32:52.995012+0000","last_peered":"2024-04-26T10:32:52.995012+0000","last_clean":"2024-04-26T10:32:52.995012+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:32:52.995012+0000","last_undegraded":"2024-04-26T10:32:52.995012+0000","last_fullsized":"2024-04-26T10:32:52.995012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996322+0000","last_change":"2024-04-26T10:32:52.004444+0000","last_active":"2024-04-26T10:32:52.996322+0000","last_peered":"2024-04-26T10:32:52.996322+0000","last_clean":"2024-04-26T10:32:52.996322+0000","last_became_active":"2024-04-26T10:32:52.003360+0000","last_became_peered":"2024-04-26T10:32:52.003360+0000","last_unstale":"2024-04-26T10:32:52.996322+0000","last_undegraded":"2024-04-26T10:32:52.996322+0000","last_fullsized":"2024-04-26T10:32:52.996322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:20.180213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995117+0000","last_change":"2024-04-26T10:32:51.584385+0000","last_active":"2024-04-26T10:32:52.995117+0000","last_peered":"2024-04-26T10:32:52.995117+0000","last_clean":"2024-04-26T10:32:52.995117+0000","last_became_active":"2024-04-26T10:32:51.584025+0000","last_became_peered":"2024-04-26T10:32:51.584025+0000","last_unstale":"2024-04-26T10:32:52.995117+0000","last_undegraded":"2024-04-26T10:32:52.995117+0000","last_fullsized":"2024-04-26T10:32:52.995117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:57.247011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698499+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:32:54.698499+0000","last_peered":"2024-04-26T10:32:54.698499+0000","last_clean":"2024-04-26T10:32:54.698499+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:32:54.698499+0000","last_undegraded":"2024-04-26T10:32:54.698499+0000","last_fullsized":"2024-04-26T10:32:54.698499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.999504+0000","last_change":"2024-04-26T10:32:46.555353+0000","last_active":"2024-04-26T10:32:51.999504+0000","last_peered":"2024-04-26T10:32:51.999504+0000","last_clean":"2024-04-26T10:32:51.999504+0000","last_became_active":"2024-04-26T10:32:46.555005+0000","last_became_peered":"2024-04-26T10:32:46.555005+0000","last_unstale":"2024-04-26T10:32:51.999504+0000","last_undegraded":"2024-04-26T10:32:51.999504+0000","last_fullsized":"2024-04-26T10:32:51.999504+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996229+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:32:52.996229+0000","last_peered":"2024-04-26T10:32:52.996229+0000","last_clean":"2024-04-26T10:32:52.996229+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:32:52.996229+0000","last_undegraded":"2024-04-26T10:32:52.996229+0000","last_fullsized":"2024-04-26T10:32:52.996229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995425+0000","last_change":"2024-04-26T10:32:52.004199+0000","last_active":"2024-04-26T10:32:52.995425+0000","last_peered":"2024-04-26T10:32:52.995425+0000","last_clean":"2024-04-26T10:32:52.995425+0000","last_became_active":"2024-04-26T10:32:52.003894+0000","last_became_peered":"2024-04-26T10:32:52.003894+0000","last_unstale":"2024-04-26T10:32:52.995425+0000","last_undegraded":"2024-04-26T10:32:52.995425+0000","last_fullsized":"2024-04-26T10:32:52.995425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.000379+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:32:52.000379+0000","last_peered":"2024-04-26T10:32:52.000379+0000","last_clean":"2024-04-26T10:32:52.000379+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:32:52.000379+0000","last_undegraded":"2024-04-26T10:32:52.000379+0000","last_fullsized":"2024-04-26T10:32:52.000379+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995781+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:32:52.995781+0000","last_peered":"2024-04-26T10:32:52.995781+0000","last_clean":"2024-04-26T10:32:52.995781+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:32:52.995781+0000","last_undegraded":"2024-04-26T10:32:52.995781+0000","last_fullsized":"2024-04-26T10:32:52.995781+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698151+0000","last_change":"2024-04-26T10:32:52.007589+0000","last_active":"2024-04-26T10:32:54.698151+0000","last_peered":"2024-04-26T10:32:54.698151+0000","last_clean":"2024-04-26T10:32:54.698151+0000","last_became_active":"2024-04-26T10:32:52.007289+0000","last_became_peered":"2024-04-26T10:32:52.007289+0000","last_unstale":"2024-04-26T10:32:54.698151+0000","last_undegraded":"2024-04-26T10:32:54.698151+0000","last_fullsized":"2024-04-26T10:32:54.698151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.998883+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:32:51.998883+0000","last_peered":"2024-04-26T10:32:51.998883+0000","last_clean":"2024-04-26T10:32:51.998883+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:32:51.998883+0000","last_undegraded":"2024-04-26T10:32:51.998883+0000","last_fullsized":"2024-04-26T10:32:51.998883+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995047+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:32:52.995047+0000","last_peered":"2024-04-26T10:32:52.995047+0000","last_clean":"2024-04-26T10:32:52.995047+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:32:52.995047+0000","last_undegraded":"2024-04-26T10:32:52.995047+0000","last_fullsized":"2024-04-26T10:32:52.995047+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698612+0000","last_change":"2024-04-26T10:32:52.009270+0000","last_active":"2024-04-26T10:32:54.698612+0000","last_peered":"2024-04-26T10:32:54.698612+0000","last_clean":"2024-04-26T10:32:54.698612+0000","last_became_active":"2024-04-26T10:32:52.008599+0000","last_became_peered":"2024-04-26T10:32:52.008599+0000","last_unstale":"2024-04-26T10:32:54.698612+0000","last_undegraded":"2024-04-26T10:32:54.698612+0000","last_fullsized":"2024-04-26T10:32:54.698612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.000550+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:32:52.000550+0000","last_peered":"2024-04-26T10:32:52.000550+0000","last_clean":"2024-04-26T10:32:52.000550+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:32:52.000550+0000","last_undegraded":"2024-04-26T10:32:52.000550+0000","last_fullsized":"2024-04-26T10:32:52.000550+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.997944+0000","last_change":"2024-04-26T10:32:46.555694+0000","last_active":"2024-04-26T10:32:51.997944+0000","last_peered":"2024-04-26T10:32:51.997944+0000","last_clean":"2024-04-26T10:32:51.997944+0000","last_became_active":"2024-04-26T10:32:46.555391+0000","last_became_peered":"2024-04-26T10:32:46.555391+0000","last_unstale":"2024-04-26T10:32:51.997944+0000","last_undegraded":"2024-04-26T10:32:51.997944+0000","last_fullsized":"2024-04-26T10:32:51.997944+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697661+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:32:54.697661+0000","last_peered":"2024-04-26T10:32:54.697661+0000","last_clean":"2024-04-26T10:32:54.697661+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:32:54.697661+0000","last_undegraded":"2024-04-26T10:32:54.697661+0000","last_fullsized":"2024-04-26T10:32:54.697661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996350+0000","last_change":"2024-04-26T10:32:52.006765+0000","last_active":"2024-04-26T10:32:52.996350+0000","last_peered":"2024-04-26T10:32:52.996350+0000","last_clean":"2024-04-26T10:32:52.996350+0000","last_became_active":"2024-04-26T10:32:52.004110+0000","last_became_peered":"2024-04-26T10:32:52.004110+0000","last_unstale":"2024-04-26T10:32:52.996350+0000","last_undegraded":"2024-04-26T10:32:52.996350+0000","last_fullsized":"2024-04-26T10:32:52.996350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:47.156703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.998516+0000","last_change":"2024-04-26T10:32:46.555501+0000","last_active":"2024-04-26T10:32:51.998516+0000","last_peered":"2024-04-26T10:32:51.998516+0000","last_clean":"2024-04-26T10:32:51.998516+0000","last_became_active":"2024-04-26T10:32:46.555252+0000","last_became_peered":"2024-04-26T10:32:46.555252+0000","last_unstale":"2024-04-26T10:32:51.998516+0000","last_undegraded":"2024-04-26T10:32:51.998516+0000","last_fullsized":"2024-04-26T10:32:51.998516+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697491+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:32:54.697491+0000","last_peered":"2024-04-26T10:32:54.697491+0000","last_clean":"2024-04-26T10:32:54.697491+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:32:54.697491+0000","last_undegraded":"2024-04-26T10:32:54.697491+0000","last_fullsized":"2024-04-26T10:32:54.697491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995980+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:32:52.995980+0000","last_peered":"2024-04-26T10:32:52.995980+0000","last_clean":"2024-04-26T10:32:52.995980+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:32:52.995980+0000","last_undegraded":"2024-04-26T10:32:52.995980+0000","last_fullsized":"2024-04-26T10:32:52.995980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.993416+0000","last_change":"2024-04-26T10:32:46.556007+0000","last_active":"2024-04-26T10:32:51.993416+0000","last_peered":"2024-04-26T10:32:51.993416+0000","last_clean":"2024-04-26T10:32:51.993416+0000","last_became_active":"2024-04-26T10:32:46.555738+0000","last_became_peered":"2024-04-26T10:32:46.555738+0000","last_unstale":"2024-04-26T10:32:51.993416+0000","last_undegraded":"2024-04-26T10:32:51.993416+0000","last_fullsized":"2024-04-26T10:32:51.993416+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:04.230186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698307+0000","last_change":"2024-04-26T10:32:51.589352+0000","last_active":"2024-04-26T10:32:54.698307+0000","last_peered":"2024-04-26T10:32:54.698307+0000","last_clean":"2024-04-26T10:32:54.698307+0000","last_became_active":"2024-04-26T10:32:51.589006+0000","last_became_peered":"2024-04-26T10:32:51.589006+0000","last_unstale":"2024-04-26T10:32:54.698307+0000","last_undegraded":"2024-04-26T10:32:54.698307+0000","last_fullsized":"2024-04-26T10:32:54.698307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995503+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:32:52.995503+0000","last_peered":"2024-04-26T10:32:52.995503+0000","last_clean":"2024-04-26T10:32:52.995503+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:32:52.995503+0000","last_undegraded":"2024-04-26T10:32:52.995503+0000","last_fullsized":"2024-04-26T10:32:52.995503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698429+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:32:54.698429+0000","last_peered":"2024-04-26T10:32:54.698429+0000","last_clean":"2024-04-26T10:32:54.698429+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:32:54.698429+0000","last_undegraded":"2024-04-26T10:32:54.698429+0000","last_fullsized":"2024-04-26T10:32:54.698429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.001757+0000","last_change":"2024-04-26T10:32:46.555394+0000","last_active":"2024-04-26T10:32:52.001757+0000","last_peered":"2024-04-26T10:32:52.001757+0000","last_clean":"2024-04-26T10:32:52.001757+0000","last_became_active":"2024-04-26T10:32:46.555053+0000","last_became_peered":"2024-04-26T10:32:46.555053+0000","last_unstale":"2024-04-26T10:32:52.001757+0000","last_undegraded":"2024-04-26T10:32:52.001757+0000","last_fullsized":"2024-04-26T10:32:52.001757+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697328+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:32:54.697328+0000","last_peered":"2024-04-26T10:32:54.697328+0000","last_clean":"2024-04-26T10:32:54.697328+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:32:54.697328+0000","last_undegraded":"2024-04-26T10:32:54.697328+0000","last_fullsized":"2024-04-26T10:32:54.697328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.002371+0000","last_change":"2024-04-26T10:32:46.555191+0000","last_active":"2024-04-26T10:32:52.002371+0000","last_peered":"2024-04-26T10:32:52.002371+0000","last_clean":"2024-04-26T10:32:52.002371+0000","last_became_active":"2024-04-26T10:32:46.554892+0000","last_became_peered":"2024-04-26T10:32:46.554892+0000","last_unstale":"2024-04-26T10:32:52.002371+0000","last_undegraded":"2024-04-26T10:32:52.002371+0000","last_fullsized":"2024-04-26T10:32:52.002371+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.991584+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:32:54.991584+0000","last_peered":"2024-04-26T10:32:54.991584+0000","last_clean":"2024-04-26T10:32:54.991584+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:32:54.991584+0000","last_undegraded":"2024-04-26T10:32:54.991584+0000","last_fullsized":"2024-04-26T10:32:54.991584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995288+0000","last_change":"2024-04-26T10:32:52.001408+0000","last_active":"2024-04-26T10:32:52.995288+0000","last_peered":"2024-04-26T10:32:52.995288+0000","last_clean":"2024-04-26T10:32:52.995288+0000","last_became_active":"2024-04-26T10:32:52.000668+0000","last_became_peered":"2024-04-26T10:32:52.000668+0000","last_unstale":"2024-04-26T10:32:52.995288+0000","last_undegraded":"2024-04-26T10:32:52.995288+0000","last_fullsized":"2024-04-26T10:32:52.995288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995353+0000","last_change":"2024-04-26T10:32:51.586234+0000","last_active":"2024-04-26T10:32:52.995353+0000","last_peered":"2024-04-26T10:32:52.995353+0000","last_clean":"2024-04-26T10:32:52.995353+0000","last_became_active":"2024-04-26T10:32:51.586004+0000","last_became_peered":"2024-04-26T10:32:51.586004+0000","last_unstale":"2024-04-26T10:32:52.995353+0000","last_undegraded":"2024-04-26T10:32:52.995353+0000","last_fullsized":"2024-04-26T10:32:52.995353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:03.977752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995947+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:32:52.995947+0000","last_peered":"2024-04-26T10:32:52.995947+0000","last_clean":"2024-04-26T10:32:52.995947+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:32:52.995947+0000","last_undegraded":"2024-04-26T10:32:52.995947+0000","last_fullsized":"2024-04-26T10:32:52.995947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995869+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:32:52.995869+0000","last_peered":"2024-04-26T10:32:52.995869+0000","last_clean":"2024-04-26T10:32:52.995869+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:32:52.995869+0000","last_undegraded":"2024-04-26T10:32:52.995869+0000","last_fullsized":"2024-04-26T10:32:52.995869+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995676+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:32:52.995676+0000","last_peered":"2024-04-26T10:32:52.995676+0000","last_clean":"2024-04-26T10:32:52.995676+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:32:52.995676+0000","last_undegraded":"2024-04-26T10:32:52.995676+0000","last_fullsized":"2024-04-26T10:32:52.995676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996240+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:32:52.996240+0000","last_peered":"2024-04-26T10:32:52.996240+0000","last_clean":"2024-04-26T10:32:52.996240+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:32:52.996240+0000","last_undegraded":"2024-04-26T10:32:52.996240+0000","last_fullsized":"2024-04-26T10:32:52.996240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995491+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:32:52.995491+0000","last_peered":"2024-04-26T10:32:52.995491+0000","last_clean":"2024-04-26T10:32:52.995491+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:32:52.995491+0000","last_undegraded":"2024-04-26T10:32:52.995491+0000","last_fullsized":"2024-04-26T10:32:52.995491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698596+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:32:54.698596+0000","last_peered":"2024-04-26T10:32:54.698596+0000","last_clean":"2024-04-26T10:32:54.698596+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:32:54.698596+0000","last_undegraded":"2024-04-26T10:32:54.698596+0000","last_fullsized":"2024-04-26T10:32:54.698596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995567+0000","last_change":"2024-04-26T10:32:51.999341+0000","last_active":"2024-04-26T10:32:52.995567+0000","last_peered":"2024-04-26T10:32:52.995567+0000","last_clean":"2024-04-26T10:32:52.995567+0000","last_became_active":"2024-04-26T10:32:51.998256+0000","last_became_peered":"2024-04-26T10:32:51.998256+0000","last_unstale":"2024-04-26T10:32:52.995567+0000","last_undegraded":"2024-04-26T10:32:52.995567+0000","last_fullsized":"2024-04-26T10:32:52.995567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698554+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:32:54.698554+0000","last_peered":"2024-04-26T10:32:54.698554+0000","last_clean":"2024-04-26T10:32:54.698554+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:32:54.698554+0000","last_undegraded":"2024-04-26T10:32:54.698554+0000","last_fullsized":"2024-04-26T10:32:54.698554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995762+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:32:52.995762+0000","last_peered":"2024-04-26T10:32:52.995762+0000","last_clean":"2024-04-26T10:32:52.995762+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:32:52.995762+0000","last_undegraded":"2024-04-26T10:32:52.995762+0000","last_fullsized":"2024-04-26T10:32:52.995762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995699+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:32:52.995699+0000","last_peered":"2024-04-26T10:32:52.995699+0000","last_clean":"2024-04-26T10:32:52.995699+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:32:52.995699+0000","last_undegraded":"2024-04-26T10:32:52.995699+0000","last_fullsized":"2024-04-26T10:32:52.995699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697606+0000","last_change":"2024-04-26T10:32:52.004844+0000","last_active":"2024-04-26T10:32:54.697606+0000","last_peered":"2024-04-26T10:32:54.697606+0000","last_clean":"2024-04-26T10:32:54.697606+0000","last_became_active":"2024-04-26T10:32:52.004484+0000","last_became_peered":"2024-04-26T10:32:52.004484+0000","last_unstale":"2024-04-26T10:32:54.697606+0000","last_undegraded":"2024-04-26T10:32:54.697606+0000","last_fullsized":"2024-04-26T10:32:54.697606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995521+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:32:52.995521+0000","last_peered":"2024-04-26T10:32:52.995521+0000","last_clean":"2024-04-26T10:32:52.995521+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:32:52.995521+0000","last_undegraded":"2024-04-26T10:32:52.995521+0000","last_fullsized":"2024-04-26T10:32:52.995521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698146+0000","last_change":"2024-04-26T10:32:52.007818+0000","last_active":"2024-04-26T10:32:54.698146+0000","last_peered":"2024-04-26T10:32:54.698146+0000","last_clean":"2024-04-26T10:32:54.698146+0000","last_became_active":"2024-04-26T10:32:52.007552+0000","last_became_peered":"2024-04-26T10:32:52.007552+0000","last_unstale":"2024-04-26T10:32:54.698146+0000","last_undegraded":"2024-04-26T10:32:54.698146+0000","last_fullsized":"2024-04-26T10:32:54.698146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995977+0000","last_change":"2024-04-26T10:32:52.010309+0000","last_active":"2024-04-26T10:32:52.995977+0000","last_peered":"2024-04-26T10:32:52.995977+0000","last_clean":"2024-04-26T10:32:52.995977+0000","last_became_active":"2024-04-26T10:32:52.009152+0000","last_became_peered":"2024-04-26T10:32:52.009152+0000","last_unstale":"2024-04-26T10:32:52.995977+0000","last_undegraded":"2024-04-26T10:32:52.995977+0000","last_fullsized":"2024-04-26T10:32:52.995977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:33:01.132 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T10:33:01.132 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T10:33:01.132 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T10:33:01.132 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T10:33:01.133 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T10:33:01.571 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:01.584 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":41275},{"type":"v1","addr":"172.21.15.43:6801","nonce":41275}]},"active_addr":"172.21.15.43:6801/41275","active_change":"2024-04-26T10:32:42.978238+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4099,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":21553832}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":1651224360}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":3818241886}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.43:0","nonce":2198655444}]}]} 2024-04-26T10:33:01.591 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T10:33:01.591 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T10:33:01.591 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:33:01.930 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:01.930 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":15,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:32:52.989368+0000","last_up_change":"2024-04-26T10:32:44.545583+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:32:49.859710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:32:50.968196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":41771},{"type":"v1","addr":"172.21.15.112:6801","nonce":41771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":41771},{"type":"v1","addr":"172.21.15.112:6803","nonce":41771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":41771},{"type":"v1","addr":"172.21.15.112:6807","nonce":41771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":41771},{"type":"v1","addr":"172.21.15.112:6805","nonce":41771}]},"public_addr":"172.21.15.112:6801/41771","cluster_addr":"172.21.15.112:6803/41771","heartbeat_back_addr":"172.21.15.112:6807/41771","heartbeat_front_addr":"172.21.15.112:6805/41771","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:33:01.944 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T10:33:01.944 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:33:02.287 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:02.287 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":15,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:32:52.989368+0000","last_up_change":"2024-04-26T10:32:44.545583+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:32:49.859710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:32:50.968196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":41771},{"type":"v1","addr":"172.21.15.112:6801","nonce":41771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":41771},{"type":"v1","addr":"172.21.15.112:6803","nonce":41771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":41771},{"type":"v1","addr":"172.21.15.112:6807","nonce":41771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":41771},{"type":"v1","addr":"172.21.15.112:6805","nonce":41771}]},"public_addr":"172.21.15.112:6801/41771","cluster_addr":"172.21.15.112:6803/41771","heartbeat_back_addr":"172.21.15.112:6807/41771","heartbeat_front_addr":"172.21.15.112:6805/41771","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:33:02.301 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T10:33:02.301 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T10:33:02.302 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T10:33:02.473 INFO:teuthology.orchestra.run.smithi043.stdout:34359738373 2024-04-26T10:33:02.474 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T10:33:02.479 INFO:teuthology.orchestra.run.smithi043.stdout:34359738373 2024-04-26T10:33:02.480 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T10:33:02.480 INFO:teuthology.orchestra.run.smithi043.stdout:34359738374 2024-04-26T10:33:02.480 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T10:33:02.830 INFO:teuthology.orchestra.run.smithi043.stdout:34359738372 2024-04-26T10:33:02.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.1 2024-04-26T10:33:02.872 INFO:teuthology.orchestra.run.smithi043.stdout:34359738372 2024-04-26T10:33:02.883 INFO:teuthology.orchestra.run.smithi043.stdout:34359738373 2024-04-26T10:33:02.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738372 for osd.0 2024-04-26T10:33:02.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.2 2024-04-26T10:33:03.846 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T10:33:03.888 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T10:33:03.899 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T10:33:04.216 INFO:teuthology.orchestra.run.smithi043.stdout:34359738373 2024-04-26T10:33:04.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.1 2024-04-26T10:33:04.232 DEBUG:teuthology.parallel:result is None 2024-04-26T10:33:04.252 INFO:teuthology.orchestra.run.smithi043.stdout:34359738373 2024-04-26T10:33:04.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.0 2024-04-26T10:33:04.267 DEBUG:teuthology.parallel:result is None 2024-04-26T10:33:04.286 INFO:teuthology.orchestra.run.smithi043.stdout:34359738374 2024-04-26T10:33:04.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.2 2024-04-26T10:33:04.300 DEBUG:teuthology.parallel:result is None 2024-04-26T10:33:04.300 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T10:33:04.301 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:33:04.684 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:04.686 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:33:04.696 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-26T10:33:02.986696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82684,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032836,"statfs":{"total":289910292480,"available":289825624064,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002378"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996155+0000","last_change":"2024-04-26T10:32:51.998840+0000","last_active":"2024-04-26T10:32:52.996155+0000","last_peered":"2024-04-26T10:32:52.996155+0000","last_clean":"2024-04-26T10:32:52.996155+0000","last_became_active":"2024-04-26T10:32:51.998236+0000","last_became_peered":"2024-04-26T10:32:51.998236+0000","last_unstale":"2024-04-26T10:32:52.996155+0000","last_undegraded":"2024-04-26T10:32:52.996155+0000","last_fullsized":"2024-04-26T10:32:52.996155+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995759+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:32:52.995759+0000","last_peered":"2024-04-26T10:32:52.995759+0000","last_clean":"2024-04-26T10:32:52.995759+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:32:52.995759+0000","last_undegraded":"2024-04-26T10:32:52.995759+0000","last_fullsized":"2024-04-26T10:32:52.995759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996256+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:32:52.996256+0000","last_peered":"2024-04-26T10:32:52.996256+0000","last_clean":"2024-04-26T10:32:52.996256+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:32:52.996256+0000","last_undegraded":"2024-04-26T10:32:52.996256+0000","last_fullsized":"2024-04-26T10:32:52.996256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996029+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:32:52.996029+0000","last_peered":"2024-04-26T10:32:52.996029+0000","last_clean":"2024-04-26T10:32:52.996029+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:32:52.996029+0000","last_undegraded":"2024-04-26T10:32:52.996029+0000","last_fullsized":"2024-04-26T10:32:52.996029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995460+0000","last_change":"2024-04-26T10:32:51.999420+0000","last_active":"2024-04-26T10:32:52.995460+0000","last_peered":"2024-04-26T10:32:52.995460+0000","last_clean":"2024-04-26T10:32:52.995460+0000","last_became_active":"2024-04-26T10:32:51.999046+0000","last_became_peered":"2024-04-26T10:32:51.999046+0000","last_unstale":"2024-04-26T10:32:52.995460+0000","last_undegraded":"2024-04-26T10:32:52.995460+0000","last_fullsized":"2024-04-26T10:32:52.995460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:10.442986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995344+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:32:52.995344+0000","last_peered":"2024-04-26T10:32:52.995344+0000","last_clean":"2024-04-26T10:32:52.995344+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:32:52.995344+0000","last_undegraded":"2024-04-26T10:32:52.995344+0000","last_fullsized":"2024-04-26T10:32:52.995344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995441+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:32:52.995441+0000","last_peered":"2024-04-26T10:32:52.995441+0000","last_clean":"2024-04-26T10:32:52.995441+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:32:52.995441+0000","last_undegraded":"2024-04-26T10:32:52.995441+0000","last_fullsized":"2024-04-26T10:32:52.995441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995369+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:32:52.995369+0000","last_peered":"2024-04-26T10:32:52.995369+0000","last_clean":"2024-04-26T10:32:52.995369+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:32:52.995369+0000","last_undegraded":"2024-04-26T10:32:52.995369+0000","last_fullsized":"2024-04-26T10:32:52.995369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698360+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:32:54.698360+0000","last_peered":"2024-04-26T10:32:54.698360+0000","last_clean":"2024-04-26T10:32:54.698360+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:32:54.698360+0000","last_undegraded":"2024-04-26T10:32:54.698360+0000","last_fullsized":"2024-04-26T10:32:54.698360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995967+0000","last_change":"2024-04-26T10:32:52.000612+0000","last_active":"2024-04-26T10:32:52.995967+0000","last_peered":"2024-04-26T10:32:52.995967+0000","last_clean":"2024-04-26T10:32:52.995967+0000","last_became_active":"2024-04-26T10:32:51.998958+0000","last_became_peered":"2024-04-26T10:32:51.998958+0000","last_unstale":"2024-04-26T10:32:52.995967+0000","last_undegraded":"2024-04-26T10:32:52.995967+0000","last_fullsized":"2024-04-26T10:32:52.995967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996112+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:32:52.996112+0000","last_peered":"2024-04-26T10:32:52.996112+0000","last_clean":"2024-04-26T10:32:52.996112+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:32:52.996112+0000","last_undegraded":"2024-04-26T10:32:52.996112+0000","last_fullsized":"2024-04-26T10:32:52.996112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995621+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:32:52.995621+0000","last_peered":"2024-04-26T10:32:52.995621+0000","last_clean":"2024-04-26T10:32:52.995621+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:32:52.995621+0000","last_undegraded":"2024-04-26T10:32:52.995621+0000","last_fullsized":"2024-04-26T10:32:52.995621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995312+0000","last_change":"2024-04-26T10:32:52.000261+0000","last_active":"2024-04-26T10:32:52.995312+0000","last_peered":"2024-04-26T10:32:52.995312+0000","last_clean":"2024-04-26T10:32:52.995312+0000","last_became_active":"2024-04-26T10:32:51.999284+0000","last_became_peered":"2024-04-26T10:32:51.999284+0000","last_unstale":"2024-04-26T10:32:52.995312+0000","last_undegraded":"2024-04-26T10:32:52.995312+0000","last_fullsized":"2024-04-26T10:32:52.995312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995910+0000","last_change":"2024-04-26T10:32:52.003123+0000","last_active":"2024-04-26T10:32:52.995910+0000","last_peered":"2024-04-26T10:32:52.995910+0000","last_clean":"2024-04-26T10:32:52.995910+0000","last_became_active":"2024-04-26T10:32:52.001353+0000","last_became_peered":"2024-04-26T10:32:52.001353+0000","last_unstale":"2024-04-26T10:32:52.995910+0000","last_undegraded":"2024-04-26T10:32:52.995910+0000","last_fullsized":"2024-04-26T10:32:52.995910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:59:49.869670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995298+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:32:52.995298+0000","last_peered":"2024-04-26T10:32:52.995298+0000","last_clean":"2024-04-26T10:32:52.995298+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:32:52.995298+0000","last_undegraded":"2024-04-26T10:32:52.995298+0000","last_fullsized":"2024-04-26T10:32:52.995298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995391+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:32:52.995391+0000","last_peered":"2024-04-26T10:32:52.995391+0000","last_clean":"2024-04-26T10:32:52.995391+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:32:52.995391+0000","last_undegraded":"2024-04-26T10:32:52.995391+0000","last_fullsized":"2024-04-26T10:32:52.995391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698457+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:32:54.698457+0000","last_peered":"2024-04-26T10:32:54.698457+0000","last_clean":"2024-04-26T10:32:54.698457+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:32:54.698457+0000","last_undegraded":"2024-04-26T10:32:54.698457+0000","last_fullsized":"2024-04-26T10:32:54.698457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996082+0000","last_change":"2024-04-26T10:32:52.000693+0000","last_active":"2024-04-26T10:32:52.996082+0000","last_peered":"2024-04-26T10:32:52.996082+0000","last_clean":"2024-04-26T10:32:52.996082+0000","last_became_active":"2024-04-26T10:32:51.999406+0000","last_became_peered":"2024-04-26T10:32:51.999406+0000","last_unstale":"2024-04-26T10:32:52.996082+0000","last_undegraded":"2024-04-26T10:32:52.996082+0000","last_fullsized":"2024-04-26T10:32:52.996082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698211+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:32:54.698211+0000","last_peered":"2024-04-26T10:32:54.698211+0000","last_clean":"2024-04-26T10:32:54.698211+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:32:54.698211+0000","last_undegraded":"2024-04-26T10:32:54.698211+0000","last_fullsized":"2024-04-26T10:32:54.698211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996035+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:32:52.996035+0000","last_peered":"2024-04-26T10:32:52.996035+0000","last_clean":"2024-04-26T10:32:52.996035+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:32:52.996035+0000","last_undegraded":"2024-04-26T10:32:52.996035+0000","last_fullsized":"2024-04-26T10:32:52.996035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995635+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:32:52.995635+0000","last_peered":"2024-04-26T10:32:52.995635+0000","last_clean":"2024-04-26T10:32:52.995635+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:32:52.995635+0000","last_undegraded":"2024-04-26T10:32:52.995635+0000","last_fullsized":"2024-04-26T10:32:52.995635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995342+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:32:52.995342+0000","last_peered":"2024-04-26T10:32:52.995342+0000","last_clean":"2024-04-26T10:32:52.995342+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:32:52.995342+0000","last_undegraded":"2024-04-26T10:32:52.995342+0000","last_fullsized":"2024-04-26T10:32:52.995342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697661+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:32:54.697661+0000","last_peered":"2024-04-26T10:32:54.697661+0000","last_clean":"2024-04-26T10:32:54.697661+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:32:54.697661+0000","last_undegraded":"2024-04-26T10:32:54.697661+0000","last_fullsized":"2024-04-26T10:32:54.697661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995428+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:32:52.995428+0000","last_peered":"2024-04-26T10:32:52.995428+0000","last_clean":"2024-04-26T10:32:52.995428+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:32:52.995428+0000","last_undegraded":"2024-04-26T10:32:52.995428+0000","last_fullsized":"2024-04-26T10:32:52.995428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996100+0000","last_change":"2024-04-26T10:32:52.004089+0000","last_active":"2024-04-26T10:32:52.996100+0000","last_peered":"2024-04-26T10:32:52.996100+0000","last_clean":"2024-04-26T10:32:52.996100+0000","last_became_active":"2024-04-26T10:32:52.003802+0000","last_became_peered":"2024-04-26T10:32:52.003802+0000","last_unstale":"2024-04-26T10:32:52.996100+0000","last_undegraded":"2024-04-26T10:32:52.996100+0000","last_fullsized":"2024-04-26T10:32:52.996100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698384+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:32:54.698384+0000","last_peered":"2024-04-26T10:32:54.698384+0000","last_clean":"2024-04-26T10:32:54.698384+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:32:54.698384+0000","last_undegraded":"2024-04-26T10:32:54.698384+0000","last_fullsized":"2024-04-26T10:32:54.698384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996122+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:32:52.996122+0000","last_peered":"2024-04-26T10:32:52.996122+0000","last_clean":"2024-04-26T10:32:52.996122+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:32:52.996122+0000","last_undegraded":"2024-04-26T10:32:52.996122+0000","last_fullsized":"2024-04-26T10:32:52.996122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995270+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:32:52.995270+0000","last_peered":"2024-04-26T10:32:52.995270+0000","last_clean":"2024-04-26T10:32:52.995270+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:32:52.995270+0000","last_undegraded":"2024-04-26T10:32:52.995270+0000","last_fullsized":"2024-04-26T10:32:52.995270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996297+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:32:52.996297+0000","last_peered":"2024-04-26T10:32:52.996297+0000","last_clean":"2024-04-26T10:32:52.996297+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:32:52.996297+0000","last_undegraded":"2024-04-26T10:32:52.996297+0000","last_fullsized":"2024-04-26T10:32:52.996297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697734+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:32:54.697734+0000","last_peered":"2024-04-26T10:32:54.697734+0000","last_clean":"2024-04-26T10:32:54.697734+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:32:54.697734+0000","last_undegraded":"2024-04-26T10:32:54.697734+0000","last_fullsized":"2024-04-26T10:32:54.697734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698491+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:32:54.698491+0000","last_peered":"2024-04-26T10:32:54.698491+0000","last_clean":"2024-04-26T10:32:54.698491+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:32:54.698491+0000","last_undegraded":"2024-04-26T10:32:54.698491+0000","last_fullsized":"2024-04-26T10:32:54.698491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697582+0000","last_change":"2024-04-26T10:32:51.588353+0000","last_active":"2024-04-26T10:32:54.697582+0000","last_peered":"2024-04-26T10:32:54.697582+0000","last_clean":"2024-04-26T10:32:54.697582+0000","last_became_active":"2024-04-26T10:32:51.587981+0000","last_became_peered":"2024-04-26T10:32:51.587981+0000","last_unstale":"2024-04-26T10:32:54.697582+0000","last_undegraded":"2024-04-26T10:32:54.697582+0000","last_fullsized":"2024-04-26T10:32:54.697582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:20.810803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996039+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:32:52.996039+0000","last_peered":"2024-04-26T10:32:52.996039+0000","last_clean":"2024-04-26T10:32:52.996039+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:32:52.996039+0000","last_undegraded":"2024-04-26T10:32:52.996039+0000","last_fullsized":"2024-04-26T10:32:52.996039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698553+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:32:54.698553+0000","last_peered":"2024-04-26T10:32:54.698553+0000","last_clean":"2024-04-26T10:32:54.698553+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:32:54.698553+0000","last_undegraded":"2024-04-26T10:32:54.698553+0000","last_fullsized":"2024-04-26T10:32:54.698553+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697438+0000","last_change":"2024-04-26T10:32:52.008030+0000","last_active":"2024-04-26T10:32:54.697438+0000","last_peered":"2024-04-26T10:32:54.697438+0000","last_clean":"2024-04-26T10:32:54.697438+0000","last_became_active":"2024-04-26T10:32:52.007158+0000","last_became_peered":"2024-04-26T10:32:52.007158+0000","last_unstale":"2024-04-26T10:32:54.697438+0000","last_undegraded":"2024-04-26T10:32:54.697438+0000","last_fullsized":"2024-04-26T10:32:54.697438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996258+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:32:52.996258+0000","last_peered":"2024-04-26T10:32:52.996258+0000","last_clean":"2024-04-26T10:32:52.996258+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:32:52.996258+0000","last_undegraded":"2024-04-26T10:32:52.996258+0000","last_fullsized":"2024-04-26T10:32:52.996258+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697790+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:32:54.697790+0000","last_peered":"2024-04-26T10:32:54.697790+0000","last_clean":"2024-04-26T10:32:54.697790+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:32:54.697790+0000","last_undegraded":"2024-04-26T10:32:54.697790+0000","last_fullsized":"2024-04-26T10:32:54.697790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996094+0000","last_change":"2024-04-26T10:32:51.586732+0000","last_active":"2024-04-26T10:32:52.996094+0000","last_peered":"2024-04-26T10:32:52.996094+0000","last_clean":"2024-04-26T10:32:52.996094+0000","last_became_active":"2024-04-26T10:32:51.586533+0000","last_became_peered":"2024-04-26T10:32:51.586533+0000","last_unstale":"2024-04-26T10:32:52.996094+0000","last_undegraded":"2024-04-26T10:32:52.996094+0000","last_fullsized":"2024-04-26T10:32:52.996094+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697696+0000","last_change":"2024-04-26T10:32:52.007650+0000","last_active":"2024-04-26T10:32:54.697696+0000","last_peered":"2024-04-26T10:32:54.697696+0000","last_clean":"2024-04-26T10:32:54.697696+0000","last_became_active":"2024-04-26T10:32:52.007261+0000","last_became_peered":"2024-04-26T10:32:52.007261+0000","last_unstale":"2024-04-26T10:32:54.697696+0000","last_undegraded":"2024-04-26T10:32:54.697696+0000","last_fullsized":"2024-04-26T10:32:54.697696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995900+0000","last_change":"2024-04-26T10:32:51.584497+0000","last_active":"2024-04-26T10:32:52.995900+0000","last_peered":"2024-04-26T10:32:52.995900+0000","last_clean":"2024-04-26T10:32:52.995900+0000","last_became_active":"2024-04-26T10:32:51.583460+0000","last_became_peered":"2024-04-26T10:32:51.583460+0000","last_unstale":"2024-04-26T10:32:52.995900+0000","last_undegraded":"2024-04-26T10:32:52.995900+0000","last_fullsized":"2024-04-26T10:32:52.995900+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995887+0000","last_change":"2024-04-26T10:32:52.001738+0000","last_active":"2024-04-26T10:32:52.995887+0000","last_peered":"2024-04-26T10:32:52.995887+0000","last_clean":"2024-04-26T10:32:52.995887+0000","last_became_active":"2024-04-26T10:32:51.999263+0000","last_became_peered":"2024-04-26T10:32:51.999263+0000","last_unstale":"2024-04-26T10:32:52.995887+0000","last_undegraded":"2024-04-26T10:32:52.995887+0000","last_fullsized":"2024-04-26T10:32:52.995887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:14.966669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995874+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:32:52.995874+0000","last_peered":"2024-04-26T10:32:52.995874+0000","last_clean":"2024-04-26T10:32:52.995874+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:32:52.995874+0000","last_undegraded":"2024-04-26T10:32:52.995874+0000","last_fullsized":"2024-04-26T10:32:52.995874+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995839+0000","last_change":"2024-04-26T10:32:52.000043+0000","last_active":"2024-04-26T10:32:52.995839+0000","last_peered":"2024-04-26T10:32:52.995839+0000","last_clean":"2024-04-26T10:32:52.995839+0000","last_became_active":"2024-04-26T10:32:51.999069+0000","last_became_peered":"2024-04-26T10:32:51.999069+0000","last_unstale":"2024-04-26T10:32:52.995839+0000","last_undegraded":"2024-04-26T10:32:52.995839+0000","last_fullsized":"2024-04-26T10:32:52.995839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697777+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:32:54.697777+0000","last_peered":"2024-04-26T10:32:54.697777+0000","last_clean":"2024-04-26T10:32:54.697777+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:32:54.697777+0000","last_undegraded":"2024-04-26T10:32:54.697777+0000","last_fullsized":"2024-04-26T10:32:54.697777+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996289+0000","last_change":"2024-04-26T10:32:52.000628+0000","last_active":"2024-04-26T10:32:52.996289+0000","last_peered":"2024-04-26T10:32:52.996289+0000","last_clean":"2024-04-26T10:32:52.996289+0000","last_became_active":"2024-04-26T10:32:51.998121+0000","last_became_peered":"2024-04-26T10:32:51.998121+0000","last_unstale":"2024-04-26T10:32:52.996289+0000","last_undegraded":"2024-04-26T10:32:52.996289+0000","last_fullsized":"2024-04-26T10:32:52.996289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.293526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995394+0000","last_change":"2024-04-26T10:32:51.584210+0000","last_active":"2024-04-26T10:32:52.995394+0000","last_peered":"2024-04-26T10:32:52.995394+0000","last_clean":"2024-04-26T10:32:52.995394+0000","last_became_active":"2024-04-26T10:32:51.583823+0000","last_became_peered":"2024-04-26T10:32:51.583823+0000","last_unstale":"2024-04-26T10:32:52.995394+0000","last_undegraded":"2024-04-26T10:32:52.995394+0000","last_fullsized":"2024-04-26T10:32:52.995394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.121333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698492+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:32:54.698492+0000","last_peered":"2024-04-26T10:32:54.698492+0000","last_clean":"2024-04-26T10:32:54.698492+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:32:54.698492+0000","last_undegraded":"2024-04-26T10:32:54.698492+0000","last_fullsized":"2024-04-26T10:32:54.698492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995640+0000","last_change":"2024-04-26T10:32:51.584088+0000","last_active":"2024-04-26T10:32:52.995640+0000","last_peered":"2024-04-26T10:32:52.995640+0000","last_clean":"2024-04-26T10:32:52.995640+0000","last_became_active":"2024-04-26T10:32:51.583020+0000","last_became_peered":"2024-04-26T10:32:51.583020+0000","last_unstale":"2024-04-26T10:32:52.995640+0000","last_undegraded":"2024-04-26T10:32:52.995640+0000","last_fullsized":"2024-04-26T10:32:52.995640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698660+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:32:54.698660+0000","last_peered":"2024-04-26T10:32:54.698660+0000","last_clean":"2024-04-26T10:32:54.698660+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:32:54.698660+0000","last_undegraded":"2024-04-26T10:32:54.698660+0000","last_fullsized":"2024-04-26T10:32:54.698660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996288+0000","last_change":"2024-04-26T10:32:51.583791+0000","last_active":"2024-04-26T10:32:52.996288+0000","last_peered":"2024-04-26T10:32:52.996288+0000","last_clean":"2024-04-26T10:32:52.996288+0000","last_became_active":"2024-04-26T10:32:51.583103+0000","last_became_peered":"2024-04-26T10:32:51.583103+0000","last_unstale":"2024-04-26T10:32:52.996288+0000","last_undegraded":"2024-04-26T10:32:52.996288+0000","last_fullsized":"2024-04-26T10:32:52.996288+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.994938+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:32:52.994938+0000","last_peered":"2024-04-26T10:32:52.994938+0000","last_clean":"2024-04-26T10:32:52.994938+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:32:52.994938+0000","last_undegraded":"2024-04-26T10:32:52.994938+0000","last_fullsized":"2024-04-26T10:32:52.994938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995812+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:32:52.995812+0000","last_peered":"2024-04-26T10:32:52.995812+0000","last_clean":"2024-04-26T10:32:52.995812+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:32:52.995812+0000","last_undegraded":"2024-04-26T10:32:52.995812+0000","last_fullsized":"2024-04-26T10:32:52.995812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995440+0000","last_change":"2024-04-26T10:32:51.997516+0000","last_active":"2024-04-26T10:32:52.995440+0000","last_peered":"2024-04-26T10:32:52.995440+0000","last_clean":"2024-04-26T10:32:52.995440+0000","last_became_active":"2024-04-26T10:32:51.996896+0000","last_became_peered":"2024-04-26T10:32:51.996896+0000","last_unstale":"2024-04-26T10:32:52.995440+0000","last_undegraded":"2024-04-26T10:32:52.995440+0000","last_fullsized":"2024-04-26T10:32:52.995440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:51.552418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996431+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:32:52.996431+0000","last_peered":"2024-04-26T10:32:52.996431+0000","last_clean":"2024-04-26T10:32:52.996431+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:32:52.996431+0000","last_undegraded":"2024-04-26T10:32:52.996431+0000","last_fullsized":"2024-04-26T10:32:52.996431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995565+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:32:52.995565+0000","last_peered":"2024-04-26T10:32:52.995565+0000","last_clean":"2024-04-26T10:32:52.995565+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:32:52.995565+0000","last_undegraded":"2024-04-26T10:32:52.995565+0000","last_fullsized":"2024-04-26T10:32:52.995565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995674+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:32:52.995674+0000","last_peered":"2024-04-26T10:32:52.995674+0000","last_clean":"2024-04-26T10:32:52.995674+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:32:52.995674+0000","last_undegraded":"2024-04-26T10:32:52.995674+0000","last_fullsized":"2024-04-26T10:32:52.995674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697950+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:32:54.697950+0000","last_peered":"2024-04-26T10:32:54.697950+0000","last_clean":"2024-04-26T10:32:54.697950+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:32:54.697950+0000","last_undegraded":"2024-04-26T10:32:54.697950+0000","last_fullsized":"2024-04-26T10:32:54.697950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697966+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:32:54.697966+0000","last_peered":"2024-04-26T10:32:54.697966+0000","last_clean":"2024-04-26T10:32:54.697966+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:32:54.697966+0000","last_undegraded":"2024-04-26T10:32:54.697966+0000","last_fullsized":"2024-04-26T10:32:54.697966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995743+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:32:52.995743+0000","last_peered":"2024-04-26T10:32:52.995743+0000","last_clean":"2024-04-26T10:32:52.995743+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:32:52.995743+0000","last_undegraded":"2024-04-26T10:32:52.995743+0000","last_fullsized":"2024-04-26T10:32:52.995743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995417+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:32:52.995417+0000","last_peered":"2024-04-26T10:32:52.995417+0000","last_clean":"2024-04-26T10:32:52.995417+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:32:52.995417+0000","last_undegraded":"2024-04-26T10:32:52.995417+0000","last_fullsized":"2024-04-26T10:32:52.995417+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996362+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:32:52.996362+0000","last_peered":"2024-04-26T10:32:52.996362+0000","last_clean":"2024-04-26T10:32:52.996362+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:32:52.996362+0000","last_undegraded":"2024-04-26T10:32:52.996362+0000","last_fullsized":"2024-04-26T10:32:52.996362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995012+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:32:52.995012+0000","last_peered":"2024-04-26T10:32:52.995012+0000","last_clean":"2024-04-26T10:32:52.995012+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:32:52.995012+0000","last_undegraded":"2024-04-26T10:32:52.995012+0000","last_fullsized":"2024-04-26T10:32:52.995012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996322+0000","last_change":"2024-04-26T10:32:52.004444+0000","last_active":"2024-04-26T10:32:52.996322+0000","last_peered":"2024-04-26T10:32:52.996322+0000","last_clean":"2024-04-26T10:32:52.996322+0000","last_became_active":"2024-04-26T10:32:52.003360+0000","last_became_peered":"2024-04-26T10:32:52.003360+0000","last_unstale":"2024-04-26T10:32:52.996322+0000","last_undegraded":"2024-04-26T10:32:52.996322+0000","last_fullsized":"2024-04-26T10:32:52.996322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:20.180213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995117+0000","last_change":"2024-04-26T10:32:51.584385+0000","last_active":"2024-04-26T10:32:52.995117+0000","last_peered":"2024-04-26T10:32:52.995117+0000","last_clean":"2024-04-26T10:32:52.995117+0000","last_became_active":"2024-04-26T10:32:51.584025+0000","last_became_peered":"2024-04-26T10:32:51.584025+0000","last_unstale":"2024-04-26T10:32:52.995117+0000","last_undegraded":"2024-04-26T10:32:52.995117+0000","last_fullsized":"2024-04-26T10:32:52.995117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:57.247011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698499+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:32:54.698499+0000","last_peered":"2024-04-26T10:32:54.698499+0000","last_clean":"2024-04-26T10:32:54.698499+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:32:54.698499+0000","last_undegraded":"2024-04-26T10:32:54.698499+0000","last_fullsized":"2024-04-26T10:32:54.698499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.999504+0000","last_change":"2024-04-26T10:32:46.555353+0000","last_active":"2024-04-26T10:32:51.999504+0000","last_peered":"2024-04-26T10:32:51.999504+0000","last_clean":"2024-04-26T10:32:51.999504+0000","last_became_active":"2024-04-26T10:32:46.555005+0000","last_became_peered":"2024-04-26T10:32:46.555005+0000","last_unstale":"2024-04-26T10:32:51.999504+0000","last_undegraded":"2024-04-26T10:32:51.999504+0000","last_fullsized":"2024-04-26T10:32:51.999504+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996229+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:32:52.996229+0000","last_peered":"2024-04-26T10:32:52.996229+0000","last_clean":"2024-04-26T10:32:52.996229+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:32:52.996229+0000","last_undegraded":"2024-04-26T10:32:52.996229+0000","last_fullsized":"2024-04-26T10:32:52.996229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995425+0000","last_change":"2024-04-26T10:32:52.004199+0000","last_active":"2024-04-26T10:32:52.995425+0000","last_peered":"2024-04-26T10:32:52.995425+0000","last_clean":"2024-04-26T10:32:52.995425+0000","last_became_active":"2024-04-26T10:32:52.003894+0000","last_became_peered":"2024-04-26T10:32:52.003894+0000","last_unstale":"2024-04-26T10:32:52.995425+0000","last_undegraded":"2024-04-26T10:32:52.995425+0000","last_fullsized":"2024-04-26T10:32:52.995425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.000379+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:32:52.000379+0000","last_peered":"2024-04-26T10:32:52.000379+0000","last_clean":"2024-04-26T10:32:52.000379+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:32:52.000379+0000","last_undegraded":"2024-04-26T10:32:52.000379+0000","last_fullsized":"2024-04-26T10:32:52.000379+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995781+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:32:52.995781+0000","last_peered":"2024-04-26T10:32:52.995781+0000","last_clean":"2024-04-26T10:32:52.995781+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:32:52.995781+0000","last_undegraded":"2024-04-26T10:32:52.995781+0000","last_fullsized":"2024-04-26T10:32:52.995781+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698151+0000","last_change":"2024-04-26T10:32:52.007589+0000","last_active":"2024-04-26T10:32:54.698151+0000","last_peered":"2024-04-26T10:32:54.698151+0000","last_clean":"2024-04-26T10:32:54.698151+0000","last_became_active":"2024-04-26T10:32:52.007289+0000","last_became_peered":"2024-04-26T10:32:52.007289+0000","last_unstale":"2024-04-26T10:32:54.698151+0000","last_undegraded":"2024-04-26T10:32:54.698151+0000","last_fullsized":"2024-04-26T10:32:54.698151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.998883+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:32:51.998883+0000","last_peered":"2024-04-26T10:32:51.998883+0000","last_clean":"2024-04-26T10:32:51.998883+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:32:51.998883+0000","last_undegraded":"2024-04-26T10:32:51.998883+0000","last_fullsized":"2024-04-26T10:32:51.998883+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995047+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:32:52.995047+0000","last_peered":"2024-04-26T10:32:52.995047+0000","last_clean":"2024-04-26T10:32:52.995047+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:32:52.995047+0000","last_undegraded":"2024-04-26T10:32:52.995047+0000","last_fullsized":"2024-04-26T10:32:52.995047+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698612+0000","last_change":"2024-04-26T10:32:52.009270+0000","last_active":"2024-04-26T10:32:54.698612+0000","last_peered":"2024-04-26T10:32:54.698612+0000","last_clean":"2024-04-26T10:32:54.698612+0000","last_became_active":"2024-04-26T10:32:52.008599+0000","last_became_peered":"2024-04-26T10:32:52.008599+0000","last_unstale":"2024-04-26T10:32:54.698612+0000","last_undegraded":"2024-04-26T10:32:54.698612+0000","last_fullsized":"2024-04-26T10:32:54.698612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.000550+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:32:52.000550+0000","last_peered":"2024-04-26T10:32:52.000550+0000","last_clean":"2024-04-26T10:32:52.000550+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:32:52.000550+0000","last_undegraded":"2024-04-26T10:32:52.000550+0000","last_fullsized":"2024-04-26T10:32:52.000550+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.997944+0000","last_change":"2024-04-26T10:32:46.555694+0000","last_active":"2024-04-26T10:32:51.997944+0000","last_peered":"2024-04-26T10:32:51.997944+0000","last_clean":"2024-04-26T10:32:51.997944+0000","last_became_active":"2024-04-26T10:32:46.555391+0000","last_became_peered":"2024-04-26T10:32:46.555391+0000","last_unstale":"2024-04-26T10:32:51.997944+0000","last_undegraded":"2024-04-26T10:32:51.997944+0000","last_fullsized":"2024-04-26T10:32:51.997944+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697661+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:32:54.697661+0000","last_peered":"2024-04-26T10:32:54.697661+0000","last_clean":"2024-04-26T10:32:54.697661+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:32:54.697661+0000","last_undegraded":"2024-04-26T10:32:54.697661+0000","last_fullsized":"2024-04-26T10:32:54.697661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996350+0000","last_change":"2024-04-26T10:32:52.006765+0000","last_active":"2024-04-26T10:32:52.996350+0000","last_peered":"2024-04-26T10:32:52.996350+0000","last_clean":"2024-04-26T10:32:52.996350+0000","last_became_active":"2024-04-26T10:32:52.004110+0000","last_became_peered":"2024-04-26T10:32:52.004110+0000","last_unstale":"2024-04-26T10:32:52.996350+0000","last_undegraded":"2024-04-26T10:32:52.996350+0000","last_fullsized":"2024-04-26T10:32:52.996350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:47.156703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.998516+0000","last_change":"2024-04-26T10:32:46.555501+0000","last_active":"2024-04-26T10:32:51.998516+0000","last_peered":"2024-04-26T10:32:51.998516+0000","last_clean":"2024-04-26T10:32:51.998516+0000","last_became_active":"2024-04-26T10:32:46.555252+0000","last_became_peered":"2024-04-26T10:32:46.555252+0000","last_unstale":"2024-04-26T10:32:51.998516+0000","last_undegraded":"2024-04-26T10:32:51.998516+0000","last_fullsized":"2024-04-26T10:32:51.998516+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697491+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:32:54.697491+0000","last_peered":"2024-04-26T10:32:54.697491+0000","last_clean":"2024-04-26T10:32:54.697491+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:32:54.697491+0000","last_undegraded":"2024-04-26T10:32:54.697491+0000","last_fullsized":"2024-04-26T10:32:54.697491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995980+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:32:52.995980+0000","last_peered":"2024-04-26T10:32:52.995980+0000","last_clean":"2024-04-26T10:32:52.995980+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:32:52.995980+0000","last_undegraded":"2024-04-26T10:32:52.995980+0000","last_fullsized":"2024-04-26T10:32:52.995980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.993416+0000","last_change":"2024-04-26T10:32:46.556007+0000","last_active":"2024-04-26T10:32:51.993416+0000","last_peered":"2024-04-26T10:32:51.993416+0000","last_clean":"2024-04-26T10:32:51.993416+0000","last_became_active":"2024-04-26T10:32:46.555738+0000","last_became_peered":"2024-04-26T10:32:46.555738+0000","last_unstale":"2024-04-26T10:32:51.993416+0000","last_undegraded":"2024-04-26T10:32:51.993416+0000","last_fullsized":"2024-04-26T10:32:51.993416+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:04.230186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698307+0000","last_change":"2024-04-26T10:32:51.589352+0000","last_active":"2024-04-26T10:32:54.698307+0000","last_peered":"2024-04-26T10:32:54.698307+0000","last_clean":"2024-04-26T10:32:54.698307+0000","last_became_active":"2024-04-26T10:32:51.589006+0000","last_became_peered":"2024-04-26T10:32:51.589006+0000","last_unstale":"2024-04-26T10:32:54.698307+0000","last_undegraded":"2024-04-26T10:32:54.698307+0000","last_fullsized":"2024-04-26T10:32:54.698307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995503+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:32:52.995503+0000","last_peered":"2024-04-26T10:32:52.995503+0000","last_clean":"2024-04-26T10:32:52.995503+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:32:52.995503+0000","last_undegraded":"2024-04-26T10:32:52.995503+0000","last_fullsized":"2024-04-26T10:32:52.995503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698429+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:32:54.698429+0000","last_peered":"2024-04-26T10:32:54.698429+0000","last_clean":"2024-04-26T10:32:54.698429+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:32:54.698429+0000","last_undegraded":"2024-04-26T10:32:54.698429+0000","last_fullsized":"2024-04-26T10:32:54.698429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.001757+0000","last_change":"2024-04-26T10:32:46.555394+0000","last_active":"2024-04-26T10:32:52.001757+0000","last_peered":"2024-04-26T10:32:52.001757+0000","last_clean":"2024-04-26T10:32:52.001757+0000","last_became_active":"2024-04-26T10:32:46.555053+0000","last_became_peered":"2024-04-26T10:32:46.555053+0000","last_unstale":"2024-04-26T10:32:52.001757+0000","last_undegraded":"2024-04-26T10:32:52.001757+0000","last_fullsized":"2024-04-26T10:32:52.001757+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697328+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:32:54.697328+0000","last_peered":"2024-04-26T10:32:54.697328+0000","last_clean":"2024-04-26T10:32:54.697328+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:32:54.697328+0000","last_undegraded":"2024-04-26T10:32:54.697328+0000","last_fullsized":"2024-04-26T10:32:54.697328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.002371+0000","last_change":"2024-04-26T10:32:46.555191+0000","last_active":"2024-04-26T10:32:52.002371+0000","last_peered":"2024-04-26T10:32:52.002371+0000","last_clean":"2024-04-26T10:32:52.002371+0000","last_became_active":"2024-04-26T10:32:46.554892+0000","last_became_peered":"2024-04-26T10:32:46.554892+0000","last_unstale":"2024-04-26T10:32:52.002371+0000","last_undegraded":"2024-04-26T10:32:52.002371+0000","last_fullsized":"2024-04-26T10:32:52.002371+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.991584+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:32:54.991584+0000","last_peered":"2024-04-26T10:32:54.991584+0000","last_clean":"2024-04-26T10:32:54.991584+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:32:54.991584+0000","last_undegraded":"2024-04-26T10:32:54.991584+0000","last_fullsized":"2024-04-26T10:32:54.991584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995288+0000","last_change":"2024-04-26T10:32:52.001408+0000","last_active":"2024-04-26T10:32:52.995288+0000","last_peered":"2024-04-26T10:32:52.995288+0000","last_clean":"2024-04-26T10:32:52.995288+0000","last_became_active":"2024-04-26T10:32:52.000668+0000","last_became_peered":"2024-04-26T10:32:52.000668+0000","last_unstale":"2024-04-26T10:32:52.995288+0000","last_undegraded":"2024-04-26T10:32:52.995288+0000","last_fullsized":"2024-04-26T10:32:52.995288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995353+0000","last_change":"2024-04-26T10:32:51.586234+0000","last_active":"2024-04-26T10:32:52.995353+0000","last_peered":"2024-04-26T10:32:52.995353+0000","last_clean":"2024-04-26T10:32:52.995353+0000","last_became_active":"2024-04-26T10:32:51.586004+0000","last_became_peered":"2024-04-26T10:32:51.586004+0000","last_unstale":"2024-04-26T10:32:52.995353+0000","last_undegraded":"2024-04-26T10:32:52.995353+0000","last_fullsized":"2024-04-26T10:32:52.995353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:03.977752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995947+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:32:52.995947+0000","last_peered":"2024-04-26T10:32:52.995947+0000","last_clean":"2024-04-26T10:32:52.995947+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:32:52.995947+0000","last_undegraded":"2024-04-26T10:32:52.995947+0000","last_fullsized":"2024-04-26T10:32:52.995947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995869+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:32:52.995869+0000","last_peered":"2024-04-26T10:32:52.995869+0000","last_clean":"2024-04-26T10:32:52.995869+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:32:52.995869+0000","last_undegraded":"2024-04-26T10:32:52.995869+0000","last_fullsized":"2024-04-26T10:32:52.995869+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995676+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:32:52.995676+0000","last_peered":"2024-04-26T10:32:52.995676+0000","last_clean":"2024-04-26T10:32:52.995676+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:32:52.995676+0000","last_undegraded":"2024-04-26T10:32:52.995676+0000","last_fullsized":"2024-04-26T10:32:52.995676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996240+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:32:52.996240+0000","last_peered":"2024-04-26T10:32:52.996240+0000","last_clean":"2024-04-26T10:32:52.996240+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:32:52.996240+0000","last_undegraded":"2024-04-26T10:32:52.996240+0000","last_fullsized":"2024-04-26T10:32:52.996240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995491+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:32:52.995491+0000","last_peered":"2024-04-26T10:32:52.995491+0000","last_clean":"2024-04-26T10:32:52.995491+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:32:52.995491+0000","last_undegraded":"2024-04-26T10:32:52.995491+0000","last_fullsized":"2024-04-26T10:32:52.995491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698596+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:32:54.698596+0000","last_peered":"2024-04-26T10:32:54.698596+0000","last_clean":"2024-04-26T10:32:54.698596+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:32:54.698596+0000","last_undegraded":"2024-04-26T10:32:54.698596+0000","last_fullsized":"2024-04-26T10:32:54.698596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995567+0000","last_change":"2024-04-26T10:32:51.999341+0000","last_active":"2024-04-26T10:32:52.995567+0000","last_peered":"2024-04-26T10:32:52.995567+0000","last_clean":"2024-04-26T10:32:52.995567+0000","last_became_active":"2024-04-26T10:32:51.998256+0000","last_became_peered":"2024-04-26T10:32:51.998256+0000","last_unstale":"2024-04-26T10:32:52.995567+0000","last_undegraded":"2024-04-26T10:32:52.995567+0000","last_fullsized":"2024-04-26T10:32:52.995567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698554+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:32:54.698554+0000","last_peered":"2024-04-26T10:32:54.698554+0000","last_clean":"2024-04-26T10:32:54.698554+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:32:54.698554+0000","last_undegraded":"2024-04-26T10:32:54.698554+0000","last_fullsized":"2024-04-26T10:32:54.698554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995762+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:32:52.995762+0000","last_peered":"2024-04-26T10:32:52.995762+0000","last_clean":"2024-04-26T10:32:52.995762+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:32:52.995762+0000","last_undegraded":"2024-04-26T10:32:52.995762+0000","last_fullsized":"2024-04-26T10:32:52.995762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995699+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:32:52.995699+0000","last_peered":"2024-04-26T10:32:52.995699+0000","last_clean":"2024-04-26T10:32:52.995699+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:32:52.995699+0000","last_undegraded":"2024-04-26T10:32:52.995699+0000","last_fullsized":"2024-04-26T10:32:52.995699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697606+0000","last_change":"2024-04-26T10:32:52.004844+0000","last_active":"2024-04-26T10:32:54.697606+0000","last_peered":"2024-04-26T10:32:54.697606+0000","last_clean":"2024-04-26T10:32:54.697606+0000","last_became_active":"2024-04-26T10:32:52.004484+0000","last_became_peered":"2024-04-26T10:32:52.004484+0000","last_unstale":"2024-04-26T10:32:54.697606+0000","last_undegraded":"2024-04-26T10:32:54.697606+0000","last_fullsized":"2024-04-26T10:32:54.697606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995521+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:32:52.995521+0000","last_peered":"2024-04-26T10:32:52.995521+0000","last_clean":"2024-04-26T10:32:52.995521+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:32:52.995521+0000","last_undegraded":"2024-04-26T10:32:52.995521+0000","last_fullsized":"2024-04-26T10:32:52.995521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698146+0000","last_change":"2024-04-26T10:32:52.007818+0000","last_active":"2024-04-26T10:32:54.698146+0000","last_peered":"2024-04-26T10:32:54.698146+0000","last_clean":"2024-04-26T10:32:54.698146+0000","last_became_active":"2024-04-26T10:32:52.007552+0000","last_became_peered":"2024-04-26T10:32:52.007552+0000","last_unstale":"2024-04-26T10:32:54.698146+0000","last_undegraded":"2024-04-26T10:32:54.698146+0000","last_fullsized":"2024-04-26T10:32:54.698146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995977+0000","last_change":"2024-04-26T10:32:52.010309+0000","last_active":"2024-04-26T10:32:52.995977+0000","last_peered":"2024-04-26T10:32:52.995977+0000","last_clean":"2024-04-26T10:32:52.995977+0000","last_became_active":"2024-04-26T10:32:52.009152+0000","last_became_peered":"2024-04-26T10:32:52.009152+0000","last_unstale":"2024-04-26T10:32:52.995977+0000","last_undegraded":"2024-04-26T10:32:52.995977+0000","last_fullsized":"2024-04-26T10:32:52.995977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:33:04.701 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:33:05.082 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:05.084 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:33:05.094 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-26T10:33:04.987329+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82684,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032836,"statfs":{"total":289910292480,"available":289825624064,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.994161"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996155+0000","last_change":"2024-04-26T10:32:51.998840+0000","last_active":"2024-04-26T10:32:52.996155+0000","last_peered":"2024-04-26T10:32:52.996155+0000","last_clean":"2024-04-26T10:32:52.996155+0000","last_became_active":"2024-04-26T10:32:51.998236+0000","last_became_peered":"2024-04-26T10:32:51.998236+0000","last_unstale":"2024-04-26T10:32:52.996155+0000","last_undegraded":"2024-04-26T10:32:52.996155+0000","last_fullsized":"2024-04-26T10:32:52.996155+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995759+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:32:52.995759+0000","last_peered":"2024-04-26T10:32:52.995759+0000","last_clean":"2024-04-26T10:32:52.995759+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:32:52.995759+0000","last_undegraded":"2024-04-26T10:32:52.995759+0000","last_fullsized":"2024-04-26T10:32:52.995759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996256+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:32:52.996256+0000","last_peered":"2024-04-26T10:32:52.996256+0000","last_clean":"2024-04-26T10:32:52.996256+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:32:52.996256+0000","last_undegraded":"2024-04-26T10:32:52.996256+0000","last_fullsized":"2024-04-26T10:32:52.996256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996029+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:32:52.996029+0000","last_peered":"2024-04-26T10:32:52.996029+0000","last_clean":"2024-04-26T10:32:52.996029+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:32:52.996029+0000","last_undegraded":"2024-04-26T10:32:52.996029+0000","last_fullsized":"2024-04-26T10:32:52.996029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995460+0000","last_change":"2024-04-26T10:32:51.999420+0000","last_active":"2024-04-26T10:32:52.995460+0000","last_peered":"2024-04-26T10:32:52.995460+0000","last_clean":"2024-04-26T10:32:52.995460+0000","last_became_active":"2024-04-26T10:32:51.999046+0000","last_became_peered":"2024-04-26T10:32:51.999046+0000","last_unstale":"2024-04-26T10:32:52.995460+0000","last_undegraded":"2024-04-26T10:32:52.995460+0000","last_fullsized":"2024-04-26T10:32:52.995460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:10.442986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995344+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:32:52.995344+0000","last_peered":"2024-04-26T10:32:52.995344+0000","last_clean":"2024-04-26T10:32:52.995344+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:32:52.995344+0000","last_undegraded":"2024-04-26T10:32:52.995344+0000","last_fullsized":"2024-04-26T10:32:52.995344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995441+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:32:52.995441+0000","last_peered":"2024-04-26T10:32:52.995441+0000","last_clean":"2024-04-26T10:32:52.995441+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:32:52.995441+0000","last_undegraded":"2024-04-26T10:32:52.995441+0000","last_fullsized":"2024-04-26T10:32:52.995441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995369+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:32:52.995369+0000","last_peered":"2024-04-26T10:32:52.995369+0000","last_clean":"2024-04-26T10:32:52.995369+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:32:52.995369+0000","last_undegraded":"2024-04-26T10:32:52.995369+0000","last_fullsized":"2024-04-26T10:32:52.995369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698360+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:32:54.698360+0000","last_peered":"2024-04-26T10:32:54.698360+0000","last_clean":"2024-04-26T10:32:54.698360+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:32:54.698360+0000","last_undegraded":"2024-04-26T10:32:54.698360+0000","last_fullsized":"2024-04-26T10:32:54.698360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995967+0000","last_change":"2024-04-26T10:32:52.000612+0000","last_active":"2024-04-26T10:32:52.995967+0000","last_peered":"2024-04-26T10:32:52.995967+0000","last_clean":"2024-04-26T10:32:52.995967+0000","last_became_active":"2024-04-26T10:32:51.998958+0000","last_became_peered":"2024-04-26T10:32:51.998958+0000","last_unstale":"2024-04-26T10:32:52.995967+0000","last_undegraded":"2024-04-26T10:32:52.995967+0000","last_fullsized":"2024-04-26T10:32:52.995967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996112+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:32:52.996112+0000","last_peered":"2024-04-26T10:32:52.996112+0000","last_clean":"2024-04-26T10:32:52.996112+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:32:52.996112+0000","last_undegraded":"2024-04-26T10:32:52.996112+0000","last_fullsized":"2024-04-26T10:32:52.996112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995621+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:32:52.995621+0000","last_peered":"2024-04-26T10:32:52.995621+0000","last_clean":"2024-04-26T10:32:52.995621+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:32:52.995621+0000","last_undegraded":"2024-04-26T10:32:52.995621+0000","last_fullsized":"2024-04-26T10:32:52.995621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995312+0000","last_change":"2024-04-26T10:32:52.000261+0000","last_active":"2024-04-26T10:32:52.995312+0000","last_peered":"2024-04-26T10:32:52.995312+0000","last_clean":"2024-04-26T10:32:52.995312+0000","last_became_active":"2024-04-26T10:32:51.999284+0000","last_became_peered":"2024-04-26T10:32:51.999284+0000","last_unstale":"2024-04-26T10:32:52.995312+0000","last_undegraded":"2024-04-26T10:32:52.995312+0000","last_fullsized":"2024-04-26T10:32:52.995312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995910+0000","last_change":"2024-04-26T10:32:52.003123+0000","last_active":"2024-04-26T10:32:52.995910+0000","last_peered":"2024-04-26T10:32:52.995910+0000","last_clean":"2024-04-26T10:32:52.995910+0000","last_became_active":"2024-04-26T10:32:52.001353+0000","last_became_peered":"2024-04-26T10:32:52.001353+0000","last_unstale":"2024-04-26T10:32:52.995910+0000","last_undegraded":"2024-04-26T10:32:52.995910+0000","last_fullsized":"2024-04-26T10:32:52.995910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:59:49.869670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995298+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:32:52.995298+0000","last_peered":"2024-04-26T10:32:52.995298+0000","last_clean":"2024-04-26T10:32:52.995298+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:32:52.995298+0000","last_undegraded":"2024-04-26T10:32:52.995298+0000","last_fullsized":"2024-04-26T10:32:52.995298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995391+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:32:52.995391+0000","last_peered":"2024-04-26T10:32:52.995391+0000","last_clean":"2024-04-26T10:32:52.995391+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:32:52.995391+0000","last_undegraded":"2024-04-26T10:32:52.995391+0000","last_fullsized":"2024-04-26T10:32:52.995391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698457+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:32:54.698457+0000","last_peered":"2024-04-26T10:32:54.698457+0000","last_clean":"2024-04-26T10:32:54.698457+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:32:54.698457+0000","last_undegraded":"2024-04-26T10:32:54.698457+0000","last_fullsized":"2024-04-26T10:32:54.698457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996082+0000","last_change":"2024-04-26T10:32:52.000693+0000","last_active":"2024-04-26T10:32:52.996082+0000","last_peered":"2024-04-26T10:32:52.996082+0000","last_clean":"2024-04-26T10:32:52.996082+0000","last_became_active":"2024-04-26T10:32:51.999406+0000","last_became_peered":"2024-04-26T10:32:51.999406+0000","last_unstale":"2024-04-26T10:32:52.996082+0000","last_undegraded":"2024-04-26T10:32:52.996082+0000","last_fullsized":"2024-04-26T10:32:52.996082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698211+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:32:54.698211+0000","last_peered":"2024-04-26T10:32:54.698211+0000","last_clean":"2024-04-26T10:32:54.698211+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:32:54.698211+0000","last_undegraded":"2024-04-26T10:32:54.698211+0000","last_fullsized":"2024-04-26T10:32:54.698211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996035+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:32:52.996035+0000","last_peered":"2024-04-26T10:32:52.996035+0000","last_clean":"2024-04-26T10:32:52.996035+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:32:52.996035+0000","last_undegraded":"2024-04-26T10:32:52.996035+0000","last_fullsized":"2024-04-26T10:32:52.996035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995635+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:32:52.995635+0000","last_peered":"2024-04-26T10:32:52.995635+0000","last_clean":"2024-04-26T10:32:52.995635+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:32:52.995635+0000","last_undegraded":"2024-04-26T10:32:52.995635+0000","last_fullsized":"2024-04-26T10:32:52.995635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995342+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:32:52.995342+0000","last_peered":"2024-04-26T10:32:52.995342+0000","last_clean":"2024-04-26T10:32:52.995342+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:32:52.995342+0000","last_undegraded":"2024-04-26T10:32:52.995342+0000","last_fullsized":"2024-04-26T10:32:52.995342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697661+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:32:54.697661+0000","last_peered":"2024-04-26T10:32:54.697661+0000","last_clean":"2024-04-26T10:32:54.697661+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:32:54.697661+0000","last_undegraded":"2024-04-26T10:32:54.697661+0000","last_fullsized":"2024-04-26T10:32:54.697661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995428+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:32:52.995428+0000","last_peered":"2024-04-26T10:32:52.995428+0000","last_clean":"2024-04-26T10:32:52.995428+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:32:52.995428+0000","last_undegraded":"2024-04-26T10:32:52.995428+0000","last_fullsized":"2024-04-26T10:32:52.995428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996100+0000","last_change":"2024-04-26T10:32:52.004089+0000","last_active":"2024-04-26T10:32:52.996100+0000","last_peered":"2024-04-26T10:32:52.996100+0000","last_clean":"2024-04-26T10:32:52.996100+0000","last_became_active":"2024-04-26T10:32:52.003802+0000","last_became_peered":"2024-04-26T10:32:52.003802+0000","last_unstale":"2024-04-26T10:32:52.996100+0000","last_undegraded":"2024-04-26T10:32:52.996100+0000","last_fullsized":"2024-04-26T10:32:52.996100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698384+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:32:54.698384+0000","last_peered":"2024-04-26T10:32:54.698384+0000","last_clean":"2024-04-26T10:32:54.698384+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:32:54.698384+0000","last_undegraded":"2024-04-26T10:32:54.698384+0000","last_fullsized":"2024-04-26T10:32:54.698384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996122+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:32:52.996122+0000","last_peered":"2024-04-26T10:32:52.996122+0000","last_clean":"2024-04-26T10:32:52.996122+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:32:52.996122+0000","last_undegraded":"2024-04-26T10:32:52.996122+0000","last_fullsized":"2024-04-26T10:32:52.996122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995270+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:32:52.995270+0000","last_peered":"2024-04-26T10:32:52.995270+0000","last_clean":"2024-04-26T10:32:52.995270+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:32:52.995270+0000","last_undegraded":"2024-04-26T10:32:52.995270+0000","last_fullsized":"2024-04-26T10:32:52.995270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996297+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:32:52.996297+0000","last_peered":"2024-04-26T10:32:52.996297+0000","last_clean":"2024-04-26T10:32:52.996297+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:32:52.996297+0000","last_undegraded":"2024-04-26T10:32:52.996297+0000","last_fullsized":"2024-04-26T10:32:52.996297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697734+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:32:54.697734+0000","last_peered":"2024-04-26T10:32:54.697734+0000","last_clean":"2024-04-26T10:32:54.697734+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:32:54.697734+0000","last_undegraded":"2024-04-26T10:32:54.697734+0000","last_fullsized":"2024-04-26T10:32:54.697734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698491+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:32:54.698491+0000","last_peered":"2024-04-26T10:32:54.698491+0000","last_clean":"2024-04-26T10:32:54.698491+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:32:54.698491+0000","last_undegraded":"2024-04-26T10:32:54.698491+0000","last_fullsized":"2024-04-26T10:32:54.698491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697582+0000","last_change":"2024-04-26T10:32:51.588353+0000","last_active":"2024-04-26T10:32:54.697582+0000","last_peered":"2024-04-26T10:32:54.697582+0000","last_clean":"2024-04-26T10:32:54.697582+0000","last_became_active":"2024-04-26T10:32:51.587981+0000","last_became_peered":"2024-04-26T10:32:51.587981+0000","last_unstale":"2024-04-26T10:32:54.697582+0000","last_undegraded":"2024-04-26T10:32:54.697582+0000","last_fullsized":"2024-04-26T10:32:54.697582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:20.810803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996039+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:32:52.996039+0000","last_peered":"2024-04-26T10:32:52.996039+0000","last_clean":"2024-04-26T10:32:52.996039+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:32:52.996039+0000","last_undegraded":"2024-04-26T10:32:52.996039+0000","last_fullsized":"2024-04-26T10:32:52.996039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698553+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:32:54.698553+0000","last_peered":"2024-04-26T10:32:54.698553+0000","last_clean":"2024-04-26T10:32:54.698553+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:32:54.698553+0000","last_undegraded":"2024-04-26T10:32:54.698553+0000","last_fullsized":"2024-04-26T10:32:54.698553+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697438+0000","last_change":"2024-04-26T10:32:52.008030+0000","last_active":"2024-04-26T10:32:54.697438+0000","last_peered":"2024-04-26T10:32:54.697438+0000","last_clean":"2024-04-26T10:32:54.697438+0000","last_became_active":"2024-04-26T10:32:52.007158+0000","last_became_peered":"2024-04-26T10:32:52.007158+0000","last_unstale":"2024-04-26T10:32:54.697438+0000","last_undegraded":"2024-04-26T10:32:54.697438+0000","last_fullsized":"2024-04-26T10:32:54.697438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996258+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:32:52.996258+0000","last_peered":"2024-04-26T10:32:52.996258+0000","last_clean":"2024-04-26T10:32:52.996258+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:32:52.996258+0000","last_undegraded":"2024-04-26T10:32:52.996258+0000","last_fullsized":"2024-04-26T10:32:52.996258+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697790+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:32:54.697790+0000","last_peered":"2024-04-26T10:32:54.697790+0000","last_clean":"2024-04-26T10:32:54.697790+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:32:54.697790+0000","last_undegraded":"2024-04-26T10:32:54.697790+0000","last_fullsized":"2024-04-26T10:32:54.697790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996094+0000","last_change":"2024-04-26T10:32:51.586732+0000","last_active":"2024-04-26T10:32:52.996094+0000","last_peered":"2024-04-26T10:32:52.996094+0000","last_clean":"2024-04-26T10:32:52.996094+0000","last_became_active":"2024-04-26T10:32:51.586533+0000","last_became_peered":"2024-04-26T10:32:51.586533+0000","last_unstale":"2024-04-26T10:32:52.996094+0000","last_undegraded":"2024-04-26T10:32:52.996094+0000","last_fullsized":"2024-04-26T10:32:52.996094+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697696+0000","last_change":"2024-04-26T10:32:52.007650+0000","last_active":"2024-04-26T10:32:54.697696+0000","last_peered":"2024-04-26T10:32:54.697696+0000","last_clean":"2024-04-26T10:32:54.697696+0000","last_became_active":"2024-04-26T10:32:52.007261+0000","last_became_peered":"2024-04-26T10:32:52.007261+0000","last_unstale":"2024-04-26T10:32:54.697696+0000","last_undegraded":"2024-04-26T10:32:54.697696+0000","last_fullsized":"2024-04-26T10:32:54.697696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995900+0000","last_change":"2024-04-26T10:32:51.584497+0000","last_active":"2024-04-26T10:32:52.995900+0000","last_peered":"2024-04-26T10:32:52.995900+0000","last_clean":"2024-04-26T10:32:52.995900+0000","last_became_active":"2024-04-26T10:32:51.583460+0000","last_became_peered":"2024-04-26T10:32:51.583460+0000","last_unstale":"2024-04-26T10:32:52.995900+0000","last_undegraded":"2024-04-26T10:32:52.995900+0000","last_fullsized":"2024-04-26T10:32:52.995900+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995887+0000","last_change":"2024-04-26T10:32:52.001738+0000","last_active":"2024-04-26T10:32:52.995887+0000","last_peered":"2024-04-26T10:32:52.995887+0000","last_clean":"2024-04-26T10:32:52.995887+0000","last_became_active":"2024-04-26T10:32:51.999263+0000","last_became_peered":"2024-04-26T10:32:51.999263+0000","last_unstale":"2024-04-26T10:32:52.995887+0000","last_undegraded":"2024-04-26T10:32:52.995887+0000","last_fullsized":"2024-04-26T10:32:52.995887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:14.966669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995874+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:32:52.995874+0000","last_peered":"2024-04-26T10:32:52.995874+0000","last_clean":"2024-04-26T10:32:52.995874+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:32:52.995874+0000","last_undegraded":"2024-04-26T10:32:52.995874+0000","last_fullsized":"2024-04-26T10:32:52.995874+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995839+0000","last_change":"2024-04-26T10:32:52.000043+0000","last_active":"2024-04-26T10:32:52.995839+0000","last_peered":"2024-04-26T10:32:52.995839+0000","last_clean":"2024-04-26T10:32:52.995839+0000","last_became_active":"2024-04-26T10:32:51.999069+0000","last_became_peered":"2024-04-26T10:32:51.999069+0000","last_unstale":"2024-04-26T10:32:52.995839+0000","last_undegraded":"2024-04-26T10:32:52.995839+0000","last_fullsized":"2024-04-26T10:32:52.995839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697777+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:32:54.697777+0000","last_peered":"2024-04-26T10:32:54.697777+0000","last_clean":"2024-04-26T10:32:54.697777+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:32:54.697777+0000","last_undegraded":"2024-04-26T10:32:54.697777+0000","last_fullsized":"2024-04-26T10:32:54.697777+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996289+0000","last_change":"2024-04-26T10:32:52.000628+0000","last_active":"2024-04-26T10:32:52.996289+0000","last_peered":"2024-04-26T10:32:52.996289+0000","last_clean":"2024-04-26T10:32:52.996289+0000","last_became_active":"2024-04-26T10:32:51.998121+0000","last_became_peered":"2024-04-26T10:32:51.998121+0000","last_unstale":"2024-04-26T10:32:52.996289+0000","last_undegraded":"2024-04-26T10:32:52.996289+0000","last_fullsized":"2024-04-26T10:32:52.996289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.293526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995394+0000","last_change":"2024-04-26T10:32:51.584210+0000","last_active":"2024-04-26T10:32:52.995394+0000","last_peered":"2024-04-26T10:32:52.995394+0000","last_clean":"2024-04-26T10:32:52.995394+0000","last_became_active":"2024-04-26T10:32:51.583823+0000","last_became_peered":"2024-04-26T10:32:51.583823+0000","last_unstale":"2024-04-26T10:32:52.995394+0000","last_undegraded":"2024-04-26T10:32:52.995394+0000","last_fullsized":"2024-04-26T10:32:52.995394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.121333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698492+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:32:54.698492+0000","last_peered":"2024-04-26T10:32:54.698492+0000","last_clean":"2024-04-26T10:32:54.698492+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:32:54.698492+0000","last_undegraded":"2024-04-26T10:32:54.698492+0000","last_fullsized":"2024-04-26T10:32:54.698492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995640+0000","last_change":"2024-04-26T10:32:51.584088+0000","last_active":"2024-04-26T10:32:52.995640+0000","last_peered":"2024-04-26T10:32:52.995640+0000","last_clean":"2024-04-26T10:32:52.995640+0000","last_became_active":"2024-04-26T10:32:51.583020+0000","last_became_peered":"2024-04-26T10:32:51.583020+0000","last_unstale":"2024-04-26T10:32:52.995640+0000","last_undegraded":"2024-04-26T10:32:52.995640+0000","last_fullsized":"2024-04-26T10:32:52.995640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698660+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:32:54.698660+0000","last_peered":"2024-04-26T10:32:54.698660+0000","last_clean":"2024-04-26T10:32:54.698660+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:32:54.698660+0000","last_undegraded":"2024-04-26T10:32:54.698660+0000","last_fullsized":"2024-04-26T10:32:54.698660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996288+0000","last_change":"2024-04-26T10:32:51.583791+0000","last_active":"2024-04-26T10:32:52.996288+0000","last_peered":"2024-04-26T10:32:52.996288+0000","last_clean":"2024-04-26T10:32:52.996288+0000","last_became_active":"2024-04-26T10:32:51.583103+0000","last_became_peered":"2024-04-26T10:32:51.583103+0000","last_unstale":"2024-04-26T10:32:52.996288+0000","last_undegraded":"2024-04-26T10:32:52.996288+0000","last_fullsized":"2024-04-26T10:32:52.996288+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.994938+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:32:52.994938+0000","last_peered":"2024-04-26T10:32:52.994938+0000","last_clean":"2024-04-26T10:32:52.994938+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:32:52.994938+0000","last_undegraded":"2024-04-26T10:32:52.994938+0000","last_fullsized":"2024-04-26T10:32:52.994938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995812+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:32:52.995812+0000","last_peered":"2024-04-26T10:32:52.995812+0000","last_clean":"2024-04-26T10:32:52.995812+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:32:52.995812+0000","last_undegraded":"2024-04-26T10:32:52.995812+0000","last_fullsized":"2024-04-26T10:32:52.995812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995440+0000","last_change":"2024-04-26T10:32:51.997516+0000","last_active":"2024-04-26T10:32:52.995440+0000","last_peered":"2024-04-26T10:32:52.995440+0000","last_clean":"2024-04-26T10:32:52.995440+0000","last_became_active":"2024-04-26T10:32:51.996896+0000","last_became_peered":"2024-04-26T10:32:51.996896+0000","last_unstale":"2024-04-26T10:32:52.995440+0000","last_undegraded":"2024-04-26T10:32:52.995440+0000","last_fullsized":"2024-04-26T10:32:52.995440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:51.552418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996431+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:32:52.996431+0000","last_peered":"2024-04-26T10:32:52.996431+0000","last_clean":"2024-04-26T10:32:52.996431+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:32:52.996431+0000","last_undegraded":"2024-04-26T10:32:52.996431+0000","last_fullsized":"2024-04-26T10:32:52.996431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995565+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:32:52.995565+0000","last_peered":"2024-04-26T10:32:52.995565+0000","last_clean":"2024-04-26T10:32:52.995565+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:32:52.995565+0000","last_undegraded":"2024-04-26T10:32:52.995565+0000","last_fullsized":"2024-04-26T10:32:52.995565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995674+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:32:52.995674+0000","last_peered":"2024-04-26T10:32:52.995674+0000","last_clean":"2024-04-26T10:32:52.995674+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:32:52.995674+0000","last_undegraded":"2024-04-26T10:32:52.995674+0000","last_fullsized":"2024-04-26T10:32:52.995674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697950+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:32:54.697950+0000","last_peered":"2024-04-26T10:32:54.697950+0000","last_clean":"2024-04-26T10:32:54.697950+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:32:54.697950+0000","last_undegraded":"2024-04-26T10:32:54.697950+0000","last_fullsized":"2024-04-26T10:32:54.697950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697966+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:32:54.697966+0000","last_peered":"2024-04-26T10:32:54.697966+0000","last_clean":"2024-04-26T10:32:54.697966+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:32:54.697966+0000","last_undegraded":"2024-04-26T10:32:54.697966+0000","last_fullsized":"2024-04-26T10:32:54.697966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995743+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:32:52.995743+0000","last_peered":"2024-04-26T10:32:52.995743+0000","last_clean":"2024-04-26T10:32:52.995743+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:32:52.995743+0000","last_undegraded":"2024-04-26T10:32:52.995743+0000","last_fullsized":"2024-04-26T10:32:52.995743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995417+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:32:52.995417+0000","last_peered":"2024-04-26T10:32:52.995417+0000","last_clean":"2024-04-26T10:32:52.995417+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:32:52.995417+0000","last_undegraded":"2024-04-26T10:32:52.995417+0000","last_fullsized":"2024-04-26T10:32:52.995417+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996362+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:32:52.996362+0000","last_peered":"2024-04-26T10:32:52.996362+0000","last_clean":"2024-04-26T10:32:52.996362+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:32:52.996362+0000","last_undegraded":"2024-04-26T10:32:52.996362+0000","last_fullsized":"2024-04-26T10:32:52.996362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995012+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:32:52.995012+0000","last_peered":"2024-04-26T10:32:52.995012+0000","last_clean":"2024-04-26T10:32:52.995012+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:32:52.995012+0000","last_undegraded":"2024-04-26T10:32:52.995012+0000","last_fullsized":"2024-04-26T10:32:52.995012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996322+0000","last_change":"2024-04-26T10:32:52.004444+0000","last_active":"2024-04-26T10:32:52.996322+0000","last_peered":"2024-04-26T10:32:52.996322+0000","last_clean":"2024-04-26T10:32:52.996322+0000","last_became_active":"2024-04-26T10:32:52.003360+0000","last_became_peered":"2024-04-26T10:32:52.003360+0000","last_unstale":"2024-04-26T10:32:52.996322+0000","last_undegraded":"2024-04-26T10:32:52.996322+0000","last_fullsized":"2024-04-26T10:32:52.996322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:20.180213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995117+0000","last_change":"2024-04-26T10:32:51.584385+0000","last_active":"2024-04-26T10:32:52.995117+0000","last_peered":"2024-04-26T10:32:52.995117+0000","last_clean":"2024-04-26T10:32:52.995117+0000","last_became_active":"2024-04-26T10:32:51.584025+0000","last_became_peered":"2024-04-26T10:32:51.584025+0000","last_unstale":"2024-04-26T10:32:52.995117+0000","last_undegraded":"2024-04-26T10:32:52.995117+0000","last_fullsized":"2024-04-26T10:32:52.995117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:57.247011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698499+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:32:54.698499+0000","last_peered":"2024-04-26T10:32:54.698499+0000","last_clean":"2024-04-26T10:32:54.698499+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:32:54.698499+0000","last_undegraded":"2024-04-26T10:32:54.698499+0000","last_fullsized":"2024-04-26T10:32:54.698499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.999504+0000","last_change":"2024-04-26T10:32:46.555353+0000","last_active":"2024-04-26T10:32:51.999504+0000","last_peered":"2024-04-26T10:32:51.999504+0000","last_clean":"2024-04-26T10:32:51.999504+0000","last_became_active":"2024-04-26T10:32:46.555005+0000","last_became_peered":"2024-04-26T10:32:46.555005+0000","last_unstale":"2024-04-26T10:32:51.999504+0000","last_undegraded":"2024-04-26T10:32:51.999504+0000","last_fullsized":"2024-04-26T10:32:51.999504+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996229+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:32:52.996229+0000","last_peered":"2024-04-26T10:32:52.996229+0000","last_clean":"2024-04-26T10:32:52.996229+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:32:52.996229+0000","last_undegraded":"2024-04-26T10:32:52.996229+0000","last_fullsized":"2024-04-26T10:32:52.996229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995425+0000","last_change":"2024-04-26T10:32:52.004199+0000","last_active":"2024-04-26T10:32:52.995425+0000","last_peered":"2024-04-26T10:32:52.995425+0000","last_clean":"2024-04-26T10:32:52.995425+0000","last_became_active":"2024-04-26T10:32:52.003894+0000","last_became_peered":"2024-04-26T10:32:52.003894+0000","last_unstale":"2024-04-26T10:32:52.995425+0000","last_undegraded":"2024-04-26T10:32:52.995425+0000","last_fullsized":"2024-04-26T10:32:52.995425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.000379+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:32:52.000379+0000","last_peered":"2024-04-26T10:32:52.000379+0000","last_clean":"2024-04-26T10:32:52.000379+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:32:52.000379+0000","last_undegraded":"2024-04-26T10:32:52.000379+0000","last_fullsized":"2024-04-26T10:32:52.000379+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995781+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:32:52.995781+0000","last_peered":"2024-04-26T10:32:52.995781+0000","last_clean":"2024-04-26T10:32:52.995781+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:32:52.995781+0000","last_undegraded":"2024-04-26T10:32:52.995781+0000","last_fullsized":"2024-04-26T10:32:52.995781+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698151+0000","last_change":"2024-04-26T10:32:52.007589+0000","last_active":"2024-04-26T10:32:54.698151+0000","last_peered":"2024-04-26T10:32:54.698151+0000","last_clean":"2024-04-26T10:32:54.698151+0000","last_became_active":"2024-04-26T10:32:52.007289+0000","last_became_peered":"2024-04-26T10:32:52.007289+0000","last_unstale":"2024-04-26T10:32:54.698151+0000","last_undegraded":"2024-04-26T10:32:54.698151+0000","last_fullsized":"2024-04-26T10:32:54.698151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.998883+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:32:51.998883+0000","last_peered":"2024-04-26T10:32:51.998883+0000","last_clean":"2024-04-26T10:32:51.998883+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:32:51.998883+0000","last_undegraded":"2024-04-26T10:32:51.998883+0000","last_fullsized":"2024-04-26T10:32:51.998883+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995047+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:32:52.995047+0000","last_peered":"2024-04-26T10:32:52.995047+0000","last_clean":"2024-04-26T10:32:52.995047+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:32:52.995047+0000","last_undegraded":"2024-04-26T10:32:52.995047+0000","last_fullsized":"2024-04-26T10:32:52.995047+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698612+0000","last_change":"2024-04-26T10:32:52.009270+0000","last_active":"2024-04-26T10:32:54.698612+0000","last_peered":"2024-04-26T10:32:54.698612+0000","last_clean":"2024-04-26T10:32:54.698612+0000","last_became_active":"2024-04-26T10:32:52.008599+0000","last_became_peered":"2024-04-26T10:32:52.008599+0000","last_unstale":"2024-04-26T10:32:54.698612+0000","last_undegraded":"2024-04-26T10:32:54.698612+0000","last_fullsized":"2024-04-26T10:32:54.698612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.000550+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:32:52.000550+0000","last_peered":"2024-04-26T10:32:52.000550+0000","last_clean":"2024-04-26T10:32:52.000550+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:32:52.000550+0000","last_undegraded":"2024-04-26T10:32:52.000550+0000","last_fullsized":"2024-04-26T10:32:52.000550+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.997944+0000","last_change":"2024-04-26T10:32:46.555694+0000","last_active":"2024-04-26T10:32:51.997944+0000","last_peered":"2024-04-26T10:32:51.997944+0000","last_clean":"2024-04-26T10:32:51.997944+0000","last_became_active":"2024-04-26T10:32:46.555391+0000","last_became_peered":"2024-04-26T10:32:46.555391+0000","last_unstale":"2024-04-26T10:32:51.997944+0000","last_undegraded":"2024-04-26T10:32:51.997944+0000","last_fullsized":"2024-04-26T10:32:51.997944+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697661+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:32:54.697661+0000","last_peered":"2024-04-26T10:32:54.697661+0000","last_clean":"2024-04-26T10:32:54.697661+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:32:54.697661+0000","last_undegraded":"2024-04-26T10:32:54.697661+0000","last_fullsized":"2024-04-26T10:32:54.697661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996350+0000","last_change":"2024-04-26T10:32:52.006765+0000","last_active":"2024-04-26T10:32:52.996350+0000","last_peered":"2024-04-26T10:32:52.996350+0000","last_clean":"2024-04-26T10:32:52.996350+0000","last_became_active":"2024-04-26T10:32:52.004110+0000","last_became_peered":"2024-04-26T10:32:52.004110+0000","last_unstale":"2024-04-26T10:32:52.996350+0000","last_undegraded":"2024-04-26T10:32:52.996350+0000","last_fullsized":"2024-04-26T10:32:52.996350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:47.156703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.998516+0000","last_change":"2024-04-26T10:32:46.555501+0000","last_active":"2024-04-26T10:32:51.998516+0000","last_peered":"2024-04-26T10:32:51.998516+0000","last_clean":"2024-04-26T10:32:51.998516+0000","last_became_active":"2024-04-26T10:32:46.555252+0000","last_became_peered":"2024-04-26T10:32:46.555252+0000","last_unstale":"2024-04-26T10:32:51.998516+0000","last_undegraded":"2024-04-26T10:32:51.998516+0000","last_fullsized":"2024-04-26T10:32:51.998516+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697491+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:32:54.697491+0000","last_peered":"2024-04-26T10:32:54.697491+0000","last_clean":"2024-04-26T10:32:54.697491+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:32:54.697491+0000","last_undegraded":"2024-04-26T10:32:54.697491+0000","last_fullsized":"2024-04-26T10:32:54.697491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995980+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:32:52.995980+0000","last_peered":"2024-04-26T10:32:52.995980+0000","last_clean":"2024-04-26T10:32:52.995980+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:32:52.995980+0000","last_undegraded":"2024-04-26T10:32:52.995980+0000","last_fullsized":"2024-04-26T10:32:52.995980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.993416+0000","last_change":"2024-04-26T10:32:46.556007+0000","last_active":"2024-04-26T10:32:51.993416+0000","last_peered":"2024-04-26T10:32:51.993416+0000","last_clean":"2024-04-26T10:32:51.993416+0000","last_became_active":"2024-04-26T10:32:46.555738+0000","last_became_peered":"2024-04-26T10:32:46.555738+0000","last_unstale":"2024-04-26T10:32:51.993416+0000","last_undegraded":"2024-04-26T10:32:51.993416+0000","last_fullsized":"2024-04-26T10:32:51.993416+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:04.230186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698307+0000","last_change":"2024-04-26T10:32:51.589352+0000","last_active":"2024-04-26T10:32:54.698307+0000","last_peered":"2024-04-26T10:32:54.698307+0000","last_clean":"2024-04-26T10:32:54.698307+0000","last_became_active":"2024-04-26T10:32:51.589006+0000","last_became_peered":"2024-04-26T10:32:51.589006+0000","last_unstale":"2024-04-26T10:32:54.698307+0000","last_undegraded":"2024-04-26T10:32:54.698307+0000","last_fullsized":"2024-04-26T10:32:54.698307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995503+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:32:52.995503+0000","last_peered":"2024-04-26T10:32:52.995503+0000","last_clean":"2024-04-26T10:32:52.995503+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:32:52.995503+0000","last_undegraded":"2024-04-26T10:32:52.995503+0000","last_fullsized":"2024-04-26T10:32:52.995503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698429+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:32:54.698429+0000","last_peered":"2024-04-26T10:32:54.698429+0000","last_clean":"2024-04-26T10:32:54.698429+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:32:54.698429+0000","last_undegraded":"2024-04-26T10:32:54.698429+0000","last_fullsized":"2024-04-26T10:32:54.698429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.001757+0000","last_change":"2024-04-26T10:32:46.555394+0000","last_active":"2024-04-26T10:32:52.001757+0000","last_peered":"2024-04-26T10:32:52.001757+0000","last_clean":"2024-04-26T10:32:52.001757+0000","last_became_active":"2024-04-26T10:32:46.555053+0000","last_became_peered":"2024-04-26T10:32:46.555053+0000","last_unstale":"2024-04-26T10:32:52.001757+0000","last_undegraded":"2024-04-26T10:32:52.001757+0000","last_fullsized":"2024-04-26T10:32:52.001757+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697328+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:32:54.697328+0000","last_peered":"2024-04-26T10:32:54.697328+0000","last_clean":"2024-04-26T10:32:54.697328+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:32:54.697328+0000","last_undegraded":"2024-04-26T10:32:54.697328+0000","last_fullsized":"2024-04-26T10:32:54.697328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.002371+0000","last_change":"2024-04-26T10:32:46.555191+0000","last_active":"2024-04-26T10:32:52.002371+0000","last_peered":"2024-04-26T10:32:52.002371+0000","last_clean":"2024-04-26T10:32:52.002371+0000","last_became_active":"2024-04-26T10:32:46.554892+0000","last_became_peered":"2024-04-26T10:32:46.554892+0000","last_unstale":"2024-04-26T10:32:52.002371+0000","last_undegraded":"2024-04-26T10:32:52.002371+0000","last_fullsized":"2024-04-26T10:32:52.002371+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.991584+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:32:54.991584+0000","last_peered":"2024-04-26T10:32:54.991584+0000","last_clean":"2024-04-26T10:32:54.991584+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:32:54.991584+0000","last_undegraded":"2024-04-26T10:32:54.991584+0000","last_fullsized":"2024-04-26T10:32:54.991584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995288+0000","last_change":"2024-04-26T10:32:52.001408+0000","last_active":"2024-04-26T10:32:52.995288+0000","last_peered":"2024-04-26T10:32:52.995288+0000","last_clean":"2024-04-26T10:32:52.995288+0000","last_became_active":"2024-04-26T10:32:52.000668+0000","last_became_peered":"2024-04-26T10:32:52.000668+0000","last_unstale":"2024-04-26T10:32:52.995288+0000","last_undegraded":"2024-04-26T10:32:52.995288+0000","last_fullsized":"2024-04-26T10:32:52.995288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995353+0000","last_change":"2024-04-26T10:32:51.586234+0000","last_active":"2024-04-26T10:32:52.995353+0000","last_peered":"2024-04-26T10:32:52.995353+0000","last_clean":"2024-04-26T10:32:52.995353+0000","last_became_active":"2024-04-26T10:32:51.586004+0000","last_became_peered":"2024-04-26T10:32:51.586004+0000","last_unstale":"2024-04-26T10:32:52.995353+0000","last_undegraded":"2024-04-26T10:32:52.995353+0000","last_fullsized":"2024-04-26T10:32:52.995353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:03.977752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995947+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:32:52.995947+0000","last_peered":"2024-04-26T10:32:52.995947+0000","last_clean":"2024-04-26T10:32:52.995947+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:32:52.995947+0000","last_undegraded":"2024-04-26T10:32:52.995947+0000","last_fullsized":"2024-04-26T10:32:52.995947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995869+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:32:52.995869+0000","last_peered":"2024-04-26T10:32:52.995869+0000","last_clean":"2024-04-26T10:32:52.995869+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:32:52.995869+0000","last_undegraded":"2024-04-26T10:32:52.995869+0000","last_fullsized":"2024-04-26T10:32:52.995869+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995676+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:32:52.995676+0000","last_peered":"2024-04-26T10:32:52.995676+0000","last_clean":"2024-04-26T10:32:52.995676+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:32:52.995676+0000","last_undegraded":"2024-04-26T10:32:52.995676+0000","last_fullsized":"2024-04-26T10:32:52.995676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996240+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:32:52.996240+0000","last_peered":"2024-04-26T10:32:52.996240+0000","last_clean":"2024-04-26T10:32:52.996240+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:32:52.996240+0000","last_undegraded":"2024-04-26T10:32:52.996240+0000","last_fullsized":"2024-04-26T10:32:52.996240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995491+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:32:52.995491+0000","last_peered":"2024-04-26T10:32:52.995491+0000","last_clean":"2024-04-26T10:32:52.995491+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:32:52.995491+0000","last_undegraded":"2024-04-26T10:32:52.995491+0000","last_fullsized":"2024-04-26T10:32:52.995491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698596+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:32:54.698596+0000","last_peered":"2024-04-26T10:32:54.698596+0000","last_clean":"2024-04-26T10:32:54.698596+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:32:54.698596+0000","last_undegraded":"2024-04-26T10:32:54.698596+0000","last_fullsized":"2024-04-26T10:32:54.698596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995567+0000","last_change":"2024-04-26T10:32:51.999341+0000","last_active":"2024-04-26T10:32:52.995567+0000","last_peered":"2024-04-26T10:32:52.995567+0000","last_clean":"2024-04-26T10:32:52.995567+0000","last_became_active":"2024-04-26T10:32:51.998256+0000","last_became_peered":"2024-04-26T10:32:51.998256+0000","last_unstale":"2024-04-26T10:32:52.995567+0000","last_undegraded":"2024-04-26T10:32:52.995567+0000","last_fullsized":"2024-04-26T10:32:52.995567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698554+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:32:54.698554+0000","last_peered":"2024-04-26T10:32:54.698554+0000","last_clean":"2024-04-26T10:32:54.698554+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:32:54.698554+0000","last_undegraded":"2024-04-26T10:32:54.698554+0000","last_fullsized":"2024-04-26T10:32:54.698554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995762+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:32:52.995762+0000","last_peered":"2024-04-26T10:32:52.995762+0000","last_clean":"2024-04-26T10:32:52.995762+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:32:52.995762+0000","last_undegraded":"2024-04-26T10:32:52.995762+0000","last_fullsized":"2024-04-26T10:32:52.995762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995699+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:32:52.995699+0000","last_peered":"2024-04-26T10:32:52.995699+0000","last_clean":"2024-04-26T10:32:52.995699+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:32:52.995699+0000","last_undegraded":"2024-04-26T10:32:52.995699+0000","last_fullsized":"2024-04-26T10:32:52.995699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697606+0000","last_change":"2024-04-26T10:32:52.004844+0000","last_active":"2024-04-26T10:32:54.697606+0000","last_peered":"2024-04-26T10:32:54.697606+0000","last_clean":"2024-04-26T10:32:54.697606+0000","last_became_active":"2024-04-26T10:32:52.004484+0000","last_became_peered":"2024-04-26T10:32:52.004484+0000","last_unstale":"2024-04-26T10:32:54.697606+0000","last_undegraded":"2024-04-26T10:32:54.697606+0000","last_fullsized":"2024-04-26T10:32:54.697606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995521+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:32:52.995521+0000","last_peered":"2024-04-26T10:32:52.995521+0000","last_clean":"2024-04-26T10:32:52.995521+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:32:52.995521+0000","last_undegraded":"2024-04-26T10:32:52.995521+0000","last_fullsized":"2024-04-26T10:32:52.995521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698146+0000","last_change":"2024-04-26T10:32:52.007818+0000","last_active":"2024-04-26T10:32:54.698146+0000","last_peered":"2024-04-26T10:32:54.698146+0000","last_clean":"2024-04-26T10:32:54.698146+0000","last_became_active":"2024-04-26T10:32:52.007552+0000","last_became_peered":"2024-04-26T10:32:52.007552+0000","last_unstale":"2024-04-26T10:32:54.698146+0000","last_undegraded":"2024-04-26T10:32:54.698146+0000","last_fullsized":"2024-04-26T10:32:54.698146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995977+0000","last_change":"2024-04-26T10:32:52.010309+0000","last_active":"2024-04-26T10:32:52.995977+0000","last_peered":"2024-04-26T10:32:52.995977+0000","last_clean":"2024-04-26T10:32:52.995977+0000","last_became_active":"2024-04-26T10:32:52.009152+0000","last_became_peered":"2024-04-26T10:32:52.009152+0000","last_unstale":"2024-04-26T10:32:52.995977+0000","last_undegraded":"2024-04-26T10:32:52.995977+0000","last_fullsized":"2024-04-26T10:32:52.995977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:33:05.099 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T10:33:05.099 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T10:33:05.100 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T10:33:05.100 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T10:33:05.516 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:05.516 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T10:33:05.530 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T10:33:05.531 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:33:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:05.869 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":15,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:32:52.989368+0000","last_up_change":"2024-04-26T10:32:44.545583+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:32:49.859710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:32:50.968196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":41771},{"type":"v1","addr":"172.21.15.112:6801","nonce":41771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":41771},{"type":"v1","addr":"172.21.15.112:6803","nonce":41771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":41771},{"type":"v1","addr":"172.21.15.112:6807","nonce":41771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":41771},{"type":"v1","addr":"172.21.15.112:6805","nonce":41771}]},"public_addr":"172.21.15.112:6801/41771","cluster_addr":"172.21.15.112:6803/41771","heartbeat_back_addr":"172.21.15.112:6807/41771","heartbeat_front_addr":"172.21.15.112:6805/41771","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:33:05.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:32:45.037545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:32:45.393201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:32:49.859710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:32:50.968196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:33:05.884 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:33:06.225 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-26T10:33:06.239 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:33:06.580 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2024-04-26T10:33:06.595 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T10:33:06.937 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-26T10:33:06.952 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T10:33:07.299 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-26T10:33:07.313 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:33:07.699 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:07.699 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:32:51.988112+0000","modified":"2024-04-26T10:32:54.993485+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6803/3548002075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3548002075},{"type":"v1","addr":"172.21.15.43:6803","nonce":3548002075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:33:07.700 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-26T10:33:07.711 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:33:08.060 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:08.060 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":15,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:32:52.989368+0000","last_up_change":"2024-04-26T10:32:44.545583+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:32:49.859710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:32:50.968196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":41771},{"type":"v1","addr":"172.21.15.112:6801","nonce":41771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":41771},{"type":"v1","addr":"172.21.15.112:6803","nonce":41771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":41771},{"type":"v1","addr":"172.21.15.112:6807","nonce":41771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":41771},{"type":"v1","addr":"172.21.15.112:6805","nonce":41771}]},"public_addr":"172.21.15.112:6801/41771","cluster_addr":"172.21.15.112:6803/41771","heartbeat_back_addr":"172.21.15.112:6807/41771","heartbeat_front_addr":"172.21.15.112:6805/41771","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:33:08.075 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:32:45.037545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:32:45.393201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:32:49.859710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:32:50.968196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:33:08.075 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:33:08.413 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 1 2024-04-26T10:33:08.427 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:33:08.766 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 8 2024-04-26T10:33:08.780 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T10:33:09.124 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 32 2024-04-26T10:33:09.139 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T10:33:09.481 INFO:teuthology.orchestra.run.smithi043.stdout:pg_num: 64 2024-04-26T10:33:09.495 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:33:09.878 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:09.878 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:32:51.988112+0000","modified":"2024-04-26T10:32:54.993485+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6803/3548002075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3548002075},{"type":"v1","addr":"172.21.15.43:6803","nonce":3548002075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:33:09.880 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-26T10:33:09.891 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:33:10.234 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:10.235 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":15,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:32:52.989368+0000","last_up_change":"2024-04-26T10:32:44.545583+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:32:49.859710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:32:50.968196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":41771},{"type":"v1","addr":"172.21.15.112:6801","nonce":41771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":41771},{"type":"v1","addr":"172.21.15.112:6803","nonce":41771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":41771},{"type":"v1","addr":"172.21.15.112:6807","nonce":41771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":41771},{"type":"v1","addr":"172.21.15.112:6805","nonce":41771}]},"public_addr":"172.21.15.112:6801/41771","cluster_addr":"172.21.15.112:6803/41771","heartbeat_back_addr":"172.21.15.112:6807/41771","heartbeat_front_addr":"172.21.15.112:6805/41771","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:33:10.249 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:33:10.634 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:10.634 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:32:51.988112+0000","modified":"2024-04-26T10:32:54.993485+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6803/3548002075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3548002075},{"type":"v1","addr":"172.21.15.43:6803","nonce":3548002075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:33:10.637 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-26T10:33:10.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T10:32:51.988112+0000', 'modified': '2024-04-26T10:32:54.993485+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4186}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4186': {'gid': 4186, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.43:6803/3548002075', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.43:6802', 'nonce': 3548002075}, {'type': 'v1', 'addr': '172.21.15.43:6803', 'nonce': 3548002075}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-26T10:33:10.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T10:33:10.750 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T10:33:10.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-26T10:33:10.887+0000 7f7051ffb700 0 client.4460 ms_handle_reset on v2:172.21.15.43:6802/3548002075 2024-04-26T10:33:10.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-04-26T10:33:10.909+0000 7f7051ffb700 0 client.4480 ms_handle_reset on v2:172.21.15.43:6802/3548002075 2024-04-26T10:33:10.911 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-26T10:33:10.911 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_fsid": "6d35b773-83ef-4e54-be62-89cec0b09327", 2024-04-26T10:33:10.911 INFO:teuthology.orchestra.run.smithi043.stdout: "whoami": 0, 2024-04-26T10:33:10.911 INFO:teuthology.orchestra.run.smithi043.stdout: "id": 4186, 2024-04-26T10:33:10.911 INFO:teuthology.orchestra.run.smithi043.stdout: "want_state": "up:active", 2024-04-26T10:33:10.911 INFO:teuthology.orchestra.run.smithi043.stdout: "state": "up:active", 2024-04-26T10:33:10.911 INFO:teuthology.orchestra.run.smithi043.stdout: "fs_name": "cephfs", 2024-04-26T10:33:10.911 INFO:teuthology.orchestra.run.smithi043.stdout: "rank_uptime": 18.920458721999999, 2024-04-26T10:33:10.911 INFO:teuthology.orchestra.run.smithi043.stdout: "mdsmap_epoch": 6, 2024-04-26T10:33:10.911 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch": 15, 2024-04-26T10:33:10.911 INFO:teuthology.orchestra.run.smithi043.stdout: "osdmap_epoch_barrier": 15, 2024-04-26T10:33:10.911 INFO:teuthology.orchestra.run.smithi043.stdout: "uptime": 24.250252818 2024-04-26T10:33:10.911 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-26T10:33:10.923 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T10:33:10.933 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T10:33:10.934 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}} 2024-04-26T10:33:10.934 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T10:33:10.934 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-26T10:33:10.934 DEBUG:teuthology.orchestra.run.smithi043:> sync 2024-04-26T10:33:11.137 DEBUG:teuthology.orchestra.run.smithi112:> sync 2024-04-26T10:33:11.349 DEBUG:teuthology.orchestra.run.smithi186:> sync 2024-04-26T10:33:11.635 DEBUG:teuthology.orchestra.run.smithi187:> sync 2024-04-26T10:33:11.735 DEBUG:tasks.thrashosds:checking console status of smithi043 2024-04-26T10:33:11.735 DEBUG:teuthology.orchestra.console.smithi043:Waiting for login prompt 2024-04-26T10:33:11.736 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi043 2024-04-26T10:33:11.911 DEBUG:teuthology.orchestra.console.smithi043:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T10:33:11.911 DEBUG:teuthology.orchestra.console.smithi043:expect after: smithi043 login: 2024-04-26T10:33:11.963 DEBUG:teuthology.orchestra.console.smithi043:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi043 login: [disconnect] 2024-04-26T10:33:12.064 DEBUG:tasks.thrashosds:checking console status of smithi112 2024-04-26T10:33:12.065 DEBUG:teuthology.orchestra.console.smithi112:Waiting for login prompt 2024-04-26T10:33:12.065 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi112 2024-04-26T10:33:12.155 DEBUG:teuthology.orchestra.console.smithi112:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T10:33:12.155 DEBUG:teuthology.orchestra.console.smithi112:expect after: smithi112 login: 2024-04-26T10:33:12.207 DEBUG:teuthology.orchestra.console.smithi112:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi112 login: [disconnect] 2024-04-26T10:33:12.309 DEBUG:tasks.thrashosds:checking console status of smithi186 2024-04-26T10:33:12.309 DEBUG:teuthology.orchestra.console.smithi186:Waiting for login prompt 2024-04-26T10:33:12.309 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi186 2024-04-26T10:33:12.445 DEBUG:teuthology.orchestra.console.smithi186:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T10:33:12.445 DEBUG:teuthology.orchestra.console.smithi186:expect after: smithi186 login: 2024-04-26T10:33:12.497 DEBUG:teuthology.orchestra.console.smithi186:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi186 login: [disconnect] 2024-04-26T10:33:12.599 DEBUG:tasks.thrashosds:checking console status of smithi187 2024-04-26T10:33:12.599 DEBUG:teuthology.orchestra.console.smithi187:Waiting for login prompt 2024-04-26T10:33:12.599 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi187 2024-04-26T10:33:12.752 DEBUG:teuthology.orchestra.console.smithi187:expect before: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T10:33:12.752 DEBUG:teuthology.orchestra.console.smithi187:expect after: smithi187 login: 2024-04-26T10:33:12.807 DEBUG:teuthology.orchestra.console.smithi187:console disconnect output: [Enter `^Ec?' for help] CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi187 login: [disconnect] 2024-04-26T10:33:12.909 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T10:33:13.285 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T10:33:13.286 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T10:33:13.286 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:33:13.633 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:13.636 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:33:13.643 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T10:33:12.988859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82684,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032836,"statfs":{"total":289910292480,"available":289825624064,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002713"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996155+0000","last_change":"2024-04-26T10:32:51.998840+0000","last_active":"2024-04-26T10:32:52.996155+0000","last_peered":"2024-04-26T10:32:52.996155+0000","last_clean":"2024-04-26T10:32:52.996155+0000","last_became_active":"2024-04-26T10:32:51.998236+0000","last_became_peered":"2024-04-26T10:32:51.998236+0000","last_unstale":"2024-04-26T10:32:52.996155+0000","last_undegraded":"2024-04-26T10:32:52.996155+0000","last_fullsized":"2024-04-26T10:32:52.996155+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995759+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:32:52.995759+0000","last_peered":"2024-04-26T10:32:52.995759+0000","last_clean":"2024-04-26T10:32:52.995759+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:32:52.995759+0000","last_undegraded":"2024-04-26T10:32:52.995759+0000","last_fullsized":"2024-04-26T10:32:52.995759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996256+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:32:52.996256+0000","last_peered":"2024-04-26T10:32:52.996256+0000","last_clean":"2024-04-26T10:32:52.996256+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:32:52.996256+0000","last_undegraded":"2024-04-26T10:32:52.996256+0000","last_fullsized":"2024-04-26T10:32:52.996256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996029+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:32:52.996029+0000","last_peered":"2024-04-26T10:32:52.996029+0000","last_clean":"2024-04-26T10:32:52.996029+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:32:52.996029+0000","last_undegraded":"2024-04-26T10:32:52.996029+0000","last_fullsized":"2024-04-26T10:32:52.996029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995460+0000","last_change":"2024-04-26T10:32:51.999420+0000","last_active":"2024-04-26T10:32:52.995460+0000","last_peered":"2024-04-26T10:32:52.995460+0000","last_clean":"2024-04-26T10:32:52.995460+0000","last_became_active":"2024-04-26T10:32:51.999046+0000","last_became_peered":"2024-04-26T10:32:51.999046+0000","last_unstale":"2024-04-26T10:32:52.995460+0000","last_undegraded":"2024-04-26T10:32:52.995460+0000","last_fullsized":"2024-04-26T10:32:52.995460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:10.442986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995344+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:32:52.995344+0000","last_peered":"2024-04-26T10:32:52.995344+0000","last_clean":"2024-04-26T10:32:52.995344+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:32:52.995344+0000","last_undegraded":"2024-04-26T10:32:52.995344+0000","last_fullsized":"2024-04-26T10:32:52.995344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995441+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:32:52.995441+0000","last_peered":"2024-04-26T10:32:52.995441+0000","last_clean":"2024-04-26T10:32:52.995441+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:32:52.995441+0000","last_undegraded":"2024-04-26T10:32:52.995441+0000","last_fullsized":"2024-04-26T10:32:52.995441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995369+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:32:52.995369+0000","last_peered":"2024-04-26T10:32:52.995369+0000","last_clean":"2024-04-26T10:32:52.995369+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:32:52.995369+0000","last_undegraded":"2024-04-26T10:32:52.995369+0000","last_fullsized":"2024-04-26T10:32:52.995369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698360+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:32:54.698360+0000","last_peered":"2024-04-26T10:32:54.698360+0000","last_clean":"2024-04-26T10:32:54.698360+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:32:54.698360+0000","last_undegraded":"2024-04-26T10:32:54.698360+0000","last_fullsized":"2024-04-26T10:32:54.698360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995967+0000","last_change":"2024-04-26T10:32:52.000612+0000","last_active":"2024-04-26T10:32:52.995967+0000","last_peered":"2024-04-26T10:32:52.995967+0000","last_clean":"2024-04-26T10:32:52.995967+0000","last_became_active":"2024-04-26T10:32:51.998958+0000","last_became_peered":"2024-04-26T10:32:51.998958+0000","last_unstale":"2024-04-26T10:32:52.995967+0000","last_undegraded":"2024-04-26T10:32:52.995967+0000","last_fullsized":"2024-04-26T10:32:52.995967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996112+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:32:52.996112+0000","last_peered":"2024-04-26T10:32:52.996112+0000","last_clean":"2024-04-26T10:32:52.996112+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:32:52.996112+0000","last_undegraded":"2024-04-26T10:32:52.996112+0000","last_fullsized":"2024-04-26T10:32:52.996112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995621+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:32:52.995621+0000","last_peered":"2024-04-26T10:32:52.995621+0000","last_clean":"2024-04-26T10:32:52.995621+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:32:52.995621+0000","last_undegraded":"2024-04-26T10:32:52.995621+0000","last_fullsized":"2024-04-26T10:32:52.995621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995312+0000","last_change":"2024-04-26T10:32:52.000261+0000","last_active":"2024-04-26T10:32:52.995312+0000","last_peered":"2024-04-26T10:32:52.995312+0000","last_clean":"2024-04-26T10:32:52.995312+0000","last_became_active":"2024-04-26T10:32:51.999284+0000","last_became_peered":"2024-04-26T10:32:51.999284+0000","last_unstale":"2024-04-26T10:32:52.995312+0000","last_undegraded":"2024-04-26T10:32:52.995312+0000","last_fullsized":"2024-04-26T10:32:52.995312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995910+0000","last_change":"2024-04-26T10:32:52.003123+0000","last_active":"2024-04-26T10:32:52.995910+0000","last_peered":"2024-04-26T10:32:52.995910+0000","last_clean":"2024-04-26T10:32:52.995910+0000","last_became_active":"2024-04-26T10:32:52.001353+0000","last_became_peered":"2024-04-26T10:32:52.001353+0000","last_unstale":"2024-04-26T10:32:52.995910+0000","last_undegraded":"2024-04-26T10:32:52.995910+0000","last_fullsized":"2024-04-26T10:32:52.995910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:59:49.869670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995298+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:32:52.995298+0000","last_peered":"2024-04-26T10:32:52.995298+0000","last_clean":"2024-04-26T10:32:52.995298+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:32:52.995298+0000","last_undegraded":"2024-04-26T10:32:52.995298+0000","last_fullsized":"2024-04-26T10:32:52.995298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995391+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:32:52.995391+0000","last_peered":"2024-04-26T10:32:52.995391+0000","last_clean":"2024-04-26T10:32:52.995391+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:32:52.995391+0000","last_undegraded":"2024-04-26T10:32:52.995391+0000","last_fullsized":"2024-04-26T10:32:52.995391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698457+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:32:54.698457+0000","last_peered":"2024-04-26T10:32:54.698457+0000","last_clean":"2024-04-26T10:32:54.698457+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:32:54.698457+0000","last_undegraded":"2024-04-26T10:32:54.698457+0000","last_fullsized":"2024-04-26T10:32:54.698457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996082+0000","last_change":"2024-04-26T10:32:52.000693+0000","last_active":"2024-04-26T10:32:52.996082+0000","last_peered":"2024-04-26T10:32:52.996082+0000","last_clean":"2024-04-26T10:32:52.996082+0000","last_became_active":"2024-04-26T10:32:51.999406+0000","last_became_peered":"2024-04-26T10:32:51.999406+0000","last_unstale":"2024-04-26T10:32:52.996082+0000","last_undegraded":"2024-04-26T10:32:52.996082+0000","last_fullsized":"2024-04-26T10:32:52.996082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698211+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:32:54.698211+0000","last_peered":"2024-04-26T10:32:54.698211+0000","last_clean":"2024-04-26T10:32:54.698211+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:32:54.698211+0000","last_undegraded":"2024-04-26T10:32:54.698211+0000","last_fullsized":"2024-04-26T10:32:54.698211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996035+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:32:52.996035+0000","last_peered":"2024-04-26T10:32:52.996035+0000","last_clean":"2024-04-26T10:32:52.996035+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:32:52.996035+0000","last_undegraded":"2024-04-26T10:32:52.996035+0000","last_fullsized":"2024-04-26T10:32:52.996035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995635+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:32:52.995635+0000","last_peered":"2024-04-26T10:32:52.995635+0000","last_clean":"2024-04-26T10:32:52.995635+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:32:52.995635+0000","last_undegraded":"2024-04-26T10:32:52.995635+0000","last_fullsized":"2024-04-26T10:32:52.995635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995342+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:32:52.995342+0000","last_peered":"2024-04-26T10:32:52.995342+0000","last_clean":"2024-04-26T10:32:52.995342+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:32:52.995342+0000","last_undegraded":"2024-04-26T10:32:52.995342+0000","last_fullsized":"2024-04-26T10:32:52.995342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697661+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:32:54.697661+0000","last_peered":"2024-04-26T10:32:54.697661+0000","last_clean":"2024-04-26T10:32:54.697661+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:32:54.697661+0000","last_undegraded":"2024-04-26T10:32:54.697661+0000","last_fullsized":"2024-04-26T10:32:54.697661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995428+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:32:52.995428+0000","last_peered":"2024-04-26T10:32:52.995428+0000","last_clean":"2024-04-26T10:32:52.995428+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:32:52.995428+0000","last_undegraded":"2024-04-26T10:32:52.995428+0000","last_fullsized":"2024-04-26T10:32:52.995428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996100+0000","last_change":"2024-04-26T10:32:52.004089+0000","last_active":"2024-04-26T10:32:52.996100+0000","last_peered":"2024-04-26T10:32:52.996100+0000","last_clean":"2024-04-26T10:32:52.996100+0000","last_became_active":"2024-04-26T10:32:52.003802+0000","last_became_peered":"2024-04-26T10:32:52.003802+0000","last_unstale":"2024-04-26T10:32:52.996100+0000","last_undegraded":"2024-04-26T10:32:52.996100+0000","last_fullsized":"2024-04-26T10:32:52.996100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698384+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:32:54.698384+0000","last_peered":"2024-04-26T10:32:54.698384+0000","last_clean":"2024-04-26T10:32:54.698384+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:32:54.698384+0000","last_undegraded":"2024-04-26T10:32:54.698384+0000","last_fullsized":"2024-04-26T10:32:54.698384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996122+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:32:52.996122+0000","last_peered":"2024-04-26T10:32:52.996122+0000","last_clean":"2024-04-26T10:32:52.996122+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:32:52.996122+0000","last_undegraded":"2024-04-26T10:32:52.996122+0000","last_fullsized":"2024-04-26T10:32:52.996122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995270+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:32:52.995270+0000","last_peered":"2024-04-26T10:32:52.995270+0000","last_clean":"2024-04-26T10:32:52.995270+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:32:52.995270+0000","last_undegraded":"2024-04-26T10:32:52.995270+0000","last_fullsized":"2024-04-26T10:32:52.995270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996297+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:32:52.996297+0000","last_peered":"2024-04-26T10:32:52.996297+0000","last_clean":"2024-04-26T10:32:52.996297+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:32:52.996297+0000","last_undegraded":"2024-04-26T10:32:52.996297+0000","last_fullsized":"2024-04-26T10:32:52.996297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697734+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:32:54.697734+0000","last_peered":"2024-04-26T10:32:54.697734+0000","last_clean":"2024-04-26T10:32:54.697734+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:32:54.697734+0000","last_undegraded":"2024-04-26T10:32:54.697734+0000","last_fullsized":"2024-04-26T10:32:54.697734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698491+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:32:54.698491+0000","last_peered":"2024-04-26T10:32:54.698491+0000","last_clean":"2024-04-26T10:32:54.698491+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:32:54.698491+0000","last_undegraded":"2024-04-26T10:32:54.698491+0000","last_fullsized":"2024-04-26T10:32:54.698491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697582+0000","last_change":"2024-04-26T10:32:51.588353+0000","last_active":"2024-04-26T10:32:54.697582+0000","last_peered":"2024-04-26T10:32:54.697582+0000","last_clean":"2024-04-26T10:32:54.697582+0000","last_became_active":"2024-04-26T10:32:51.587981+0000","last_became_peered":"2024-04-26T10:32:51.587981+0000","last_unstale":"2024-04-26T10:32:54.697582+0000","last_undegraded":"2024-04-26T10:32:54.697582+0000","last_fullsized":"2024-04-26T10:32:54.697582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:20.810803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996039+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:32:52.996039+0000","last_peered":"2024-04-26T10:32:52.996039+0000","last_clean":"2024-04-26T10:32:52.996039+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:32:52.996039+0000","last_undegraded":"2024-04-26T10:32:52.996039+0000","last_fullsized":"2024-04-26T10:32:52.996039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698553+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:32:54.698553+0000","last_peered":"2024-04-26T10:32:54.698553+0000","last_clean":"2024-04-26T10:32:54.698553+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:32:54.698553+0000","last_undegraded":"2024-04-26T10:32:54.698553+0000","last_fullsized":"2024-04-26T10:32:54.698553+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697438+0000","last_change":"2024-04-26T10:32:52.008030+0000","last_active":"2024-04-26T10:32:54.697438+0000","last_peered":"2024-04-26T10:32:54.697438+0000","last_clean":"2024-04-26T10:32:54.697438+0000","last_became_active":"2024-04-26T10:32:52.007158+0000","last_became_peered":"2024-04-26T10:32:52.007158+0000","last_unstale":"2024-04-26T10:32:54.697438+0000","last_undegraded":"2024-04-26T10:32:54.697438+0000","last_fullsized":"2024-04-26T10:32:54.697438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996258+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:32:52.996258+0000","last_peered":"2024-04-26T10:32:52.996258+0000","last_clean":"2024-04-26T10:32:52.996258+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:32:52.996258+0000","last_undegraded":"2024-04-26T10:32:52.996258+0000","last_fullsized":"2024-04-26T10:32:52.996258+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697790+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:32:54.697790+0000","last_peered":"2024-04-26T10:32:54.697790+0000","last_clean":"2024-04-26T10:32:54.697790+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:32:54.697790+0000","last_undegraded":"2024-04-26T10:32:54.697790+0000","last_fullsized":"2024-04-26T10:32:54.697790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996094+0000","last_change":"2024-04-26T10:32:51.586732+0000","last_active":"2024-04-26T10:32:52.996094+0000","last_peered":"2024-04-26T10:32:52.996094+0000","last_clean":"2024-04-26T10:32:52.996094+0000","last_became_active":"2024-04-26T10:32:51.586533+0000","last_became_peered":"2024-04-26T10:32:51.586533+0000","last_unstale":"2024-04-26T10:32:52.996094+0000","last_undegraded":"2024-04-26T10:32:52.996094+0000","last_fullsized":"2024-04-26T10:32:52.996094+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697696+0000","last_change":"2024-04-26T10:32:52.007650+0000","last_active":"2024-04-26T10:32:54.697696+0000","last_peered":"2024-04-26T10:32:54.697696+0000","last_clean":"2024-04-26T10:32:54.697696+0000","last_became_active":"2024-04-26T10:32:52.007261+0000","last_became_peered":"2024-04-26T10:32:52.007261+0000","last_unstale":"2024-04-26T10:32:54.697696+0000","last_undegraded":"2024-04-26T10:32:54.697696+0000","last_fullsized":"2024-04-26T10:32:54.697696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995900+0000","last_change":"2024-04-26T10:32:51.584497+0000","last_active":"2024-04-26T10:32:52.995900+0000","last_peered":"2024-04-26T10:32:52.995900+0000","last_clean":"2024-04-26T10:32:52.995900+0000","last_became_active":"2024-04-26T10:32:51.583460+0000","last_became_peered":"2024-04-26T10:32:51.583460+0000","last_unstale":"2024-04-26T10:32:52.995900+0000","last_undegraded":"2024-04-26T10:32:52.995900+0000","last_fullsized":"2024-04-26T10:32:52.995900+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995887+0000","last_change":"2024-04-26T10:32:52.001738+0000","last_active":"2024-04-26T10:32:52.995887+0000","last_peered":"2024-04-26T10:32:52.995887+0000","last_clean":"2024-04-26T10:32:52.995887+0000","last_became_active":"2024-04-26T10:32:51.999263+0000","last_became_peered":"2024-04-26T10:32:51.999263+0000","last_unstale":"2024-04-26T10:32:52.995887+0000","last_undegraded":"2024-04-26T10:32:52.995887+0000","last_fullsized":"2024-04-26T10:32:52.995887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:14.966669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995874+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:32:52.995874+0000","last_peered":"2024-04-26T10:32:52.995874+0000","last_clean":"2024-04-26T10:32:52.995874+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:32:52.995874+0000","last_undegraded":"2024-04-26T10:32:52.995874+0000","last_fullsized":"2024-04-26T10:32:52.995874+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995839+0000","last_change":"2024-04-26T10:32:52.000043+0000","last_active":"2024-04-26T10:32:52.995839+0000","last_peered":"2024-04-26T10:32:52.995839+0000","last_clean":"2024-04-26T10:32:52.995839+0000","last_became_active":"2024-04-26T10:32:51.999069+0000","last_became_peered":"2024-04-26T10:32:51.999069+0000","last_unstale":"2024-04-26T10:32:52.995839+0000","last_undegraded":"2024-04-26T10:32:52.995839+0000","last_fullsized":"2024-04-26T10:32:52.995839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697777+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:32:54.697777+0000","last_peered":"2024-04-26T10:32:54.697777+0000","last_clean":"2024-04-26T10:32:54.697777+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:32:54.697777+0000","last_undegraded":"2024-04-26T10:32:54.697777+0000","last_fullsized":"2024-04-26T10:32:54.697777+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996289+0000","last_change":"2024-04-26T10:32:52.000628+0000","last_active":"2024-04-26T10:32:52.996289+0000","last_peered":"2024-04-26T10:32:52.996289+0000","last_clean":"2024-04-26T10:32:52.996289+0000","last_became_active":"2024-04-26T10:32:51.998121+0000","last_became_peered":"2024-04-26T10:32:51.998121+0000","last_unstale":"2024-04-26T10:32:52.996289+0000","last_undegraded":"2024-04-26T10:32:52.996289+0000","last_fullsized":"2024-04-26T10:32:52.996289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.293526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995394+0000","last_change":"2024-04-26T10:32:51.584210+0000","last_active":"2024-04-26T10:32:52.995394+0000","last_peered":"2024-04-26T10:32:52.995394+0000","last_clean":"2024-04-26T10:32:52.995394+0000","last_became_active":"2024-04-26T10:32:51.583823+0000","last_became_peered":"2024-04-26T10:32:51.583823+0000","last_unstale":"2024-04-26T10:32:52.995394+0000","last_undegraded":"2024-04-26T10:32:52.995394+0000","last_fullsized":"2024-04-26T10:32:52.995394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.121333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698492+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:32:54.698492+0000","last_peered":"2024-04-26T10:32:54.698492+0000","last_clean":"2024-04-26T10:32:54.698492+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:32:54.698492+0000","last_undegraded":"2024-04-26T10:32:54.698492+0000","last_fullsized":"2024-04-26T10:32:54.698492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995640+0000","last_change":"2024-04-26T10:32:51.584088+0000","last_active":"2024-04-26T10:32:52.995640+0000","last_peered":"2024-04-26T10:32:52.995640+0000","last_clean":"2024-04-26T10:32:52.995640+0000","last_became_active":"2024-04-26T10:32:51.583020+0000","last_became_peered":"2024-04-26T10:32:51.583020+0000","last_unstale":"2024-04-26T10:32:52.995640+0000","last_undegraded":"2024-04-26T10:32:52.995640+0000","last_fullsized":"2024-04-26T10:32:52.995640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698660+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:32:54.698660+0000","last_peered":"2024-04-26T10:32:54.698660+0000","last_clean":"2024-04-26T10:32:54.698660+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:32:54.698660+0000","last_undegraded":"2024-04-26T10:32:54.698660+0000","last_fullsized":"2024-04-26T10:32:54.698660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996288+0000","last_change":"2024-04-26T10:32:51.583791+0000","last_active":"2024-04-26T10:32:52.996288+0000","last_peered":"2024-04-26T10:32:52.996288+0000","last_clean":"2024-04-26T10:32:52.996288+0000","last_became_active":"2024-04-26T10:32:51.583103+0000","last_became_peered":"2024-04-26T10:32:51.583103+0000","last_unstale":"2024-04-26T10:32:52.996288+0000","last_undegraded":"2024-04-26T10:32:52.996288+0000","last_fullsized":"2024-04-26T10:32:52.996288+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.994938+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:32:52.994938+0000","last_peered":"2024-04-26T10:32:52.994938+0000","last_clean":"2024-04-26T10:32:52.994938+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:32:52.994938+0000","last_undegraded":"2024-04-26T10:32:52.994938+0000","last_fullsized":"2024-04-26T10:32:52.994938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995812+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:32:52.995812+0000","last_peered":"2024-04-26T10:32:52.995812+0000","last_clean":"2024-04-26T10:32:52.995812+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:32:52.995812+0000","last_undegraded":"2024-04-26T10:32:52.995812+0000","last_fullsized":"2024-04-26T10:32:52.995812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995440+0000","last_change":"2024-04-26T10:32:51.997516+0000","last_active":"2024-04-26T10:32:52.995440+0000","last_peered":"2024-04-26T10:32:52.995440+0000","last_clean":"2024-04-26T10:32:52.995440+0000","last_became_active":"2024-04-26T10:32:51.996896+0000","last_became_peered":"2024-04-26T10:32:51.996896+0000","last_unstale":"2024-04-26T10:32:52.995440+0000","last_undegraded":"2024-04-26T10:32:52.995440+0000","last_fullsized":"2024-04-26T10:32:52.995440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:51.552418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996431+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:32:52.996431+0000","last_peered":"2024-04-26T10:32:52.996431+0000","last_clean":"2024-04-26T10:32:52.996431+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:32:52.996431+0000","last_undegraded":"2024-04-26T10:32:52.996431+0000","last_fullsized":"2024-04-26T10:32:52.996431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995565+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:32:52.995565+0000","last_peered":"2024-04-26T10:32:52.995565+0000","last_clean":"2024-04-26T10:32:52.995565+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:32:52.995565+0000","last_undegraded":"2024-04-26T10:32:52.995565+0000","last_fullsized":"2024-04-26T10:32:52.995565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995674+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:32:52.995674+0000","last_peered":"2024-04-26T10:32:52.995674+0000","last_clean":"2024-04-26T10:32:52.995674+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:32:52.995674+0000","last_undegraded":"2024-04-26T10:32:52.995674+0000","last_fullsized":"2024-04-26T10:32:52.995674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697950+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:32:54.697950+0000","last_peered":"2024-04-26T10:32:54.697950+0000","last_clean":"2024-04-26T10:32:54.697950+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:32:54.697950+0000","last_undegraded":"2024-04-26T10:32:54.697950+0000","last_fullsized":"2024-04-26T10:32:54.697950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697966+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:32:54.697966+0000","last_peered":"2024-04-26T10:32:54.697966+0000","last_clean":"2024-04-26T10:32:54.697966+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:32:54.697966+0000","last_undegraded":"2024-04-26T10:32:54.697966+0000","last_fullsized":"2024-04-26T10:32:54.697966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995743+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:32:52.995743+0000","last_peered":"2024-04-26T10:32:52.995743+0000","last_clean":"2024-04-26T10:32:52.995743+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:32:52.995743+0000","last_undegraded":"2024-04-26T10:32:52.995743+0000","last_fullsized":"2024-04-26T10:32:52.995743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995417+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:32:52.995417+0000","last_peered":"2024-04-26T10:32:52.995417+0000","last_clean":"2024-04-26T10:32:52.995417+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:32:52.995417+0000","last_undegraded":"2024-04-26T10:32:52.995417+0000","last_fullsized":"2024-04-26T10:32:52.995417+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996362+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:32:52.996362+0000","last_peered":"2024-04-26T10:32:52.996362+0000","last_clean":"2024-04-26T10:32:52.996362+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:32:52.996362+0000","last_undegraded":"2024-04-26T10:32:52.996362+0000","last_fullsized":"2024-04-26T10:32:52.996362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995012+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:32:52.995012+0000","last_peered":"2024-04-26T10:32:52.995012+0000","last_clean":"2024-04-26T10:32:52.995012+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:32:52.995012+0000","last_undegraded":"2024-04-26T10:32:52.995012+0000","last_fullsized":"2024-04-26T10:32:52.995012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996322+0000","last_change":"2024-04-26T10:32:52.004444+0000","last_active":"2024-04-26T10:32:52.996322+0000","last_peered":"2024-04-26T10:32:52.996322+0000","last_clean":"2024-04-26T10:32:52.996322+0000","last_became_active":"2024-04-26T10:32:52.003360+0000","last_became_peered":"2024-04-26T10:32:52.003360+0000","last_unstale":"2024-04-26T10:32:52.996322+0000","last_undegraded":"2024-04-26T10:32:52.996322+0000","last_fullsized":"2024-04-26T10:32:52.996322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:20.180213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995117+0000","last_change":"2024-04-26T10:32:51.584385+0000","last_active":"2024-04-26T10:32:52.995117+0000","last_peered":"2024-04-26T10:32:52.995117+0000","last_clean":"2024-04-26T10:32:52.995117+0000","last_became_active":"2024-04-26T10:32:51.584025+0000","last_became_peered":"2024-04-26T10:32:51.584025+0000","last_unstale":"2024-04-26T10:32:52.995117+0000","last_undegraded":"2024-04-26T10:32:52.995117+0000","last_fullsized":"2024-04-26T10:32:52.995117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:57.247011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698499+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:32:54.698499+0000","last_peered":"2024-04-26T10:32:54.698499+0000","last_clean":"2024-04-26T10:32:54.698499+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:32:54.698499+0000","last_undegraded":"2024-04-26T10:32:54.698499+0000","last_fullsized":"2024-04-26T10:32:54.698499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.999504+0000","last_change":"2024-04-26T10:32:46.555353+0000","last_active":"2024-04-26T10:32:51.999504+0000","last_peered":"2024-04-26T10:32:51.999504+0000","last_clean":"2024-04-26T10:32:51.999504+0000","last_became_active":"2024-04-26T10:32:46.555005+0000","last_became_peered":"2024-04-26T10:32:46.555005+0000","last_unstale":"2024-04-26T10:32:51.999504+0000","last_undegraded":"2024-04-26T10:32:51.999504+0000","last_fullsized":"2024-04-26T10:32:51.999504+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996229+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:32:52.996229+0000","last_peered":"2024-04-26T10:32:52.996229+0000","last_clean":"2024-04-26T10:32:52.996229+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:32:52.996229+0000","last_undegraded":"2024-04-26T10:32:52.996229+0000","last_fullsized":"2024-04-26T10:32:52.996229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995425+0000","last_change":"2024-04-26T10:32:52.004199+0000","last_active":"2024-04-26T10:32:52.995425+0000","last_peered":"2024-04-26T10:32:52.995425+0000","last_clean":"2024-04-26T10:32:52.995425+0000","last_became_active":"2024-04-26T10:32:52.003894+0000","last_became_peered":"2024-04-26T10:32:52.003894+0000","last_unstale":"2024-04-26T10:32:52.995425+0000","last_undegraded":"2024-04-26T10:32:52.995425+0000","last_fullsized":"2024-04-26T10:32:52.995425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.000379+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:32:52.000379+0000","last_peered":"2024-04-26T10:32:52.000379+0000","last_clean":"2024-04-26T10:32:52.000379+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:32:52.000379+0000","last_undegraded":"2024-04-26T10:32:52.000379+0000","last_fullsized":"2024-04-26T10:32:52.000379+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995781+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:32:52.995781+0000","last_peered":"2024-04-26T10:32:52.995781+0000","last_clean":"2024-04-26T10:32:52.995781+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:32:52.995781+0000","last_undegraded":"2024-04-26T10:32:52.995781+0000","last_fullsized":"2024-04-26T10:32:52.995781+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698151+0000","last_change":"2024-04-26T10:32:52.007589+0000","last_active":"2024-04-26T10:32:54.698151+0000","last_peered":"2024-04-26T10:32:54.698151+0000","last_clean":"2024-04-26T10:32:54.698151+0000","last_became_active":"2024-04-26T10:32:52.007289+0000","last_became_peered":"2024-04-26T10:32:52.007289+0000","last_unstale":"2024-04-26T10:32:54.698151+0000","last_undegraded":"2024-04-26T10:32:54.698151+0000","last_fullsized":"2024-04-26T10:32:54.698151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.998883+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:32:51.998883+0000","last_peered":"2024-04-26T10:32:51.998883+0000","last_clean":"2024-04-26T10:32:51.998883+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:32:51.998883+0000","last_undegraded":"2024-04-26T10:32:51.998883+0000","last_fullsized":"2024-04-26T10:32:51.998883+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995047+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:32:52.995047+0000","last_peered":"2024-04-26T10:32:52.995047+0000","last_clean":"2024-04-26T10:32:52.995047+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:32:52.995047+0000","last_undegraded":"2024-04-26T10:32:52.995047+0000","last_fullsized":"2024-04-26T10:32:52.995047+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698612+0000","last_change":"2024-04-26T10:32:52.009270+0000","last_active":"2024-04-26T10:32:54.698612+0000","last_peered":"2024-04-26T10:32:54.698612+0000","last_clean":"2024-04-26T10:32:54.698612+0000","last_became_active":"2024-04-26T10:32:52.008599+0000","last_became_peered":"2024-04-26T10:32:52.008599+0000","last_unstale":"2024-04-26T10:32:54.698612+0000","last_undegraded":"2024-04-26T10:32:54.698612+0000","last_fullsized":"2024-04-26T10:32:54.698612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.000550+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:32:52.000550+0000","last_peered":"2024-04-26T10:32:52.000550+0000","last_clean":"2024-04-26T10:32:52.000550+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:32:52.000550+0000","last_undegraded":"2024-04-26T10:32:52.000550+0000","last_fullsized":"2024-04-26T10:32:52.000550+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.997944+0000","last_change":"2024-04-26T10:32:46.555694+0000","last_active":"2024-04-26T10:32:51.997944+0000","last_peered":"2024-04-26T10:32:51.997944+0000","last_clean":"2024-04-26T10:32:51.997944+0000","last_became_active":"2024-04-26T10:32:46.555391+0000","last_became_peered":"2024-04-26T10:32:46.555391+0000","last_unstale":"2024-04-26T10:32:51.997944+0000","last_undegraded":"2024-04-26T10:32:51.997944+0000","last_fullsized":"2024-04-26T10:32:51.997944+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697661+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:32:54.697661+0000","last_peered":"2024-04-26T10:32:54.697661+0000","last_clean":"2024-04-26T10:32:54.697661+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:32:54.697661+0000","last_undegraded":"2024-04-26T10:32:54.697661+0000","last_fullsized":"2024-04-26T10:32:54.697661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996350+0000","last_change":"2024-04-26T10:32:52.006765+0000","last_active":"2024-04-26T10:32:52.996350+0000","last_peered":"2024-04-26T10:32:52.996350+0000","last_clean":"2024-04-26T10:32:52.996350+0000","last_became_active":"2024-04-26T10:32:52.004110+0000","last_became_peered":"2024-04-26T10:32:52.004110+0000","last_unstale":"2024-04-26T10:32:52.996350+0000","last_undegraded":"2024-04-26T10:32:52.996350+0000","last_fullsized":"2024-04-26T10:32:52.996350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:47.156703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.998516+0000","last_change":"2024-04-26T10:32:46.555501+0000","last_active":"2024-04-26T10:32:51.998516+0000","last_peered":"2024-04-26T10:32:51.998516+0000","last_clean":"2024-04-26T10:32:51.998516+0000","last_became_active":"2024-04-26T10:32:46.555252+0000","last_became_peered":"2024-04-26T10:32:46.555252+0000","last_unstale":"2024-04-26T10:32:51.998516+0000","last_undegraded":"2024-04-26T10:32:51.998516+0000","last_fullsized":"2024-04-26T10:32:51.998516+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697491+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:32:54.697491+0000","last_peered":"2024-04-26T10:32:54.697491+0000","last_clean":"2024-04-26T10:32:54.697491+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:32:54.697491+0000","last_undegraded":"2024-04-26T10:32:54.697491+0000","last_fullsized":"2024-04-26T10:32:54.697491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995980+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:32:52.995980+0000","last_peered":"2024-04-26T10:32:52.995980+0000","last_clean":"2024-04-26T10:32:52.995980+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:32:52.995980+0000","last_undegraded":"2024-04-26T10:32:52.995980+0000","last_fullsized":"2024-04-26T10:32:52.995980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.993416+0000","last_change":"2024-04-26T10:32:46.556007+0000","last_active":"2024-04-26T10:32:51.993416+0000","last_peered":"2024-04-26T10:32:51.993416+0000","last_clean":"2024-04-26T10:32:51.993416+0000","last_became_active":"2024-04-26T10:32:46.555738+0000","last_became_peered":"2024-04-26T10:32:46.555738+0000","last_unstale":"2024-04-26T10:32:51.993416+0000","last_undegraded":"2024-04-26T10:32:51.993416+0000","last_fullsized":"2024-04-26T10:32:51.993416+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:04.230186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698307+0000","last_change":"2024-04-26T10:32:51.589352+0000","last_active":"2024-04-26T10:32:54.698307+0000","last_peered":"2024-04-26T10:32:54.698307+0000","last_clean":"2024-04-26T10:32:54.698307+0000","last_became_active":"2024-04-26T10:32:51.589006+0000","last_became_peered":"2024-04-26T10:32:51.589006+0000","last_unstale":"2024-04-26T10:32:54.698307+0000","last_undegraded":"2024-04-26T10:32:54.698307+0000","last_fullsized":"2024-04-26T10:32:54.698307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995503+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:32:52.995503+0000","last_peered":"2024-04-26T10:32:52.995503+0000","last_clean":"2024-04-26T10:32:52.995503+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:32:52.995503+0000","last_undegraded":"2024-04-26T10:32:52.995503+0000","last_fullsized":"2024-04-26T10:32:52.995503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698429+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:32:54.698429+0000","last_peered":"2024-04-26T10:32:54.698429+0000","last_clean":"2024-04-26T10:32:54.698429+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:32:54.698429+0000","last_undegraded":"2024-04-26T10:32:54.698429+0000","last_fullsized":"2024-04-26T10:32:54.698429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.001757+0000","last_change":"2024-04-26T10:32:46.555394+0000","last_active":"2024-04-26T10:32:52.001757+0000","last_peered":"2024-04-26T10:32:52.001757+0000","last_clean":"2024-04-26T10:32:52.001757+0000","last_became_active":"2024-04-26T10:32:46.555053+0000","last_became_peered":"2024-04-26T10:32:46.555053+0000","last_unstale":"2024-04-26T10:32:52.001757+0000","last_undegraded":"2024-04-26T10:32:52.001757+0000","last_fullsized":"2024-04-26T10:32:52.001757+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697328+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:32:54.697328+0000","last_peered":"2024-04-26T10:32:54.697328+0000","last_clean":"2024-04-26T10:32:54.697328+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:32:54.697328+0000","last_undegraded":"2024-04-26T10:32:54.697328+0000","last_fullsized":"2024-04-26T10:32:54.697328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.002371+0000","last_change":"2024-04-26T10:32:46.555191+0000","last_active":"2024-04-26T10:32:52.002371+0000","last_peered":"2024-04-26T10:32:52.002371+0000","last_clean":"2024-04-26T10:32:52.002371+0000","last_became_active":"2024-04-26T10:32:46.554892+0000","last_became_peered":"2024-04-26T10:32:46.554892+0000","last_unstale":"2024-04-26T10:32:52.002371+0000","last_undegraded":"2024-04-26T10:32:52.002371+0000","last_fullsized":"2024-04-26T10:32:52.002371+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.991584+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:32:54.991584+0000","last_peered":"2024-04-26T10:32:54.991584+0000","last_clean":"2024-04-26T10:32:54.991584+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:32:54.991584+0000","last_undegraded":"2024-04-26T10:32:54.991584+0000","last_fullsized":"2024-04-26T10:32:54.991584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995288+0000","last_change":"2024-04-26T10:32:52.001408+0000","last_active":"2024-04-26T10:32:52.995288+0000","last_peered":"2024-04-26T10:32:52.995288+0000","last_clean":"2024-04-26T10:32:52.995288+0000","last_became_active":"2024-04-26T10:32:52.000668+0000","last_became_peered":"2024-04-26T10:32:52.000668+0000","last_unstale":"2024-04-26T10:32:52.995288+0000","last_undegraded":"2024-04-26T10:32:52.995288+0000","last_fullsized":"2024-04-26T10:32:52.995288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995353+0000","last_change":"2024-04-26T10:32:51.586234+0000","last_active":"2024-04-26T10:32:52.995353+0000","last_peered":"2024-04-26T10:32:52.995353+0000","last_clean":"2024-04-26T10:32:52.995353+0000","last_became_active":"2024-04-26T10:32:51.586004+0000","last_became_peered":"2024-04-26T10:32:51.586004+0000","last_unstale":"2024-04-26T10:32:52.995353+0000","last_undegraded":"2024-04-26T10:32:52.995353+0000","last_fullsized":"2024-04-26T10:32:52.995353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:03.977752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995947+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:32:52.995947+0000","last_peered":"2024-04-26T10:32:52.995947+0000","last_clean":"2024-04-26T10:32:52.995947+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:32:52.995947+0000","last_undegraded":"2024-04-26T10:32:52.995947+0000","last_fullsized":"2024-04-26T10:32:52.995947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995869+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:32:52.995869+0000","last_peered":"2024-04-26T10:32:52.995869+0000","last_clean":"2024-04-26T10:32:52.995869+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:32:52.995869+0000","last_undegraded":"2024-04-26T10:32:52.995869+0000","last_fullsized":"2024-04-26T10:32:52.995869+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995676+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:32:52.995676+0000","last_peered":"2024-04-26T10:32:52.995676+0000","last_clean":"2024-04-26T10:32:52.995676+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:32:52.995676+0000","last_undegraded":"2024-04-26T10:32:52.995676+0000","last_fullsized":"2024-04-26T10:32:52.995676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996240+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:32:52.996240+0000","last_peered":"2024-04-26T10:32:52.996240+0000","last_clean":"2024-04-26T10:32:52.996240+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:32:52.996240+0000","last_undegraded":"2024-04-26T10:32:52.996240+0000","last_fullsized":"2024-04-26T10:32:52.996240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995491+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:32:52.995491+0000","last_peered":"2024-04-26T10:32:52.995491+0000","last_clean":"2024-04-26T10:32:52.995491+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:32:52.995491+0000","last_undegraded":"2024-04-26T10:32:52.995491+0000","last_fullsized":"2024-04-26T10:32:52.995491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698596+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:32:54.698596+0000","last_peered":"2024-04-26T10:32:54.698596+0000","last_clean":"2024-04-26T10:32:54.698596+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:32:54.698596+0000","last_undegraded":"2024-04-26T10:32:54.698596+0000","last_fullsized":"2024-04-26T10:32:54.698596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995567+0000","last_change":"2024-04-26T10:32:51.999341+0000","last_active":"2024-04-26T10:32:52.995567+0000","last_peered":"2024-04-26T10:32:52.995567+0000","last_clean":"2024-04-26T10:32:52.995567+0000","last_became_active":"2024-04-26T10:32:51.998256+0000","last_became_peered":"2024-04-26T10:32:51.998256+0000","last_unstale":"2024-04-26T10:32:52.995567+0000","last_undegraded":"2024-04-26T10:32:52.995567+0000","last_fullsized":"2024-04-26T10:32:52.995567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698554+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:32:54.698554+0000","last_peered":"2024-04-26T10:32:54.698554+0000","last_clean":"2024-04-26T10:32:54.698554+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:32:54.698554+0000","last_undegraded":"2024-04-26T10:32:54.698554+0000","last_fullsized":"2024-04-26T10:32:54.698554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995762+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:32:52.995762+0000","last_peered":"2024-04-26T10:32:52.995762+0000","last_clean":"2024-04-26T10:32:52.995762+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:32:52.995762+0000","last_undegraded":"2024-04-26T10:32:52.995762+0000","last_fullsized":"2024-04-26T10:32:52.995762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995699+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:32:52.995699+0000","last_peered":"2024-04-26T10:32:52.995699+0000","last_clean":"2024-04-26T10:32:52.995699+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:32:52.995699+0000","last_undegraded":"2024-04-26T10:32:52.995699+0000","last_fullsized":"2024-04-26T10:32:52.995699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697606+0000","last_change":"2024-04-26T10:32:52.004844+0000","last_active":"2024-04-26T10:32:54.697606+0000","last_peered":"2024-04-26T10:32:54.697606+0000","last_clean":"2024-04-26T10:32:54.697606+0000","last_became_active":"2024-04-26T10:32:52.004484+0000","last_became_peered":"2024-04-26T10:32:52.004484+0000","last_unstale":"2024-04-26T10:32:54.697606+0000","last_undegraded":"2024-04-26T10:32:54.697606+0000","last_fullsized":"2024-04-26T10:32:54.697606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995521+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:32:52.995521+0000","last_peered":"2024-04-26T10:32:52.995521+0000","last_clean":"2024-04-26T10:32:52.995521+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:32:52.995521+0000","last_undegraded":"2024-04-26T10:32:52.995521+0000","last_fullsized":"2024-04-26T10:32:52.995521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698146+0000","last_change":"2024-04-26T10:32:52.007818+0000","last_active":"2024-04-26T10:32:54.698146+0000","last_peered":"2024-04-26T10:32:54.698146+0000","last_clean":"2024-04-26T10:32:54.698146+0000","last_became_active":"2024-04-26T10:32:52.007552+0000","last_became_peered":"2024-04-26T10:32:52.007552+0000","last_unstale":"2024-04-26T10:32:54.698146+0000","last_undegraded":"2024-04-26T10:32:54.698146+0000","last_fullsized":"2024-04-26T10:32:54.698146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995977+0000","last_change":"2024-04-26T10:32:52.010309+0000","last_active":"2024-04-26T10:32:52.995977+0000","last_peered":"2024-04-26T10:32:52.995977+0000","last_clean":"2024-04-26T10:32:52.995977+0000","last_became_active":"2024-04-26T10:32:52.009152+0000","last_became_peered":"2024-04-26T10:32:52.009152+0000","last_unstale":"2024-04-26T10:32:52.995977+0000","last_undegraded":"2024-04-26T10:32:52.995977+0000","last_fullsized":"2024-04-26T10:32:52.995977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:33:13.649 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:33:14.027 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:14.029 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:33:14.037 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T10:33:12.988859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82684,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032836,"statfs":{"total":289910292480,"available":289825624064,"internally_reserved":0,"allocated":1646592,"data_stored":1323601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002713"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996155+0000","last_change":"2024-04-26T10:32:51.998840+0000","last_active":"2024-04-26T10:32:52.996155+0000","last_peered":"2024-04-26T10:32:52.996155+0000","last_clean":"2024-04-26T10:32:52.996155+0000","last_became_active":"2024-04-26T10:32:51.998236+0000","last_became_peered":"2024-04-26T10:32:51.998236+0000","last_unstale":"2024-04-26T10:32:52.996155+0000","last_undegraded":"2024-04-26T10:32:52.996155+0000","last_fullsized":"2024-04-26T10:32:52.996155+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995759+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:32:52.995759+0000","last_peered":"2024-04-26T10:32:52.995759+0000","last_clean":"2024-04-26T10:32:52.995759+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:32:52.995759+0000","last_undegraded":"2024-04-26T10:32:52.995759+0000","last_fullsized":"2024-04-26T10:32:52.995759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996256+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:32:52.996256+0000","last_peered":"2024-04-26T10:32:52.996256+0000","last_clean":"2024-04-26T10:32:52.996256+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:32:52.996256+0000","last_undegraded":"2024-04-26T10:32:52.996256+0000","last_fullsized":"2024-04-26T10:32:52.996256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996029+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:32:52.996029+0000","last_peered":"2024-04-26T10:32:52.996029+0000","last_clean":"2024-04-26T10:32:52.996029+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:32:52.996029+0000","last_undegraded":"2024-04-26T10:32:52.996029+0000","last_fullsized":"2024-04-26T10:32:52.996029+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995460+0000","last_change":"2024-04-26T10:32:51.999420+0000","last_active":"2024-04-26T10:32:52.995460+0000","last_peered":"2024-04-26T10:32:52.995460+0000","last_clean":"2024-04-26T10:32:52.995460+0000","last_became_active":"2024-04-26T10:32:51.999046+0000","last_became_peered":"2024-04-26T10:32:51.999046+0000","last_unstale":"2024-04-26T10:32:52.995460+0000","last_undegraded":"2024-04-26T10:32:52.995460+0000","last_fullsized":"2024-04-26T10:32:52.995460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:10.442986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995344+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:32:52.995344+0000","last_peered":"2024-04-26T10:32:52.995344+0000","last_clean":"2024-04-26T10:32:52.995344+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:32:52.995344+0000","last_undegraded":"2024-04-26T10:32:52.995344+0000","last_fullsized":"2024-04-26T10:32:52.995344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995441+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:32:52.995441+0000","last_peered":"2024-04-26T10:32:52.995441+0000","last_clean":"2024-04-26T10:32:52.995441+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:32:52.995441+0000","last_undegraded":"2024-04-26T10:32:52.995441+0000","last_fullsized":"2024-04-26T10:32:52.995441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995369+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:32:52.995369+0000","last_peered":"2024-04-26T10:32:52.995369+0000","last_clean":"2024-04-26T10:32:52.995369+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:32:52.995369+0000","last_undegraded":"2024-04-26T10:32:52.995369+0000","last_fullsized":"2024-04-26T10:32:52.995369+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698360+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:32:54.698360+0000","last_peered":"2024-04-26T10:32:54.698360+0000","last_clean":"2024-04-26T10:32:54.698360+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:32:54.698360+0000","last_undegraded":"2024-04-26T10:32:54.698360+0000","last_fullsized":"2024-04-26T10:32:54.698360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995967+0000","last_change":"2024-04-26T10:32:52.000612+0000","last_active":"2024-04-26T10:32:52.995967+0000","last_peered":"2024-04-26T10:32:52.995967+0000","last_clean":"2024-04-26T10:32:52.995967+0000","last_became_active":"2024-04-26T10:32:51.998958+0000","last_became_peered":"2024-04-26T10:32:51.998958+0000","last_unstale":"2024-04-26T10:32:52.995967+0000","last_undegraded":"2024-04-26T10:32:52.995967+0000","last_fullsized":"2024-04-26T10:32:52.995967+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996112+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:32:52.996112+0000","last_peered":"2024-04-26T10:32:52.996112+0000","last_clean":"2024-04-26T10:32:52.996112+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:32:52.996112+0000","last_undegraded":"2024-04-26T10:32:52.996112+0000","last_fullsized":"2024-04-26T10:32:52.996112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995621+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:32:52.995621+0000","last_peered":"2024-04-26T10:32:52.995621+0000","last_clean":"2024-04-26T10:32:52.995621+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:32:52.995621+0000","last_undegraded":"2024-04-26T10:32:52.995621+0000","last_fullsized":"2024-04-26T10:32:52.995621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995312+0000","last_change":"2024-04-26T10:32:52.000261+0000","last_active":"2024-04-26T10:32:52.995312+0000","last_peered":"2024-04-26T10:32:52.995312+0000","last_clean":"2024-04-26T10:32:52.995312+0000","last_became_active":"2024-04-26T10:32:51.999284+0000","last_became_peered":"2024-04-26T10:32:51.999284+0000","last_unstale":"2024-04-26T10:32:52.995312+0000","last_undegraded":"2024-04-26T10:32:52.995312+0000","last_fullsized":"2024-04-26T10:32:52.995312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995910+0000","last_change":"2024-04-26T10:32:52.003123+0000","last_active":"2024-04-26T10:32:52.995910+0000","last_peered":"2024-04-26T10:32:52.995910+0000","last_clean":"2024-04-26T10:32:52.995910+0000","last_became_active":"2024-04-26T10:32:52.001353+0000","last_became_peered":"2024-04-26T10:32:52.001353+0000","last_unstale":"2024-04-26T10:32:52.995910+0000","last_undegraded":"2024-04-26T10:32:52.995910+0000","last_fullsized":"2024-04-26T10:32:52.995910+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:59:49.869670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995298+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:32:52.995298+0000","last_peered":"2024-04-26T10:32:52.995298+0000","last_clean":"2024-04-26T10:32:52.995298+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:32:52.995298+0000","last_undegraded":"2024-04-26T10:32:52.995298+0000","last_fullsized":"2024-04-26T10:32:52.995298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995391+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:32:52.995391+0000","last_peered":"2024-04-26T10:32:52.995391+0000","last_clean":"2024-04-26T10:32:52.995391+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:32:52.995391+0000","last_undegraded":"2024-04-26T10:32:52.995391+0000","last_fullsized":"2024-04-26T10:32:52.995391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698457+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:32:54.698457+0000","last_peered":"2024-04-26T10:32:54.698457+0000","last_clean":"2024-04-26T10:32:54.698457+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:32:54.698457+0000","last_undegraded":"2024-04-26T10:32:54.698457+0000","last_fullsized":"2024-04-26T10:32:54.698457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996082+0000","last_change":"2024-04-26T10:32:52.000693+0000","last_active":"2024-04-26T10:32:52.996082+0000","last_peered":"2024-04-26T10:32:52.996082+0000","last_clean":"2024-04-26T10:32:52.996082+0000","last_became_active":"2024-04-26T10:32:51.999406+0000","last_became_peered":"2024-04-26T10:32:51.999406+0000","last_unstale":"2024-04-26T10:32:52.996082+0000","last_undegraded":"2024-04-26T10:32:52.996082+0000","last_fullsized":"2024-04-26T10:32:52.996082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698211+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:32:54.698211+0000","last_peered":"2024-04-26T10:32:54.698211+0000","last_clean":"2024-04-26T10:32:54.698211+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:32:54.698211+0000","last_undegraded":"2024-04-26T10:32:54.698211+0000","last_fullsized":"2024-04-26T10:32:54.698211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996035+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:32:52.996035+0000","last_peered":"2024-04-26T10:32:52.996035+0000","last_clean":"2024-04-26T10:32:52.996035+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:32:52.996035+0000","last_undegraded":"2024-04-26T10:32:52.996035+0000","last_fullsized":"2024-04-26T10:32:52.996035+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995635+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:32:52.995635+0000","last_peered":"2024-04-26T10:32:52.995635+0000","last_clean":"2024-04-26T10:32:52.995635+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:32:52.995635+0000","last_undegraded":"2024-04-26T10:32:52.995635+0000","last_fullsized":"2024-04-26T10:32:52.995635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995342+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:32:52.995342+0000","last_peered":"2024-04-26T10:32:52.995342+0000","last_clean":"2024-04-26T10:32:52.995342+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:32:52.995342+0000","last_undegraded":"2024-04-26T10:32:52.995342+0000","last_fullsized":"2024-04-26T10:32:52.995342+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697661+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:32:54.697661+0000","last_peered":"2024-04-26T10:32:54.697661+0000","last_clean":"2024-04-26T10:32:54.697661+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:32:54.697661+0000","last_undegraded":"2024-04-26T10:32:54.697661+0000","last_fullsized":"2024-04-26T10:32:54.697661+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995428+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:32:52.995428+0000","last_peered":"2024-04-26T10:32:52.995428+0000","last_clean":"2024-04-26T10:32:52.995428+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:32:52.995428+0000","last_undegraded":"2024-04-26T10:32:52.995428+0000","last_fullsized":"2024-04-26T10:32:52.995428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996100+0000","last_change":"2024-04-26T10:32:52.004089+0000","last_active":"2024-04-26T10:32:52.996100+0000","last_peered":"2024-04-26T10:32:52.996100+0000","last_clean":"2024-04-26T10:32:52.996100+0000","last_became_active":"2024-04-26T10:32:52.003802+0000","last_became_peered":"2024-04-26T10:32:52.003802+0000","last_unstale":"2024-04-26T10:32:52.996100+0000","last_undegraded":"2024-04-26T10:32:52.996100+0000","last_fullsized":"2024-04-26T10:32:52.996100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698384+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:32:54.698384+0000","last_peered":"2024-04-26T10:32:54.698384+0000","last_clean":"2024-04-26T10:32:54.698384+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:32:54.698384+0000","last_undegraded":"2024-04-26T10:32:54.698384+0000","last_fullsized":"2024-04-26T10:32:54.698384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996122+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:32:52.996122+0000","last_peered":"2024-04-26T10:32:52.996122+0000","last_clean":"2024-04-26T10:32:52.996122+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:32:52.996122+0000","last_undegraded":"2024-04-26T10:32:52.996122+0000","last_fullsized":"2024-04-26T10:32:52.996122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995270+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:32:52.995270+0000","last_peered":"2024-04-26T10:32:52.995270+0000","last_clean":"2024-04-26T10:32:52.995270+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:32:52.995270+0000","last_undegraded":"2024-04-26T10:32:52.995270+0000","last_fullsized":"2024-04-26T10:32:52.995270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996297+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:32:52.996297+0000","last_peered":"2024-04-26T10:32:52.996297+0000","last_clean":"2024-04-26T10:32:52.996297+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:32:52.996297+0000","last_undegraded":"2024-04-26T10:32:52.996297+0000","last_fullsized":"2024-04-26T10:32:52.996297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697734+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:32:54.697734+0000","last_peered":"2024-04-26T10:32:54.697734+0000","last_clean":"2024-04-26T10:32:54.697734+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:32:54.697734+0000","last_undegraded":"2024-04-26T10:32:54.697734+0000","last_fullsized":"2024-04-26T10:32:54.697734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698491+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:32:54.698491+0000","last_peered":"2024-04-26T10:32:54.698491+0000","last_clean":"2024-04-26T10:32:54.698491+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:32:54.698491+0000","last_undegraded":"2024-04-26T10:32:54.698491+0000","last_fullsized":"2024-04-26T10:32:54.698491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697582+0000","last_change":"2024-04-26T10:32:51.588353+0000","last_active":"2024-04-26T10:32:54.697582+0000","last_peered":"2024-04-26T10:32:54.697582+0000","last_clean":"2024-04-26T10:32:54.697582+0000","last_became_active":"2024-04-26T10:32:51.587981+0000","last_became_peered":"2024-04-26T10:32:51.587981+0000","last_unstale":"2024-04-26T10:32:54.697582+0000","last_undegraded":"2024-04-26T10:32:54.697582+0000","last_fullsized":"2024-04-26T10:32:54.697582+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:20.810803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996039+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:32:52.996039+0000","last_peered":"2024-04-26T10:32:52.996039+0000","last_clean":"2024-04-26T10:32:52.996039+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:32:52.996039+0000","last_undegraded":"2024-04-26T10:32:52.996039+0000","last_fullsized":"2024-04-26T10:32:52.996039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698553+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:32:54.698553+0000","last_peered":"2024-04-26T10:32:54.698553+0000","last_clean":"2024-04-26T10:32:54.698553+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:32:54.698553+0000","last_undegraded":"2024-04-26T10:32:54.698553+0000","last_fullsized":"2024-04-26T10:32:54.698553+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697438+0000","last_change":"2024-04-26T10:32:52.008030+0000","last_active":"2024-04-26T10:32:54.697438+0000","last_peered":"2024-04-26T10:32:54.697438+0000","last_clean":"2024-04-26T10:32:54.697438+0000","last_became_active":"2024-04-26T10:32:52.007158+0000","last_became_peered":"2024-04-26T10:32:52.007158+0000","last_unstale":"2024-04-26T10:32:54.697438+0000","last_undegraded":"2024-04-26T10:32:54.697438+0000","last_fullsized":"2024-04-26T10:32:54.697438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996258+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:32:52.996258+0000","last_peered":"2024-04-26T10:32:52.996258+0000","last_clean":"2024-04-26T10:32:52.996258+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:32:52.996258+0000","last_undegraded":"2024-04-26T10:32:52.996258+0000","last_fullsized":"2024-04-26T10:32:52.996258+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697790+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:32:54.697790+0000","last_peered":"2024-04-26T10:32:54.697790+0000","last_clean":"2024-04-26T10:32:54.697790+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:32:54.697790+0000","last_undegraded":"2024-04-26T10:32:54.697790+0000","last_fullsized":"2024-04-26T10:32:54.697790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996094+0000","last_change":"2024-04-26T10:32:51.586732+0000","last_active":"2024-04-26T10:32:52.996094+0000","last_peered":"2024-04-26T10:32:52.996094+0000","last_clean":"2024-04-26T10:32:52.996094+0000","last_became_active":"2024-04-26T10:32:51.586533+0000","last_became_peered":"2024-04-26T10:32:51.586533+0000","last_unstale":"2024-04-26T10:32:52.996094+0000","last_undegraded":"2024-04-26T10:32:52.996094+0000","last_fullsized":"2024-04-26T10:32:52.996094+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697696+0000","last_change":"2024-04-26T10:32:52.007650+0000","last_active":"2024-04-26T10:32:54.697696+0000","last_peered":"2024-04-26T10:32:54.697696+0000","last_clean":"2024-04-26T10:32:54.697696+0000","last_became_active":"2024-04-26T10:32:52.007261+0000","last_became_peered":"2024-04-26T10:32:52.007261+0000","last_unstale":"2024-04-26T10:32:54.697696+0000","last_undegraded":"2024-04-26T10:32:54.697696+0000","last_fullsized":"2024-04-26T10:32:54.697696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995900+0000","last_change":"2024-04-26T10:32:51.584497+0000","last_active":"2024-04-26T10:32:52.995900+0000","last_peered":"2024-04-26T10:32:52.995900+0000","last_clean":"2024-04-26T10:32:52.995900+0000","last_became_active":"2024-04-26T10:32:51.583460+0000","last_became_peered":"2024-04-26T10:32:51.583460+0000","last_unstale":"2024-04-26T10:32:52.995900+0000","last_undegraded":"2024-04-26T10:32:52.995900+0000","last_fullsized":"2024-04-26T10:32:52.995900+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995887+0000","last_change":"2024-04-26T10:32:52.001738+0000","last_active":"2024-04-26T10:32:52.995887+0000","last_peered":"2024-04-26T10:32:52.995887+0000","last_clean":"2024-04-26T10:32:52.995887+0000","last_became_active":"2024-04-26T10:32:51.999263+0000","last_became_peered":"2024-04-26T10:32:51.999263+0000","last_unstale":"2024-04-26T10:32:52.995887+0000","last_undegraded":"2024-04-26T10:32:52.995887+0000","last_fullsized":"2024-04-26T10:32:52.995887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:14.966669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995874+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:32:52.995874+0000","last_peered":"2024-04-26T10:32:52.995874+0000","last_clean":"2024-04-26T10:32:52.995874+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:32:52.995874+0000","last_undegraded":"2024-04-26T10:32:52.995874+0000","last_fullsized":"2024-04-26T10:32:52.995874+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995839+0000","last_change":"2024-04-26T10:32:52.000043+0000","last_active":"2024-04-26T10:32:52.995839+0000","last_peered":"2024-04-26T10:32:52.995839+0000","last_clean":"2024-04-26T10:32:52.995839+0000","last_became_active":"2024-04-26T10:32:51.999069+0000","last_became_peered":"2024-04-26T10:32:51.999069+0000","last_unstale":"2024-04-26T10:32:52.995839+0000","last_undegraded":"2024-04-26T10:32:52.995839+0000","last_fullsized":"2024-04-26T10:32:52.995839+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697777+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:32:54.697777+0000","last_peered":"2024-04-26T10:32:54.697777+0000","last_clean":"2024-04-26T10:32:54.697777+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:32:54.697777+0000","last_undegraded":"2024-04-26T10:32:54.697777+0000","last_fullsized":"2024-04-26T10:32:54.697777+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996289+0000","last_change":"2024-04-26T10:32:52.000628+0000","last_active":"2024-04-26T10:32:52.996289+0000","last_peered":"2024-04-26T10:32:52.996289+0000","last_clean":"2024-04-26T10:32:52.996289+0000","last_became_active":"2024-04-26T10:32:51.998121+0000","last_became_peered":"2024-04-26T10:32:51.998121+0000","last_unstale":"2024-04-26T10:32:52.996289+0000","last_undegraded":"2024-04-26T10:32:52.996289+0000","last_fullsized":"2024-04-26T10:32:52.996289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.293526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995394+0000","last_change":"2024-04-26T10:32:51.584210+0000","last_active":"2024-04-26T10:32:52.995394+0000","last_peered":"2024-04-26T10:32:52.995394+0000","last_clean":"2024-04-26T10:32:52.995394+0000","last_became_active":"2024-04-26T10:32:51.583823+0000","last_became_peered":"2024-04-26T10:32:51.583823+0000","last_unstale":"2024-04-26T10:32:52.995394+0000","last_undegraded":"2024-04-26T10:32:52.995394+0000","last_fullsized":"2024-04-26T10:32:52.995394+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.121333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698492+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:32:54.698492+0000","last_peered":"2024-04-26T10:32:54.698492+0000","last_clean":"2024-04-26T10:32:54.698492+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:32:54.698492+0000","last_undegraded":"2024-04-26T10:32:54.698492+0000","last_fullsized":"2024-04-26T10:32:54.698492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995640+0000","last_change":"2024-04-26T10:32:51.584088+0000","last_active":"2024-04-26T10:32:52.995640+0000","last_peered":"2024-04-26T10:32:52.995640+0000","last_clean":"2024-04-26T10:32:52.995640+0000","last_became_active":"2024-04-26T10:32:51.583020+0000","last_became_peered":"2024-04-26T10:32:51.583020+0000","last_unstale":"2024-04-26T10:32:52.995640+0000","last_undegraded":"2024-04-26T10:32:52.995640+0000","last_fullsized":"2024-04-26T10:32:52.995640+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698660+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:32:54.698660+0000","last_peered":"2024-04-26T10:32:54.698660+0000","last_clean":"2024-04-26T10:32:54.698660+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:32:54.698660+0000","last_undegraded":"2024-04-26T10:32:54.698660+0000","last_fullsized":"2024-04-26T10:32:54.698660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996288+0000","last_change":"2024-04-26T10:32:51.583791+0000","last_active":"2024-04-26T10:32:52.996288+0000","last_peered":"2024-04-26T10:32:52.996288+0000","last_clean":"2024-04-26T10:32:52.996288+0000","last_became_active":"2024-04-26T10:32:51.583103+0000","last_became_peered":"2024-04-26T10:32:51.583103+0000","last_unstale":"2024-04-26T10:32:52.996288+0000","last_undegraded":"2024-04-26T10:32:52.996288+0000","last_fullsized":"2024-04-26T10:32:52.996288+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.994938+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:32:52.994938+0000","last_peered":"2024-04-26T10:32:52.994938+0000","last_clean":"2024-04-26T10:32:52.994938+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:32:52.994938+0000","last_undegraded":"2024-04-26T10:32:52.994938+0000","last_fullsized":"2024-04-26T10:32:52.994938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995812+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:32:52.995812+0000","last_peered":"2024-04-26T10:32:52.995812+0000","last_clean":"2024-04-26T10:32:52.995812+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:32:52.995812+0000","last_undegraded":"2024-04-26T10:32:52.995812+0000","last_fullsized":"2024-04-26T10:32:52.995812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995440+0000","last_change":"2024-04-26T10:32:51.997516+0000","last_active":"2024-04-26T10:32:52.995440+0000","last_peered":"2024-04-26T10:32:52.995440+0000","last_clean":"2024-04-26T10:32:52.995440+0000","last_became_active":"2024-04-26T10:32:51.996896+0000","last_became_peered":"2024-04-26T10:32:51.996896+0000","last_unstale":"2024-04-26T10:32:52.995440+0000","last_undegraded":"2024-04-26T10:32:52.995440+0000","last_fullsized":"2024-04-26T10:32:52.995440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:51.552418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996431+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:32:52.996431+0000","last_peered":"2024-04-26T10:32:52.996431+0000","last_clean":"2024-04-26T10:32:52.996431+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:32:52.996431+0000","last_undegraded":"2024-04-26T10:32:52.996431+0000","last_fullsized":"2024-04-26T10:32:52.996431+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995565+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:32:52.995565+0000","last_peered":"2024-04-26T10:32:52.995565+0000","last_clean":"2024-04-26T10:32:52.995565+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:32:52.995565+0000","last_undegraded":"2024-04-26T10:32:52.995565+0000","last_fullsized":"2024-04-26T10:32:52.995565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995674+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:32:52.995674+0000","last_peered":"2024-04-26T10:32:52.995674+0000","last_clean":"2024-04-26T10:32:52.995674+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:32:52.995674+0000","last_undegraded":"2024-04-26T10:32:52.995674+0000","last_fullsized":"2024-04-26T10:32:52.995674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697950+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:32:54.697950+0000","last_peered":"2024-04-26T10:32:54.697950+0000","last_clean":"2024-04-26T10:32:54.697950+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:32:54.697950+0000","last_undegraded":"2024-04-26T10:32:54.697950+0000","last_fullsized":"2024-04-26T10:32:54.697950+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697966+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:32:54.697966+0000","last_peered":"2024-04-26T10:32:54.697966+0000","last_clean":"2024-04-26T10:32:54.697966+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:32:54.697966+0000","last_undegraded":"2024-04-26T10:32:54.697966+0000","last_fullsized":"2024-04-26T10:32:54.697966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995743+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:32:52.995743+0000","last_peered":"2024-04-26T10:32:52.995743+0000","last_clean":"2024-04-26T10:32:52.995743+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:32:52.995743+0000","last_undegraded":"2024-04-26T10:32:52.995743+0000","last_fullsized":"2024-04-26T10:32:52.995743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995417+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:32:52.995417+0000","last_peered":"2024-04-26T10:32:52.995417+0000","last_clean":"2024-04-26T10:32:52.995417+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:32:52.995417+0000","last_undegraded":"2024-04-26T10:32:52.995417+0000","last_fullsized":"2024-04-26T10:32:52.995417+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996362+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:32:52.996362+0000","last_peered":"2024-04-26T10:32:52.996362+0000","last_clean":"2024-04-26T10:32:52.996362+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:32:52.996362+0000","last_undegraded":"2024-04-26T10:32:52.996362+0000","last_fullsized":"2024-04-26T10:32:52.996362+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995012+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:32:52.995012+0000","last_peered":"2024-04-26T10:32:52.995012+0000","last_clean":"2024-04-26T10:32:52.995012+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:32:52.995012+0000","last_undegraded":"2024-04-26T10:32:52.995012+0000","last_fullsized":"2024-04-26T10:32:52.995012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996322+0000","last_change":"2024-04-26T10:32:52.004444+0000","last_active":"2024-04-26T10:32:52.996322+0000","last_peered":"2024-04-26T10:32:52.996322+0000","last_clean":"2024-04-26T10:32:52.996322+0000","last_became_active":"2024-04-26T10:32:52.003360+0000","last_became_peered":"2024-04-26T10:32:52.003360+0000","last_unstale":"2024-04-26T10:32:52.996322+0000","last_undegraded":"2024-04-26T10:32:52.996322+0000","last_fullsized":"2024-04-26T10:32:52.996322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:20.180213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995117+0000","last_change":"2024-04-26T10:32:51.584385+0000","last_active":"2024-04-26T10:32:52.995117+0000","last_peered":"2024-04-26T10:32:52.995117+0000","last_clean":"2024-04-26T10:32:52.995117+0000","last_became_active":"2024-04-26T10:32:51.584025+0000","last_became_peered":"2024-04-26T10:32:51.584025+0000","last_unstale":"2024-04-26T10:32:52.995117+0000","last_undegraded":"2024-04-26T10:32:52.995117+0000","last_fullsized":"2024-04-26T10:32:52.995117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:57.247011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698499+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:32:54.698499+0000","last_peered":"2024-04-26T10:32:54.698499+0000","last_clean":"2024-04-26T10:32:54.698499+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:32:54.698499+0000","last_undegraded":"2024-04-26T10:32:54.698499+0000","last_fullsized":"2024-04-26T10:32:54.698499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.999504+0000","last_change":"2024-04-26T10:32:46.555353+0000","last_active":"2024-04-26T10:32:51.999504+0000","last_peered":"2024-04-26T10:32:51.999504+0000","last_clean":"2024-04-26T10:32:51.999504+0000","last_became_active":"2024-04-26T10:32:46.555005+0000","last_became_peered":"2024-04-26T10:32:46.555005+0000","last_unstale":"2024-04-26T10:32:51.999504+0000","last_undegraded":"2024-04-26T10:32:51.999504+0000","last_fullsized":"2024-04-26T10:32:51.999504+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996229+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:32:52.996229+0000","last_peered":"2024-04-26T10:32:52.996229+0000","last_clean":"2024-04-26T10:32:52.996229+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:32:52.996229+0000","last_undegraded":"2024-04-26T10:32:52.996229+0000","last_fullsized":"2024-04-26T10:32:52.996229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995425+0000","last_change":"2024-04-26T10:32:52.004199+0000","last_active":"2024-04-26T10:32:52.995425+0000","last_peered":"2024-04-26T10:32:52.995425+0000","last_clean":"2024-04-26T10:32:52.995425+0000","last_became_active":"2024-04-26T10:32:52.003894+0000","last_became_peered":"2024-04-26T10:32:52.003894+0000","last_unstale":"2024-04-26T10:32:52.995425+0000","last_undegraded":"2024-04-26T10:32:52.995425+0000","last_fullsized":"2024-04-26T10:32:52.995425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.000379+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:32:52.000379+0000","last_peered":"2024-04-26T10:32:52.000379+0000","last_clean":"2024-04-26T10:32:52.000379+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:32:52.000379+0000","last_undegraded":"2024-04-26T10:32:52.000379+0000","last_fullsized":"2024-04-26T10:32:52.000379+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995781+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:32:52.995781+0000","last_peered":"2024-04-26T10:32:52.995781+0000","last_clean":"2024-04-26T10:32:52.995781+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:32:52.995781+0000","last_undegraded":"2024-04-26T10:32:52.995781+0000","last_fullsized":"2024-04-26T10:32:52.995781+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698151+0000","last_change":"2024-04-26T10:32:52.007589+0000","last_active":"2024-04-26T10:32:54.698151+0000","last_peered":"2024-04-26T10:32:54.698151+0000","last_clean":"2024-04-26T10:32:54.698151+0000","last_became_active":"2024-04-26T10:32:52.007289+0000","last_became_peered":"2024-04-26T10:32:52.007289+0000","last_unstale":"2024-04-26T10:32:54.698151+0000","last_undegraded":"2024-04-26T10:32:54.698151+0000","last_fullsized":"2024-04-26T10:32:54.698151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.998883+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:32:51.998883+0000","last_peered":"2024-04-26T10:32:51.998883+0000","last_clean":"2024-04-26T10:32:51.998883+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:32:51.998883+0000","last_undegraded":"2024-04-26T10:32:51.998883+0000","last_fullsized":"2024-04-26T10:32:51.998883+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995047+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:32:52.995047+0000","last_peered":"2024-04-26T10:32:52.995047+0000","last_clean":"2024-04-26T10:32:52.995047+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:32:52.995047+0000","last_undegraded":"2024-04-26T10:32:52.995047+0000","last_fullsized":"2024-04-26T10:32:52.995047+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698612+0000","last_change":"2024-04-26T10:32:52.009270+0000","last_active":"2024-04-26T10:32:54.698612+0000","last_peered":"2024-04-26T10:32:54.698612+0000","last_clean":"2024-04-26T10:32:54.698612+0000","last_became_active":"2024-04-26T10:32:52.008599+0000","last_became_peered":"2024-04-26T10:32:52.008599+0000","last_unstale":"2024-04-26T10:32:54.698612+0000","last_undegraded":"2024-04-26T10:32:54.698612+0000","last_fullsized":"2024-04-26T10:32:54.698612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.000550+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:32:52.000550+0000","last_peered":"2024-04-26T10:32:52.000550+0000","last_clean":"2024-04-26T10:32:52.000550+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:32:52.000550+0000","last_undegraded":"2024-04-26T10:32:52.000550+0000","last_fullsized":"2024-04-26T10:32:52.000550+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":210,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.997944+0000","last_change":"2024-04-26T10:32:46.555694+0000","last_active":"2024-04-26T10:32:51.997944+0000","last_peered":"2024-04-26T10:32:51.997944+0000","last_clean":"2024-04-26T10:32:51.997944+0000","last_became_active":"2024-04-26T10:32:46.555391+0000","last_became_peered":"2024-04-26T10:32:46.555391+0000","last_unstale":"2024-04-26T10:32:51.997944+0000","last_undegraded":"2024-04-26T10:32:51.997944+0000","last_fullsized":"2024-04-26T10:32:51.997944+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697661+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:32:54.697661+0000","last_peered":"2024-04-26T10:32:54.697661+0000","last_clean":"2024-04-26T10:32:54.697661+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:32:54.697661+0000","last_undegraded":"2024-04-26T10:32:54.697661+0000","last_fullsized":"2024-04-26T10:32:54.697661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996350+0000","last_change":"2024-04-26T10:32:52.006765+0000","last_active":"2024-04-26T10:32:52.996350+0000","last_peered":"2024-04-26T10:32:52.996350+0000","last_clean":"2024-04-26T10:32:52.996350+0000","last_became_active":"2024-04-26T10:32:52.004110+0000","last_became_peered":"2024-04-26T10:32:52.004110+0000","last_unstale":"2024-04-26T10:32:52.996350+0000","last_undegraded":"2024-04-26T10:32:52.996350+0000","last_fullsized":"2024-04-26T10:32:52.996350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:47.156703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.998516+0000","last_change":"2024-04-26T10:32:46.555501+0000","last_active":"2024-04-26T10:32:51.998516+0000","last_peered":"2024-04-26T10:32:51.998516+0000","last_clean":"2024-04-26T10:32:51.998516+0000","last_became_active":"2024-04-26T10:32:46.555252+0000","last_became_peered":"2024-04-26T10:32:46.555252+0000","last_unstale":"2024-04-26T10:32:51.998516+0000","last_undegraded":"2024-04-26T10:32:51.998516+0000","last_fullsized":"2024-04-26T10:32:51.998516+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697491+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:32:54.697491+0000","last_peered":"2024-04-26T10:32:54.697491+0000","last_clean":"2024-04-26T10:32:54.697491+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:32:54.697491+0000","last_undegraded":"2024-04-26T10:32:54.697491+0000","last_fullsized":"2024-04-26T10:32:54.697491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995980+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:32:52.995980+0000","last_peered":"2024-04-26T10:32:52.995980+0000","last_clean":"2024-04-26T10:32:52.995980+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:32:52.995980+0000","last_undegraded":"2024-04-26T10:32:52.995980+0000","last_fullsized":"2024-04-26T10:32:52.995980+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:51.993416+0000","last_change":"2024-04-26T10:32:46.556007+0000","last_active":"2024-04-26T10:32:51.993416+0000","last_peered":"2024-04-26T10:32:51.993416+0000","last_clean":"2024-04-26T10:32:51.993416+0000","last_became_active":"2024-04-26T10:32:46.555738+0000","last_became_peered":"2024-04-26T10:32:46.555738+0000","last_unstale":"2024-04-26T10:32:51.993416+0000","last_undegraded":"2024-04-26T10:32:51.993416+0000","last_fullsized":"2024-04-26T10:32:51.993416+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:04.230186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698307+0000","last_change":"2024-04-26T10:32:51.589352+0000","last_active":"2024-04-26T10:32:54.698307+0000","last_peered":"2024-04-26T10:32:54.698307+0000","last_clean":"2024-04-26T10:32:54.698307+0000","last_became_active":"2024-04-26T10:32:51.589006+0000","last_became_peered":"2024-04-26T10:32:51.589006+0000","last_unstale":"2024-04-26T10:32:54.698307+0000","last_undegraded":"2024-04-26T10:32:54.698307+0000","last_fullsized":"2024-04-26T10:32:54.698307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995503+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:32:52.995503+0000","last_peered":"2024-04-26T10:32:52.995503+0000","last_clean":"2024-04-26T10:32:52.995503+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:32:52.995503+0000","last_undegraded":"2024-04-26T10:32:52.995503+0000","last_fullsized":"2024-04-26T10:32:52.995503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698429+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:32:54.698429+0000","last_peered":"2024-04-26T10:32:54.698429+0000","last_clean":"2024-04-26T10:32:54.698429+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:32:54.698429+0000","last_undegraded":"2024-04-26T10:32:54.698429+0000","last_fullsized":"2024-04-26T10:32:54.698429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.001757+0000","last_change":"2024-04-26T10:32:46.555394+0000","last_active":"2024-04-26T10:32:52.001757+0000","last_peered":"2024-04-26T10:32:52.001757+0000","last_clean":"2024-04-26T10:32:52.001757+0000","last_became_active":"2024-04-26T10:32:46.555053+0000","last_became_peered":"2024-04-26T10:32:46.555053+0000","last_unstale":"2024-04-26T10:32:52.001757+0000","last_undegraded":"2024-04-26T10:32:52.001757+0000","last_fullsized":"2024-04-26T10:32:52.001757+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697328+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:32:54.697328+0000","last_peered":"2024-04-26T10:32:54.697328+0000","last_clean":"2024-04-26T10:32:54.697328+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:32:54.697328+0000","last_undegraded":"2024-04-26T10:32:54.697328+0000","last_fullsized":"2024-04-26T10:32:54.697328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.002371+0000","last_change":"2024-04-26T10:32:46.555191+0000","last_active":"2024-04-26T10:32:52.002371+0000","last_peered":"2024-04-26T10:32:52.002371+0000","last_clean":"2024-04-26T10:32:52.002371+0000","last_became_active":"2024-04-26T10:32:46.554892+0000","last_became_peered":"2024-04-26T10:32:46.554892+0000","last_unstale":"2024-04-26T10:32:52.002371+0000","last_undegraded":"2024-04-26T10:32:52.002371+0000","last_fullsized":"2024-04-26T10:32:52.002371+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.991584+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:32:54.991584+0000","last_peered":"2024-04-26T10:32:54.991584+0000","last_clean":"2024-04-26T10:32:54.991584+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:32:54.991584+0000","last_undegraded":"2024-04-26T10:32:54.991584+0000","last_fullsized":"2024-04-26T10:32:54.991584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995288+0000","last_change":"2024-04-26T10:32:52.001408+0000","last_active":"2024-04-26T10:32:52.995288+0000","last_peered":"2024-04-26T10:32:52.995288+0000","last_clean":"2024-04-26T10:32:52.995288+0000","last_became_active":"2024-04-26T10:32:52.000668+0000","last_became_peered":"2024-04-26T10:32:52.000668+0000","last_unstale":"2024-04-26T10:32:52.995288+0000","last_undegraded":"2024-04-26T10:32:52.995288+0000","last_fullsized":"2024-04-26T10:32:52.995288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995353+0000","last_change":"2024-04-26T10:32:51.586234+0000","last_active":"2024-04-26T10:32:52.995353+0000","last_peered":"2024-04-26T10:32:52.995353+0000","last_clean":"2024-04-26T10:32:52.995353+0000","last_became_active":"2024-04-26T10:32:51.586004+0000","last_became_peered":"2024-04-26T10:32:51.586004+0000","last_unstale":"2024-04-26T10:32:52.995353+0000","last_undegraded":"2024-04-26T10:32:52.995353+0000","last_fullsized":"2024-04-26T10:32:52.995353+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:03.977752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995947+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:32:52.995947+0000","last_peered":"2024-04-26T10:32:52.995947+0000","last_clean":"2024-04-26T10:32:52.995947+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:32:52.995947+0000","last_undegraded":"2024-04-26T10:32:52.995947+0000","last_fullsized":"2024-04-26T10:32:52.995947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995869+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:32:52.995869+0000","last_peered":"2024-04-26T10:32:52.995869+0000","last_clean":"2024-04-26T10:32:52.995869+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:32:52.995869+0000","last_undegraded":"2024-04-26T10:32:52.995869+0000","last_fullsized":"2024-04-26T10:32:52.995869+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995676+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:32:52.995676+0000","last_peered":"2024-04-26T10:32:52.995676+0000","last_clean":"2024-04-26T10:32:52.995676+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:32:52.995676+0000","last_undegraded":"2024-04-26T10:32:52.995676+0000","last_fullsized":"2024-04-26T10:32:52.995676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.996240+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:32:52.996240+0000","last_peered":"2024-04-26T10:32:52.996240+0000","last_clean":"2024-04-26T10:32:52.996240+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:32:52.996240+0000","last_undegraded":"2024-04-26T10:32:52.996240+0000","last_fullsized":"2024-04-26T10:32:52.996240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995491+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:32:52.995491+0000","last_peered":"2024-04-26T10:32:52.995491+0000","last_clean":"2024-04-26T10:32:52.995491+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:32:52.995491+0000","last_undegraded":"2024-04-26T10:32:52.995491+0000","last_fullsized":"2024-04-26T10:32:52.995491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698596+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:32:54.698596+0000","last_peered":"2024-04-26T10:32:54.698596+0000","last_clean":"2024-04-26T10:32:54.698596+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:32:54.698596+0000","last_undegraded":"2024-04-26T10:32:54.698596+0000","last_fullsized":"2024-04-26T10:32:54.698596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995567+0000","last_change":"2024-04-26T10:32:51.999341+0000","last_active":"2024-04-26T10:32:52.995567+0000","last_peered":"2024-04-26T10:32:52.995567+0000","last_clean":"2024-04-26T10:32:52.995567+0000","last_became_active":"2024-04-26T10:32:51.998256+0000","last_became_peered":"2024-04-26T10:32:51.998256+0000","last_unstale":"2024-04-26T10:32:52.995567+0000","last_undegraded":"2024-04-26T10:32:52.995567+0000","last_fullsized":"2024-04-26T10:32:52.995567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698554+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:32:54.698554+0000","last_peered":"2024-04-26T10:32:54.698554+0000","last_clean":"2024-04-26T10:32:54.698554+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:32:54.698554+0000","last_undegraded":"2024-04-26T10:32:54.698554+0000","last_fullsized":"2024-04-26T10:32:54.698554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995762+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:32:52.995762+0000","last_peered":"2024-04-26T10:32:52.995762+0000","last_clean":"2024-04-26T10:32:52.995762+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:32:52.995762+0000","last_undegraded":"2024-04-26T10:32:52.995762+0000","last_fullsized":"2024-04-26T10:32:52.995762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995699+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:32:52.995699+0000","last_peered":"2024-04-26T10:32:52.995699+0000","last_clean":"2024-04-26T10:32:52.995699+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:32:52.995699+0000","last_undegraded":"2024-04-26T10:32:52.995699+0000","last_fullsized":"2024-04-26T10:32:52.995699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.697606+0000","last_change":"2024-04-26T10:32:52.004844+0000","last_active":"2024-04-26T10:32:54.697606+0000","last_peered":"2024-04-26T10:32:54.697606+0000","last_clean":"2024-04-26T10:32:54.697606+0000","last_became_active":"2024-04-26T10:32:52.004484+0000","last_became_peered":"2024-04-26T10:32:52.004484+0000","last_unstale":"2024-04-26T10:32:54.697606+0000","last_undegraded":"2024-04-26T10:32:54.697606+0000","last_fullsized":"2024-04-26T10:32:54.697606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995521+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:32:52.995521+0000","last_peered":"2024-04-26T10:32:52.995521+0000","last_clean":"2024-04-26T10:32:52.995521+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:32:52.995521+0000","last_undegraded":"2024-04-26T10:32:52.995521+0000","last_fullsized":"2024-04-26T10:32:52.995521+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:54.698146+0000","last_change":"2024-04-26T10:32:52.007818+0000","last_active":"2024-04-26T10:32:54.698146+0000","last_peered":"2024-04-26T10:32:54.698146+0000","last_clean":"2024-04-26T10:32:54.698146+0000","last_became_active":"2024-04-26T10:32:52.007552+0000","last_became_peered":"2024-04-26T10:32:52.007552+0000","last_unstale":"2024-04-26T10:32:54.698146+0000","last_undegraded":"2024-04-26T10:32:54.698146+0000","last_fullsized":"2024-04-26T10:32:54.698146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-26T10:32:52.995977+0000","last_change":"2024-04-26T10:32:52.010309+0000","last_active":"2024-04-26T10:32:52.995977+0000","last_peered":"2024-04-26T10:32:52.995977+0000","last_clean":"2024-04-26T10:32:52.995977+0000","last_became_active":"2024-04-26T10:32:52.009152+0000","last_became_peered":"2024-04-26T10:32:52.009152+0000","last_unstale":"2024-04-26T10:32:52.995977+0000","last_undegraded":"2024-04-26T10:32:52.995977+0000","last_fullsized":"2024-04-26T10:32:52.995977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":46663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":638777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:33:14.041 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T10:33:14.042 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T10:33:14.416 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 15 2024-04-26T10:33:14.417 INFO:teuthology.orchestra.run.smithi043.stdout:fsid 6d35b773-83ef-4e54-be62-89cec0b09327 2024-04-26T10:33:14.417 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-04-26T10:32:36.651799+0000 2024-04-26T10:33:14.417 INFO:teuthology.orchestra.run.smithi043.stdout:modified 2024-04-26T10:32:52.989368+0000 2024-04-26T10:33:14.417 INFO:teuthology.orchestra.run.smithi043.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T10:33:14.417 INFO:teuthology.orchestra.run.smithi043.stdout:crush_version 4 2024-04-26T10:33:14.418 INFO:teuthology.orchestra.run.smithi043.stdout:full_ratio 0.95 2024-04-26T10:33:14.418 INFO:teuthology.orchestra.run.smithi043.stdout:backfillfull_ratio 0.9 2024-04-26T10:33:14.418 INFO:teuthology.orchestra.run.smithi043.stdout:nearfull_ratio 0.85 2024-04-26T10:33:14.418 INFO:teuthology.orchestra.run.smithi043.stdout:require_min_compat_client luminous 2024-04-26T10:33:14.418 INFO:teuthology.orchestra.run.smithi043.stdout:min_compat_client jewel 2024-04-26T10:33:14.419 INFO:teuthology.orchestra.run.smithi043.stdout:require_osd_release reef 2024-04-26T10:33:14.419 INFO:teuthology.orchestra.run.smithi043.stdout:stretch_mode_enabled false 2024-04-26T10:33:14.419 INFO:teuthology.orchestra.run.smithi043.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-26T10:33:14.419 INFO:teuthology.orchestra.run.smithi043.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-26T10:33:14.419 INFO:teuthology.orchestra.run.smithi043.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-26T10:33:14.419 INFO:teuthology.orchestra.run.smithi043.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-26T10:33:14.419 INFO:teuthology.orchestra.run.smithi043.stdout:max_osd 3 2024-04-26T10:33:14.419 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6800/41771,v1:172.21.15.112:6801/41771] [v2:172.21.15.112:6802/41771,v1:172.21.15.112:6803/41771] exists,up 32399f03-8160-43f7-a69f-1db73f105676 2024-04-26T10:33:14.419 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6800/41804,v1:172.21.15.186:6801/41804] [v2:172.21.15.186:6802/41804,v1:172.21.15.186:6803/41804] exists,up 89e46a83-bfff-458f-bbac-258edb6ddad2 2024-04-26T10:33:14.420 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6800/41919,v1:172.21.15.187:6801/41919] [v2:172.21.15.187:6802/41919,v1:172.21.15.187:6803/41919] exists,up 24c9e06d-1386-4075-b64e-d6c1d57c57bb 2024-04-26T10:33:14.430 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6800/41771,v1:172.21.15.112:6801/41771] [v2:172.21.15.112:6802/41771,v1:172.21.15.112:6803/41771] exists,up 32399f03-8160-43f7-a69f-1db73f105676', 'osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6800/41804,v1:172.21.15.186:6801/41804] [v2:172.21.15.186:6802/41804,v1:172.21.15.186:6803/41804] exists,up 89e46a83-bfff-458f-bbac-258edb6ddad2', 'osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6800/41919,v1:172.21.15.187:6801/41919] [v2:172.21.15.187:6802/41919,v1:172.21.15.187:6803/41919] exists,up 24c9e06d-1386-4075-b64e-d6c1d57c57bb'] 2024-04-26T10:33:14.434 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T10:33:14.558 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-26T10:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "name": "mon.a", 2024-04-26T10:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster": "ceph", 2024-04-26T10:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T10:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "admin_socket_mode": "", 2024-04-26T10:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T10:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_client_required": "cephx, none", 2024-04-26T10:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_cluster_required": "cephx", 2024-04-26T10:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_debug": "true", 2024-04-26T10:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T10:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T10:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_service_required": "cephx", 2024-04-26T10:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T10:33:14.559 INFO:teuthology.orchestra.run.smithi043.stdout: "auth_supported": "cephx", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_aio": "true", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_aio_reap_max": "16", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_async_discard": "false", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_block_size": "4096", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_debug_aio": "false", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_enable_discard": "false", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_flock_retry": "3", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T10:33:14.560 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_inject_crash": "0", 2024-04-26T10:33:14.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T10:33:14.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_ioring": "false", 2024-04-26T10:33:14.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_ioring_hipri": "false", 2024-04-26T10:33:14.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T10:33:14.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T10:33:14.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T10:33:14.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T10:33:14.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bdev_type": "", 2024-04-26T10:33:14.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T10:33:14.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_allocator": "hybrid", 2024-04-26T10:33:14.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_buffered_io": "true", 2024-04-26T10:33:14.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T10:33:14.561 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_replay_recovery": "false", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T10:33:14.562 INFO:teuthology.orchestra.run.smithi043.stdout: "bluefs_sync_write": "false", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_allocator": "hybrid", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_create": "true", 2024-04-26T10:33:14.563 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_db_create": "false", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_db_path": "", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_db_size": "0", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_path": "", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_size": "107374182400", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_wal_create": "false", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_wal_path": "", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bluefs": "true", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T10:33:14.564 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_autotune": "true", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_size": "0", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T10:33:14.565 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cache_type": "2q", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_clone_cow": "true", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_mode": "none", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T10:33:14.566 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_freelist": "false", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T10:33:14.567 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fail_eio": "false", 2024-04-26T10:33:14.568 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T10:33:14.569 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_blob_size": "0", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T10:33:14.570 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T10:33:14.571 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T10:33:14.571 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T10:33:14.571 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T10:33:14.571 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T10:33:14.571 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T10:33:14.571 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T10:33:14.571 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T10:33:14.571 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T10:33:14.571 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T10:33:14.571 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T10:33:14.571 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T10:33:14.571 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T10:33:14.571 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_spdk_mem": "512", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_tracing": "false", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T10:33:14.572 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T10:33:14.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T10:33:14.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T10:33:14.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T10:33:14.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T10:33:14.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T10:33:14.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T10:33:14.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T10:33:14.573 INFO:teuthology.orchestra.run.smithi043.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T10:33:14.573 INFO:teuthology.orchestra.run.smithi043.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T10:33:14.573 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T10:33:14.573 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T10:33:14.573 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T10:33:14.573 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T10:33:14.574 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T10:33:14.574 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T10:33:14.574 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T10:33:14.574 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T10:33:14.574 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T10:33:14.574 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T10:33:14.574 INFO:teuthology.orchestra.run.smithi043.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T10:33:14.574 INFO:teuthology.orchestra.run.smithi043.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T10:33:14.574 INFO:teuthology.orchestra.run.smithi043.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T10:33:14.574 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T10:33:14.574 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_cluster_require_version": "2", 2024-04-26T10:33:14.574 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_require_signatures": "false", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_require_version": "2", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_service_require_signatures": "false", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_service_require_version": "2", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "cephx_sign_messages": "true", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "chdir": "", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "client_acl_type": "", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "client_asio_thread_count": "2", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "client_cache_mid": "0.750000", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "client_cache_size": "16384", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "client_caps_release_delay": "5", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "client_check_pool_perm": "true", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "client_debug_force_sync_read": "false", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "client_debug_getattr_caps": "false", 2024-04-26T10:33:14.575 INFO:teuthology.orchestra.run.smithi043.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T10:33:14.576 INFO:teuthology.orchestra.run.smithi043.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T10:33:14.576 INFO:teuthology.orchestra.run.smithi043.stdout: "client_die_on_failed_remount": "false", 2024-04-26T10:33:14.576 INFO:teuthology.orchestra.run.smithi043.stdout: "client_dirsize_rbytes": "true", 2024-04-26T10:33:14.576 INFO:teuthology.orchestra.run.smithi043.stdout: "client_force_lazyio": "false", 2024-04-26T10:33:14.576 INFO:teuthology.orchestra.run.smithi043.stdout: "client_fs": "", 2024-04-26T10:33:14.576 INFO:teuthology.orchestra.run.smithi043.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T10:33:14.576 INFO:teuthology.orchestra.run.smithi043.stdout: "client_inject_release_failure": "false", 2024-04-26T10:33:14.576 INFO:teuthology.orchestra.run.smithi043.stdout: "client_max_inline_size": "4096", 2024-04-26T10:33:14.576 INFO:teuthology.orchestra.run.smithi043.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T10:33:14.576 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mds_namespace": "", 2024-04-26T10:33:14.576 INFO:teuthology.orchestra.run.smithi043.stdout: "client_metadata": "", 2024-04-26T10:33:14.576 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mount_gid": "-1", 2024-04-26T10:33:14.577 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mount_timeout": "300", 2024-04-26T10:33:14.577 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mount_uid": "-1", 2024-04-26T10:33:14.577 INFO:teuthology.orchestra.run.smithi043.stdout: "client_mountpoint": "/", 2024-04-26T10:33:14.577 INFO:teuthology.orchestra.run.smithi043.stdout: "client_notify_timeout": "10", 2024-04-26T10:33:14.577 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc": "true", 2024-04-26T10:33:14.577 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T10:33:14.577 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T10:33:14.577 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_max_objects": "1000", 2024-04-26T10:33:14.577 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_size": "209715200", 2024-04-26T10:33:14.577 INFO:teuthology.orchestra.run.smithi043.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T10:33:14.577 INFO:teuthology.orchestra.run.smithi043.stdout: "client_permissions": "true", 2024-04-26T10:33:14.577 INFO:teuthology.orchestra.run.smithi043.stdout: "client_quota": "true", 2024-04-26T10:33:14.577 INFO:teuthology.orchestra.run.smithi043.stdout: "client_quota_df": "true", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "client_readahead_max_bytes": "0", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "client_readahead_max_periods": "4", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "client_readahead_min": "131072", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "client_reconnect_stale": "false", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "client_shutdown_timeout": "30", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "client_snapdir": ".snap", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "client_tick_interval": "1", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "client_trace": "", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "client_use_faked_inos": "false", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "client_use_random_mds": "false", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_graylog": "false", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T10:33:14.578 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_graylog_port": "12201", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_monitors": "default=true", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_syslog": "false", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "clog_to_syslog_level": "info", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "-", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_network": "", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_network_interface": "", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "compressor_zlib_isal": "false", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "compressor_zlib_level": "5", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "compressor_zstd_level": "1", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T10:33:14.579 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "crimson_seastar_smp": "1", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location": "", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location_hook": "", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_location_hook_timeout": "10", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "daemonize": "false", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "daos_pool": "tank", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_alienstore": "0/5", 2024-04-26T10:33:14.580 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T10:33:14.581 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_asok": "1/5", 2024-04-26T10:33:14.581 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_asok_assert_abort": "false", 2024-04-26T10:33:14.581 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T10:33:14.581 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_auth": "20/20", 2024-04-26T10:33:14.581 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_bdev": "1/3", 2024-04-26T10:33:14.581 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_bluefs": "1/5", 2024-04-26T10:33:14.581 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_bluestore": "1/5", 2024-04-26T10:33:14.581 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_buffer": "0/1", 2024-04-26T10:33:14.581 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T10:33:14.581 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T10:33:14.581 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_cephsqlite": "0/5", 2024-04-26T10:33:14.581 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_client": "0/5", 2024-04-26T10:33:14.581 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_compressor": "1/5", 2024-04-26T10:33:14.582 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_context": "0/1", 2024-04-26T10:33:14.582 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_crush": "1/1", 2024-04-26T10:33:14.582 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_crypto": "1/5", 2024-04-26T10:33:14.582 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_cyanstore": "0/5", 2024-04-26T10:33:14.582 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T10:33:14.582 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T10:33:14.582 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_dpdk": "1/5", 2024-04-26T10:33:14.582 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_eventtrace": "1/5", 2024-04-26T10:33:14.582 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_filer": "0/1", 2024-04-26T10:33:14.582 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_filestore": "1/3", 2024-04-26T10:33:14.582 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_finisher": "1/1", 2024-04-26T10:33:14.582 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_fuse": "1/5", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_javaclient": "1/5", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_journal": "1/3", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_journaler": "0/5", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_kstore": "1/5", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_leveldb": "4/5", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_lockdep": "0/1", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mclock": "1/5", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds": "1/5", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_balancer": "1/5", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_locker": "1/5", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_log": "1/5", 2024-04-26T10:33:14.583 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mds_migrator": "1/5", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_memstore": "1/5", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mgr": "2/5", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mgrc": "1/5", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_mon": "20/20", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_monc": "0/10", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_ms": "1/1", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_none": "0/5", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_objclass": "0/5", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_objectcacher": "0/5", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_objecter": "0/1", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_optracker": "0/5", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_osd": "1/5", 2024-04-26T10:33:14.584 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_paxos": "20/20", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_perfcounter": "1/5", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_prioritycache": "1/5", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rados": "0/5", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rbd": "0/5", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rbd_replay": "0/5", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_refs": "0/0", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_reserver": "1/1", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw": "1/5", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_access": "1/5", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T10:33:14.585 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_flight": "1/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rgw_sync": "1/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_rocksdb": "4/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore": "0/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_backref": "0/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_cache": "0/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_device": "0/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_epm": "0/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_journal": "0/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_lba": "0/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_odata": "0/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_omap": "0/5", 2024-04-26T10:33:14.586 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_onode": "0/5", 2024-04-26T10:33:14.587 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_t": "0/5", 2024-04-26T10:33:14.587 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_seastore_tm": "0/5", 2024-04-26T10:33:14.587 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_striper": "0/1", 2024-04-26T10:33:14.587 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_test": "0/5", 2024-04-26T10:33:14.587 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_throttle": "1/1", 2024-04-26T10:33:14.587 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_timer": "0/1", 2024-04-26T10:33:14.587 INFO:teuthology.orchestra.run.smithi043.stdout: "debug_tp": "0/5", 2024-04-26T10:33:14.587 INFO:teuthology.orchestra.run.smithi043.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T10:33:14.587 INFO:teuthology.orchestra.run.smithi043.stdout: "device_failure_prediction_mode": "none", 2024-04-26T10:33:14.587 INFO:teuthology.orchestra.run.smithi043.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T10:33:14.587 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-26T10:33:14.587 INFO:teuthology.orchestra.run.smithi043.stdout: "err_to_graylog": "false", 2024-04-26T10:33:14.587 INFO:teuthology.orchestra.run.smithi043.stdout: "err_to_journald": "false", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "err_to_stderr": "true", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "err_to_syslog": "false", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "event_tracing": "false", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_http_port": "9926", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_prio_limit": "5", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_sort_metrics": "true", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "exporter_stats_period": "5", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "fake_statfs_for_testing": "0", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "fatal_signal_handlers": "true", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "filer_max_purge_ops": "10", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "filer_max_truncate_ops": "128", 2024-04-26T10:33:14.588 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_blackhole": "false", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_btrfs_snap": "true", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_caller_concurrency": "10", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_debug_omap_check": "false", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_debug_verify_split": "false", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_dump_file": "", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T10:33:14.589 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fadvise": "true", 2024-04-26T10:33:14.590 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fail_eio": "true", 2024-04-26T10:33:14.590 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T10:33:14.590 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fd_cache_size": "128", 2024-04-26T10:33:14.590 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fiemap": "false", 2024-04-26T10:33:14.590 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T10:33:14.590 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T10:33:14.590 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T10:33:14.590 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_inject_stall": "0", 2024-04-26T10:33:14.590 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_journal_parallel": "false", 2024-04-26T10:33:14.590 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_journal_trailing": "false", 2024-04-26T10:33:14.590 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_journal_writeahead": "false", 2024-04-26T10:33:14.590 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_kill_at": "0", 2024-04-26T10:33:14.590 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_merge_threshold": "-10", 2024-04-26T10:33:14.591 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T10:33:14.592 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_odsync_write": "false", 2024-04-26T10:33:14.592 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T10:33:14.592 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_omap_backend_path": "", 2024-04-26T10:33:14.592 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T10:33:14.592 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T10:33:14.592 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T10:33:14.592 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T10:33:14.592 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_op_threads": "2", 2024-04-26T10:33:14.592 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_punch_hole": "false", 2024-04-26T10:33:14.592 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T10:33:14.592 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T10:33:14.592 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T10:33:14.592 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_queue_max_ops": "50", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_seek_data_hole": "false", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_sloppy_crc": "false", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_splice": "false", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_split_multiple": "2", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_split_rand_factor": "20", 2024-04-26T10:33:14.593 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_update_to": "1000", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T10:33:14.594 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_xfs_extsize": "false", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "filestore_zfs_snap": "false", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fio_dir": "/tmp/fio", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "6d35b773-83ef-4e54-be62-89cec0b09327", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_allow_other": "true", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_big_writes": "true", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_debug": "false", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_default_permissions": "false", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_disable_pagecache": "false", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_max_write": "0", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_multithreaded": "true", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_require_active_mds": "true", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_set_user_groups": "true", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_splice_move": "true", 2024-04-26T10:33:14.595 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_splice_read": "true", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_splice_write": "true", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "gss_target_name": "ceph", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_file": "", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_inject_failure": "0", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_interval": "5", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "host": "smithi043", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T10:33:14.596 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "inject_early_sigterm": "false", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "jaeger_agent_port": "6799", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "jaeger_tracing_enable": "false", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_aio": "true", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_align_min_size": "65536", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_block_align": "true", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_block_size": "4096", 2024-04-26T10:33:14.597 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_dio": "true", 2024-04-26T10:33:14.598 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_discard": "false", 2024-04-26T10:33:14.598 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_force_aio": "false", 2024-04-26T10:33:14.598 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_ignore_corruption": "false", 2024-04-26T10:33:14.598 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T10:33:14.598 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_max_write_entries": "100", 2024-04-26T10:33:14.598 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_replay_from": "0", 2024-04-26T10:33:14.598 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T10:33:14.598 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T10:33:14.598 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T10:33:14.598 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T10:33:14.598 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_write_header_frequency": "0", 2024-04-26T10:33:14.598 INFO:teuthology.orchestra.run.smithi043.stdout: "journal_zero_on_create": "false", 2024-04-26T10:33:14.598 INFO:teuthology.orchestra.run.smithi043.stdout: "journaler_prefetch_periods": "10", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "journaler_prezero_periods": "5", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "journaler_write_head_interval": "15", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "key": "", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "keyfile": "", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_backend": "rocksdb", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_max_bytes": "67108864", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_max_ops": "512", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_onode_map_size": "1024", 2024-04-26T10:33:14.599 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "kstore_sync_transaction": "false", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "leveldb_block_size": "65536", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "leveldb_bloom_size": "0", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "leveldb_cache_size": "536870912", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "leveldb_compact_on_mount": "false", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "leveldb_compression": "false", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "leveldb_log": "", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "leveldb_max_open_files": "0", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "leveldb_paranoid": "false", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "librados_thread_count": "2", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "lockdep": "false", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "lockdep_force_backtrace": "false", 2024-04-26T10:33:14.600 INFO:teuthology.orchestra.run.smithi043.stdout: "log_coarse_timestamps": "true", 2024-04-26T10:33:14.601 INFO:teuthology.orchestra.run.smithi043.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T10:33:14.601 INFO:teuthology.orchestra.run.smithi043.stdout: "log_flush_on_exit": "false", 2024-04-26T10:33:14.601 INFO:teuthology.orchestra.run.smithi043.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T10:33:14.601 INFO:teuthology.orchestra.run.smithi043.stdout: "log_graylog_port": "12201", 2024-04-26T10:33:14.601 INFO:teuthology.orchestra.run.smithi043.stdout: "log_max_new": "1000", 2024-04-26T10:33:14.601 INFO:teuthology.orchestra.run.smithi043.stdout: "log_max_recent": "10000", 2024-04-26T10:33:14.601 INFO:teuthology.orchestra.run.smithi043.stdout: "log_stderr_prefix": "", 2024-04-26T10:33:14.601 INFO:teuthology.orchestra.run.smithi043.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T10:33:14.601 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_file": "true", 2024-04-26T10:33:14.601 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_graylog": "false", 2024-04-26T10:33:14.601 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_journald": "false", 2024-04-26T10:33:14.601 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_stderr": "false", 2024-04-26T10:33:14.601 INFO:teuthology.orchestra.run.smithi043.stdout: "log_to_syslog": "false", 2024-04-26T10:33:14.602 INFO:teuthology.orchestra.run.smithi043.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T10:33:14.602 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T10:33:14.602 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_action_on_write_error": "1", 2024-04-26T10:33:14.602 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_alternate_name_max": "8192", 2024-04-26T10:33:14.602 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_asio_thread_count": "2", 2024-04-26T10:33:14.602 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_export_pin": "true", 2024-04-26T10:33:14.602 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T10:33:14.602 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T10:33:14.602 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T10:33:14.602 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T10:33:14.602 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T10:33:14.602 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_interval": "10", 2024-04-26T10:33:14.602 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_max": "-1", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_max_until": "-1", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_merge_size": "50", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_mode": "0", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_split_bits": "3", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_split_size": "10000", 2024-04-26T10:33:14.603 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_mid": "0.700000", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_trim_interval": "1", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T10:33:14.604 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_debug_auth_pins": "false", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_debug_frag": "false", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_debug_scatterstat": "false", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_debug_subtrees": "false", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_default_dir_hash": "2", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_defer_session_stale": "true", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T10:33:14.605 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dir_max_entries": "0", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dir_prefetch": "true", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_early_reply": "true", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_enable_op_tracker": "true", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_enforce_unique_name": "true", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T10:33:14.606 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_health_dummy": "false", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T10:33:14.607 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_join_fs": "", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_journal_format": "1", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_create_at": "0", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_export_at": "0", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_import_at": "0", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_journal_at": "0", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_link_at": "0", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_openc_at": "0", 2024-04-26T10:33:14.608 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_rename_at": "0", 2024-04-26T10:33:14.609 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T10:33:14.609 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T10:33:14.609 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_max_events": "-1", 2024-04-26T10:33:14.609 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_max_segments": "128", 2024-04-26T10:33:14.609 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_pause": "false", 2024-04-26T10:33:14.609 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_segment_size": "0", 2024-04-26T10:33:14.609 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T10:33:14.609 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T10:33:14.609 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T10:33:14.609 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T10:33:14.609 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_completed_requests": "100000", 2024-04-26T10:33:14.609 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_export_size": "20971520", 2024-04-26T10:33:14.609 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_file_recover": "32", 2024-04-26T10:33:14.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_purge_files": "64", 2024-04-26T10:33:14.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_purge_ops": "8192", 2024-04-26T10:33:14.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T10:33:14.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T10:33:14.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T10:33:14.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_metrics_update_interval": "2", 2024-04-26T10:33:14.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_min_caps_per_client": "100", 2024-04-26T10:33:14.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T10:33:14.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T10:33:14.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_numa_node": "-1", 2024-04-26T10:33:14.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T10:33:14.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T10:33:14.610 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_history_duration": "600", 2024-04-26T10:33:14.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_history_size": "20", 2024-04-26T10:33:14.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T10:33:14.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T10:33:14.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_op_log_threshold": "5", 2024-04-26T10:33:14.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_ping_grace": "15", 2024-04-26T10:33:14.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_ping_interval": "5", 2024-04-26T10:33:14.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T10:33:14.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T10:33:14.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_max_caps": "30000", 2024-04-26T10:33:14.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T10:33:14.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T10:33:14.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T10:33:14.611 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_replay_interval": "1.000000", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_root_ino_gid": "0", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_root_ino_uid": "0", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T10:33:14.612 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_shutdown_check": "0", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_skip_ino": "0", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_snap_min_uid": "0", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_snap_rstat": "false", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_symlink_recovery": "true", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_thrash_exports": "0", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_thrash_fragments": "0", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_tick_interval": "5.000000", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_valgrind_exit": "false", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_verify_backtrace": "1", 2024-04-26T10:33:14.613 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_verify_scatter": "false", 2024-04-26T10:33:14.614 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T10:33:14.614 INFO:teuthology.orchestra.run.smithi043.stdout: "mds_wipe_sessions": "false", 2024-04-26T10:33:14.614 INFO:teuthology.orchestra.run.smithi043.stdout: "mempool_debug": "false", 2024-04-26T10:33:14.614 INFO:teuthology.orchestra.run.smithi043.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T10:33:14.614 INFO:teuthology.orchestra.run.smithi043.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T10:33:14.614 INFO:teuthology.orchestra.run.smithi043.stdout: "memstore_page_set": "false", 2024-04-26T10:33:14.614 INFO:teuthology.orchestra.run.smithi043.stdout: "memstore_page_size": "65536", 2024-04-26T10:33:14.614 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_client_bytes": "134217728", 2024-04-26T10:33:14.614 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_client_messages": "512", 2024-04-26T10:33:14.614 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T10:33:14.614 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T10:33:14.614 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T10:33:14.614 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_disabled_modules": "", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_mds_messages": "128", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_mon_messages": "128", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_osd_messages": "8192", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_pool": "true", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_standby_modules": "true", 2024-04-26T10:33:14.615 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_stats_period": "5", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_stats_threshold": "5", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_tick_period": "2", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_allow_pool_delete": "true", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_bytes": "104857600", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_directed_command_retry": "2", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T10:33:14.616 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T10:33:14.617 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_compact_on_start": "false", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_compact_on_trim": "true", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_cpu_threads": "4", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T10:33:14.618 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_data_avail_crit": "5", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_data_avail_warn": "5", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_dump_json": "false", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_extra_checks": "false", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_no_require_quincy": "false", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T10:33:14.619 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T10:33:14.620 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T10:33:14.620 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T10:33:14.620 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T10:33:14.620 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_election_default_strategy": "1", 2024-04-26T10:33:14.620 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_election_timeout": "5.000000", 2024-04-26T10:33:14.620 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T10:33:14.620 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T10:33:14.620 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T10:33:14.620 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_enable_op_tracker": "true", 2024-04-26T10:33:14.620 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_fake_pool_delete": "false", 2024-04-26T10:33:14.620 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_force_quorum_join": "false", 2024-04-26T10:33:14.620 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_log_update_period": "5", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_max_detail": "50", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_to_clog": "true", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_host": "172.21.15.43,[v2:172.21.15.43:3301,v1:172.21.15.43:6790],[v2:172.21.15.43:3302,v1:172.21.15.43:6791]", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_host_override": "", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_initial_members": "", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T10:33:14.621 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T10:33:14.622 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_lease": "5.000000", 2024-04-26T10:33:14.622 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T10:33:14.622 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T10:33:14.622 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_log_full_interval": "50", 2024-04-26T10:33:14.622 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_log_max": "10000", 2024-04-26T10:33:14.622 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_log_max_summary": "50", 2024-04-26T10:33:14.622 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T10:33:14.622 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_log_epochs": "500", 2024-04-26T10:33:14.622 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T10:33:14.622 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T10:33:14.622 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_osd": "10000", 2024-04-26T10:33:14.622 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T10:33:14.622 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_memory_autotune": "true", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_memory_target": "2147483648", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_digest_period": "5", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T10:33:14.623 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_complaint_time": "30", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_history_duration": "600", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_history_size": "20", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_op_log_threshold": "5", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_cache_size": "500", 2024-04-26T10:33:14.624 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T10:33:14.625 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_report_timeout": "900", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T10:33:14.626 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_reweight_max_osds": "4", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T10:33:14.627 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_interval": "86400", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_max_keys": "100", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_scrub_timeout": "300", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_session_timeout": "300", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_smart_report_timeout": "5", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stretch_pool_size": "4", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T10:33:14.628 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_debug": "false", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_tick_interval": "5", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T10:33:14.629 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T10:33:14.630 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T10:33:14.630 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T10:33:14.630 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T10:33:14.630 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T10:33:14.630 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T10:33:14.630 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T10:33:14.630 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_older_version": "true", 2024-04-26T10:33:14.630 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T10:33:14.630 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T10:33:14.630 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T10:33:14.630 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T10:33:14.630 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T10:33:14.630 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "monmap": "", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "motr_tracing_enabled": "false", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_op_threads": "3", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T10:33:14.631 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_cm": "false", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_device_name": "", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_sl": "3", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_rdma_type": "ib", 2024-04-26T10:33:14.632 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_async_reap_threshold": "5", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_before_connect": "false", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_ipv4": "true", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_ipv6": "false", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_msgr1": "true", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_msgr2": "true", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_port_max": "7568", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_port_min": "6800", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_retry_count": "3", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_bind_retry_delay": "5", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_client": "false", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_mds": "false", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_mgr": "false", 2024-04-26T10:33:14.633 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_mon": "false", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_blackhole_osd": "false", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_client_mode": "crc secure", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_cluster_type": "", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_compress_secure": "false", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_crc_data": "true", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_crc_header": "true", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_bug": "true", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_old_message": "true", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T10:33:14.634 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_hugepages": "", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_lro": "true", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_pmd": "", 2024-04-26T10:33:14.635 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_port_id": "0", 2024-04-26T10:33:14.636 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T10:33:14.636 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T10:33:14.636 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_dump_on_send": "false", 2024-04-26T10:33:14.636 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T10:33:14.636 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T10:33:14.636 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T10:33:14.636 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_delay_type": "", 2024-04-26T10:33:14.636 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T10:33:14.636 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_network_congestion": "0", 2024-04-26T10:33:14.636 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_inject_socket_failures": "0", 2024-04-26T10:33:14.637 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T10:33:14.637 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_max_accept_failures": "4", 2024-04-26T10:33:14.637 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_max_backoff": "15.000000", 2024-04-26T10:33:14.637 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_osd_compress_mode": "none", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_pq_min_cost": "65536", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_public_type": "", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_service_mode": "crc secure", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_tcp_nodelay": "true", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T10:33:14.638 INFO:teuthology.orchestra.run.smithi043.stdout: "ms_type": "async+posix", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "no_config_file": "false", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_inflight_ops": "1024", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "objecter_timeout": "10.000000", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "objectstore_blackhole": "false", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "openssl_engine_opts": "", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T10:33:14.639 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_max_ops": "4", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_agent_slop": "0.020000", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_asio_thread_count": "2", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backfill_scan_max": "512", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backfill_scan_min": "64", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T10:33:14.640 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backoff_on_peering": "false", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_beacon_report_interval": "300", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bench_duration": "30", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_blkin_trace_all": "false", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T10:33:14.641 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_class_update_on_start": "true", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_client_message_cap": "256", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_client_op_priority": "63", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_client_watch_timeout": "30", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_command_max_records": "256", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_compact_on_start": "false", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_crush_update_on_start": "true", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T10:33:14.642 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_op_order": "false", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T10:33:14.643 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T10:33:14.644 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T10:33:14.644 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_shutdown": "false", 2024-04-26T10:33:14.644 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T10:33:14.644 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T10:33:14.644 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T10:33:14.644 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T10:33:14.644 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T10:33:14.644 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T10:33:14.644 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T10:33:14.644 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T10:33:14.644 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_default_notify_timeout": "30", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_enable_op_tracker": "true", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T10:33:14.645 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_info": "true", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_shutdown": "true", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_function_tracing": "false", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_grace": "20", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_interval": "6", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T10:33:14.646 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_stale": "600", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_journal_size": "5120", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_kill_backfill_at": "0", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_cache_size": "50", 2024-04-26T10:33:14.647 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_dedup": "true", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_message_max": "40", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_attr_name_len": "100", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_attr_size": "0", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_backfills": "1", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_markdown_count": "5", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_markdown_period": "600", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_object_name_len": "2048", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_object_size": "134217728", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T10:33:14.648 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_pgls": "1024", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_push_cost": "8388608", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_push_objects": "10", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_scrubs": "3", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_max_write_size": "90", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T10:33:14.649 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T10:33:14.650 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T10:33:14.650 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T10:33:14.650 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T10:33:14.650 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_profile": "balanced", 2024-04-26T10:33:14.650 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T10:33:14.650 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T10:33:14.650 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T10:33:14.650 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T10:33:14.650 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T10:33:14.650 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T10:33:14.650 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T10:33:14.650 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_base": "805306368", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_target": "4294967296", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_target_autotune": "false", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_min_recovery_priority": "0", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T10:33:14.651 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_report_interval": "5", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_num_cache_shards": "32", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_numa_node": "-1", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_objecter_finishers": "1", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_objectstore": "bluestore", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_objectstore_fuse": "false", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_objectstore_tracing": "false", 2024-04-26T10:33:14.652 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_history_duration": "600", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_history_size": "20", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_log_threshold": "5", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_shards": "0", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T10:33:14.653 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_op_thread_timeout": "15", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_open_classes_on_start": "true", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_os_flags": "0", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_peering_op_priority": "255", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_delete_priority": "5", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T10:33:14.654 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_crimson": "false", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T10:33:14.655 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_flags": "0", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_min_size": "0", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_size": "2", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_default_type": "replicated", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T10:33:14.656 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_cost": "20971520", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_active": "0", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_op_priority": "3", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_priority": "5", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T10:33:14.657 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_repair_during_recovery": "false", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T10:33:14.658 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_cost": "52428800", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_end_hour": "0", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_priority": "5", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-26T10:33:14.659 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_skip_data_digest": "false", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_smart_report_timeout": "5", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_priority": "5", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T10:33:14.660 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_target_transaction_size": "30", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_tracing": "false", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_use_stale_snap": "false", 2024-04-26T10:33:14.661 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_kill_at": "0", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_max_join_drift": "10", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_min": "500", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_min_wait": "0.050000", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_service_trim_max": "500", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_service_trim_min": "250", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_stash_full_interval": "25", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_trim_max": "500", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "paxos_trim_min": "250", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "perf": "true", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T10:33:14.662 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "-", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrv": "", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "public_bind_addr": "-", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "public_network": "", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "public_network_interface": "", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "qat_compressor_enabled": "false", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "rados_mon_op_timeout": "0", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "rados_osd_op_timeout": "0", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "rados_tracing": "false", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_atime_update_interval": "60", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T10:33:14.663 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache": "true", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_policy": "writearound", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_size": "33554432", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T10:33:14.664 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_compression_hint": "none", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_clone_format": "auto", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_data_pool": "", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_features": "61", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_format": "2", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_map_options": "", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_order": "22", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_pool": "rbd", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_stripe_count": "0", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T10:33:14.665 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_io_scheduler": "simple", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T10:33:14.666 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_order": "24", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_pool": "", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_journal_splay_width": "4", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T10:33:14.667 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T10:33:14.668 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_op_threads": "1", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T10:33:14.669 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_plugins": "", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T10:33:14.670 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T10:33:14.671 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_tracing": "false", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_validate_names": "true", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd_validate_pool": "true", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "restapi_base_url": "", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "restapi_log_level": "", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_admin_entry": "admin", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_backend_store": "rados", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_barbican_url": "", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_beast_enable_async": "true", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T10:33:14.672 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cache_enabled": "true", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cache_lru_size": "10000", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_config_store": "rados", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_content_length_compat": "false", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_cross_domain_policy": "", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T10:33:14.673 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T10:33:14.674 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T10:33:14.675 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T10:33:14.676 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T10:33:14.677 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T10:33:14.677 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T10:33:14.677 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T10:33:14.677 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T10:33:14.677 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T10:33:14.677 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T10:33:14.677 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T10:33:14.677 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T10:33:14.677 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_log_window": "30", 2024-04-26T10:33:14.677 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T10:33:14.677 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T10:33:14.677 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T10:33:14.678 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T10:33:14.678 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T10:33:14.678 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T10:33:14.678 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T10:33:14.678 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T10:33:14.678 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T10:33:14.678 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T10:33:14.678 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T10:33:14.678 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T10:33:14.678 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T10:33:14.678 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T10:33:14.678 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T10:33:14.678 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dns_name": "", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dns_s3website_name": "", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T10:33:14.679 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T10:33:14.680 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_ops_log": "false", 2024-04-26T10:33:14.680 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T10:33:14.680 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_static_website": "false", 2024-04-26T10:33:14.680 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enable_usage_log": "false", 2024-04-26T10:33:14.680 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T10:33:14.680 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T10:33:14.680 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_expose_bucket": "false", 2024-04-26T10:33:14.680 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_extended_http_attrs": "", 2024-04-26T10:33:14.680 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_filter": "none", 2024-04-26T10:33:14.680 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T10:33:14.680 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T10:33:14.680 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T10:33:14.680 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_objs": "32", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_init_timeout": "300", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T10:33:14.681 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T10:33:14.682 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T10:33:14.682 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T10:33:14.682 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T10:33:14.682 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_password": "", 2024-04-26T10:33:14.682 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T10:33:14.682 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_project": "", 2024-04-26T10:33:14.682 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T10:33:14.682 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_token": "", 2024-04-26T10:33:14.682 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T10:33:14.682 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_admin_user": "", 2024-04-26T10:33:14.682 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_api_version": "2", 2024-04-26T10:33:14.682 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T10:33:14.682 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_url": "", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_max_objs": "32", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T10:33:14.683 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_max_worker": "3", 2024-04-26T10:33:14.684 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T10:33:14.684 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T10:33:14.684 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T10:33:14.684 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T10:33:14.684 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T10:33:14.684 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T10:33:14.684 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T10:33:14.684 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-26T10:33:14.684 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T10:33:14.684 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T10:33:14.684 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T10:33:14.684 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_log_http_headers": "", 2024-04-26T10:33:14.684 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T10:33:14.685 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T10:33:14.685 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T10:33:14.685 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-26T10:33:14.685 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T10:33:14.685 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_attr_size": "0", 2024-04-26T10:33:14.685 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T10:33:14.685 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T10:33:14.685 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T10:33:14.685 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T10:33:14.685 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T10:33:14.685 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_listing_results": "1000", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_notify_retries": "10", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T10:33:14.686 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T10:33:14.687 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_num_control_oids": "8", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_numa_node": "-1", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_op_tracing": "false", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_opa_token": "", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_opa_url": "", 2024-04-26T10:33:14.688 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ops_log_rados": "false", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_print_continue": "true", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T10:33:14.689 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_rados_tracing": "false", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_realm": "", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_realm_id": "", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_region": "", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_request_uri": "", 2024-04-26T10:33:14.690 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_resolve_cname": "false", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_run_sync_thread": "true", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T10:33:14.691 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_script_uri": "", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_service_provider_name": "", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_client_id": "", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_client_secret": "", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_entry": "sts", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_key": "sts", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T10:33:14.692 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_auth_url": "", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_custom_header": "", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_need_stats": "true", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_tenant_name": "", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_url": "", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_lease_period": "120", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T10:33:14.693 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T10:33:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T10:33:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T10:33:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T10:33:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T10:33:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T10:33:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T10:33:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T10:33:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_thread_pool_size": "512", 2024-04-26T10:33:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_comment": "", 2024-04-26T10:33:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_createby": "", 2024-04-26T10:33:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_encoding": "", 2024-04-26T10:33:14.694 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_flag": "false", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_origin": "", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_torrent_tracker": "", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_usage_max_shards": "32", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_use_opa_authz": "false", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T10:33:14.695 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_user_unique_email": "true", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_verify_ssl": "true", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zone": "", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zone_id": "", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zonegroup": "", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zonegroup_id": "", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T10:33:14.696 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_block_size": "4096", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T10:33:14.697 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_partition_filters": "false", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_perf": "false", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "run_dir": "/var/run/ceph", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_block_create": "true", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_device_size": "53687091200", 2024-04-26T10:33:14.698 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_main_device_type": "SSD", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "seastore_segment_size": "67108864", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "set_keepcaps": "false", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "setgroup": "", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "setuser": "", 2024-04-26T10:33:14.699 INFO:teuthology.orchestra.run.smithi043.stdout: "setuser_match_path": "", 2024-04-26T10:33:14.700 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T10:33:14.700 INFO:teuthology.orchestra.run.smithi043.stdout: "thp": "false", 2024-04-26T10:33:14.700 INFO:teuthology.orchestra.run.smithi043.stdout: "threadpool_default_timeout": "60", 2024-04-26T10:33:14.700 INFO:teuthology.orchestra.run.smithi043.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T10:33:14.700 INFO:teuthology.orchestra.run.smithi043.stdout: "throttler_perf_counter": "true" 2024-04-26T10:33:14.700 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-26T10:33:14.702 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T10:33:14.842 INFO:teuthology.orchestra.run.smithi043.stdout:mon.a: {} 2024-04-26T10:33:14.851 INFO:teuthology.orchestra.run.smithi043.stdout:mon.b: {} 2024-04-26T10:33:14.860 INFO:teuthology.orchestra.run.smithi043.stdout:mon.c: {} 2024-04-26T10:33:14.861 INFO:teuthology.orchestra.run.smithi043.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:33:14.861 INFO:teuthology.orchestra.run.smithi043.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:33:14.862 INFO:teuthology.orchestra.run.smithi043.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:33:14.872 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-26T10:33:14.873 INFO:teuthology.run_tasks:Running task radosbench... 2024-04-26T10:33:14.884 INFO:tasks.radosbench:Beginning radosbench... 2024-04-26T10:33:14.884 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-04-26T10:33:14.884 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-04-26T10:33:14.884 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T10:33:14.885 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:33:14.885 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:33:14.885 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-26T10:33:14.885 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T10:33:14.885 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T10:33:14.885 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-26T10:33:14.886 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T10:33:14.886 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T10:33:14.886 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:33:14.886 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T10:33:14.887 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:14.888 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T10:33:14.888 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:33:14.889 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:14.885+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:14.988 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:14.986+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:15.028 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:15.028 INFO:teuthology.orchestra.run.smithi187.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T10:33:15.028 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:15.029 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:15.029 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:33:15.030 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-04-26T10:33:15.030 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:15.040 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:15.050 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:15.076 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:15.088 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:15.086+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:15.096 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:15.097 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:15.097 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:15.097 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:15.166 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:15.166 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:15.176 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:15.189 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:15.188+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:15.290 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:15.289+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:15.302 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:15.303 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:15.312 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:15.341 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-26T10:33:15.342 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'unique_pool_0' created 2024-04-26T10:33:15.359 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-04-26T10:33:15.391 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:15.390+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:15.452 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:15.453 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:15.464 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:15.493 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:15.491+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:15.592 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:15.592 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:15.593 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:15.591+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:15.602 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:15.694 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:15.693+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:15.729 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:15.729 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:15.739 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:15.795 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:15.793+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:15.874 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:15.875 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:15.885 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:15.930 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:15.928+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:15.997 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:15.995+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:16.012 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:16.012 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:16.022 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:16.098 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:16.096+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:16.189 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:16.189 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:16.198 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:16.197+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:16.199 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:16.300 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:16.298+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:16.339 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:16.339 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:16.344 INFO:teuthology.orchestra.run.smithi043.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-04-26T10:33:16.351 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:16.401 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:16.400+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:16.477 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:16.477 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:16.487 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:16.502 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:16.500+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:16.603 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:16.602+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:16.612 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:16.613 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:16.622 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:16.704 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:16.702+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:16.762 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:16.762 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:16.771 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:16.805 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:16.804+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:16.906 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:16.905+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:16.938 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:16.938 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:16.948 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:17.006 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:17.005+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:17.074 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:17.074 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:17.084 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:17.109 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:33:17.128 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:17.126+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:17.209 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:17.207+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:17.221 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:17.221 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:17.231 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:17.272 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:17.292 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:17.312 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:17.313 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:17.313 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:17.313 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:17.314 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:17.313+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:17.359 DEBUG:teuthology.orchestra.run.smithi043:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-04-26T10:33:17.360 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:33:17.362 INFO:teuthology.run_tasks:Running task admin_socket... 2024-04-26T10:33:17.375 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-04-26T10:33:17.375 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-04-26T10:33:17.399 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:33:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:33:17.399 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:33:17.399 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:17.409 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:17.410 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:17.409+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:17.416 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:hints = 1 2024-04-26T10:33:17.416 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-04-26T10:33:17.417 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Object prefix: benchmark_data_smithi043_45180 2024-04-26T10:33:17.417 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T10:33:17.417 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 0 0 0 0 0 0 - 0 2024-04-26T10:33:17.511 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:17.510+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:17.612 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:17.611+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:17.623 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:17.624 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:33:17.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:33:17.624 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:17.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.624 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:17.624 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993605+0000", 2024-04-26T10:33:17.624 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.627462338000001, 2024-04-26T10:33:17.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017888707, 2024-04-26T10:33:17.624 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.624 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:17.624 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.625 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993605+0000", 2024-04-26T10:33:17.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.625 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.625 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.625 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993605+0000", 2024-04-26T10:33:17.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.625 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.625 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.625 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993604+0000", 2024-04-26T10:33:17.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:17.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993612+0000", 2024-04-26T10:33:17.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:33:17.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993623+0000", 2024-04-26T10:33:17.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.117e-05 2024-04-26T10:33:17.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993640+0000", 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7095000000000001e-05 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993699+0000", 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9123000000000003e-05 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993704+0000", 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3140000000000003e-06 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.002866+0000", 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0091614869999999994 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.003153+0000", 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028684400000000002 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.003399+0000", 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024633100000000002 2024-04-26T10:33:17.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005747+0000", 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023480139999999998 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011388+0000", 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056412750000000003 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011447+0000", 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8443000000000003e-05 2024-04-26T10:33:17.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.630 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011494+0000", 2024-04-26T10:33:17.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6814000000000003e-05 2024-04-26T10:33:17.630 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.630 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.630 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.631 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:10 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:17.631 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:17.631 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.627405622000001, 2024-04-26T10:33:17.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018785385000000002, 2024-04-26T10:33:17.631 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.631 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:17.632 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:17.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:17.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993661+0000", 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993667+0000", 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9120000000000003e-06 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993676+0000", 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0270000000000001e-06 2024-04-26T10:33:17.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993681+0000", 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9919999999999998e-06 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993763+0000", 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2799999999999993e-05 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993768+0000", 2024-04-26T10:33:17.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9409999999999998e-06 2024-04-26T10:33:17.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004133+0000", 2024-04-26T10:33:17.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01036455 2024-04-26T10:33:17.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004220+0000", 2024-04-26T10:33:17.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7394999999999999e-05 2024-04-26T10:33:17.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:17.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004343+0000", 2024-04-26T10:33:17.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012254900000000001 2024-04-26T10:33:17.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:17.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005750+0000", 2024-04-26T10:33:17.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001406991 2024-04-26T10:33:17.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:17.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012396+0000", 2024-04-26T10:33:17.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0066459129999999998 2024-04-26T10:33:17.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:17.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012422+0000", 2024-04-26T10:33:17.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6182000000000001e-05 2024-04-26T10:33:17.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012447+0000", 2024-04-26T10:33:17.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4981e-05 2024-04-26T10:33:17.639 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.639 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.639 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.639 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:17.639 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993685+0000", 2024-04-26T10:33:17.639 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.627381929999999, 2024-04-26T10:33:17.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014631474, 2024-04-26T10:33:17.639 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.639 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:17.639 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993685+0000", 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993685+0000", 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993685+0000", 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993687+0000", 2024-04-26T10:33:17.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2220000000000001e-06 2024-04-26T10:33:17.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993691+0000", 2024-04-26T10:33:17.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7979999999999999e-06 2024-04-26T10:33:17.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993694+0000", 2024-04-26T10:33:17.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4319999999999999e-06 2024-04-26T10:33:17.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993750+0000", 2024-04-26T10:33:17.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5447e-05 2024-04-26T10:33:17.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-26T10:33:17.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993755+0000", 2024-04-26T10:33:17.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.87e-06 2024-04-26T10:33:17.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005448+0000", 2024-04-26T10:33:17.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011693301 2024-04-26T10:33:17.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.644 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005552+0000", 2024-04-26T10:33:17.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010411 2024-04-26T10:33:17.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:17.644 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005664+0000", 2024-04-26T10:33:17.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111926 2024-04-26T10:33:17.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:17.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006535+0000", 2024-04-26T10:33:17.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00087124700000000002 2024-04-26T10:33:17.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:17.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008226+0000", 2024-04-26T10:33:17.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016902729999999999 2024-04-26T10:33:17.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:17.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008270+0000", 2024-04-26T10:33:17.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4755000000000001e-05 2024-04-26T10:33:17.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008317+0000", 2024-04-26T10:33:17.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6375000000000002e-05 2024-04-26T10:33:17.647 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.647 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.647 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.648 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:17.648 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993699+0000", 2024-04-26T10:33:17.648 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.627368619999999, 2024-04-26T10:33:17.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014757767, 2024-04-26T10:33:17.648 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.648 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:17.648 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993699+0000", 2024-04-26T10:33:17.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993699+0000", 2024-04-26T10:33:17.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993698+0000", 2024-04-26T10:33:17.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993704+0000", 2024-04-26T10:33:17.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6760000000000004e-06 2024-04-26T10:33:17.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993708+0000", 2024-04-26T10:33:17.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8840000000000004e-06 2024-04-26T10:33:17.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993713+0000", 2024-04-26T10:33:17.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7079999999999996e-06 2024-04-26T10:33:17.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993776+0000", 2024-04-26T10:33:17.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3637000000000001e-05 2024-04-26T10:33:17.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:17.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:17.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7164999999999999e-05 2024-04-26T10:33:17.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005913+0000", 2024-04-26T10:33:17.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012119237999999999 2024-04-26T10:33:17.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005960+0000", 2024-04-26T10:33:17.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7138999999999997e-05 2024-04-26T10:33:17.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:17.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006042+0000", 2024-04-26T10:33:17.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2204000000000001e-05 2024-04-26T10:33:17.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:17.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006543+0000", 2024-04-26T10:33:17.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00050083300000000001 2024-04-26T10:33:17.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:17.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008364+0000", 2024-04-26T10:33:17.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018215729999999999 2024-04-26T10:33:17.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:17.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008406+0000", 2024-04-26T10:33:17.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2077999999999999e-05 2024-04-26T10:33:17.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008456+0000", 2024-04-26T10:33:17.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9950000000000001e-05 2024-04-26T10:33:17.657 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.657 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.657 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.657 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:17.658 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:17.658 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.627348056999999, 2024-04-26T10:33:17.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018863001000000001, 2024-04-26T10:33:17.658 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.658 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:17.658 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:17.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:17.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:17.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993722+0000", 2024-04-26T10:33:17.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7630000000000001e-06 2024-04-26T10:33:17.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993726+0000", 2024-04-26T10:33:17.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9999999999999998e-06 2024-04-26T10:33:17.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993729+0000", 2024-04-26T10:33:17.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3210000000000001e-06 2024-04-26T10:33:17.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993795+0000", 2024-04-26T10:33:17.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5903999999999998e-05 2024-04-26T10:33:17.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:17.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993798+0000", 2024-04-26T10:33:17.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:33:17.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004680+0000", 2024-04-26T10:33:17.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010881823000000001 2024-04-26T10:33:17.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004804+0000", 2024-04-26T10:33:17.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012401 2024-04-26T10:33:17.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:17.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005121+0000", 2024-04-26T10:33:17.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031651100000000001 2024-04-26T10:33:17.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:17.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006210+0000", 2024-04-26T10:33:17.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010888930000000001 2024-04-26T10:33:17.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:17.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012493+0000", 2024-04-26T10:33:17.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062830630000000002 2024-04-26T10:33:17.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:17.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012543+0000", 2024-04-26T10:33:17.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0331999999999999e-05 2024-04-26T10:33:17.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012582+0000", 2024-04-26T10:33:17.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9230999999999998e-05 2024-04-26T10:33:17.665 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.665 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.665 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.665 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:17.665 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993760+0000", 2024-04-26T10:33:17.665 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.627307151, 2024-04-26T10:33:17.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017241877999999999, 2024-04-26T10:33:17.665 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.665 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:17.665 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993760+0000", 2024-04-26T10:33:17.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993760+0000", 2024-04-26T10:33:17.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993760+0000", 2024-04-26T10:33:17.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993763+0000", 2024-04-26T10:33:17.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3419999999999999e-06 2024-04-26T10:33:17.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993779+0000", 2024-04-26T10:33:17.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6331e-05 2024-04-26T10:33:17.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993786+0000", 2024-04-26T10:33:17.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8299999999999998e-06 2024-04-26T10:33:17.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993826+0000", 2024-04-26T10:33:17.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9947000000000002e-05 2024-04-26T10:33:17.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-26T10:33:17.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993831+0000", 2024-04-26T10:33:17.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7500000000000003e-06 2024-04-26T10:33:17.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.000042+0000", 2024-04-26T10:33:17.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.006211299 2024-04-26T10:33:17.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.000240+0000", 2024-04-26T10:33:17.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000197715 2024-04-26T10:33:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.000529+0000", 2024-04-26T10:33:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028910699999999998 2024-04-26T10:33:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004479+0000", 2024-04-26T10:33:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039500250000000002 2024-04-26T10:33:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:17.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.010951+0000", 2024-04-26T10:33:17.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064716210000000003 2024-04-26T10:33:17.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:17.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.010979+0000", 2024-04-26T10:33:17.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7946e-05 2024-04-26T10:33:17.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011002+0000", 2024-04-26T10:33:17.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3388e-05 2024-04-26T10:33:17.672 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.672 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.672 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.672 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:17.672 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993797+0000", 2024-04-26T10:33:17.672 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.627270604, 2024-04-26T10:33:17.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017310459, 2024-04-26T10:33:17.672 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.672 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:17.672 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993797+0000", 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993797+0000", 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993796+0000", 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993800+0000", 2024-04-26T10:33:17.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5899999999999999e-06 2024-04-26T10:33:17.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993806+0000", 2024-04-26T10:33:17.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6189999999999996e-06 2024-04-26T10:33:17.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993818+0000", 2024-04-26T10:33:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2339e-05 2024-04-26T10:33:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993853+0000", 2024-04-26T10:33:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4987999999999998e-05 2024-04-26T10:33:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993856+0000", 2024-04-26T10:33:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5160000000000001e-06 2024-04-26T10:33:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001544+0000", 2024-04-26T10:33:17.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076884620000000001 2024-04-26T10:33:17.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001688+0000", 2024-04-26T10:33:17.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014332200000000001 2024-04-26T10:33:17.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011107+0000", 2024-04-26T10:33:17.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0094193209999999996 2024-04-26T10:33:17.677 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.677 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.677 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.677 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:17.678 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:17.678 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.627229845999999, 2024-04-26T10:33:17.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018824634, 2024-04-26T10:33:17.678 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.678 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:17.678 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:17.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:17.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:17.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:17.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993841+0000", 2024-04-26T10:33:17.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3059999999999999e-06 2024-04-26T10:33:17.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993849+0000", 2024-04-26T10:33:17.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:33:17.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993855+0000", 2024-04-26T10:33:17.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9479999999999996e-06 2024-04-26T10:33:17.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993885+0000", 2024-04-26T10:33:17.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9798000000000002e-05 2024-04-26T10:33:17.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:17.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993891+0000", 2024-04-26T10:33:17.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2689999999999996e-06 2024-04-26T10:33:17.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005459+0000", 2024-04-26T10:33:17.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011567898 2024-04-26T10:33:17.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005556+0000", 2024-04-26T10:33:17.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7751999999999995e-05 2024-04-26T10:33:17.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012662+0000", 2024-04-26T10:33:17.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071055830000000004 2024-04-26T10:33:17.685 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.685 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.685 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.685 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:17.686 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993864+0000", 2024-04-26T10:33:17.686 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.627203522999999, 2024-04-26T10:33:17.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01335422, 2024-04-26T10:33:17.686 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.686 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:17.686 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993864+0000", 2024-04-26T10:33:17.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993864+0000", 2024-04-26T10:33:17.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993863+0000", 2024-04-26T10:33:17.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993879+0000", 2024-04-26T10:33:17.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5279000000000001e-05 2024-04-26T10:33:17.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993887+0000", 2024-04-26T10:33:17.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9959999999999993e-06 2024-04-26T10:33:17.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993898+0000", 2024-04-26T10:33:17.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1712000000000001e-05 2024-04-26T10:33:17.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993923+0000", 2024-04-26T10:33:17.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4893e-05 2024-04-26T10:33:17.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-26T10:33:17.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993926+0000", 2024-04-26T10:33:17.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2959999999999999e-06 2024-04-26T10:33:17.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001993+0000", 2024-04-26T10:33:17.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080661759999999996 2024-04-26T10:33:17.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.002082+0000", 2024-04-26T10:33:17.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9689000000000001e-05 2024-04-26T10:33:17.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007218+0000", 2024-04-26T10:33:17.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005135667 2024-04-26T10:33:17.693 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.693 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.693 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.694 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 7 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:33:17.694 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:52.001727+0000", 2024-04-26T10:33:17.694 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.619340108999999, 2024-04-26T10:33:17.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029472690000000002, 2024-04-26T10:33:17.694 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.694 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-26T10:33:17.695 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001727+0000", 2024-04-26T10:33:17.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001727+0000", 2024-04-26T10:33:17.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001727+0000", 2024-04-26T10:33:17.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001736+0000", 2024-04-26T10:33:17.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7309999999999999e-06 2024-04-26T10:33:17.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001748+0000", 2024-04-26T10:33:17.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2471e-05 2024-04-26T10:33:17.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001858+0000", 2024-04-26T10:33:17.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011042700000000001 2024-04-26T10:33:17.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001946+0000", 2024-04-26T10:33:17.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7783999999999998e-05 2024-04-26T10:33:17.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004674+0000", 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027281699999999998 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:52.007855+0000", 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.613212325999999, 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00046903599999999999, 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007855+0000", 2024-04-26T10:33:17.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007855+0000", 2024-04-26T10:33:17.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007854+0000", 2024-04-26T10:33:17.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:17.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007860+0000", 2024-04-26T10:33:17.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4999999999999999e-06 2024-04-26T10:33:17.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007869+0000", 2024-04-26T10:33:17.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.918e-06 2024-04-26T10:33:17.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007878+0000", 2024-04-26T10:33:17.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.414e-06 2024-04-26T10:33:17.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008212+0000", 2024-04-26T10:33:17.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033366 2024-04-26T10:33:17.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008220+0000", 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4489999999999999e-06 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008324+0000", 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103875 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e14/12 ondisk, result = 0)", 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:52.007895+0000", 2024-04-26T10:33:17.703 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.613172117000001, 2024-04-26T10:33:17.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00056915399999999999, 2024-04-26T10:33:17.704 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.704 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:17.704 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007895+0000", 2024-04-26T10:33:17.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007895+0000", 2024-04-26T10:33:17.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007895+0000", 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007898+0000", 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0510000000000001e-06 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007904+0000", 2024-04-26T10:33:17.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2310000000000001e-06 2024-04-26T10:33:17.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007920+0000", 2024-04-26T10:33:17.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6269e-05 2024-04-26T10:33:17.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008347+0000", 2024-04-26T10:33:17.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00042695899999999998 2024-04-26T10:33:17.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008359+0000", 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2099999999999999e-05 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008464+0000", 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104974 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:33:17.707 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:52.008932+0000", 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.612135254999998, 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015793700000000001, 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008932+0000", 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008932+0000", 2024-04-26T10:33:17.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008932+0000", 2024-04-26T10:33:17.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008956+0000", 2024-04-26T10:33:17.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4810000000000001e-05 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008974+0000", 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7876999999999998e-05 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008983+0000", 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8529999999999998e-06 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009033+0000", 2024-04-26T10:33:17.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9799999999999998e-05 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009050+0000", 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7105999999999999e-05 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.010481+0000", 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014312929999999999 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.010511+0000", 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0048000000000001e-05 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:19 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:52.009307+0000", 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.611760565000001, 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012583360000000001, 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009307+0000", 2024-04-26T10:33:17.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009307+0000", 2024-04-26T10:33:17.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009306+0000", 2024-04-26T10:33:17.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009311+0000", 2024-04-26T10:33:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6999999999999999e-06 2024-04-26T10:33:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009319+0000", 2024-04-26T10:33:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5429999999999996e-06 2024-04-26T10:33:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009325+0000", 2024-04-26T10:33:17.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4019999999999999e-06 2024-04-26T10:33:17.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009393+0000", 2024-04-26T10:33:17.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7872000000000003e-05 2024-04-26T10:33:17.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009410+0000", 2024-04-26T10:33:17.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7331999999999999e-05 2024-04-26T10:33:17.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:17.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.010542+0000", 2024-04-26T10:33:17.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001131787 2024-04-26T10:33:17.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.010565+0000", 2024-04-26T10:33:17.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3105999999999999e-05 2024-04-26T10:33:17.720 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.720 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.720 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.720 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-26T10:33:17.720 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:52.009382+0000", 2024-04-26T10:33:17.720 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.611685340000001, 2024-04-26T10:33:17.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002330267, 2024-04-26T10:33:17.721 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.721 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:17.721 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009382+0000", 2024-04-26T10:33:17.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009382+0000", 2024-04-26T10:33:17.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009381+0000", 2024-04-26T10:33:17.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009386+0000", 2024-04-26T10:33:17.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2749999999999997e-06 2024-04-26T10:33:17.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009392+0000", 2024-04-26T10:33:17.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9179999999999999e-06 2024-04-26T10:33:17.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009397+0000", 2024-04-26T10:33:17.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2259999999999996e-06 2024-04-26T10:33:17.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009602+0000", 2024-04-26T10:33:17.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020558100000000001 2024-04-26T10:33:17.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009615+0000", 2024-04-26T10:33:17.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2836e-05 2024-04-26T10:33:17.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:17.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011674+0000", 2024-04-26T10:33:17.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020584779999999999 2024-04-26T10:33:17.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011712+0000", 2024-04-26T10:33:17.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.837e-05 2024-04-26T10:33:17.725 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.725 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.725 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.726 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-26T10:33:17.726 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:52.009523+0000", 2024-04-26T10:33:17.726 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.611544106, 2024-04-26T10:33:17.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021570930000000001, 2024-04-26T10:33:17.726 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.726 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009523+0000", 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009523+0000", 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009523+0000", 2024-04-26T10:33:17.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009531+0000", 2024-04-26T10:33:17.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5739999999999996e-06 2024-04-26T10:33:17.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009540+0000", 2024-04-26T10:33:17.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7329999999999992e-06 2024-04-26T10:33:17.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009546+0000", 2024-04-26T10:33:17.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9900000000000002e-06 2024-04-26T10:33:17.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009637+0000", 2024-04-26T10:33:17.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0995000000000005e-05 2024-04-26T10:33:17.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.009660+0000", 2024-04-26T10:33:17.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2934000000000001e-05 2024-04-26T10:33:17.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:17.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011639+0000", 2024-04-26T10:33:17.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019794510000000001 2024-04-26T10:33:17.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011680+0000", 2024-04-26T10:33:17.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1019000000000001e-05 2024-04-26T10:33:17.731 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.731 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.731 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.731 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:33:17.732 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:52.011116+0000", 2024-04-26T10:33:17.732 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.609951687999999, 2024-04-26T10:33:17.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00038576499999999999, 2024-04-26T10:33:17.732 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.732 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:17.732 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011116+0000", 2024-04-26T10:33:17.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011116+0000", 2024-04-26T10:33:17.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011115+0000", 2024-04-26T10:33:17.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011119+0000", 2024-04-26T10:33:17.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.658e-06 2024-04-26T10:33:17.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011127+0000", 2024-04-26T10:33:17.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9440000000000005e-06 2024-04-26T10:33:17.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011133+0000", 2024-04-26T10:33:17.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1859999999999997e-06 2024-04-26T10:33:17.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011374+0000", 2024-04-26T10:33:17.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000241248 2024-04-26T10:33:17.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011383+0000", 2024-04-26T10:33:17.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3809999999999999e-06 2024-04-26T10:33:17.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011501+0000", 2024-04-26T10:33:17.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000118806 2024-04-26T10:33:17.737 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.737 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.737 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.737 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-26T10:33:17.737 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:52.012373+0000", 2024-04-26T10:33:17.738 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.608694672999999, 2024-04-26T10:33:17.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00021803999999999999, 2024-04-26T10:33:17.738 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.738 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:17.738 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012373+0000", 2024-04-26T10:33:17.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012373+0000", 2024-04-26T10:33:17.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012372+0000", 2024-04-26T10:33:17.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967296 2024-04-26T10:33:17.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012374+0000", 2024-04-26T10:33:17.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7630000000000001e-06 2024-04-26T10:33:17.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012378+0000", 2024-04-26T10:33:17.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9530000000000001e-06 2024-04-26T10:33:17.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012381+0000", 2024-04-26T10:33:17.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3749999999999999e-06 2024-04-26T10:33:17.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012478+0000", 2024-04-26T10:33:17.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6916000000000005e-05 2024-04-26T10:33:17.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012486+0000", 2024-04-26T10:33:17.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0010000000000001e-06 2024-04-26T10:33:17.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012591+0000", 2024-04-26T10:33:17.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104244 2024-04-26T10:33:17.742 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.742 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.742 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.742 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 14/12 rep_tid 6 lcod 14'4)", 2024-04-26T10:33:17.742 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:52.012390+0000", 2024-04-26T10:33:17.742 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.608676926000001, 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027562700000000002, 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012390+0000", 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012390+0000", 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012390+0000", 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967296 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012392+0000", 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.547e-06 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012397+0000", 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9479999999999999e-06 2024-04-26T10:33:17.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012406+0000", 2024-04-26T10:33:17.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9330000000000007e-06 2024-04-26T10:33:17.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012603+0000", 2024-04-26T10:33:17.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019725499999999999 2024-04-26T10:33:17.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012666+0000", 2024-04-26T10:33:17.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3110999999999999e-05 2024-04-26T10:33:17.746 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.746 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.746 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.746 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-26T10:33:17.746 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:56.662050+0000", 2024-04-26T10:33:17.746 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 20.95901722, 2024-04-26T10:33:17.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016152409999999999, 2024-04-26T10:33:17.746 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:17.747 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:17.747 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:17.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:17.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:56.662050+0000", 2024-04-26T10:33:17.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:17.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:56.662050+0000", 2024-04-26T10:33:17.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:17.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:17.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:56.662048+0000", 2024-04-26T10:33:17.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999976 2024-04-26T10:33:17.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:17.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:56.662062+0000", 2024-04-26T10:33:17.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3987e-05 2024-04-26T10:33:17.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:56.662092+0000", 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0380000000000001e-05 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:56.662109+0000", 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6792000000000001e-05 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:56.662256+0000", 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014736799999999999 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:17.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:56.662385+0000", 2024-04-26T10:33:17.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012877599999999999 2024-04-26T10:33:17.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:17.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:56.662505+0000", 2024-04-26T10:33:17.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000120387 2024-04-26T10:33:17.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:17.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:56.663205+0000", 2024-04-26T10:33:17.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00069965700000000001 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:56.663600+0000", 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00039473999999999998 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:56.663636+0000", 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5935000000000001e-05 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:56.663665+0000", 2024-04-26T10:33:17.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9558999999999999e-05 2024-04-26T10:33:17.752 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.752 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.752 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.752 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:17.752 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:17.752 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:17.753 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:17.752+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:17.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:17.854 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:17.853+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:17.924 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:17.924 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:17.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.924 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:2373 5.9 5:975011d3:::benchmark_data_smithi043_45180_object2372:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:17.925 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:17.918770+0000", 2024-04-26T10:33:17.925 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0038690249999999999, 2024-04-26T10:33:17.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039073399999999996, 2024-04-26T10:33:17.925 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:17.925 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:17.925 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:17.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:17.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:17.926 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2373 2024-04-26T10:33:17.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.926 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:17.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:17.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.918770+0000", 2024-04-26T10:33:17.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.918770+0000", 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.918769+0000", 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.918822+0000", 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3165999999999999e-05 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.918831+0000", 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6619999999999994e-06 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.918838+0000", 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9210000000000003e-06 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.919504+0000", 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066671099999999995 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.919632+0000", 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000127255 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.919777+0000", 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000145465 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.920903+0000", 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011255760000000001 2024-04-26T10:33:17.929 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:2375 5.1 5:840a08a0:::benchmark_data_smithi043_45180_object2374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:17.918887+0000", 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0037516490000000001, 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038983070000000002, 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:17.930 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2375 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.918887+0000", 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.918887+0000", 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:17.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.918887+0000", 2024-04-26T10:33:17.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:17.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.918972+0000", 2024-04-26T10:33:17.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5396999999999996e-05 2024-04-26T10:33:17.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:17.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.918978+0000", 2024-04-26T10:33:17.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9730000000000002e-06 2024-04-26T10:33:17.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.918983+0000", 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7430000000000002e-06 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.920212+0000", 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001229427 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.920331+0000", 2024-04-26T10:33:17.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119342 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.920491+0000", 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159853 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922714+0000", 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002223142 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:2384 5.9 5:96d4a2a6:::benchmark_data_smithi043_45180_object2383:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:17.920312+0000", 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0023267740000000002, 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025535010000000001, 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2384 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.920312+0000", 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.920312+0000", 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.920311+0000", 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:17.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.920337+0000", 2024-04-26T10:33:17.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5437999999999999e-05 2024-04-26T10:33:17.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:17.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.920346+0000", 2024-04-26T10:33:17.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1109999999999997e-06 2024-04-26T10:33:17.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.920353+0000", 2024-04-26T10:33:17.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0480000000000001e-06 2024-04-26T10:33:17.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:17.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.920930+0000", 2024-04-26T10:33:17.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057721200000000002 2024-04-26T10:33:17.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:17.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921028+0000", 2024-04-26T10:33:17.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8227000000000007e-05 2024-04-26T10:33:17.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:17.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921125+0000", 2024-04-26T10:33:17.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6551000000000004e-05 2024-04-26T10:33:17.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.939 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:17.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:2390 5.1 5:809ad483:::benchmark_data_smithi043_45180_object2389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:17.921269+0000", 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.001369845, 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016528440000000001, 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2390 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:17.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:17.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921269+0000", 2024-04-26T10:33:17.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:17.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921269+0000", 2024-04-26T10:33:17.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:17.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921268+0000", 2024-04-26T10:33:17.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921389+0000", 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012126200000000001 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921397+0000", 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7800000000000001e-06 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921404+0000", 2024-04-26T10:33:17.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5969999999999997e-06 2024-04-26T10:33:17.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:17.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921471+0000", 2024-04-26T10:33:17.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6885999999999996e-05 2024-04-26T10:33:17.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921596+0000", 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000125291 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921736+0000", 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000139722 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.945 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:2391 5.1 5:80a4964e:::benchmark_data_smithi043_45180_object2390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:17.946 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:17.921413+0000", 2024-04-26T10:33:17.946 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0012258950000000001, 2024-04-26T10:33:17.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001556249, 2024-04-26T10:33:17.946 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:17.946 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:17.946 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:17.946 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:17.946 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:17.946 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2391 2024-04-26T10:33:17.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.946 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:17.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921413+0000", 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921413+0000", 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921412+0000", 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921440+0000", 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.826e-05 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921502+0000", 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1438000000000004e-05 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921510+0000", 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0700000000000007e-06 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922243+0000", 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000733149 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922311+0000", 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8287999999999994e-05 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922395+0000", 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3169000000000003e-05 2024-04-26T10:33:17.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.950 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:17.950 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.950 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:2392 5.9 5:9794c0c1:::benchmark_data_smithi043_45180_object2391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:17.950 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:17.921517+0000", 2024-04-26T10:33:17.950 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.001121396, 2024-04-26T10:33:17.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014940929999999999, 2024-04-26T10:33:17.950 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:17.950 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:17.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:17.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:17.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2392 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921517+0000", 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921517+0000", 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921517+0000", 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921547+0000", 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9912000000000001e-05 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921553+0000", 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.331e-06 2024-04-26T10:33:17.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921559+0000", 2024-04-26T10:33:17.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0959999999999997e-06 2024-04-26T10:33:17.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:17.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922700+0000", 2024-04-26T10:33:17.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001140723 2024-04-26T10:33:17.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:17.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922834+0000", 2024-04-26T10:33:17.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013372899999999999 2024-04-26T10:33:17.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:17.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922977+0000", 2024-04-26T10:33:17.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014341700000000001 2024-04-26T10:33:17.954 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.954 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:17.954 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop_reply(client.4538.0:2375 5.1 e18/16 ondisk, result = 0)", 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:17.921630+0000", 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0010092020000000001, 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014811550000000001, 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921630+0000", 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921630+0000", 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921629+0000", 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921632+0000", 2024-04-26T10:33:17.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.306e-06 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921637+0000", 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6359999999999999e-06 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921641+0000", 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3139999999999997e-06 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:17.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922703+0000", 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010614489999999999 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922709+0000", 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.173e-06 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:2393 5.f 5:f8abceaf:::benchmark_data_smithi043_45180_object2392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:17.921565+0000", 2024-04-26T10:33:17.958 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.001073598, 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016264859999999999, 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2393 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921565+0000", 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921565+0000", 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921565+0000", 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921693+0000", 2024-04-26T10:33:17.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000127997 2024-04-26T10:33:17.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:17.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921700+0000", 2024-04-26T10:33:17.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7109999999999995e-06 2024-04-26T10:33:17.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921707+0000", 2024-04-26T10:33:17.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1959999999999996e-06 2024-04-26T10:33:17.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921745+0000", 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8099000000000002e-05 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921861+0000", 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011678 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921952+0000", 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0762999999999998e-05 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922766+0000", 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081380199999999997 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:2396 5.7 5:e4ee4271:::benchmark_data_smithi043_45180_object2395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:17.921983+0000", 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00065536000000000001, 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013073080000000001, 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:17.963 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2396 2024-04-26T10:33:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921983+0000", 2024-04-26T10:33:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:17.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921983+0000", 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.921983+0000", 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922085+0000", 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000101896 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:17.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922093+0000", 2024-04-26T10:33:17.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0399999999999993e-06 2024-04-26T10:33:17.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922099+0000", 2024-04-26T10:33:17.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1099999999999999e-06 2024-04-26T10:33:17.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:17.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922123+0000", 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.44e-05 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922220+0000", 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7002000000000004e-05 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922302+0000", 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2198000000000001e-05 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:17.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922921+0000", 2024-04-26T10:33:17.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061842400000000001 2024-04-26T10:33:17.968 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.968 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:17.968 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.969 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:2397 5.d e18/16 5:be6aafd9:::benchmark_data_smithi043_45180_object2396:head v 18'153, mlcod=18'150)", 2024-04-26T10:33:17.970 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:17.922474+0000", 2024-04-26T10:33:17.970 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00016500400000000001, 2024-04-26T10:33:17.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00091928799999999998, 2024-04-26T10:33:17.970 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:17.970 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:17.970 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:17.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922474+0000", 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922474+0000", 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922473+0000", 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:17.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922616+0000", 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142528 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922624+0000", 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4619999999999996e-06 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922629+0000", 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:33:17.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922660+0000", 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1572000000000002e-05 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.922672+0000", 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1459e-05 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.923372+0000", 2024-04-26T10:33:17.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070053100000000001 2024-04-26T10:33:17.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:17.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:17.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:17.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:17.923397+0000", 2024-04-26T10:33:17.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4349999999999999e-05 2024-04-26T10:33:17.974 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.974 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:17.974 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.974 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:17.974 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:33:17.974 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 10 2024-04-26T10:33:17.974 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:17.976 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:17.974+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:17.976 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:18.076 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:18.075+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:18.151 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:18.151 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:33:18.152 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:33:18.152 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:33:18.152 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:18.165 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:18.207 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:18.205+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:18.278 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:18.277+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:18.350 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-26T10:33:18.380 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:18.379+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:18.384 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:33:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:33:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4170.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:33:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:46.779409+0000", 2024-04-26T10:33:18.384 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.600764542, 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014037745000000001, 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4170", 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/1651224360", 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 112 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779409+0000", 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779409+0000", 2024-04-26T10:33:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779408+0000", 2024-04-26T10:33:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779521+0000", 2024-04-26T10:33:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112438 2024-04-26T10:33:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779526+0000", 2024-04-26T10:33:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0649999999999998e-06 2024-04-26T10:33:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779530+0000", 2024-04-26T10:33:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5829999999999998e-06 2024-04-26T10:33:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.786218+0000", 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066884479999999996 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.786292+0000", 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4479000000000003e-05 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.786427+0000", 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013449100000000001 2024-04-26T10:33:18.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.787840+0000", 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014126449999999999 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.793310+0000", 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054708409999999997 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.793412+0000", 2024-04-26T10:33:18.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000101226 2024-04-26T10:33:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.793447+0000", 2024-04-26T10:33:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4879000000000003e-05 2024-04-26T10:33:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4170.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:33:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:46.779533+0000", 2024-04-26T10:33:18.390 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.600640014, 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013982076, 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4170", 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/1651224360", 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 113 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779533+0000", 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779533+0000", 2024-04-26T10:33:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779533+0000", 2024-04-26T10:33:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779535+0000", 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.888e-06 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779538+0000", 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.151e-06 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779541+0000", 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.559e-06 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.786926+0000", 2024-04-26T10:33:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073854929999999999 2024-04-26T10:33:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.786975+0000", 2024-04-26T10:33:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8695e-05 2024-04-26T10:33:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.787065+0000", 2024-04-26T10:33:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0573000000000002e-05 2024-04-26T10:33:18.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.788455+0000", 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001389653 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.793452+0000", 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049972439999999996 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.793481+0000", 2024-04-26T10:33:18.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8313000000000001e-05 2024-04-26T10:33:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.793515+0000", 2024-04-26T10:33:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4790999999999999e-05 2024-04-26T10:33:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4170.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T10:33:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:46.779547+0000", 2024-04-26T10:33:18.396 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.600626774999999, 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014035234000000001, 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4170", 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/1651224360", 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 114 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779547+0000", 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779547+0000", 2024-04-26T10:33:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779546+0000", 2024-04-26T10:33:18.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779549+0000", 2024-04-26T10:33:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6639999999999998e-06 2024-04-26T10:33:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779552+0000", 2024-04-26T10:33:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2899999999999998e-06 2024-04-26T10:33:18.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.779557+0000", 2024-04-26T10:33:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8960000000000002e-06 2024-04-26T10:33:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.787301+0000", 2024-04-26T10:33:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077439639999999999 2024-04-26T10:33:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.787377+0000", 2024-04-26T10:33:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6268999999999998e-05 2024-04-26T10:33:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.787526+0000", 2024-04-26T10:33:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014863100000000001 2024-04-26T10:33:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.788484+0000", 2024-04-26T10:33:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095773899999999999 2024-04-26T10:33:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.793521+0000", 2024-04-26T10:33:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0050372680000000001 2024-04-26T10:33:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.793543+0000", 2024-04-26T10:33:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2334e-05 2024-04-26T10:33:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:46.793582+0000", 2024-04-26T10:33:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8414000000000002e-05 2024-04-26T10:33:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993731+0000", 2024-04-26T10:33:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.386442078000002, 2024-04-26T10:33:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014047472, 2024-04-26T10:33:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993731+0000", 2024-04-26T10:33:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993731+0000", 2024-04-26T10:33:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993730+0000", 2024-04-26T10:33:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993736+0000", 2024-04-26T10:33:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.161e-06 2024-04-26T10:33:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993747+0000", 2024-04-26T10:33:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0523000000000001e-05 2024-04-26T10:33:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993756+0000", 2024-04-26T10:33:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2310000000000002e-06 2024-04-26T10:33:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993821+0000", 2024-04-26T10:33:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4536999999999996e-05 2024-04-26T10:33:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993826+0000", 2024-04-26T10:33:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3499999999999996e-06 2024-04-26T10:33:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.998590+0000", 2024-04-26T10:33:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047645090000000001 2024-04-26T10:33:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.998838+0000", 2024-04-26T10:33:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024790000000000001 2024-04-26T10:33:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.999038+0000", 2024-04-26T10:33:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000199273 2024-04-26T10:33:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005146+0000", 2024-04-26T10:33:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.006108006 2024-04-26T10:33:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007669+0000", 2024-04-26T10:33:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025231059999999998 2024-04-26T10:33:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007722+0000", 2024-04-26T10:33:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3504999999999997e-05 2024-04-26T10:33:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007779+0000", 2024-04-26T10:33:18.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6542999999999997e-05 2024-04-26T10:33:18.412 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.412 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.412 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.412 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.412 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993766+0000", 2024-04-26T10:33:18.412 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.386407085999998, 2024-04-26T10:33:18.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014208985, 2024-04-26T10:33:18.413 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.413 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.413 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993766+0000", 2024-04-26T10:33:18.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993766+0000", 2024-04-26T10:33:18.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993766+0000", 2024-04-26T10:33:18.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993773+0000", 2024-04-26T10:33:18.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.605e-06 2024-04-26T10:33:18.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993783+0000", 2024-04-26T10:33:18.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0035e-05 2024-04-26T10:33:18.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993788+0000", 2024-04-26T10:33:18.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2910000000000001e-06 2024-04-26T10:33:18.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993895+0000", 2024-04-26T10:33:18.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107295 2024-04-26T10:33:18.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:18.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993901+0000", 2024-04-26T10:33:18.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0240000000000003e-06 2024-04-26T10:33:18.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.001050+0000", 2024-04-26T10:33:18.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071485560000000004 2024-04-26T10:33:18.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.001205+0000", 2024-04-26T10:33:18.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155747 2024-04-26T10:33:18.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.001586+0000", 2024-04-26T10:33:18.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038079200000000002 2024-04-26T10:33:18.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006272+0000", 2024-04-26T10:33:18.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046858000000000004 2024-04-26T10:33:18.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007884+0000", 2024-04-26T10:33:18.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016121639999999999 2024-04-26T10:33:18.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007933+0000", 2024-04-26T10:33:18.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8810999999999997e-05 2024-04-26T10:33:18.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007975+0000", 2024-04-26T10:33:18.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2318999999999999e-05 2024-04-26T10:33:18.420 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.420 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.420 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.421 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.421 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:18.421 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.386380709000001, 2024-04-26T10:33:18.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017960028999999999, 2024-04-26T10:33:18.421 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.421 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.421 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:18.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:18.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993792+0000", 2024-04-26T10:33:18.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993800+0000", 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0900000000000005e-06 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993805+0000", 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9919999999999998e-06 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993809+0000", 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.703e-06 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012428800000000001 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993937+0000", 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0010000000000003e-06 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006732+0000", 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012794972 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006890+0000", 2024-04-26T10:33:18.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015741999999999999 2024-04-26T10:33:18.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007049+0000", 2024-04-26T10:33:18.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159872 2024-04-26T10:33:18.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011426+0000", 2024-04-26T10:33:18.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043764370000000004 2024-04-26T10:33:18.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011667+0000", 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024095400000000001 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011712+0000", 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4752000000000001e-05 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011753+0000", 2024-04-26T10:33:18.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0995999999999998e-05 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.386314420000001, 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018053829, 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:18.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:18.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:18.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993861+0000", 2024-04-26T10:33:18.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4990000000000001e-06 2024-04-26T10:33:18.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993868+0000", 2024-04-26T10:33:18.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7190000000000004e-06 2024-04-26T10:33:18.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993873+0000", 2024-04-26T10:33:18.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0200000000000002e-06 2024-04-26T10:33:18.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993968+0000", 2024-04-26T10:33:18.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5310999999999996e-05 2024-04-26T10:33:18.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:18.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993974+0000", 2024-04-26T10:33:18.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008004+0000", 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014029700000000001 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008126+0000", 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122087 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008229+0000", 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102358 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011613+0000", 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033843279999999998 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011812+0000", 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000198798 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011871+0000", 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9283000000000001e-05 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011913+0000", 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1798000000000002e-05 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.433 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:18.434 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.386284372999999, 2024-04-26T10:33:18.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018338483999999999, 2024-04-26T10:33:18.434 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.434 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.434 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:18.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993892+0000", 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.546e-06 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993899+0000", 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993906+0000", 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9820000000000002e-06 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994023+0000", 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116766 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994028+0000", 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7079999999999996e-06 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008784+0000", 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014756833 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008838+0000", 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3112000000000002e-05 2024-04-26T10:33:18.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008957+0000", 2024-04-26T10:33:18.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119523 2024-04-26T10:33:18.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011618+0000", 2024-04-26T10:33:18.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026610330000000001 2024-04-26T10:33:18.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012154+0000", 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053582800000000002 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012193+0000", 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9047000000000001e-05 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012227+0000", 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4442e-05 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.439 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.440 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:13 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.440 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:18.440 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.386242135, 2024-04-26T10:33:18.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018412833, 2024-04-26T10:33:18.440 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.440 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.440 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:18.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:18.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:18.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:18.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6139999999999999e-06 2024-04-26T10:33:18.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993939+0000", 2024-04-26T10:33:18.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3279999999999996e-06 2024-04-26T10:33:18.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993949+0000", 2024-04-26T10:33:18.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.047e-05 2024-04-26T10:33:18.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994066+0000", 2024-04-26T10:33:18.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116952 2024-04-26T10:33:18.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:18.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994071+0000", 2024-04-26T10:33:18.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869999999999996e-06 2024-04-26T10:33:18.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009196+0000", 2024-04-26T10:33:18.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015125148 2024-04-26T10:33:18.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009272+0000", 2024-04-26T10:33:18.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5440999999999998e-05 2024-04-26T10:33:18.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009381+0000", 2024-04-26T10:33:18.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010946399999999999 2024-04-26T10:33:18.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012090+0000", 2024-04-26T10:33:18.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027090700000000001 2024-04-26T10:33:18.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012271+0000", 2024-04-26T10:33:18.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018098699999999999 2024-04-26T10:33:18.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012312+0000", 2024-04-26T10:33:18.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0286e-05 2024-04-26T10:33:18.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:18.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2276000000000001e-05 2024-04-26T10:33:18.447 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.447 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.447 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.448 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:15 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.448 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:18.448 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.386181356000002, 2024-04-26T10:33:18.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018433715, 2024-04-26T10:33:18.448 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.448 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.448 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:18.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:18.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:18.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993995+0000", 2024-04-26T10:33:18.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.225e-06 2024-04-26T10:33:18.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994001+0000", 2024-04-26T10:33:18.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0619999999999997e-06 2024-04-26T10:33:18.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994004+0000", 2024-04-26T10:33:18.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.422e-06 2024-04-26T10:33:18.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994157+0000", 2024-04-26T10:33:18.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015285 2024-04-26T10:33:18.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:18.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:18.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1449999999999999e-06 2024-04-26T10:33:18.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009937+0000", 2024-04-26T10:33:18.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015774455 2024-04-26T10:33:18.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010028+0000", 2024-04-26T10:33:18.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0746000000000002e-05 2024-04-26T10:33:18.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010174+0000", 2024-04-26T10:33:18.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146682 2024-04-26T10:33:18.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012358+0000", 2024-04-26T10:33:18.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021837900000000001 2024-04-26T10:33:18.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012382+0000", 2024-04-26T10:33:18.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3768e-05 2024-04-26T10:33:18.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012406+0000", 2024-04-26T10:33:18.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4006999999999999e-05 2024-04-26T10:33:18.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012426+0000", 2024-04-26T10:33:18.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9896000000000001e-05 2024-04-26T10:33:18.455 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.455 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.455 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.456 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:16 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.456 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:18.456 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.386157960999999, 2024-04-26T10:33:18.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020879298000000001, 2024-04-26T10:33:18.456 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.456 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.456 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:18.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:18.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:18.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:18.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994017+0000", 2024-04-26T10:33:18.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1459999999999999e-06 2024-04-26T10:33:18.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994021+0000", 2024-04-26T10:33:18.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2169999999999996e-06 2024-04-26T10:33:18.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994025+0000", 2024-04-26T10:33:18.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3450000000000002e-06 2024-04-26T10:33:18.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996368+0000", 2024-04-26T10:33:18.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002342841 2024-04-26T10:33:18.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:18.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996374+0000", 2024-04-26T10:33:18.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6590000000000001e-06 2024-04-26T10:33:18.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010589+0000", 2024-04-26T10:33:18.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014214648999999999 2024-04-26T10:33:18.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010670+0000", 2024-04-26T10:33:18.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1463000000000003e-05 2024-04-26T10:33:18.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010824+0000", 2024-04-26T10:33:18.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000154007 2024-04-26T10:33:18.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.013067+0000", 2024-04-26T10:33:18.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022428629999999999 2024-04-26T10:33:18.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014821+0000", 2024-04-26T10:33:18.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017534530000000001 2024-04-26T10:33:18.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014860+0000", 2024-04-26T10:33:18.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9264000000000002e-05 2024-04-26T10:33:18.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014895+0000", 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4619999999999997e-05 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:19 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.386144452, 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018265699, 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:18.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994031+0000", 2024-04-26T10:33:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9980000000000002e-06 2024-04-26T10:33:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994037+0000", 2024-04-26T10:33:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0100000000000001e-06 2024-04-26T10:33:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994043+0000", 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1500000000000004e-06 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994085+0000", 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2354000000000001e-05 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994095+0000", 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8749999999999995e-06 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008664+0000", 2024-04-26T10:33:18.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01456942 2024-04-26T10:33:18.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008786+0000", 2024-04-26T10:33:18.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121735 2024-04-26T10:33:18.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:18.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008948+0000", 2024-04-26T10:33:18.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016180400000000001 2024-04-26T10:33:18.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010761+0000", 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018125120000000001 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012205+0000", 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014441040000000001 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012256+0000", 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1817999999999998e-05 2024-04-26T10:33:18.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012295+0000", 2024-04-26T10:33:18.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8142000000000002e-05 2024-04-26T10:33:18.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.470 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.470 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.470 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994049+0000", 2024-04-26T10:33:18.470 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.386123832999999, 2024-04-26T10:33:18.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01468798, 2024-04-26T10:33:18.471 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.471 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.471 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994049+0000", 2024-04-26T10:33:18.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994049+0000", 2024-04-26T10:33:18.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994049+0000", 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994057+0000", 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2519999999999999e-06 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994065+0000", 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3529999999999997e-06 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994071+0000", 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9909999999999999e-06 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994101+0000", 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9933e-05 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:18.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994104+0000", 2024-04-26T10:33:18.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7110000000000001e-06 2024-04-26T10:33:18.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.002416+0000", 2024-04-26T10:33:18.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0083117250000000007 2024-04-26T10:33:18.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.002511+0000", 2024-04-26T10:33:18.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4848999999999999e-05 2024-04-26T10:33:18.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.002637+0000", 2024-04-26T10:33:18.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012612600000000001 2024-04-26T10:33:18.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007787+0000", 2024-04-26T10:33:18.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051496620000000002 2024-04-26T10:33:18.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008358+0000", 2024-04-26T10:33:18.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000571427 2024-04-26T10:33:18.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008695+0000", 2024-04-26T10:33:18.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033693500000000001 2024-04-26T10:33:18.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008737+0000", 2024-04-26T10:33:18.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2385999999999997e-05 2024-04-26T10:33:18.477 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.477 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.477 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.386095377, 2024-04-26T10:33:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018349608999999999, 2024-04-26T10:33:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:18.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:18.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:18.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994081+0000", 2024-04-26T10:33:18.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0589999999999998e-06 2024-04-26T10:33:18.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994086+0000", 2024-04-26T10:33:18.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1900000000000003e-06 2024-04-26T10:33:18.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994090+0000", 2024-04-26T10:33:18.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.771e-06 2024-04-26T10:33:18.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994139+0000", 2024-04-26T10:33:18.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9737999999999997e-05 2024-04-26T10:33:18.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:18.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994145+0000", 2024-04-26T10:33:18.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2460000000000003e-06 2024-04-26T10:33:18.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009213+0000", 2024-04-26T10:33:18.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015068834 2024-04-26T10:33:18.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009263+0000", 2024-04-26T10:33:18.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9991999999999998e-05 2024-04-26T10:33:18.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:18.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009347+0000", 2024-04-26T10:33:18.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3997000000000002e-05 2024-04-26T10:33:18.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012307+0000", 2024-04-26T10:33:18.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029601229999999998 2024-04-26T10:33:18.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:18.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6470000000000001e-05 2024-04-26T10:33:18.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012390+0000", 2024-04-26T10:33:18.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5893000000000003e-05 2024-04-26T10:33:18.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012428+0000", 2024-04-26T10:33:18.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7721e-05 2024-04-26T10:33:18.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.485 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.485 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.485 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:18.485 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.386074684, 2024-04-26T10:33:18.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017262810999999999, 2024-04-26T10:33:18.486 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.486 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.486 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:18.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:18.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994098+0000", 2024-04-26T10:33:18.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994105+0000", 2024-04-26T10:33:18.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5599999999999999e-06 2024-04-26T10:33:18.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994109+0000", 2024-04-26T10:33:18.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5419999999999999e-06 2024-04-26T10:33:18.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994115+0000", 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.181e-06 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994169+0000", 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4505000000000001e-05 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994176+0000", 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9090000000000003e-06 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006451+0000", 2024-04-26T10:33:18.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012274571999999999 2024-04-26T10:33:18.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006594+0000", 2024-04-26T10:33:18.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014321900000000001 2024-04-26T10:33:18.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:18.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006804+0000", 2024-04-26T10:33:18.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020967800000000001 2024-04-26T10:33:18.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011137+0000", 2024-04-26T10:33:18.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043333349999999998 2024-04-26T10:33:18.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011261+0000", 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012443 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011317+0000", 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6093e-05 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011361+0000", 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4039000000000003e-05 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.492 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.386046095000001, 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017534645000000001, 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:18.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:18.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:18.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994130+0000", 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5530000000000001e-06 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994155+0000", 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4703999999999999e-05 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8650000000000003e-06 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997690+0000", 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035285249999999998 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997697+0000", 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1399999999999997e-06 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003133+0000", 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054364549999999998 2024-04-26T10:33:18.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003272+0000", 2024-04-26T10:33:18.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138839 2024-04-26T10:33:18.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003879+0000", 2024-04-26T10:33:18.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00060699599999999995 2024-04-26T10:33:18.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009920+0000", 2024-04-26T10:33:18.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060407209999999998 2024-04-26T10:33:18.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011512+0000", 2024-04-26T10:33:18.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015920940000000001 2024-04-26T10:33:18.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011591+0000", 2024-04-26T10:33:18.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9054999999999994e-05 2024-04-26T10:33:18.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011662+0000", 2024-04-26T10:33:18.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1095999999999998e-05 2024-04-26T10:33:18.499 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.499 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.499 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.385964365, 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017587693000000001, 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:18.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:18.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994219+0000", 2024-04-26T10:33:18.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0421000000000001e-05 2024-04-26T10:33:18.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994226+0000", 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4000000000000003e-06 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994232+0000", 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.575e-06 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997723+0000", 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003491133 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997727+0000", 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5769999999999998e-06 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.004741+0000", 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070140410000000004 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005283+0000", 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054229500000000004 2024-04-26T10:33:18.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005451+0000", 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016849700000000001 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010173+0000", 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047220259999999998 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011703+0000", 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015294499999999999 2024-04-26T10:33:18.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011752+0000", 2024-04-26T10:33:18.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9524999999999998e-05 2024-04-26T10:33:18.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011797+0000", 2024-04-26T10:33:18.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4205000000000001e-05 2024-04-26T10:33:18.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.506 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.507 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.507 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:18.507 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.385935833000001, 2024-04-26T10:33:18.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01805445, 2024-04-26T10:33:18.507 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.507 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.507 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994240+0000", 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4920000000000002e-06 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994249+0000", 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4810000000000006e-06 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994254+0000", 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3839999999999996e-06 2024-04-26T10:33:18.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996056+0000", 2024-04-26T10:33:18.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018018839999999999 2024-04-26T10:33:18.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:18.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996061+0000", 2024-04-26T10:33:18.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8690000000000003e-06 2024-04-26T10:33:18.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008974+0000", 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012913127 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009078+0000", 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010333899999999999 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009193+0000", 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011555100000000001 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011374+0000", 2024-04-26T10:33:18.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002180642 2024-04-26T10:33:18.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012202+0000", 2024-04-26T10:33:18.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00082862099999999998 2024-04-26T10:33:18.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012254+0000", 2024-04-26T10:33:18.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1498000000000001e-05 2024-04-26T10:33:18.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012292+0000", 2024-04-26T10:33:18.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8071999999999997e-05 2024-04-26T10:33:18.513 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.513 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.513 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.513 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994260+0000", 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.385913229, 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01408387, 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994260+0000", 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994260+0000", 2024-04-26T10:33:18.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994260+0000", 2024-04-26T10:33:18.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994273+0000", 2024-04-26T10:33:18.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3309000000000001e-05 2024-04-26T10:33:18.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994282+0000", 2024-04-26T10:33:18.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8750000000000006e-06 2024-04-26T10:33:18.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994288+0000", 2024-04-26T10:33:18.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6579999999999999e-06 2024-04-26T10:33:18.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994365+0000", 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7428000000000005e-05 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994372+0000", 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2309999999999999e-06 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.001531+0000", 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071590229999999996 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.001656+0000", 2024-04-26T10:33:18.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012448400000000001 2024-04-26T10:33:18.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:18.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.001803+0000", 2024-04-26T10:33:18.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000147467 2024-04-26T10:33:18.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:18.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007861+0000", 2024-04-26T10:33:18.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.006057766 2024-04-26T10:33:18.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008254+0000", 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000393058 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008303+0000", 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9073999999999998e-05 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008344+0000", 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0878999999999999e-05 2024-04-26T10:33:18.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.385872776999999, 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017896868, 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:18.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:18.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:18.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:18.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:18.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:18.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994300+0000", 2024-04-26T10:33:18.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:18.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994303+0000", 2024-04-26T10:33:18.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.145e-06 2024-04-26T10:33:18.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:18.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994310+0000", 2024-04-26T10:33:18.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.345e-06 2024-04-26T10:33:18.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994317+0000", 2024-04-26T10:33:18.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9e-06 2024-04-26T10:33:18.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997746+0000", 2024-04-26T10:33:18.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034290190000000002 2024-04-26T10:33:18.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:18.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997753+0000", 2024-04-26T10:33:18.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2999999999999998e-06 2024-04-26T10:33:18.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:18.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007898+0000", 2024-04-26T10:33:18.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010145207 2024-04-26T10:33:18.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:18.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008073+0000", 2024-04-26T10:33:18.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017543800000000001 2024-04-26T10:33:18.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:18.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:18.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:18.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012197+0000", 2024-04-26T10:33:18.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041240950000000004 2024-04-26T10:33:18.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.527 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:18.527 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:18.527 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:18.528 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:18.527+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:18.530 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'reef'} 2024-04-26T10:33:18.530 DEBUG:teuthology.orchestra.run.smithi043:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=reef' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-26T10:33:18.530 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 1 16 4980 4964 310.232 310.25 0.00443176 0.00321522 2024-04-26T10:33:18.531 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:18.629 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:18.628+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:18.706 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:18.706 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:18.706 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.706 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:6500 5.e 5:74947509:::benchmark_data_smithi043_45180_object6499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:18.707 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.700364+0000", 2024-04-26T10:33:18.707 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0038292399999999998, 2024-04-26T10:33:18.707 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0038585949999999998, 2024-04-26T10:33:18.707 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:18.707 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:18.707 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:18.707 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:18.707 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:18.707 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 6500 2024-04-26T10:33:18.707 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.707 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:18.707 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.708 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:18.708 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.700364+0000", 2024-04-26T10:33:18.708 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.708 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.708 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.708 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:18.708 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.700364+0000", 2024-04-26T10:33:18.708 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.708 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.708 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.708 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:18.708 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.700364+0000", 2024-04-26T10:33:18.708 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.700426+0000", 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2453000000000007e-05 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.700438+0000", 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2206e-05 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.700446+0000", 2024-04-26T10:33:18.709 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7700000000000001e-06 2024-04-26T10:33:18.710 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.710 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.710 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:18.710 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.700478+0000", 2024-04-26T10:33:18.710 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2082999999999998e-05 2024-04-26T10:33:18.710 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.710 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.710 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:18.710 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.700561+0000", 2024-04-26T10:33:18.710 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2795999999999998e-05 2024-04-26T10:33:18.710 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.710 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.710 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.700649+0000", 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8591000000000006e-05 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.701423+0000", 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00077352900000000001 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:6507 5.b 5:dc4c2ba8:::benchmark_data_smithi043_45180_object6506:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:18.711 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.701967+0000", 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0022264720000000002, 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002413887, 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 6507 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.701967+0000", 2024-04-26T10:33:18.712 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.701967+0000", 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.701966+0000", 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702055+0000", 2024-04-26T10:33:18.713 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8140999999999995e-05 2024-04-26T10:33:18.714 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.714 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.714 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:18.714 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702067+0000", 2024-04-26T10:33:18.714 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2906e-05 2024-04-26T10:33:18.714 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.714 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.714 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.714 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702077+0000", 2024-04-26T10:33:18.714 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3249999999999997e-06 2024-04-26T10:33:18.714 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.714 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.714 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702116+0000", 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702194+0000", 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8288999999999995e-05 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702275+0000", 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0541e-05 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.715 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.716 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:18.716 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702936+0000", 2024-04-26T10:33:18.716 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00066176199999999998 2024-04-26T10:33:18.716 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.716 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:18.716 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.716 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.716 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.716 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:6510 5.8 5:13967314:::benchmark_data_smithi043_45180_object6509:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:18.716 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.702095+0000", 2024-04-26T10:33:18.716 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.002099138, 2024-04-26T10:33:18.716 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0023833309999999998, 2024-04-26T10:33:18.716 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 6510 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702095+0000", 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:18.717 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702095+0000", 2024-04-26T10:33:18.718 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.718 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.718 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.718 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:18.718 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702094+0000", 2024-04-26T10:33:18.718 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.718 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.718 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.718 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:18.718 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702202+0000", 2024-04-26T10:33:18.718 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000108362 2024-04-26T10:33:18.718 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702212+0000", 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5410000000000006e-06 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702219+0000", 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9079999999999998e-06 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702244+0000", 2024-04-26T10:33:18.719 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5731000000000001e-05 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702316+0000", 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1913000000000001e-05 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702412+0000", 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5565999999999999e-05 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:18.720 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.703500+0000", 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001087969 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:6511 5.8 5:1078d12b:::benchmark_data_smithi043_45180_object6510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.702230+0000", 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0019639010000000001, 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0023743620000000001, 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:18.721 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 6511 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702230+0000", 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702230+0000", 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.722 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:18.723 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702229+0000", 2024-04-26T10:33:18.723 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.723 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.723 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.723 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:18.723 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702347+0000", 2024-04-26T10:33:18.723 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000117891 2024-04-26T10:33:18.723 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.723 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.723 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:18.723 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702358+0000", 2024-04-26T10:33:18.723 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1103e-05 2024-04-26T10:33:18.723 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702366+0000", 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2600000000000005e-06 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702857+0000", 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00049109900000000005 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702951+0000", 2024-04-26T10:33:18.724 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3579999999999995e-05 2024-04-26T10:33:18.725 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.725 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.725 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:18.725 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.703081+0000", 2024-04-26T10:33:18.725 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000129691 2024-04-26T10:33:18.725 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.725 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.725 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:18.725 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.703797+0000", 2024-04-26T10:33:18.725 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00071652900000000004 2024-04-26T10:33:18.725 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.725 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:18.725 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.726 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.726 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.726 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:6512 5.0 5:03de9281:::benchmark_data_smithi043_45180_object6511:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:18.726 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.702375+0000", 2024-04-26T10:33:18.726 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001818989, 2024-04-26T10:33:18.726 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0023917019999999999, 2024-04-26T10:33:18.726 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:18.726 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:18.726 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:18.726 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:18.726 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:18.726 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 6512 2024-04-26T10:33:18.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.727 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:18.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:18.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702375+0000", 2024-04-26T10:33:18.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:18.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702375+0000", 2024-04-26T10:33:18.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:18.731 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702374+0000", 2024-04-26T10:33:18.731 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:18.731 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702454+0000", 2024-04-26T10:33:18.731 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9599999999999997e-05 2024-04-26T10:33:18.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702463+0000", 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6269999999999995e-06 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702470+0000", 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.72e-06 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702845+0000", 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00037459 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:18.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.702954+0000", 2024-04-26T10:33:18.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000109882 2024-04-26T10:33:18.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:18.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.703039+0000", 2024-04-26T10:33:18.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4790999999999995e-05 2024-04-26T10:33:18.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:18.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.703781+0000", 2024-04-26T10:33:18.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00074215999999999996 2024-04-26T10:33:18.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.734 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:18.734 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704688+0000", 2024-04-26T10:33:18.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090691100000000005 2024-04-26T10:33:18.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.734 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:18.734 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704730+0000", 2024-04-26T10:33:18.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1578000000000001e-05 2024-04-26T10:33:18.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.734 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704768+0000", 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7734000000000002e-05 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:6515 5.d 5:b2aa79fd:::benchmark_data_smithi043_45180_object6514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.703961+0000", 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00023242599999999999, 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00098762000000000003, 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:18.735 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 6515 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.703961+0000", 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.703961+0000", 2024-04-26T10:33:18.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.703960+0000", 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704034+0000", 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4166999999999996e-05 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:18.737 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704047+0000", 2024-04-26T10:33:18.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2398000000000001e-05 2024-04-26T10:33:18.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704055+0000", 2024-04-26T10:33:18.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5420000000000005e-06 2024-04-26T10:33:18.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:18.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704093+0000", 2024-04-26T10:33:18.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7626000000000002e-05 2024-04-26T10:33:18.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704171+0000", 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7791000000000001e-05 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704252+0000", 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1427999999999994e-05 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704929+0000", 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00067662400000000002 2024-04-26T10:33:18.739 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:6516 5.b 5:dc6f2e95:::benchmark_data_smithi043_45180_object6515:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.704300+0000", 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4294967295.9998932, 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00074664700000000002, 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:18.740 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 6516 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704300+0000", 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704300+0000", 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:18.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704300+0000", 2024-04-26T10:33:18.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.742 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:18.742 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704385+0000", 2024-04-26T10:33:18.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5458999999999996e-05 2024-04-26T10:33:18.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.742 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:18.742 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704392+0000", 2024-04-26T10:33:18.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6619999999999999e-06 2024-04-26T10:33:18.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704396+0000", 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.605e-06 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704437+0000", 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0111000000000003e-05 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704573+0000", 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013672000000000001 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704674+0000", 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100394 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:6517 5.e 5:76884785:::benchmark_data_smithi043_45180_object6516:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.704564+0000", 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4294967295.9996295, 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00063079399999999995, 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:18.744 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 6517 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704564+0000", 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704564+0000", 2024-04-26T10:33:18.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704564+0000", 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704637+0000", 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3397000000000002e-05 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:18.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704646+0000", 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7800000000000006e-06 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704653+0000", 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0310000000000001e-06 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704749+0000", 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6663999999999995e-05 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.747 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704863+0000", 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000113686 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704979+0000", 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011616 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:6518 5.0 5:002b2325:::benchmark_data_smithi043_45180_object6517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.704664+0000", 2024-04-26T10:33:18.748 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4294967295.9995294, 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00067770600000000003, 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 6518 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704664+0000", 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704664+0000", 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704664+0000", 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704694+0000", 2024-04-26T10:33:18.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0022000000000002e-05 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704702+0000", 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2269999999999993e-06 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704709+0000", 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0600000000000002e-06 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.704968+0000", 2024-04-26T10:33:18.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00025878799999999998 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.705080+0000", 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000111669 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.705224+0000", 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000144809 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.752 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:18.753 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:33:18.753 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 9 2024-04-26T10:33:18.753 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:18.754 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:18.755 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:18.752+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:18.855 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:18.853+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:18.955 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:18.954+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:18.975 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:18.975 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:33:18.975 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:33:18.975 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:33:18.975 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:18.989 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:19.057 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:19.055+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:19.157 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:19.156+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:19.177 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:19.177 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:33:19.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:33:19.177 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:19.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.177 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:19.177 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994163+0000", 2024-04-26T10:33:19.177 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.180254380000001, 2024-04-26T10:33:19.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014381321000000001, 2024-04-26T10:33:19.177 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.177 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994163+0000", 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994163+0000", 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.178 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994161+0000", 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999981 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994172+0000", 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0889e-05 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994201+0000", 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9059000000000001e-05 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994242+0000", 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1121000000000002e-05 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994597+0000", 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00035472299999999998 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994769+0000", 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000172139 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994938+0000", 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0001694 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998089+0000", 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0031503640000000001 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008433+0000", 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010344020000000001 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008492+0000", 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9370999999999998e-05 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008544+0000", 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2030999999999997e-05 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.182 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994299+0000", 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.180118071999999, 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014404745, 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994299+0000", 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994299+0000", 2024-04-26T10:33:19.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.184 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.184 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994298+0000", 2024-04-26T10:33:19.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:19.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.184 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.184 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994305+0000", 2024-04-26T10:33:19.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.063e-06 2024-04-26T10:33:19.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994328+0000", 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2819e-05 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994345+0000", 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6952e-05 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994863+0000", 2024-04-26T10:33:19.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000518192 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994990+0000", 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000126802 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995146+0000", 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015556700000000001 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:19.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998096+0000", 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0029506799999999998 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008616+0000", 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010520102999999999 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008664+0000", 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7219000000000003e-05 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008704+0000", 2024-04-26T10:33:19.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0330000000000002e-05 2024-04-26T10:33:19.188 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.188 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.188 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.188 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:17 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:19.188 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994833+0000", 2024-04-26T10:33:19.188 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.179584542000001, 2024-04-26T10:33:19.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014019953999999999, 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994833+0000", 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994833+0000", 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994832+0000", 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994845+0000", 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3159999999999999e-05 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994855+0000", 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0045e-05 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994863+0000", 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1750000000000005e-06 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995186+0000", 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00032241399999999998 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995240+0000", 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4054000000000001e-05 2024-04-26T10:33:19.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995318+0000", 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8665999999999995e-05 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998102+0000", 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027840830000000001 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008616+0000", 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010513623999999999 2024-04-26T10:33:19.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008663+0000", 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7172000000000002e-05 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008853+0000", 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00018943200000000001 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:18 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.179547951, 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014077793999999999, 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994874+0000", 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5509999999999999e-06 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994881+0000", 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8979999999999999e-06 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994889+0000", 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995378+0000", 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00048941399999999997 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995429+0000", 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0878000000000003e-05 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995513+0000", 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4412000000000004e-05 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998109+0000", 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0025955319999999998 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008861+0000", 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010752421999999999 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008909+0000", 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7788999999999999e-05 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008947+0000", 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7888e-05 2024-04-26T10:33:19.198 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994894+0000", 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.17952343, 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013916404, 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994894+0000", 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994894+0000", 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994893+0000", 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994897+0000", 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7299999999999999e-06 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994904+0000", 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6270000000000002e-06 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994909+0000", 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6760000000000004e-06 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996220+0000", 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001310192 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996370+0000", 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015071099999999999 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996516+0000", 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014541200000000001 2024-04-26T10:33:19.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998074+0000", 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015584539999999999 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008719+0000", 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010645116 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008760+0000", 2024-04-26T10:33:19.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0284000000000003e-05 2024-04-26T10:33:19.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008810+0000", 2024-04-26T10:33:19.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0662999999999999e-05 2024-04-26T10:33:19.204 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.204 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.204 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.204 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:19.204 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.995975+0000", 2024-04-26T10:33:19.204 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.178442382, 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.01320091, 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995975+0000", 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995975+0000", 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995974+0000", 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995981+0000", 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0890000000000002e-06 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996182+0000", 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000201101 2024-04-26T10:33:19.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996192+0000", 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.007e-05 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.997573+0000", 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001380799 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.997655+0000", 2024-04-26T10:33:19.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2196999999999999e-05 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.997812+0000", 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015662799999999999 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.000517+0000", 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027054539999999999 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.009094+0000", 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0085771470000000002 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.009142+0000", 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7237000000000002e-05 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.009176+0000", 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4053000000000001e-05 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.996202+0000", 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.178215093999999, 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013275234, 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996202+0000", 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996202+0000", 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996201+0000", 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996217+0000", 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5279000000000001e-05 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996226+0000", 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3500000000000003e-06 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996233+0000", 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8669999999999996e-06 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996275+0000", 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2261000000000001e-05 2024-04-26T10:33:19.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996410+0000", 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013463799999999999 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996553+0000", 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000143153 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.000187+0000", 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0036337880000000002 2024-04-26T10:33:19.213 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.009391+0000", 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0092038759999999997 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.009434+0000", 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.009477+0000", 2024-04-26T10:33:19.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3504999999999998e-05 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.996245+0000", 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.178172193000002, 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012253351000000001, 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996245+0000", 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996245+0000", 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996244+0000", 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996248+0000", 2024-04-26T10:33:19.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.053e-06 2024-04-26T10:33:19.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996255+0000", 2024-04-26T10:33:19.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8360000000000003e-06 2024-04-26T10:33:19.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996262+0000", 2024-04-26T10:33:19.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7410000000000003e-06 2024-04-26T10:33:19.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996349+0000", 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6724000000000005e-05 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996510+0000", 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00016152399999999999 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008498+0000", 2024-04-26T10:33:19.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.011988277 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.996272+0000", 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.178145104999999, 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0096662469999999993, 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996272+0000", 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996272+0000", 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996272+0000", 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996274+0000", 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7590000000000002e-06 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996282+0000", 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0419999999999997e-06 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996287+0000", 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2170000000000002e-06 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996388+0000", 2024-04-26T10:33:19.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100887 2024-04-26T10:33:19.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996513+0000", 2024-04-26T10:33:19.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000125031 2024-04-26T10:33:19.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.005938+0000", 2024-04-26T10:33:19.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0094257500000000001 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:260 5.0 5:0ce3243d:::benchmark_data_smithi043_45180_object259:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:17.480106+0000", 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.694310773, 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0091898310000000007, 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:19.223 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 260 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.480106+0000", 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.480106+0000", 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.480106+0000", 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.480166+0000", 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0551999999999999e-05 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.480180+0000", 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.382e-05 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.480185+0000", 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9470000000000002e-06 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.482057+0000", 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001872166 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.482135+0000", 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7238999999999997e-05 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.482220+0000", 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5012000000000005e-05 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.484768+0000", 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0025487410000000002 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.489233+0000", 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0044647929999999999 2024-04-26T10:33:19.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.489268+0000", 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5349000000000003e-05 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.489296+0000", 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7892999999999999e-05 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:1708 5.d 5:bbe7e03e:::benchmark_data_smithi043_45180_object1707:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:17.786613+0000", 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.387803916, 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012954663999999999, 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 1708 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786613+0000", 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786613+0000", 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786613+0000", 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786729+0000", 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011634299999999999 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786737+0000", 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1480000000000006e-06 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786742+0000", 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0309999999999998e-06 2024-04-26T10:33:19.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786778+0000", 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6155000000000002e-05 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786916+0000", 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013772 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.787051+0000", 2024-04-26T10:33:19.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000134666 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.787701+0000", 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00064989099999999999 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.799494+0000", 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.011793348 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.799536+0000", 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1526999999999997e-05 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.799568+0000", 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2468999999999997e-05 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:5892 5.0 5:043c8bce:::benchmark_data_smithi043_45180_object5891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.580753+0000", 2024-04-26T10:33:19.234 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.59366421899999999, 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012606622, 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 5892 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580753+0000", 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580753+0000", 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580753+0000", 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580826+0000", 2024-04-26T10:33:19.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3034999999999994e-05 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580832+0000", 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9499999999999998e-06 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580837+0000", 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1050000000000003e-06 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580882+0000", 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4919000000000001e-05 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581001+0000", 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000119312 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581147+0000", 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014619200000000001 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584159+0000", 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0030116840000000001 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593308+0000", 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0091495090000000001 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593338+0000", 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9447000000000001e-05 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593360+0000", 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1829000000000001e-05 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:5891 5.a e19/16 5:5d67d644:::benchmark_data_smithi043_45180_object5890:head v 19'423, mlcod=19'419)", 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.581507+0000", 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.59290998100000003, 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012306259999999999, 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581507+0000", 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581507+0000", 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581507+0000", 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581605+0000", 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8559000000000003e-05 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581612+0000", 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.489e-06 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581616+0000", 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:33:19.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581644+0000", 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.817e-05 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581656+0000", 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593782+0000", 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012125841 2024-04-26T10:33:19.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593814+0000", 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1652999999999997e-05 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:5898 5.0 5:06cc85ec:::benchmark_data_smithi043_45180_object5897:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.581664+0000", 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.59275341000000004, 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012175844999999999, 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.244 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 5898 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581664+0000", 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581664+0000", 2024-04-26T10:33:19.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581663+0000", 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581712+0000", 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8937999999999998e-05 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581720+0000", 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581727+0000", 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4980000000000003e-06 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581771+0000", 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4393e-05 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581911+0000", 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013961299999999999 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.582076+0000", 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00016489900000000001 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.585190+0000", 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0031140130000000001 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593763+0000", 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0085732550000000001 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593803+0000", 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0234000000000001e-05 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593840+0000", 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6318e-05 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.249 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.250 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.250 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:5899 5.b 5:dd0bd524:::benchmark_data_smithi043_45180_object5898:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:19.250 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.581834+0000", 2024-04-26T10:33:19.250 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.59258336, 2024-04-26T10:33:19.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012104335000000001, 2024-04-26T10:33:19.250 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.250 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.250 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:19.250 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:19.250 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:19.250 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 5899 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581834+0000", 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581834+0000", 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581833+0000", 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581904+0000", 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0687999999999998e-05 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581912+0000", 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0430000000000008e-06 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581919+0000", 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.678e-06 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581958+0000", 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8380999999999997e-05 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.582052+0000", 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3790999999999997e-05 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.582162+0000", 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000110339 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584579+0000", 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0024170020000000001 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593880+0000", 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00930134 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593917+0000", 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7083999999999999e-05 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593938+0000", 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0931999999999999e-05 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.255 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:5894 5.a e19/16 5:52763aef:::benchmark_data_smithi043_45180_object5893:head v 19'424, mlcod=19'421)", 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.582405+0000", 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.59201211899999995, 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.011434016999999999, 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.582405+0000", 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.582405+0000", 2024-04-26T10:33:19.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.582405+0000", 2024-04-26T10:33:19.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.582480+0000", 2024-04-26T10:33:19.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5238e-05 2024-04-26T10:33:19.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.582490+0000", 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0224000000000001e-05 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.582498+0000", 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7940000000000003e-06 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.582532+0000", 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4073999999999999e-05 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.582544+0000", 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2334000000000001e-05 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593818+0000", 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.011273455 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593839+0000", 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1518999999999998e-05 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.259 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:5900 5.a e19/16 5:5bc10c46:::benchmark_data_smithi043_45180_object5899:head v 19'425, mlcod=19'421)", 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.584264+0000", 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.59015324199999997, 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0096107610000000007, 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584264+0000", 2024-04-26T10:33:19.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584264+0000", 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584264+0000", 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.261 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584404+0000", 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014088800000000001 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584413+0000", 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4370000000000007e-06 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584417+0000", 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4390000000000002e-06 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584445+0000", 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7662999999999999e-05 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584463+0000", 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7734999999999999e-05 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593841+0000", 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0093779899999999992 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593875+0000", 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4059e-05 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:5906 5.0 5:076f7a14:::benchmark_data_smithi043_45180_object5905:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.584343+0000", 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.59007435100000005, 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0096006000000000008, 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.264 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 5906 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584343+0000", 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584343+0000", 2024-04-26T10:33:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584342+0000", 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584411+0000", 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8436999999999995e-05 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584416+0000", 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.989e-06 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584420+0000", 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7589999999999999e-06 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584457+0000", 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7391000000000002e-05 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584603+0000", 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014577599999999999 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584708+0000", 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000105345 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.585763+0000", 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00105532 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:19.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593847+0000", 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0080834930000000006 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593902+0000", 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5346999999999997e-05 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593943+0000", 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1226000000000001e-05 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:5901 5.a e19/16 5:5a6aec66:::benchmark_data_smithi043_45180_object5900:head v 19'426, mlcod=19'421)", 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.584785+0000", 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.58963185900000004, 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0091123049999999994, 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584785+0000", 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584785+0000", 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584785+0000", 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584856+0000", 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0953999999999999e-05 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584865+0000", 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.4909999999999994e-06 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584872+0000", 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7240000000000003e-06 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584904+0000", 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1727000000000003e-05 2024-04-26T10:33:19.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584921+0000", 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6721000000000001e-05 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593877+0000", 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0089564580000000005 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593898+0000", 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.073e-05 2024-04-26T10:33:19.273 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:5904 5.a e19/16 5:5b6c0c34:::benchmark_data_smithi043_45180_object5903:head v 19'427, mlcod=19'421)", 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.585526+0000", 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.58889104699999995, 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.008394627, 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:19.274 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.585526+0000", 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.585526+0000", 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.585526+0000", 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:19.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.585556+0000", 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0069e-05 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.585573+0000", 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.73e-05 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.585581+0000", 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7069999999999992e-06 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.585618+0000", 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7246000000000002e-05 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.585633+0000", 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5486999999999999e-05 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593899+0000", 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0082660460000000009 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:19.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:19.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593921+0000", 2024-04-26T10:33:19.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1401000000000001e-05 2024-04-26T10:33:19.278 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.278 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.278 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.278 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:19.278 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:19.278 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:19.280 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-04-26T10:33:19.281 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:19.281 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:19.278+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:19.325 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:33:19.380 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:19.379+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:19.417 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 2 16 9807 9791 305.949 301.688 0.00179995 0.00326476 2024-04-26T10:33:19.420 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-26T10:33:19.420 INFO:teuthology.orchestra.run.smithi043.stdout: "ops": [ 2024-04-26T10:33:19.420 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.420 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9791, 2024-04-26T10:33:19.420 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.a30f5e97", 2024-04-26T10:33:19.420 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:33:19.420 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9790", 2024-04-26T10:33:19.420 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.420 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9790", 2024-04-26T10:33:19.420 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.420 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.420 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.421 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.421 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.718500s", 2024-04-26T10:33:19.421 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0059999229999999999, 2024-04-26T10:33:19.421 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.421 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.421 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.421 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.414072+0000", 2024-04-26T10:33:19.421 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.421 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.421 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.421 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.421 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.421 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9794, 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.10480b42", 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9793", 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9793", 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.720500s", 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.003999949, 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.422 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.415156+0000", 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9796, 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.5d2c91c7", 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9795", 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.423 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9795", 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.720500s", 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.003999949, 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.415222+0000", 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.424 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9805, 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.98681591", 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9804", 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9804", 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.721500s", 2024-04-26T10:33:19.425 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999620000000001, 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.416829+0000", 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9795, 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.8b6cbffe", 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:33:19.426 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9794", 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9794", 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.720500s", 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.003999949, 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.415162+0000", 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.427 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9801, 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.963a5fbe", 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9800", 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9800", 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.428 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.721500s", 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999620000000001, 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.416220+0000", 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9803, 2024-04-26T10:33:19.429 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.adf87efb", 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9802", 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9802", 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.721500s", 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999620000000001, 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.430 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.416488+0000", 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9804, 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.cd4263d0", 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9803", 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9803", 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.431 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.721500s", 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999620000000001, 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.416494+0000", 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9808, 2024-04-26T10:33:19.432 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.e68475a8", 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9807", 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9807", 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.722500s", 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0019999739999999998, 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.433 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.417291+0000", 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9809, 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.8ab1a02b", 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9808", 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9808", 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.434 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.723500s", 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.00099998699999999992, 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.418315+0000", 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.435 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9797, 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.f1a3685a", 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9796", 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9796", 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.720500s", 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.003999949, 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.436 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.415393+0000", 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9799, 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.3698f2c6", 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9798", 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9798", 2024-04-26T10:33:19.437 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.720500s", 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.003999949, 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.415705+0000", 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.438 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9800, 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.ec3709ea", 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9799", 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9799", 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.721500s", 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999620000000001, 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.439 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.416211+0000", 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9802, 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.aa670e3c", 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9801", 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.440 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9801", 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.721500s", 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999620000000001, 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.416397+0000", 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.441 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9807, 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.97bf639c", 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9806", 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9806", 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.721500s", 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.0029999620000000001, 2024-04-26T10:33:19.442 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.416946+0000", 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: "tid": 9810, 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: "pg": "5.a87194e3", 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: "object_id": "benchmark_data_smithi043_45180_object9809", 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: "object_locator": "@5", 2024-04-26T10:33:19.443 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_id": "benchmark_data_smithi043_45180_object9809", 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: "target_object_locator": "@5", 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: "paused": 0, 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: "used_replica": 0, 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: "precalc_pgid": 0, 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: "last_sent": "2879.723500s", 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: "age": 0.00099998699999999992, 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: "attempts": 1, 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: "snapid": "head", 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_context": "0=[]", 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: "mtime": "2024-04-26T10:33:19.418552+0000", 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_ops": [ 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: "write 0~65536 in=65536b" 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:19.444 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:19.445 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:33:19.445 INFO:teuthology.orchestra.run.smithi043.stdout: "linger_ops": [], 2024-04-26T10:33:19.445 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_ops": [], 2024-04-26T10:33:19.445 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_stat_ops": [], 2024-04-26T10:33:19.445 INFO:teuthology.orchestra.run.smithi043.stdout: "statfs_ops": [], 2024-04-26T10:33:19.445 INFO:teuthology.orchestra.run.smithi043.stdout: "command_ops": [] 2024-04-26T10:33:19.445 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-26T10:33:19.446 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 9791, "pg": "5.a30f5e97", "osd": 0, "object_id": "benchmark_data_smithi043_45180_object9790", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9790", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.718500s", "age": 0.0059999229999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.414072+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9794, "pg": "5.10480b42", "osd": 0, "object_id": "benchmark_data_smithi043_45180_object9793", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9793", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.720500s", "age": 0.003999949, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.415156+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9796, "pg": "5.5d2c91c7", "osd": 0, "object_id": "benchmark_data_smithi043_45180_object9795", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9795", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.720500s", "age": 0.003999949, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.415222+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9805, "pg": "5.98681591", "osd": 0, "object_id": "benchmark_data_smithi043_45180_object9804", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9804", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.721500s", "age": 0.0029999620000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.416829+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9795, "pg": "5.8b6cbffe", "osd": 1, "object_id": "benchmark_data_smithi043_45180_object9794", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9794", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.720500s", "age": 0.003999949, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.415162+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9801, "pg": "5.963a5fbe", "osd": 1, "object_id": "benchmark_data_smithi043_45180_object9800", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9800", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.721500s", "age": 0.0029999620000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.416220+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9803, "pg": "5.adf87efb", "osd": 1, "object_id": "benchmark_data_smithi043_45180_object9802", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9802", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.721500s", "age": 0.0029999620000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.416488+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9804, "pg": "5.cd4263d0", "osd": 1, "object_id": "benchmark_data_smithi043_45180_object9803", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9803", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.721500s", "age": 0.0029999620000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.416494+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9808, "pg": "5.e68475a8", "osd": 1, "object_id": "benchmark_data_smithi043_45180_object9807", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9807", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.722500s", "age": 0.0019999739999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.417291+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9809, "pg": "5.8ab1a02b", "osd": 1, "object_id": "benchmark_data_smithi043_45180_object9808", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9808", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.723500s", "age": 0.00099998699999999992, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.418315+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9797, "pg": "5.f1a3685a", "osd": 2, "object_id": "benchmark_data_smithi043_45180_object9796", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9796", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.720500s", "age": 0.003999949, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.415393+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9799, "pg": "5.3698f2c6", "osd": 2, "object_id": "benchmark_data_smithi043_45180_object9798", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9798", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.720500s", "age": 0.003999949, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.415705+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9800, "pg": "5.ec3709ea", "osd": 2, "object_id": "benchmark_data_smithi043_45180_object9799", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9799", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.721500s", "age": 0.0029999620000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.416211+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9802, "pg": "5.aa670e3c", "osd": 2, "object_id": "benchmark_data_smithi043_45180_object9801", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9801", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.721500s", "age": 0.0029999620000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.416397+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9807, "pg": "5.97bf639c", "osd": 2, "object_id": "benchmark_data_smithi043_45180_object9806", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9806", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.721500s", "age": 0.0029999620000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.416946+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9810, "pg": "5.a87194e3", "osd": 2, "object_id": "benchmark_data_smithi043_45180_object9809", "object_locator": "@5", "target_object_id": "benchmark_data_smithi043_45180_object9809", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "2879.723500s", "age": 0.00099998699999999992, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:33:19.418552+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-04-26T10:33:19.446 DEBUG:teuthology.orchestra.run.smithi043:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-26T10:33:19.469 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:19.470 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:19.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.470 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:10004 5.0 e19/16 5:03cb94b3:::benchmark_data_smithi043_45180_object10003:head v 19'637, mlcod=19'633)", 2024-04-26T10:33:19.470 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.467736+0000", 2024-04-26T10:33:19.470 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00062277600000000002, 2024-04-26T10:33:19.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000650966, 2024-04-26T10:33:19.470 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:19.470 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:19.470 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:19.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:19.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467736+0000", 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467736+0000", 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467736+0000", 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:19.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467802+0000", 2024-04-26T10:33:19.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6333000000000003e-05 2024-04-26T10:33:19.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:19.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467809+0000", 2024-04-26T10:33:19.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4120000000000004e-06 2024-04-26T10:33:19.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467815+0000", 2024-04-26T10:33:19.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3510000000000001e-06 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467851+0000", 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6332999999999999e-05 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467870+0000", 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8940000000000002e-05 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:10005 5.5 5:a6b5668c:::benchmark_data_smithi043_45180_object10004:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.468040+0000", 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00031900500000000003, 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00044895299999999998, 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 10005 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:19.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.468040+0000", 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.468040+0000", 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.468039+0000", 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:19.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.468102+0000", 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2435999999999996e-05 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.468112+0000", 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0485999999999999e-05 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.468119+0000", 2024-04-26T10:33:19.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7909999999999999e-06 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.468156+0000", 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7379000000000002e-05 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.468250+0000", 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3772999999999998e-05 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:19.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.468335+0000", 2024-04-26T10:33:19.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4524999999999995e-05 2024-04-26T10:33:19.478 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.478 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:19.478 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.478 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:9998 5.3 5:cecc4403:::benchmark_data_smithi043_45180_object9997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:19.478 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.464439+0000", 2024-04-26T10:33:19.478 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0039195039999999999, 2024-04-26T10:33:19.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0041333339999999998, 2024-04-26T10:33:19.478 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:19.478 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:19.478 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 9998 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464439+0000", 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464439+0000", 2024-04-26T10:33:19.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464439+0000", 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464669+0000", 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023051500000000001 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464677+0000", 2024-04-26T10:33:19.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1410000000000005e-06 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464684+0000", 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6120000000000004e-06 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464723+0000", 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9168000000000002e-05 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:19.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464865+0000", 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000141586 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465028+0000", 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162998 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.468179+0000", 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031510919999999999 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:19.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:9993 5.0 e19/16 5:00b93044:::benchmark_data_smithi043_45180_object9992:head v 19'635, mlcod=19'632)", 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.464770+0000", 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.003588815, 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038476970000000002, 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464770+0000", 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464770+0000", 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464770+0000", 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464841+0000", 2024-04-26T10:33:19.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1330999999999999e-05 2024-04-26T10:33:19.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:19.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464849+0000", 2024-04-26T10:33:19.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0350000000000001e-06 2024-04-26T10:33:19.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464855+0000", 2024-04-26T10:33:19.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0299999999999999e-06 2024-04-26T10:33:19.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464911+0000", 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.588e-05 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464929+0000", 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7832000000000001e-05 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:9996 5.4 e19/16 5:20e29adc:::benchmark_data_smithi043_45180_object9995:head v 19'623, mlcod=19'621)", 2024-04-26T10:33:19.486 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.464861+0000", 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.003497956, 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003797258, 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464861+0000", 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464861+0000", 2024-04-26T10:33:19.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464861+0000", 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464917+0000", 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6023000000000002e-05 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:19.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464924+0000", 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464930+0000", 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.088e-06 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464961+0000", 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0783e-05 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:19.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.464979+0000", 2024-04-26T10:33:19.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8597000000000002e-05 2024-04-26T10:33:19.490 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.490 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:19.490 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.490 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:9990 5.7 e19/16 5:e06a3a49:::benchmark_data_smithi043_45180_object9989:head v 19'564, mlcod=19'561)", 2024-04-26T10:33:19.490 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.465193+0000", 2024-04-26T10:33:19.490 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0031657439999999998, 2024-04-26T10:33:19.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034983290000000001, 2024-04-26T10:33:19.490 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:19.490 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465193+0000", 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465193+0000", 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465193+0000", 2024-04-26T10:33:19.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465236+0000", 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3075999999999999e-05 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465247+0000", 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0968000000000001e-05 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465254+0000", 2024-04-26T10:33:19.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.661e-06 2024-04-26T10:33:19.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:19.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465335+0000", 2024-04-26T10:33:19.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0350000000000001e-05 2024-04-26T10:33:19.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:19.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465351+0000", 2024-04-26T10:33:19.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5851000000000001e-05 2024-04-26T10:33:19.493 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.493 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:9994 5.8 e19/16 5:18530970:::benchmark_data_smithi043_45180_object9993:head v 19'630, mlcod=19'627)", 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.465663+0000", 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0026960869999999998, 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003061252, 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465663+0000", 2024-04-26T10:33:19.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465663+0000", 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465662+0000", 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465687+0000", 2024-04-26T10:33:19.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4164000000000001e-05 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465693+0000", 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1920000000000002e-06 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465697+0000", 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0589999999999996e-06 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:19.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465725+0000", 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8053000000000001e-05 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465736+0000", 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1226000000000001e-05 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:10001 5.b e19/16 5:dcdd4c3c:::benchmark_data_smithi043_45180_object10000:head v 19'623, mlcod=19'620)", 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.465705+0000", 2024-04-26T10:33:19.497 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0026542829999999999, 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003054003, 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465705+0000", 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465705+0000", 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465704+0000", 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465731+0000", 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6769999999999999e-05 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465735+0000", 2024-04-26T10:33:19.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1219999999999997e-06 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465738+0000", 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9909999999999998e-06 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465768+0000", 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0037000000000001e-05 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:19.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465787+0000", 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8839999999999999e-05 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:9997 5.0 e19/16 5:058dca11:::benchmark_data_smithi043_45180_object9996:head v 19'636, mlcod=19'632)", 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.465743+0000", 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0026155200000000001, 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030493600000000001, 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465743+0000", 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465743+0000", 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465743+0000", 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465792+0000", 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8573999999999999e-05 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465799+0000", 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7530000000000001e-06 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465805+0000", 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3750000000000002e-06 2024-04-26T10:33:19.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465832+0000", 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7453999999999998e-05 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465848+0000", 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5868000000000001e-05 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:9999 5.7 e19/16 5:e6ef8287:::benchmark_data_smithi043_45180_object9998:head v 19'565, mlcod=19'561)", 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.465783+0000", 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0025762889999999998, 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030430359999999998, 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465783+0000", 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:19.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465783+0000", 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465782+0000", 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465845+0000", 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3448000000000006e-05 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465858+0000", 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2724e-05 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465865+0000", 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4690000000000002e-06 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465895+0000", 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0592000000000001e-05 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.465911+0000", 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5519000000000002e-05 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:10000 5.7 e19/16 5:e4845d75:::benchmark_data_smithi043_45180_object9999:head v 19'566, mlcod=19'561)", 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.466374+0000", 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0019853380000000001, 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024876770000000002, 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:19.508 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.466374+0000", 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.466374+0000", 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.466373+0000", 2024-04-26T10:33:19.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.466438+0000", 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5071000000000001e-05 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.466445+0000", 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.426e-06 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.466450+0000", 2024-04-26T10:33:19.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3290000000000001e-06 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.466477+0000", 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6809999999999999e-05 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.466494+0000", 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7487999999999999e-05 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:10002 5.a 5:59f60f84:::benchmark_data_smithi043_45180_object10001:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.466990+0000", 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0013692349999999999, 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019068010000000001, 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 10002 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:19.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.466990+0000", 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.466990+0000", 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.466989+0000", 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:19.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467061+0000", 2024-04-26T10:33:19.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2507000000000002e-05 2024-04-26T10:33:19.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:19.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467069+0000", 2024-04-26T10:33:19.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9319999999999996e-06 2024-04-26T10:33:19.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467074+0000", 2024-04-26T10:33:19.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4299999999999997e-06 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467101+0000", 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6900999999999999e-05 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467198+0000", 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6958000000000002e-05 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467280+0000", 2024-04-26T10:33:19.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1936999999999998e-05 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.468520+0000", 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012397280000000001 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:10003 5.1 e19/16 5:859a0731:::benchmark_data_smithi043_45180_object10002:head v 19'617, mlcod=19'614)", 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.467637+0000", 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00072176499999999997, 2024-04-26T10:33:19.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013021619999999999, 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467637+0000", 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467637+0000", 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467637+0000", 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467693+0000", 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6403999999999997e-05 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467701+0000", 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5700000000000004e-06 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467706+0000", 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6810000000000003e-06 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467733+0000", 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6738e-05 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.467745+0000", 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.173e-05 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.519 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:19.520 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.520 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:19.520 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:33:19.520 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 13 2024-04-26T10:33:19.520 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:19.521 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:19.522 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:19.523 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:19.519+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:19.523 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-04-26T10:33:19.523 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:19.534 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:19.536 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:19.536 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:19.536 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:19.542 DEBUG:teuthology.parallel:result is None 2024-04-26T10:33:19.546 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-04-26T10:33:19.555 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-04-26T10:33:19.555 INFO:teuthology.orchestra.run:waiting for 2100 2024-04-26T10:33:19.622 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:19.621+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:19.723 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:19.721+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:19.750 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:19.751 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:19.766 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:19.824 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:19.823+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:19.925 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:19.923+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:19.990 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:19.991 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:20.004 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:20.025 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:20.024+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:20.038 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:33:20.038 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:33:20.038 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T10:33:20.038 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T10:33:20.126 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:20.124+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:20.176 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:20.176 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:20.188 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:20.232 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:20.230+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:20.328 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:20.326+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:20.362 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:20.362 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:20.362 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:33:20.376 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:20.402 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:20.402 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-26T10:33:20.403 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 19, 2024-04-26T10:33:20.403 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "6d35b773-83ef-4e54-be62-89cec0b09327", 2024-04-26T10:33:20.403 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-04-26T10:32:36.651799+0000", 2024-04-26T10:33:20.403 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-04-26T10:33:18.340302+0000", 2024-04-26T10:33:20.403 INFO:teuthology.orchestra.run.smithi043.stdout: "last_up_change": "2024-04-26T10:32:44.545583+0000", 2024-04-26T10:33:20.403 INFO:teuthology.orchestra.run.smithi043.stdout: "last_in_change": "2024-04-26T10:32:37.588200+0000", 2024-04-26T10:33:20.403 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T10:33:20.403 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_num": 5806080, 2024-04-26T10:33:20.403 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_set": [ 2024-04-26T10:33:20.403 INFO:teuthology.orchestra.run.smithi043.stdout: "nodeep-scrub", 2024-04-26T10:33:20.403 INFO:teuthology.orchestra.run.smithi043.stdout: "noscrub", 2024-04-26T10:33:20.403 INFO:teuthology.orchestra.run.smithi043.stdout: "pglog_hardlimit", 2024-04-26T10:33:20.403 INFO:teuthology.orchestra.run.smithi043.stdout: "purged_snapdirs", 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_deletes", 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "sortbitwise" 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_version": 4, 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_snapshot": "", 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_max": 5, 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd": 3, 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "require_min_compat_client": "luminous", 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "min_compat_client": "jewel", 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "require_osd_release": "reef", 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_crimson": false, 2024-04-26T10:33:20.404 INFO:teuthology.orchestra.run.smithi043.stdout: "pools": [ 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 1, 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": ".mgr", 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.037545+0000", 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:20.405 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 1, 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 1, 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 1, 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 1, 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 1, 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:20.406 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:20.407 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:20.408 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:20.408 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:20.408 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:20.408 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:20.408 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:20.408 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:20.408 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:20.408 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:20.408 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:20.408 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:20.408 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:20.408 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:20.408 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:20.409 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.409 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:20.409 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:20.409 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:20.409 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:20.409 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:20.409 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:20.409 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:20.409 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:20.409 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:20.410 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:20.410 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:20.410 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:33:20.410 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_max": 32, 2024-04-26T10:33:20.410 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 1 2024-04-26T10:33:20.410 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.410 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:20.410 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": {} 2024-04-26T10:33:20.410 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.410 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:20.410 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 2.9900000095367432, 2024-04-26T10:33:20.410 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 2.9900000095367432, 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 2, 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 2, 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 2, 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "rbd", 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.393201+0000", 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:20.411 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 8, 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 8, 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 8, 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 8, 2024-04-26T10:33:20.412 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 8, 2024-04-26T10:33:20.413 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:20.413 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:20.413 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:20.413 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:20.413 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:20.413 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:20.413 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:20.413 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.413 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:33:20.413 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:20.413 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:20.413 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:20.413 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:20.414 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:20.414 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:20.414 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:20.414 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:20.414 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:20.414 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:20.414 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:20.414 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:20.414 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:20.414 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:20.414 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:20.414 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:20.415 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:20.415 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:20.415 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:20.415 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:20.415 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:20.415 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:20.415 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:20.415 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:20.415 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:20.415 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:20.415 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.415 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:20.415 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:20.416 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:20.416 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:20.416 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:20.416 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:20.416 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:20.416 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:20.416 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:20.416 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:20.416 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:20.416 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:33:20.416 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:20.416 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd": {} 2024-04-26T10:33:20.417 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.417 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:20.417 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.5, 2024-04-26T10:33:20.417 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.5, 2024-04-26T10:33:20.417 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:33:20.417 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.5, 2024-04-26T10:33:20.417 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.5, 2024-04-26T10:33:20.417 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:20.417 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:20.417 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:20.417 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.417 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.417 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.418 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 3, 2024-04-26T10:33:20.418 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_metadata", 2024-04-26T10:33:20.418 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:49.859710+0000", 2024-04-26T10:33:20.418 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:20.418 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:20.418 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:20.418 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:20.418 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:20.418 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:20.418 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:20.418 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:20.418 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:20.418 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:20.419 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:20.419 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:20.419 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 32, 2024-04-26T10:33:20.419 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 32, 2024-04-26T10:33:20.419 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 32, 2024-04-26T10:33:20.419 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 32, 2024-04-26T10:33:20.419 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 32, 2024-04-26T10:33:20.419 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:20.419 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:20.419 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:20.419 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:20.419 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "14", 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:20.420 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:20.421 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:20.421 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:20.421 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:20.421 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:20.421 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:20.421 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:20.421 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:20.421 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:20.421 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:20.421 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:20.421 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:20.421 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:20.421 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:20.422 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:20.422 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:20.422 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.422 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:20.422 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:20.422 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:20.422 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:20.422 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:20.422 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:20.422 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:20.422 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:20.422 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:20.422 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_bias": 4, 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 16, 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_priority": 5 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": "cephfs" 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:33:20.423 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 4, 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_data", 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:50.968196+0000", 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:20.424 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 64, 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 64, 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 64, 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 64, 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 64, 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:20.425 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "15", 2024-04-26T10:33:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:20.426 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:20.427 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:20.428 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:20.428 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:20.428 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:20.428 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:20.428 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:20.428 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:20.428 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.428 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:20.428 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:20.428 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:20.428 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:20.428 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:20.428 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:20.429 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:20.429 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:20.429 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:20.429 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:20.429 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:20.429 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:33:20.429 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 64, 2024-04-26T10:33:20.429 INFO:teuthology.orchestra.run.smithi043.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T10:33:20.429 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.429 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:20.429 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:33:20.429 INFO:teuthology.orchestra.run.smithi043.stdout: "data": "cephfs" 2024-04-26T10:33:20.430 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.430 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.430 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:20.430 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:33:20.430 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:33:20.430 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:33:20.430 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:33:20.430 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:33:20.430 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:20.430 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:20.430 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:20.430 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.430 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 5, 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "unique_pool_0", 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:33:15.284422+0000", 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:20.431 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 16, 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 16, 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 16, 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 16, 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 16, 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:20.432 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.433 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "18", 2024-04-26T10:33:20.433 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:20.433 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:20.433 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:20.433 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:20.433 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:20.433 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:20.433 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:20.433 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:20.433 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:20.433 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:20.433 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:20.434 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:33:20.435 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: "rados": {} 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.436 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "32399f03-8160-43f7-a69f-1db73f105676", 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 16, 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:33:20.437 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6800", 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6801", 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.438 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6802", 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6803", 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.439 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6806", 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6807", 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.440 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6804", 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6805", 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.441 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.112:6801/41771", 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.112:6803/41771", 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.112:6807/41771", 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.112:6805/41771", 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "89e46a83-bfff-458f-bbac-258edb6ddad2", 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:33:20.442 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 16, 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6800", 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:20.443 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6801", 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6802", 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:20.444 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6803", 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6806", 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:20.445 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.446 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.446 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:20.446 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6807", 2024-04-26T10:33:20.446 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:20.446 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.446 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.446 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.446 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:33:20.446 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:20.446 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.446 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:20.446 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6804", 2024-04-26T10:33:20.446 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6805", 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.186:6801/41804", 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.186:6803/41804", 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.186:6807/41804", 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.186:6805/41804", 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:33:20.447 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "24c9e06d-1386-4075-b64e-d6c1d57c57bb", 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 16, 2024-04-26T10:33:20.448 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6800", 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6801", 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.449 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6802", 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6803", 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.450 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6806", 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6807", 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.451 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6804", 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6805", 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.452 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.187:6801/41919", 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.187:6803/41919", 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.187:6807/41919", 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.187:6805/41919", 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_xinfo": [ 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:33:20.453 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.579572+0000", 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.596783+0000", 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:33:20.454 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.632883+0000", 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap": [], 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_items": [], 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_primaries": [], 2024-04-26T10:33:20.455 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_temp": [], 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_temp": [], 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklist": {}, 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "range_blocklist": {}, 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profiles": { 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "default": { 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-failure-domain": "osd", 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "k": "2", 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "m": "1", 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin": "jerasure", 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "technique": "reed_sol_van" 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps_queue": [], 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "new_removed_snaps": [], 2024-04-26T10:33:20.456 INFO:teuthology.orchestra.run.smithi043.stdout: "new_purged_snaps": [], 2024-04-26T10:33:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_node_flags": {}, 2024-04-26T10:33:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "device_class_flags": {}, 2024-04-26T10:33:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": { 2024-04-26T10:33:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_enabled": false, 2024-04-26T10:33:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_bucket_count": 0, 2024-04-26T10:33:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "degraded_stretch_mode": 0, 2024-04-26T10:33:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "recovering_stretch_mode": 0, 2024-04-26T10:33:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_bucket": 0 2024-04-26T10:33:20.457 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:20.457 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-26T10:33:20.459 INFO:tasks.thrashosds.thrasher:j is {'epoch': 19, 'fsid': '6d35b773-83ef-4e54-be62-89cec0b09327', 'created': '2024-04-26T10:32:36.651799+0000', 'modified': '2024-04-26T10:33:18.340302+0000', 'last_up_change': '2024-04-26T10:32:44.545583+0000', 'last_in_change': '2024-04-26T10:32:37.588200+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:32:45.037545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:32:45.393201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:32:49.859710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:32:50.968196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-26T10:33:15.284422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '32399f03-8160-43f7-a69f-1db73f105676', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 41771}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 41771}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 41771}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 41771}]}, 'public_addr': '172.21.15.112:6801/41771', 'cluster_addr': '172.21.15.112:6803/41771', 'heartbeat_back_addr': '172.21.15.112:6807/41771', 'heartbeat_front_addr': '172.21.15.112:6805/41771', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '89e46a83-bfff-458f-bbac-258edb6ddad2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6800', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6801', 'nonce': 41804}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6802', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6803', 'nonce': 41804}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6806', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6807', 'nonce': 41804}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6804', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6805', 'nonce': 41804}]}, 'public_addr': '172.21.15.186:6801/41804', 'cluster_addr': '172.21.15.186:6803/41804', 'heartbeat_back_addr': '172.21.15.186:6807/41804', 'heartbeat_front_addr': '172.21.15.186:6805/41804', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '24c9e06d-1386-4075-b64e-d6c1d57c57bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 41919}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 41919}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 41919}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 41919}]}, 'public_addr': '172.21.15.187:6801/41919', 'cluster_addr': '172.21.15.187:6803/41919', 'heartbeat_back_addr': '172.21.15.187:6807/41919', 'heartbeat_front_addr': '172.21.15.187:6805/41919', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.579572+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.596783+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.632883+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T10:33:20.460 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-26T10:33:20.460 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 3 16 13578 13562 282.522 235.688 0.00745466 0.00353471 2024-04-26T10:33:20.460 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:20.456+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:20.560 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:20.558+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:20.626 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:20.626 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:20.638 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:20.660 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:20.658+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:20.761 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:20.759+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:20.812 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:20.812 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:20.827 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:20.862 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:20.860+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:20.963 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:20.962+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:20.993 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:20.993 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:21.009 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:21.065 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:21.063+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:21.166 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:21.164+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:21.180 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:21.180 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:21.194 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:21.267 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:21.265+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:21.358 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-26T10:33:21.368 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:21.366+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:21.370 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:21.370 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:21.386 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:21.417 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 4 16 16921 16905 264.121 208.938 0.00453896 0.00378182 2024-04-26T10:33:21.469 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:21.468+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:21.557 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:33:21.570 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:21.568+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:21.600 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:21.600 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:21.614 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:21.671 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:21.669+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:21.711 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:21.732 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:21.752 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:21.753 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:21.753 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:21.753 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:21.771 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:21.770+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:21.792 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:33:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:33:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993605+0000", 2024-04-26T10:33:21.792 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.795137636, 2024-04-26T10:33:21.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017888707, 2024-04-26T10:33:21.793 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.793 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.793 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993605+0000", 2024-04-26T10:33:21.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993605+0000", 2024-04-26T10:33:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993604+0000", 2024-04-26T10:33:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993612+0000", 2024-04-26T10:33:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:33:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993623+0000", 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.117e-05 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993640+0000", 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7095000000000001e-05 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993699+0000", 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9123000000000003e-05 2024-04-26T10:33:21.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-26T10:33:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993704+0000", 2024-04-26T10:33:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3140000000000003e-06 2024-04-26T10:33:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.002866+0000", 2024-04-26T10:33:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0091614869999999994 2024-04-26T10:33:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.003153+0000", 2024-04-26T10:33:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028684400000000002 2024-04-26T10:33:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.003399+0000", 2024-04-26T10:33:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024633100000000002 2024-04-26T10:33:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005747+0000", 2024-04-26T10:33:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023480139999999998 2024-04-26T10:33:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011388+0000", 2024-04-26T10:33:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056412750000000003 2024-04-26T10:33:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011447+0000", 2024-04-26T10:33:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8443000000000003e-05 2024-04-26T10:33:21.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011494+0000", 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6814000000000003e-05 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:10 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.79508092, 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018785385000000002, 2024-04-26T10:33:21.801 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993661+0000", 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993667+0000", 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9120000000000003e-06 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993676+0000", 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0270000000000001e-06 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993681+0000", 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9919999999999998e-06 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993763+0000", 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2799999999999993e-05 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993768+0000", 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9409999999999998e-06 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004133+0000", 2024-04-26T10:33:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01036455 2024-04-26T10:33:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004220+0000", 2024-04-26T10:33:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7394999999999999e-05 2024-04-26T10:33:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004343+0000", 2024-04-26T10:33:21.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012254900000000001 2024-04-26T10:33:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005750+0000", 2024-04-26T10:33:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001406991 2024-04-26T10:33:21.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012396+0000", 2024-04-26T10:33:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0066459129999999998 2024-04-26T10:33:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012422+0000", 2024-04-26T10:33:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6182000000000001e-05 2024-04-26T10:33:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012447+0000", 2024-04-26T10:33:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4981e-05 2024-04-26T10:33:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993685+0000", 2024-04-26T10:33:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.795057228000001, 2024-04-26T10:33:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014631474, 2024-04-26T10:33:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.810 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993685+0000", 2024-04-26T10:33:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993685+0000", 2024-04-26T10:33:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993685+0000", 2024-04-26T10:33:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993687+0000", 2024-04-26T10:33:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2220000000000001e-06 2024-04-26T10:33:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993691+0000", 2024-04-26T10:33:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7979999999999999e-06 2024-04-26T10:33:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993694+0000", 2024-04-26T10:33:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4319999999999999e-06 2024-04-26T10:33:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993750+0000", 2024-04-26T10:33:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5447e-05 2024-04-26T10:33:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-26T10:33:21.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993755+0000", 2024-04-26T10:33:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.87e-06 2024-04-26T10:33:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005448+0000", 2024-04-26T10:33:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011693301 2024-04-26T10:33:21.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005552+0000", 2024-04-26T10:33:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010411 2024-04-26T10:33:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005664+0000", 2024-04-26T10:33:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111926 2024-04-26T10:33:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006535+0000", 2024-04-26T10:33:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00087124700000000002 2024-04-26T10:33:21.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008226+0000", 2024-04-26T10:33:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016902729999999999 2024-04-26T10:33:21.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008270+0000", 2024-04-26T10:33:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4755000000000001e-05 2024-04-26T10:33:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008317+0000", 2024-04-26T10:33:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6375000000000002e-05 2024-04-26T10:33:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.823 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993699+0000", 2024-04-26T10:33:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.795043918000001, 2024-04-26T10:33:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014757767, 2024-04-26T10:33:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993699+0000", 2024-04-26T10:33:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993699+0000", 2024-04-26T10:33:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993698+0000", 2024-04-26T10:33:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993704+0000", 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6760000000000004e-06 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993708+0000", 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8840000000000004e-06 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993713+0000", 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7079999999999996e-06 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993776+0000", 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3637000000000001e-05 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7164999999999999e-05 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005913+0000", 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012119237999999999 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005960+0000", 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7138999999999997e-05 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006042+0000", 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2204000000000001e-05 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006543+0000", 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00050083300000000001 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008364+0000", 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018215729999999999 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008406+0000", 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2077999999999999e-05 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008456+0000", 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9950000000000001e-05 2024-04-26T10:33:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.795023355000001, 2024-04-26T10:33:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018863001000000001, 2024-04-26T10:33:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993722+0000", 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7630000000000001e-06 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993726+0000", 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9999999999999998e-06 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993729+0000", 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3210000000000001e-06 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993795+0000", 2024-04-26T10:33:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5903999999999998e-05 2024-04-26T10:33:21.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993798+0000", 2024-04-26T10:33:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:33:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004680+0000", 2024-04-26T10:33:21.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010881823000000001 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004804+0000", 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012401 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005121+0000", 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031651100000000001 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006210+0000", 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010888930000000001 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012493+0000", 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062830630000000002 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012543+0000", 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0331999999999999e-05 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012582+0000", 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9230999999999998e-05 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993760+0000", 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.794982448999999, 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017241877999999999, 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.838 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993760+0000", 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993760+0000", 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993760+0000", 2024-04-26T10:33:21.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993763+0000", 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3419999999999999e-06 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993779+0000", 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6331e-05 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993786+0000", 2024-04-26T10:33:21.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8299999999999998e-06 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993826+0000", 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9947000000000002e-05 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993831+0000", 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7500000000000003e-06 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.000042+0000", 2024-04-26T10:33:21.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.006211299 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.000240+0000", 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000197715 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.000529+0000", 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028910699999999998 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004479+0000", 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039500250000000002 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.010951+0000", 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064716210000000003 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.010979+0000", 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7946e-05 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011002+0000", 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3388e-05 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993797+0000", 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.794945901999998, 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017310459, 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993797+0000", 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993797+0000", 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993796+0000", 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993800+0000", 2024-04-26T10:33:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5899999999999999e-06 2024-04-26T10:33:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993806+0000", 2024-04-26T10:33:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6189999999999996e-06 2024-04-26T10:33:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993818+0000", 2024-04-26T10:33:21.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2339e-05 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993853+0000", 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4987999999999998e-05 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993856+0000", 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5160000000000001e-06 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001544+0000", 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076884620000000001 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001688+0000", 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014332200000000001 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011107+0000", 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0094193209999999996 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.794905144000001, 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018824634, 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993841+0000", 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3059999999999999e-06 2024-04-26T10:33:21.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993849+0000", 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993855+0000", 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9479999999999996e-06 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993885+0000", 2024-04-26T10:33:21.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9798000000000002e-05 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993891+0000", 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2689999999999996e-06 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005459+0000", 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011567898 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005556+0000", 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7751999999999995e-05 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012662+0000", 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071055830000000004 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993864+0000", 2024-04-26T10:33:21.853 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 29.794878821000001, 2024-04-26T10:33:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01335422, 2024-04-26T10:33:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993864+0000", 2024-04-26T10:33:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993864+0000", 2024-04-26T10:33:21.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993863+0000", 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993879+0000", 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5279000000000001e-05 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993887+0000", 2024-04-26T10:33:21.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9959999999999993e-06 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993898+0000", 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1712000000000001e-05 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993923+0000", 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4893e-05 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-26T10:33:21.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993926+0000", 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2959999999999999e-06 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001993+0000", 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080661759999999996 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.002082+0000", 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9689000000000001e-05 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007218+0000", 2024-04-26T10:33:21.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005135667 2024-04-26T10:33:21.858 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.858 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.858 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.858 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:1701 5.c 5:38a26cce:::benchmark_data_smithi043_45180_object1700:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:21.858 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:17.786504+0000", 2024-04-26T10:33:21.858 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.0022383169999998, 2024-04-26T10:33:21.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012512914999999999, 2024-04-26T10:33:21.858 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.858 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.858 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 1701 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786504+0000", 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786504+0000", 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786504+0000", 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786665+0000", 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016093699999999999 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786670+0000", 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1089999999999997e-06 2024-04-26T10:33:21.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786675+0000", 2024-04-26T10:33:21.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:33:21.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786701+0000", 2024-04-26T10:33:21.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6183e-05 2024-04-26T10:33:21.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786805+0000", 2024-04-26T10:33:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104564 2024-04-26T10:33:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786921+0000", 2024-04-26T10:33:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116152 2024-04-26T10:33:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789267+0000", 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023455260000000001 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.798967+0000", 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0096995970000000008 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.798997+0000", 2024-04-26T10:33:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0130000000000001e-05 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.799017+0000", 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0465000000000001e-05 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:1704 5.6 5:671d71de:::benchmark_data_smithi043_45180_object1703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:17.786681+0000", 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.0020620039999999, 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012803653, 2024-04-26T10:33:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 1704 2024-04-26T10:33:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786681+0000", 2024-04-26T10:33:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786681+0000", 2024-04-26T10:33:21.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786680+0000", 2024-04-26T10:33:21.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786762+0000", 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1963000000000001e-05 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786769+0000", 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2450000000000001e-06 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786775+0000", 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7810000000000002e-06 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786807+0000", 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1640000000000002e-05 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.786893+0000", 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6420000000000003e-05 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:21.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.787004+0000", 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110908 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789232+0000", 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022275849999999998 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.799433+0000", 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01020155 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.799461+0000", 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8364000000000002e-05 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.799484+0000", 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2721000000000002e-05 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:1716 5.3 5:c543007d:::benchmark_data_smithi043_45180_object1715:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:21.870 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:17.789483+0000", 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.9992597280000002, 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010129122000000001, 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 1716 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789483+0000", 2024-04-26T10:33:21.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789483+0000", 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789482+0000", 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789575+0000", 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2987999999999998e-05 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789583+0000", 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4370000000000007e-06 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789590+0000", 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789622+0000", 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789732+0000", 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110512 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789820+0000", 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8228999999999998e-05 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.791119+0000", 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012989760000000001 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.799573+0000", 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084541340000000003 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.799596+0000", 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2334e-05 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.799612+0000", 2024-04-26T10:33:21.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6167e-05 2024-04-26T10:33:21.876 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.876 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.876 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.876 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:1717 5.c 5:3d335628:::benchmark_data_smithi043_45180_object1716:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:21.876 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:17.789596+0000", 2024-04-26T10:33:21.876 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.9991463409999999, 2024-04-26T10:33:21.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099609539999999993, 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 1717 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789596+0000", 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789596+0000", 2024-04-26T10:33:21.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789596+0000", 2024-04-26T10:33:21.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:21.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789690+0000", 2024-04-26T10:33:21.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4321999999999996e-05 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789697+0000", 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8079999999999999e-06 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789700+0000", 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5470000000000001e-06 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789726+0000", 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5236999999999999e-05 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789813+0000", 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7632000000000004e-05 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.789921+0000", 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107481 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.791142+0000", 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001221197 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.799508+0000", 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083659700000000004 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.799536+0000", 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7790999999999999e-05 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:17.799557+0000", 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1379e-05 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:5891 5.a 5:5d67d644:::benchmark_data_smithi043_45180_object5890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:18.580781+0000", 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.207961643, 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013237369000000001, 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.882 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:21.883 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:21.883 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:21.883 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5891 2024-04-26T10:33:21.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.883 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.580781+0000", 2024-04-26T10:33:21.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.580781+0000", 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.580773+0000", 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999924 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.580870+0000", 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6854999999999993e-05 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.580881+0000", 2024-04-26T10:33:21.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0519999999999999e-05 2024-04-26T10:33:21.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.580888+0000", 2024-04-26T10:33:21.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5079999999999999e-06 2024-04-26T10:33:21.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.581133+0000", 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024513200000000001 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.581226+0000", 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2795999999999997e-05 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.581379+0000", 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015320899999999999 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.585102+0000", 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0037228679999999998 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.593935+0000", 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088329540000000005 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.593982+0000", 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6415999999999997e-05 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594018+0000", 2024-04-26T10:33:21.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6675999999999999e-05 2024-04-26T10:33:21.888 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.888 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.888 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.888 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:5894 5.a 5:52763aef:::benchmark_data_smithi043_45180_object5893:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:21.888 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:18.581429+0000", 2024-04-26T10:33:21.888 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.207313928, 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012672862999999999, 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5894 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.581429+0000", 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.581429+0000", 2024-04-26T10:33:21.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.581428+0000", 2024-04-26T10:33:21.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:21.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.581513+0000", 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5574000000000004e-05 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.581519+0000", 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.429e-06 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.581523+0000", 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7419999999999999e-06 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582077+0000", 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00055409800000000005 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582189+0000", 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000112252 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582331+0000", 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014235499999999999 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.585109+0000", 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027774280000000002 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594053+0000", 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0089445570000000005 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594081+0000", 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8058000000000001e-05 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594101+0000", 2024-04-26T10:33:21.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0109e-05 2024-04-26T10:33:21.894 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.894 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.894 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.894 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:5900 5.a 5:5bc10c46:::benchmark_data_smithi043_45180_object5899:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:21.894 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:18.582092+0000", 2024-04-26T10:33:21.894 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.2066506330000002, 2024-04-26T10:33:21.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012123988, 2024-04-26T10:33:21.894 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.894 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5900 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582092+0000", 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582092+0000", 2024-04-26T10:33:21.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582091+0000", 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582164+0000", 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3081e-05 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582171+0000", 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1590000000000004e-06 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582178+0000", 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8859999999999998e-06 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.583967+0000", 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001788893 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.584093+0000", 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012557000000000001 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.584219+0000", 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012630599999999999 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.585829+0000", 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016099599999999999 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594143+0000", 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0083136419999999996 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594183+0000", 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0388e-05 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594216+0000", 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2830999999999998e-05 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.899 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:5901 5.a 5:5a6aec66:::benchmark_data_smithi043_45180_object5900:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:18.582185+0000", 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.2065576779999998, 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012149312000000001, 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5901 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.900 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582185+0000", 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582185+0000", 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582184+0000", 2024-04-26T10:33:21.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582239+0000", 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5219000000000001e-05 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582245+0000", 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.582248+0000", 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5049999999999999e-06 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.584561+0000", 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023125559999999999 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.584648+0000", 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7269999999999996e-05 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:21.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.584739+0000", 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0618000000000006e-05 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.585841+0000", 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001102055 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594258+0000", 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0084172569999999992 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594301+0000", 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2481000000000002e-05 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594334+0000", 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3543000000000001e-05 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:5904 5.a 5:5b6c0c34:::benchmark_data_smithi043_45180_object5903:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:21.905 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:18.583987+0000", 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.2047560000000002, 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010463949, 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5904 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.583987+0000", 2024-04-26T10:33:21.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.583987+0000", 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.583986+0000", 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.584041+0000", 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5022999999999998e-05 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.584049+0000", 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6209999999999993e-06 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.584057+0000", 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5429999999999996e-06 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.585135+0000", 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010776589999999999 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.585282+0000", 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014766900000000001 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.585418+0000", 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000135291 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.586324+0000", 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00090658500000000001 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594380+0000", 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080554870000000001 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594419+0000", 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9677e-05 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594450+0000", 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1149999999999998e-05 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:6967 5.a 5:51a04864:::benchmark_data_smithi043_45180_object6966:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:18.797110+0000", 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.9916322069999999, 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0099613659999999993, 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.911 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 6967 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.797110+0000", 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.797110+0000", 2024-04-26T10:33:21.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.797110+0000", 2024-04-26T10:33:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.797181+0000", 2024-04-26T10:33:21.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1107999999999997e-05 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.797186+0000", 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3970000000000002e-06 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.797190+0000", 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5030000000000002e-06 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.797792+0000", 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00060251900000000004 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.797883+0000", 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0562999999999993e-05 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.797969+0000", 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6065999999999999e-05 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.798444+0000", 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00047543299999999999 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.806986+0000", 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0085418690000000005 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.807035+0000", 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8335999999999999e-05 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.807072+0000", 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7132999999999998e-05 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:9027 5.6 5:6ed4aef9:::benchmark_data_smithi043_45180_object9026:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:19.236901+0000", 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.5518419290000001, 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082269690000000006, 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 9027 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.236901+0000", 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.236901+0000", 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:21.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.236900+0000", 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.236966+0000", 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6579000000000001e-05 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.236976+0000", 2024-04-26T10:33:21.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1290000000000002e-06 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.236982+0000", 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0950000000000001e-06 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.237019+0000", 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7766999999999999e-05 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:21.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.237145+0000", 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012549800000000001 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.237292+0000", 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000146589 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.242662+0000", 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053707099999999999 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:21.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.245066+0000", 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024040189999999999 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.245096+0000", 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9386999999999998e-05 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:19.245128+0000", 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1906000000000003e-05 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.922 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:21.923 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:21.923 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:21.924 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:21.925 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:21.922+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:22.025 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:22.024+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:22.097 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:22.097 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:18966 5.1 5:8213746c:::benchmark_data_smithi043_45180_object18965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.092013+0000", 2024-04-26T10:33:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0042290269999999998, 2024-04-26T10:33:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042574070000000004, 2024-04-26T10:33:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 18966 2024-04-26T10:33:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.098 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.092013+0000", 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.092013+0000", 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.092012+0000", 2024-04-26T10:33:22.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.092064+0000", 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2194000000000002e-05 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.092070+0000", 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7649999999999999e-06 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.092074+0000", 2024-04-26T10:33:22.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8569999999999997e-06 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.092117+0000", 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3056999999999998e-05 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.092238+0000", 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121267 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.092392+0000", 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015351000000000001 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.094875+0000", 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024832470000000001 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:18972 5.2 5:40f2d019:::benchmark_data_smithi043_45180_object18971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.093275+0000", 2024-04-26T10:33:22.102 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0029672019999999999, 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030602709999999998, 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 18972 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093275+0000", 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093275+0000", 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093274+0000", 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093312+0000", 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7758e-05 2024-04-26T10:33:22.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093319+0000", 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9199999999999998e-06 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093323+0000", 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3669999999999999e-06 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093345+0000", 2024-04-26T10:33:22.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1532e-05 2024-04-26T10:33:22.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093444+0000", 2024-04-26T10:33:22.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9773999999999997e-05 2024-04-26T10:33:22.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093564+0000", 2024-04-26T10:33:22.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119756 2024-04-26T10:33:22.106 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.106 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.107 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:18973 5.1 5:8e487121:::benchmark_data_smithi043_45180_object18972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.107 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.093383+0000", 2024-04-26T10:33:22.107 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0028587740000000001, 2024-04-26T10:33:22.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002996692, 2024-04-26T10:33:22.107 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.107 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:22.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:22.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 18973 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093383+0000", 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093383+0000", 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093382+0000", 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093434+0000", 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1718000000000002e-05 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093442+0000", 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.14e-06 2024-04-26T10:33:22.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093448+0000", 2024-04-26T10:33:22.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:33:22.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093492+0000", 2024-04-26T10:33:22.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3420000000000001e-05 2024-04-26T10:33:22.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093613+0000", 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121241 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093747+0000", 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013378700000000001 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:18970 5.3 e20/16 5:cda9d0de:::benchmark_data_smithi043_45180_object18969:head v 20'1234, mlcod=20'1231)", 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.093478+0000", 2024-04-26T10:33:22.111 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0027636649999999998, 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029451149999999999, 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093478+0000", 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093478+0000", 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093478+0000", 2024-04-26T10:33:22.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093569+0000", 2024-04-26T10:33:22.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0818999999999999e-05 2024-04-26T10:33:22.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093578+0000", 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7410000000000004e-06 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093594+0000", 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5461999999999999e-05 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093622+0000", 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8333000000000001e-05 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093636+0000", 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4121000000000001e-05 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:18971 5.5 e20/16 5:a30a9515:::benchmark_data_smithi043_45180_object18970:head v 20'1219, mlcod=20'1216)", 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.093604+0000", 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0026379929999999999, 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028810139999999999, 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:22.115 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093604+0000", 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093604+0000", 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093603+0000", 2024-04-26T10:33:22.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093640+0000", 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6230999999999999e-05 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093646+0000", 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4779999999999996e-06 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093652+0000", 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.711e-06 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093679+0000", 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7016999999999999e-05 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093691+0000", 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2081e-05 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.118 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:18974 5.7 5:e6f1d51c:::benchmark_data_smithi043_45180_object18973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.093462+0000", 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0027802199999999999, 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030910149999999999, 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 18974 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093462+0000", 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093462+0000", 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093461+0000", 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093700+0000", 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023826500000000001 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093708+0000", 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3170000000000002e-06 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093714+0000", 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.635e-06 2024-04-26T10:33:22.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093748+0000", 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3266000000000003e-05 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093870+0000", 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012221199999999999 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.093988+0000", 2024-04-26T10:33:22.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117957 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:18976 5.9 5:99513bd2:::benchmark_data_smithi043_45180_object18975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.094588+0000", 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.001654279, 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002063699, 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.123 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 18976 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.094588+0000", 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.094588+0000", 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.094587+0000", 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.094661+0000", 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4394999999999995e-05 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.094670+0000", 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1309999999999995e-06 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.094676+0000", 2024-04-26T10:33:22.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7180000000000001e-06 2024-04-26T10:33:22.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.094704+0000", 2024-04-26T10:33:22.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8323e-05 2024-04-26T10:33:22.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.094800+0000", 2024-04-26T10:33:22.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5364000000000004e-05 2024-04-26T10:33:22.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.094905+0000", 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105157 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:18977 5.9 5:9c64dbee:::benchmark_data_smithi043_45180_object18976:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.095048+0000", 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0011940989999999999, 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016714309999999999, 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.127 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 18977 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095048+0000", 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095048+0000", 2024-04-26T10:33:22.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095047+0000", 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095127+0000", 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9858999999999996e-05 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095135+0000", 2024-04-26T10:33:22.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5000000000000002e-06 2024-04-26T10:33:22.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095140+0000", 2024-04-26T10:33:22.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7060000000000001e-06 2024-04-26T10:33:22.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095626+0000", 2024-04-26T10:33:22.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00048565700000000002 2024-04-26T10:33:22.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095708+0000", 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2140999999999998e-05 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095784+0000", 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6334999999999993e-05 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:18981 5.1 5:8ea74b7e:::benchmark_data_smithi043_45180_object18980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.095228+0000", 2024-04-26T10:33:22.131 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.001013936, 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015380960000000001, 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 18981 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095228+0000", 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095228+0000", 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095228+0000", 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095314+0000", 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6364000000000002e-05 2024-04-26T10:33:22.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095319+0000", 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3900000000000001e-06 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095323+0000", 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4640000000000002e-06 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095616+0000", 2024-04-26T10:33:22.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029304100000000002 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095717+0000", 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100981 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095841+0000", 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012465299999999999 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:18979 5.3 e20/16 5:cf95c4d6:::benchmark_data_smithi043_45180_object18978:head v 20'1235, mlcod=20'1232)", 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.095569+0000", 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00067271500000000005, 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012367789999999999, 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095569+0000", 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095569+0000", 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095569+0000", 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095625+0000", 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6295000000000002e-05 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095630+0000", 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6149999999999999e-06 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095633+0000", 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3979999999999999e-06 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095668+0000", 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4854999999999997e-05 2024-04-26T10:33:22.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.095685+0000", 2024-04-26T10:33:22.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6891000000000001e-05 2024-04-26T10:33:22.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.139 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.139 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.139 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:33:22.139 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 10 2024-04-26T10:33:22.139 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:22.141 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:22.141 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:22.139+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:22.241 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:22.240+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:22.313 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:22.314 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:33:22.314 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:33:22.314 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:33:22.314 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:22.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:22.342 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:22.341+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:22.417 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 5 16 19971 19955 249.42 190.625 0.00392984 0.00400579 2024-04-26T10:33:22.443 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:22.441+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:22.502 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:22.502 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:33:22.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:33:22.502 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:22.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.503 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.503 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993731+0000", 2024-04-26T10:33:22.503 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504668616, 2024-04-26T10:33:22.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014047472, 2024-04-26T10:33:22.503 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.503 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.503 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993731+0000", 2024-04-26T10:33:22.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993731+0000", 2024-04-26T10:33:22.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993730+0000", 2024-04-26T10:33:22.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:22.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993736+0000", 2024-04-26T10:33:22.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.161e-06 2024-04-26T10:33:22.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993747+0000", 2024-04-26T10:33:22.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0523000000000001e-05 2024-04-26T10:33:22.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993756+0000", 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2310000000000002e-06 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993821+0000", 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4536999999999996e-05 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993826+0000", 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3499999999999996e-06 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.998590+0000", 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047645090000000001 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.998838+0000", 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024790000000000001 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.999038+0000", 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000199273 2024-04-26T10:33:22.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005146+0000", 2024-04-26T10:33:22.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.006108006 2024-04-26T10:33:22.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007669+0000", 2024-04-26T10:33:22.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025231059999999998 2024-04-26T10:33:22.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007722+0000", 2024-04-26T10:33:22.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3504999999999997e-05 2024-04-26T10:33:22.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007779+0000", 2024-04-26T10:33:22.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6542999999999997e-05 2024-04-26T10:33:22.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.512 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.512 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.512 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993766+0000", 2024-04-26T10:33:22.512 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504633624, 2024-04-26T10:33:22.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014208985, 2024-04-26T10:33:22.512 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993766+0000", 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993766+0000", 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993766+0000", 2024-04-26T10:33:22.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993773+0000", 2024-04-26T10:33:22.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.605e-06 2024-04-26T10:33:22.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993783+0000", 2024-04-26T10:33:22.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0035e-05 2024-04-26T10:33:22.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993788+0000", 2024-04-26T10:33:22.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2910000000000001e-06 2024-04-26T10:33:22.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993895+0000", 2024-04-26T10:33:22.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000107295 2024-04-26T10:33:22.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:22.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993901+0000", 2024-04-26T10:33:22.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0240000000000003e-06 2024-04-26T10:33:22.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.001050+0000", 2024-04-26T10:33:22.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071485560000000004 2024-04-26T10:33:22.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.001205+0000", 2024-04-26T10:33:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155747 2024-04-26T10:33:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.001586+0000", 2024-04-26T10:33:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038079200000000002 2024-04-26T10:33:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006272+0000", 2024-04-26T10:33:22.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046858000000000004 2024-04-26T10:33:22.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007884+0000", 2024-04-26T10:33:22.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016121639999999999 2024-04-26T10:33:22.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007933+0000", 2024-04-26T10:33:22.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8810999999999997e-05 2024-04-26T10:33:22.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007975+0000", 2024-04-26T10:33:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2318999999999999e-05 2024-04-26T10:33:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504607246999999, 2024-04-26T10:33:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017960028999999999, 2024-04-26T10:33:22.519 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.520 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.520 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:22.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:22.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993792+0000", 2024-04-26T10:33:22.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993800+0000", 2024-04-26T10:33:22.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0900000000000005e-06 2024-04-26T10:33:22.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993805+0000", 2024-04-26T10:33:22.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9919999999999998e-06 2024-04-26T10:33:22.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993809+0000", 2024-04-26T10:33:22.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.703e-06 2024-04-26T10:33:22.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:22.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012428800000000001 2024-04-26T10:33:22.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:22.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993937+0000", 2024-04-26T10:33:22.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0010000000000003e-06 2024-04-26T10:33:22.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006732+0000", 2024-04-26T10:33:22.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012794972 2024-04-26T10:33:22.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006890+0000", 2024-04-26T10:33:22.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015741999999999999 2024-04-26T10:33:22.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007049+0000", 2024-04-26T10:33:22.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159872 2024-04-26T10:33:22.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011426+0000", 2024-04-26T10:33:22.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043764370000000004 2024-04-26T10:33:22.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011667+0000", 2024-04-26T10:33:22.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024095400000000001 2024-04-26T10:33:22.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011712+0000", 2024-04-26T10:33:22.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4752000000000001e-05 2024-04-26T10:33:22.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011753+0000", 2024-04-26T10:33:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0995999999999998e-05 2024-04-26T10:33:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504540958, 2024-04-26T10:33:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018053829, 2024-04-26T10:33:22.526 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.527 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.527 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:22.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:22.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:22.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993861+0000", 2024-04-26T10:33:22.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4990000000000001e-06 2024-04-26T10:33:22.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993868+0000", 2024-04-26T10:33:22.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7190000000000004e-06 2024-04-26T10:33:22.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993873+0000", 2024-04-26T10:33:22.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0200000000000002e-06 2024-04-26T10:33:22.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993968+0000", 2024-04-26T10:33:22.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5310999999999996e-05 2024-04-26T10:33:22.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:22.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993974+0000", 2024-04-26T10:33:22.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:33:22.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008004+0000", 2024-04-26T10:33:22.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014029700000000001 2024-04-26T10:33:22.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008126+0000", 2024-04-26T10:33:22.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122087 2024-04-26T10:33:22.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008229+0000", 2024-04-26T10:33:22.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102358 2024-04-26T10:33:22.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011613+0000", 2024-04-26T10:33:22.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033843279999999998 2024-04-26T10:33:22.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011812+0000", 2024-04-26T10:33:22.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000198798 2024-04-26T10:33:22.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011871+0000", 2024-04-26T10:33:22.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9283000000000001e-05 2024-04-26T10:33:22.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011913+0000", 2024-04-26T10:33:22.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1798000000000002e-05 2024-04-26T10:33:22.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.537 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.538 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.538 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:22.538 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504510911000001, 2024-04-26T10:33:22.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018338483999999999, 2024-04-26T10:33:22.538 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.539 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.539 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:22.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:22.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:22.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993892+0000", 2024-04-26T10:33:22.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.546e-06 2024-04-26T10:33:22.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993899+0000", 2024-04-26T10:33:22.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:33:22.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993906+0000", 2024-04-26T10:33:22.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9820000000000002e-06 2024-04-26T10:33:22.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994023+0000", 2024-04-26T10:33:22.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116766 2024-04-26T10:33:22.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:22.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994028+0000", 2024-04-26T10:33:22.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7079999999999996e-06 2024-04-26T10:33:22.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008784+0000", 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014756833 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008838+0000", 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3112000000000002e-05 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008957+0000", 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119523 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011618+0000", 2024-04-26T10:33:22.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026610330000000001 2024-04-26T10:33:22.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012154+0000", 2024-04-26T10:33:22.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053582800000000002 2024-04-26T10:33:22.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012193+0000", 2024-04-26T10:33:22.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9047000000000001e-05 2024-04-26T10:33:22.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012227+0000", 2024-04-26T10:33:22.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4442e-05 2024-04-26T10:33:22.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.545 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.545 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:13 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.545 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:22.545 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504468673000002, 2024-04-26T10:33:22.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018412833, 2024-04-26T10:33:22.546 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.546 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.546 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:22.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6139999999999999e-06 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993939+0000", 2024-04-26T10:33:22.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3279999999999996e-06 2024-04-26T10:33:22.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993949+0000", 2024-04-26T10:33:22.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.047e-05 2024-04-26T10:33:22.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994066+0000", 2024-04-26T10:33:22.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116952 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994071+0000", 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869999999999996e-06 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009196+0000", 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015125148 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009272+0000", 2024-04-26T10:33:22.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5440999999999998e-05 2024-04-26T10:33:22.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009381+0000", 2024-04-26T10:33:22.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010946399999999999 2024-04-26T10:33:22.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012090+0000", 2024-04-26T10:33:22.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027090700000000001 2024-04-26T10:33:22.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012271+0000", 2024-04-26T10:33:22.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018098699999999999 2024-04-26T10:33:22.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012312+0000", 2024-04-26T10:33:22.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0286e-05 2024-04-26T10:33:22.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:22.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2276000000000001e-05 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:15 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504407894, 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018433715, 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:22.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:22.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:22.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993995+0000", 2024-04-26T10:33:22.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.225e-06 2024-04-26T10:33:22.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994001+0000", 2024-04-26T10:33:22.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0619999999999997e-06 2024-04-26T10:33:22.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994004+0000", 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.422e-06 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994157+0000", 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015285 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1449999999999999e-06 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009937+0000", 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015774455 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010028+0000", 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0746000000000002e-05 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010174+0000", 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146682 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012358+0000", 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021837900000000001 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012382+0000", 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3768e-05 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012406+0000", 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4006999999999999e-05 2024-04-26T10:33:22.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012426+0000", 2024-04-26T10:33:22.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9896000000000001e-05 2024-04-26T10:33:22.558 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.558 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.558 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.558 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:16 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.558 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:22.558 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504384499, 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020879298000000001, 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:22.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:22.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994017+0000", 2024-04-26T10:33:22.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1459999999999999e-06 2024-04-26T10:33:22.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994021+0000", 2024-04-26T10:33:22.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2169999999999996e-06 2024-04-26T10:33:22.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994025+0000", 2024-04-26T10:33:22.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3450000000000002e-06 2024-04-26T10:33:22.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996368+0000", 2024-04-26T10:33:22.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002342841 2024-04-26T10:33:22.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:22.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996374+0000", 2024-04-26T10:33:22.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6590000000000001e-06 2024-04-26T10:33:22.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010589+0000", 2024-04-26T10:33:22.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014214648999999999 2024-04-26T10:33:22.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010670+0000", 2024-04-26T10:33:22.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1463000000000003e-05 2024-04-26T10:33:22.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010824+0000", 2024-04-26T10:33:22.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000154007 2024-04-26T10:33:22.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.013067+0000", 2024-04-26T10:33:22.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022428629999999999 2024-04-26T10:33:22.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014821+0000", 2024-04-26T10:33:22.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017534530000000001 2024-04-26T10:33:22.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014860+0000", 2024-04-26T10:33:22.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9264000000000002e-05 2024-04-26T10:33:22.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014895+0000", 2024-04-26T10:33:22.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4619999999999997e-05 2024-04-26T10:33:22.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.569 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.570 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:19 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.570 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:22.570 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504370989999998, 2024-04-26T10:33:22.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018265699, 2024-04-26T10:33:22.571 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.571 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.571 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:22.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:22.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:22.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:22.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994031+0000", 2024-04-26T10:33:22.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9980000000000002e-06 2024-04-26T10:33:22.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994037+0000", 2024-04-26T10:33:22.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0100000000000001e-06 2024-04-26T10:33:22.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994043+0000", 2024-04-26T10:33:22.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1500000000000004e-06 2024-04-26T10:33:22.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994085+0000", 2024-04-26T10:33:22.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2354000000000001e-05 2024-04-26T10:33:22.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:22.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994095+0000", 2024-04-26T10:33:22.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8749999999999995e-06 2024-04-26T10:33:22.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008664+0000", 2024-04-26T10:33:22.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01456942 2024-04-26T10:33:22.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008786+0000", 2024-04-26T10:33:22.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121735 2024-04-26T10:33:22.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008948+0000", 2024-04-26T10:33:22.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016180400000000001 2024-04-26T10:33:22.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010761+0000", 2024-04-26T10:33:22.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018125120000000001 2024-04-26T10:33:22.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012205+0000", 2024-04-26T10:33:22.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014441040000000001 2024-04-26T10:33:22.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012256+0000", 2024-04-26T10:33:22.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1817999999999998e-05 2024-04-26T10:33:22.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012295+0000", 2024-04-26T10:33:22.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8142000000000002e-05 2024-04-26T10:33:22.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.584 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.584 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.584 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.584 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994049+0000", 2024-04-26T10:33:22.585 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504350371000001, 2024-04-26T10:33:22.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01468798, 2024-04-26T10:33:22.585 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.585 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.585 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994049+0000", 2024-04-26T10:33:22.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994049+0000", 2024-04-26T10:33:22.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994049+0000", 2024-04-26T10:33:22.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994057+0000", 2024-04-26T10:33:22.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2519999999999999e-06 2024-04-26T10:33:22.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994065+0000", 2024-04-26T10:33:22.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3529999999999997e-06 2024-04-26T10:33:22.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994071+0000", 2024-04-26T10:33:22.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9909999999999999e-06 2024-04-26T10:33:22.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994101+0000", 2024-04-26T10:33:22.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9933e-05 2024-04-26T10:33:22.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:22.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994104+0000", 2024-04-26T10:33:22.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7110000000000001e-06 2024-04-26T10:33:22.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.002416+0000", 2024-04-26T10:33:22.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0083117250000000007 2024-04-26T10:33:22.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.002511+0000", 2024-04-26T10:33:22.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4848999999999999e-05 2024-04-26T10:33:22.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.002637+0000", 2024-04-26T10:33:22.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012612600000000001 2024-04-26T10:33:22.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007787+0000", 2024-04-26T10:33:22.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051496620000000002 2024-04-26T10:33:22.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008358+0000", 2024-04-26T10:33:22.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000571427 2024-04-26T10:33:22.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008695+0000", 2024-04-26T10:33:22.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033693500000000001 2024-04-26T10:33:22.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008737+0000", 2024-04-26T10:33:22.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2385999999999997e-05 2024-04-26T10:33:22.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.597 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.598 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.598 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:22.598 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504321914999998, 2024-04-26T10:33:22.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018349608999999999, 2024-04-26T10:33:22.598 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.598 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.598 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994081+0000", 2024-04-26T10:33:22.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0589999999999998e-06 2024-04-26T10:33:22.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994086+0000", 2024-04-26T10:33:22.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1900000000000003e-06 2024-04-26T10:33:22.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994090+0000", 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.771e-06 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994139+0000", 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9737999999999997e-05 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994145+0000", 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2460000000000003e-06 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009213+0000", 2024-04-26T10:33:22.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015068834 2024-04-26T10:33:22.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009263+0000", 2024-04-26T10:33:22.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9991999999999998e-05 2024-04-26T10:33:22.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009347+0000", 2024-04-26T10:33:22.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3997000000000002e-05 2024-04-26T10:33:22.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012307+0000", 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029601229999999998 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6470000000000001e-05 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012390+0000", 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5893000000000003e-05 2024-04-26T10:33:22.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012428+0000", 2024-04-26T10:33:22.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7721e-05 2024-04-26T10:33:22.604 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.604 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.604 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.604 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.604 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:22.604 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504301221999999, 2024-04-26T10:33:22.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017262810999999999, 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994098+0000", 2024-04-26T10:33:22.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994105+0000", 2024-04-26T10:33:22.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5599999999999999e-06 2024-04-26T10:33:22.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994109+0000", 2024-04-26T10:33:22.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5419999999999999e-06 2024-04-26T10:33:22.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994115+0000", 2024-04-26T10:33:22.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.181e-06 2024-04-26T10:33:22.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994169+0000", 2024-04-26T10:33:22.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4505000000000001e-05 2024-04-26T10:33:22.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:22.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994176+0000", 2024-04-26T10:33:22.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9090000000000003e-06 2024-04-26T10:33:22.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006451+0000", 2024-04-26T10:33:22.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012274571999999999 2024-04-26T10:33:22.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006594+0000", 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014321900000000001 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006804+0000", 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020967800000000001 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011137+0000", 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043333349999999998 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011261+0000", 2024-04-26T10:33:22.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012443 2024-04-26T10:33:22.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011317+0000", 2024-04-26T10:33:22.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6093e-05 2024-04-26T10:33:22.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011361+0000", 2024-04-26T10:33:22.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4039000000000003e-05 2024-04-26T10:33:22.611 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.611 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.611 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.611 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504272632999999, 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017534645000000001, 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:22.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:22.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994130+0000", 2024-04-26T10:33:22.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5530000000000001e-06 2024-04-26T10:33:22.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994155+0000", 2024-04-26T10:33:22.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4703999999999999e-05 2024-04-26T10:33:22.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:22.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8650000000000003e-06 2024-04-26T10:33:22.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997690+0000", 2024-04-26T10:33:22.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035285249999999998 2024-04-26T10:33:22.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:22.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997697+0000", 2024-04-26T10:33:22.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1399999999999997e-06 2024-04-26T10:33:22.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003133+0000", 2024-04-26T10:33:22.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054364549999999998 2024-04-26T10:33:22.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003272+0000", 2024-04-26T10:33:22.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138839 2024-04-26T10:33:22.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003879+0000", 2024-04-26T10:33:22.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00060699599999999995 2024-04-26T10:33:22.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009920+0000", 2024-04-26T10:33:22.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060407209999999998 2024-04-26T10:33:22.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011512+0000", 2024-04-26T10:33:22.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015920940000000001 2024-04-26T10:33:22.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011591+0000", 2024-04-26T10:33:22.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9054999999999994e-05 2024-04-26T10:33:22.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011662+0000", 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1095999999999998e-05 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504190903000001, 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017587693000000001, 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.619 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:22.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994219+0000", 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0421000000000001e-05 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994226+0000", 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4000000000000003e-06 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994232+0000", 2024-04-26T10:33:22.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.575e-06 2024-04-26T10:33:22.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997723+0000", 2024-04-26T10:33:22.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003491133 2024-04-26T10:33:22.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:22.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997727+0000", 2024-04-26T10:33:22.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5769999999999998e-06 2024-04-26T10:33:22.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.004741+0000", 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070140410000000004 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005283+0000", 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054229500000000004 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005451+0000", 2024-04-26T10:33:22.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016849700000000001 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010173+0000", 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047220259999999998 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011703+0000", 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015294499999999999 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011752+0000", 2024-04-26T10:33:22.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9524999999999998e-05 2024-04-26T10:33:22.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011797+0000", 2024-04-26T10:33:22.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4205000000000001e-05 2024-04-26T10:33:22.625 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.625 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.625 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.625 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504162371, 2024-04-26T10:33:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01805445, 2024-04-26T10:33:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994240+0000", 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4920000000000002e-06 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994249+0000", 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4810000000000006e-06 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994254+0000", 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3839999999999996e-06 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996056+0000", 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018018839999999999 2024-04-26T10:33:22.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:22.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996061+0000", 2024-04-26T10:33:22.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8690000000000003e-06 2024-04-26T10:33:22.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008974+0000", 2024-04-26T10:33:22.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012913127 2024-04-26T10:33:22.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009078+0000", 2024-04-26T10:33:22.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010333899999999999 2024-04-26T10:33:22.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009193+0000", 2024-04-26T10:33:22.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011555100000000001 2024-04-26T10:33:22.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011374+0000", 2024-04-26T10:33:22.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002180642 2024-04-26T10:33:22.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012202+0000", 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00082862099999999998 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012254+0000", 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1498000000000001e-05 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012292+0000", 2024-04-26T10:33:22.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8071999999999997e-05 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994260+0000", 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504139767000002, 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01408387, 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994260+0000", 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994260+0000", 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994260+0000", 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994273+0000", 2024-04-26T10:33:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3309000000000001e-05 2024-04-26T10:33:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994282+0000", 2024-04-26T10:33:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8750000000000006e-06 2024-04-26T10:33:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994288+0000", 2024-04-26T10:33:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6579999999999999e-06 2024-04-26T10:33:22.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994365+0000", 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7428000000000005e-05 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994372+0000", 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2309999999999999e-06 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.001531+0000", 2024-04-26T10:33:22.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071590229999999996 2024-04-26T10:33:22.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.001656+0000", 2024-04-26T10:33:22.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012448400000000001 2024-04-26T10:33:22.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:22.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.001803+0000", 2024-04-26T10:33:22.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000147467 2024-04-26T10:33:22.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007861+0000", 2024-04-26T10:33:22.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.006057766 2024-04-26T10:33:22.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008254+0000", 2024-04-26T10:33:22.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000393058 2024-04-26T10:33:22.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008303+0000", 2024-04-26T10:33:22.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9073999999999998e-05 2024-04-26T10:33:22.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008344+0000", 2024-04-26T10:33:22.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0878999999999999e-05 2024-04-26T10:33:22.640 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.640 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.641 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.641 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:22.641 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:22.641 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.504099315000001, 2024-04-26T10:33:22.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017896868, 2024-04-26T10:33:22.642 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.642 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:22.642 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:22.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:22.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994300+0000", 2024-04-26T10:33:22.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994303+0000", 2024-04-26T10:33:22.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.145e-06 2024-04-26T10:33:22.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994310+0000", 2024-04-26T10:33:22.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.345e-06 2024-04-26T10:33:22.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994317+0000", 2024-04-26T10:33:22.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9e-06 2024-04-26T10:33:22.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997746+0000", 2024-04-26T10:33:22.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034290190000000002 2024-04-26T10:33:22.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:22.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997753+0000", 2024-04-26T10:33:22.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2999999999999998e-06 2024-04-26T10:33:22.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007898+0000", 2024-04-26T10:33:22.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010145207 2024-04-26T10:33:22.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008073+0000", 2024-04-26T10:33:22.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017543800000000001 2024-04-26T10:33:22.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012197+0000", 2024-04-26T10:33:22.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041240950000000004 2024-04-26T10:33:22.651 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.652 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.652 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.652 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17792 5.1 5:8c0814d7:::benchmark_data_smithi043_45180_object17791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.652 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:22.653 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.786610217, 2024-04-26T10:33:22.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017771348999999999, 2024-04-26T10:33:22.653 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.653 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.653 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:22.653 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:22.654 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.654 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17792 2024-04-26T10:33:22.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.654 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:22.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:22.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711789+0000", 2024-04-26T10:33:22.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711901+0000", 2024-04-26T10:33:22.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011175600000000001 2024-04-26T10:33:22.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711907+0000", 2024-04-26T10:33:22.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3049999999999998e-06 2024-04-26T10:33:22.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711911+0000", 2024-04-26T10:33:22.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0069999999999999e-06 2024-04-26T10:33:22.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711940+0000", 2024-04-26T10:33:22.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9088999999999999e-05 2024-04-26T10:33:22.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712019+0000", 2024-04-26T10:33:22.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9134000000000005e-05 2024-04-26T10:33:22.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712105+0000", 2024-04-26T10:33:22.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5932000000000003e-05 2024-04-26T10:33:22.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713135+0000", 2024-04-26T10:33:22.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010300610000000001 2024-04-26T10:33:22.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729505+0000", 2024-04-26T10:33:22.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016369775999999999 2024-04-26T10:33:22.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729539+0000", 2024-04-26T10:33:22.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4093e-05 2024-04-26T10:33:22.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729561+0000", 2024-04-26T10:33:22.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1797000000000002e-05 2024-04-26T10:33:22.664 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.665 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.665 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17796 5.1 5:8c7c4768:::benchmark_data_smithi043_45180_object17795:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.665 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.713511+0000", 2024-04-26T10:33:22.665 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.78488851900000001, 2024-04-26T10:33:22.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016125401000000001, 2024-04-26T10:33:22.666 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.666 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.666 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:22.666 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:22.666 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.667 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17796 2024-04-26T10:33:22.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.667 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713511+0000", 2024-04-26T10:33:22.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713511+0000", 2024-04-26T10:33:22.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713511+0000", 2024-04-26T10:33:22.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713562+0000", 2024-04-26T10:33:22.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1384000000000001e-05 2024-04-26T10:33:22.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713570+0000", 2024-04-26T10:33:22.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7649999999999993e-06 2024-04-26T10:33:22.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713575+0000", 2024-04-26T10:33:22.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.972e-06 2024-04-26T10:33:22.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713599+0000", 2024-04-26T10:33:22.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4108e-05 2024-04-26T10:33:22.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713681+0000", 2024-04-26T10:33:22.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:33:22.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713759+0000", 2024-04-26T10:33:22.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8530999999999997e-05 2024-04-26T10:33:22.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.719093+0000", 2024-04-26T10:33:22.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053339370000000004 2024-04-26T10:33:22.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729590+0000", 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010496768 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729617+0000", 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6871000000000001e-05 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729637+0000", 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9690999999999998e-05 2024-04-26T10:33:22.675 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17797 5.1 5:89b74c1f:::benchmark_data_smithi043_45180_object17796:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.78473017199999995, 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018126438000000002, 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17797 2024-04-26T10:33:22.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713669+0000", 2024-04-26T10:33:22.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713706+0000", 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6415000000000003e-05 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713711+0000", 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2140000000000004e-06 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713715+0000", 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2599999999999999e-06 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714380+0000", 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066529399999999998 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714509+0000", 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012870500000000001 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714643+0000", 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013370600000000001 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.719195+0000", 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045520430000000004 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731718+0000", 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012523276999999999 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:22.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731776+0000", 2024-04-26T10:33:22.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7701000000000002e-05 2024-04-26T10:33:22.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:22.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:22.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:22.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731796+0000", 2024-04-26T10:33:22.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0398999999999999e-05 2024-04-26T10:33:22.681 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.681 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.681 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.681 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:22.681 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:22.681 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:22.683 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:22.681+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:22.683 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:22.783 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:22.782+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:22.855 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:22.855 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:22.855 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.855 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:21269 5.8 5:1958125d:::benchmark_data_smithi043_45180_object21268:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.855 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:22.847337+0000", 2024-04-26T10:33:22.855 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0064649, 2024-04-26T10:33:22.855 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0064842789999999999, 2024-04-26T10:33:22.855 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:22.855 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:22.855 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:22.855 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:22.855 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 21269 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.847337+0000", 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.847337+0000", 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.847337+0000", 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.847397+0000", 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0377999999999997e-05 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.847404+0000", 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6340000000000003e-06 2024-04-26T10:33:22.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.847408+0000", 2024-04-26T10:33:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8089999999999999e-06 2024-04-26T10:33:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.851233+0000", 2024-04-26T10:33:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0038257650000000001 2024-04-26T10:33:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:22.858 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.851350+0000", 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000116332 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.851452+0000", 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010267099999999999 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853739+0000", 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0022865580000000002 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:22.859 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:21274 5.b 5:db3bc20d:::benchmark_data_smithi043_45180_object21273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:22.848813+0000", 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0049891520000000002, 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0050734509999999997, 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 21274 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:22.860 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:22.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.848813+0000", 2024-04-26T10:33:22.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:22.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:22.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.848813+0000", 2024-04-26T10:33:22.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:22.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:22.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.848812+0000", 2024-04-26T10:33:22.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.848944+0000", 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013195899999999999 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.848954+0000", 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8970000000000003e-06 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.848962+0000", 2024-04-26T10:33:22.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3059999999999998e-06 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.851310+0000", 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0023474479999999998 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.851426+0000", 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000116187 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.851556+0000", 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000129567 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853197+0000", 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016417700000000001 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:21284 5.0 5:0d2c4de0:::benchmark_data_smithi043_45180_object21283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:22.852703+0000", 2024-04-26T10:33:22.864 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0010996160000000001, 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001232017, 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 21284 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.852703+0000", 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:22.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.852703+0000", 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.852702+0000", 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.852839+0000", 2024-04-26T10:33:22.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013670199999999999 2024-04-26T10:33:22.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:22.867 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.852848+0000", 2024-04-26T10:33:22.867 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9449999999999999e-06 2024-04-26T10:33:22.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.867 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.852853+0000", 2024-04-26T10:33:22.867 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.271e-06 2024-04-26T10:33:22.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:22.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.852884+0000", 2024-04-26T10:33:22.868 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.133e-05 2024-04-26T10:33:22.868 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.868 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.868 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:22.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.852962+0000", 2024-04-26T10:33:22.868 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7835000000000003e-05 2024-04-26T10:33:22.868 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.868 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.868 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:22.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853041+0000", 2024-04-26T10:33:22.868 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8431999999999997e-05 2024-04-26T10:33:22.868 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:21280 5.9 e20/16 5:97ae8e95:::benchmark_data_smithi043_45180_object21279:head v 20'1362, mlcod=20'1358)", 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:22.853285+0000", 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00051757599999999995, 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00069199500000000004, 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:22.869 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853285+0000", 2024-04-26T10:33:22.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:22.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.870 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:22.870 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853285+0000", 2024-04-26T10:33:22.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:22.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.870 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:22.870 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853284+0000", 2024-04-26T10:33:22.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853346+0000", 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.143e-05 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853352+0000", 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8580000000000002e-06 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853357+0000", 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1670000000000001e-06 2024-04-26T10:33:22.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853390+0000", 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3081999999999999e-05 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853409+0000", 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9230999999999999e-05 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:21285 5.b 5.1bf1e9eb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:22.853923+0000", 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4294967295.9998794, 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8397000000000001e-05, 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 21285 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853923+0000", 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853923+0000", 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853922+0000", 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853985+0000", 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2551000000000005e-05 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.853996+0000", 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.095e-05 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.854001+0000", 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.507e-06 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:22.875 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:22.876 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:22.876 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:22.876 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:33:22.876 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 5 2024-04-26T10:33:22.876 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:22.877 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:22.884 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:22.882+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:22.984 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:22.983+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:23.053 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:23.311 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:33:23.311 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:33:23.311 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:33:23.311 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:23.313 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:23.313 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:23.311+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:23.371 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:33:23.415 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:23.413+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:23.417 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 6 16 23106 23090 240.504 195.938 0.00159981 0.00415338 2024-04-26T10:33:23.515 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:23.512+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:23.526 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:23.526 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:33:23.526 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:33:23.526 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:23.526 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.526 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:23.527 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994163+0000", 2024-04-26T10:33:23.527 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.529274469000001, 2024-04-26T10:33:23.527 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014381321000000001, 2024-04-26T10:33:23.527 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.527 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.527 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.527 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.527 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.527 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994163+0000", 2024-04-26T10:33:23.527 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.527 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.527 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.527 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994163+0000", 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994161+0000", 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999981 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994172+0000", 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0889e-05 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.528 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994201+0000", 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9059000000000001e-05 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994242+0000", 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1121000000000002e-05 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994597+0000", 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00035472299999999998 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.530 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994769+0000", 2024-04-26T10:33:23.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000172139 2024-04-26T10:33:23.530 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.530 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:23.530 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994938+0000", 2024-04-26T10:33:23.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0001694 2024-04-26T10:33:23.530 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.530 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.530 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998089+0000", 2024-04-26T10:33:23.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0031503640000000001 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008433+0000", 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010344020000000001 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008492+0000", 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9370999999999998e-05 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.531 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008544+0000", 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2030999999999997e-05 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994299+0000", 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.529138160999999, 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014404745, 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.532 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994299+0000", 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994299+0000", 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994298+0000", 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.533 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994305+0000", 2024-04-26T10:33:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.063e-06 2024-04-26T10:33:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994328+0000", 2024-04-26T10:33:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2819e-05 2024-04-26T10:33:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994345+0000", 2024-04-26T10:33:23.534 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6952e-05 2024-04-26T10:33:23.535 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.535 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.535 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.535 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994863+0000", 2024-04-26T10:33:23.535 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000518192 2024-04-26T10:33:23.535 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.535 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.535 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.535 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994990+0000", 2024-04-26T10:33:23.535 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000126802 2024-04-26T10:33:23.535 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.535 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.535 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995146+0000", 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015556700000000001 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998096+0000", 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0029506799999999998 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008616+0000", 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010520102999999999 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.536 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008664+0000", 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7219000000000003e-05 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008704+0000", 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0330000000000002e-05 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:17 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994833+0000", 2024-04-26T10:33:23.537 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.528604631, 2024-04-26T10:33:23.538 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014019953999999999, 2024-04-26T10:33:23.538 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.538 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.538 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.538 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.538 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.538 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994833+0000", 2024-04-26T10:33:23.538 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.538 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.538 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.538 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.538 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994833+0000", 2024-04-26T10:33:23.538 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994832+0000", 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994845+0000", 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3159999999999999e-05 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994855+0000", 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0045e-05 2024-04-26T10:33:23.539 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.540 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.540 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.540 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994863+0000", 2024-04-26T10:33:23.540 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1750000000000005e-06 2024-04-26T10:33:23.540 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.540 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.540 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.540 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995186+0000", 2024-04-26T10:33:23.540 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00032241399999999998 2024-04-26T10:33:23.540 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.540 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.540 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.540 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995240+0000", 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4054000000000001e-05 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995318+0000", 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8665999999999995e-05 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998102+0000", 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027840830000000001 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.541 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008616+0000", 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010513623999999999 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008663+0000", 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7172000000000002e-05 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008853+0000", 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00018943200000000001 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.542 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:18 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.52856804, 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014077793999999999, 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.543 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994874+0000", 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5509999999999999e-06 2024-04-26T10:33:23.544 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994881+0000", 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8979999999999999e-06 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994889+0000", 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995378+0000", 2024-04-26T10:33:23.545 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00048941399999999997 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995429+0000", 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0878000000000003e-05 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995513+0000", 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4412000000000004e-05 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.546 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998109+0000", 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0025955319999999998 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008861+0000", 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010752421999999999 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008909+0000", 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7788999999999999e-05 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.547 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008947+0000", 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7888e-05 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994894+0000", 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.528543518999999, 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013916404, 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.548 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994894+0000", 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994894+0000", 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994893+0000", 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.549 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994897+0000", 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7299999999999999e-06 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994904+0000", 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6270000000000002e-06 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994909+0000", 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6760000000000004e-06 2024-04-26T10:33:23.550 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.551 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.551 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.551 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996220+0000", 2024-04-26T10:33:23.551 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001310192 2024-04-26T10:33:23.551 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.551 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.551 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.551 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996370+0000", 2024-04-26T10:33:23.551 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015071099999999999 2024-04-26T10:33:23.551 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996516+0000", 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014541200000000001 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998074+0000", 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015584539999999999 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008719+0000", 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010645116 2024-04-26T10:33:23.552 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008760+0000", 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0284000000000003e-05 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008810+0000", 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0662999999999999e-05 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.553 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.995975+0000", 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.527462471, 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.01320091, 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995975+0000", 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.554 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995975+0000", 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995974+0000", 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995981+0000", 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0890000000000002e-06 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.555 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996182+0000", 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000201101 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996192+0000", 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.007e-05 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.997573+0000", 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001380799 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.556 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.997655+0000", 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2196999999999999e-05 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.997812+0000", 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015662799999999999 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.000517+0000", 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027054539999999999 2024-04-26T10:33:23.557 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.009094+0000", 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0085771470000000002 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.009142+0000", 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7237000000000002e-05 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.009176+0000", 2024-04-26T10:33:23.558 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4053000000000001e-05 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.996202+0000", 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.527235182999998, 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013275234, 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.559 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996202+0000", 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996202+0000", 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996201+0000", 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.560 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996217+0000", 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5279000000000001e-05 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996226+0000", 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3500000000000003e-06 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996233+0000", 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8669999999999996e-06 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.561 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.562 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996275+0000", 2024-04-26T10:33:23.562 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2261000000000001e-05 2024-04-26T10:33:23.562 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.562 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.562 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.562 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996410+0000", 2024-04-26T10:33:23.562 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013463799999999999 2024-04-26T10:33:23.562 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.562 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.562 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:23.562 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996553+0000", 2024-04-26T10:33:23.562 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000143153 2024-04-26T10:33:23.562 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.000187+0000", 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0036337880000000002 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.009391+0000", 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0092038759999999997 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.009434+0000", 2024-04-26T10:33:23.563 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3244000000000001e-05 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.009477+0000", 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3504999999999998e-05 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.996245+0000", 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.527192282000001, 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012253351000000001, 2024-04-26T10:33:23.564 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996245+0000", 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996245+0000", 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.565 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996244+0000", 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996248+0000", 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.053e-06 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996255+0000", 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8360000000000003e-06 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.566 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.567 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.567 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996262+0000", 2024-04-26T10:33:23.567 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7410000000000003e-06 2024-04-26T10:33:23.567 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.567 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.567 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.567 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996349+0000", 2024-04-26T10:33:23.567 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6724000000000005e-05 2024-04-26T10:33:23.567 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.567 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.567 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.567 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996510+0000", 2024-04-26T10:33:23.567 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00016152399999999999 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008498+0000", 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.011988277 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:1708 5.d 5:bbe7e03e:::benchmark_data_smithi043_45180_object1707:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:17.786613+0000", 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.7368240049999999, 2024-04-26T10:33:23.568 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012954663999999999, 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 1708 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786613+0000", 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.569 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.570 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.570 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786613+0000", 2024-04-26T10:33:23.570 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.570 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.570 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.570 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.570 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786613+0000", 2024-04-26T10:33:23.570 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.570 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.570 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.570 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.570 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786729+0000", 2024-04-26T10:33:23.570 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011634299999999999 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786737+0000", 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1480000000000006e-06 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786742+0000", 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0309999999999998e-06 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.571 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786778+0000", 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6155000000000002e-05 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.786916+0000", 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013772 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.787051+0000", 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000134666 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.572 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.573 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.787701+0000", 2024-04-26T10:33:23.573 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00064989099999999999 2024-04-26T10:33:23.573 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.573 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.573 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.573 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.799494+0000", 2024-04-26T10:33:23.573 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.011793348 2024-04-26T10:33:23.573 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.573 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.573 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.573 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.799536+0000", 2024-04-26T10:33:23.573 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1526999999999997e-05 2024-04-26T10:33:23.573 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:17.799568+0000", 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2468999999999997e-05 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:5892 5.0 5:043c8bce:::benchmark_data_smithi043_45180_object5891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.580753+0000", 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.9426843080000005, 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012606622, 2024-04-26T10:33:23.574 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 5892 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580753+0000", 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.575 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580753+0000", 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580753+0000", 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580826+0000", 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3034999999999994e-05 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.576 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580832+0000", 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9499999999999998e-06 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580837+0000", 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1050000000000003e-06 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.580882+0000", 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4919000000000001e-05 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.577 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.578 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.578 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581001+0000", 2024-04-26T10:33:23.578 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000119312 2024-04-26T10:33:23.578 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.578 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.578 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:23.578 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581147+0000", 2024-04-26T10:33:23.578 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014619200000000001 2024-04-26T10:33:23.578 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.578 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.578 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.578 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.584159+0000", 2024-04-26T10:33:23.578 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0030116840000000001 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593308+0000", 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0091495090000000001 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593338+0000", 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9447000000000001e-05 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.579 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593360+0000", 2024-04-26T10:33:23.580 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1829000000000001e-05 2024-04-26T10:33:23.580 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.580 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.580 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.580 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.580 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.580 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:5891 5.a e19/16 5:5d67d644:::benchmark_data_smithi043_45180_object5890:head v 19'423, mlcod=19'419)", 2024-04-26T10:33:23.580 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.581507+0000", 2024-04-26T10:33:23.580 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.9419300699999997, 2024-04-26T10:33:23.580 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012306259999999999, 2024-04-26T10:33:23.582 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.582 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.582 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.582 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.582 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.582 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581507+0000", 2024-04-26T10:33:23.582 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.582 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.582 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.582 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.582 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581507+0000", 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581507+0000", 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581605+0000", 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8559000000000003e-05 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.583 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581612+0000", 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.489e-06 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581616+0000", 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581644+0000", 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.817e-05 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.584 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581656+0000", 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1593000000000001e-05 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593782+0000", 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012125841 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593814+0000", 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1652999999999997e-05 2024-04-26T10:33:23.585 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.586 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.586 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.586 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.586 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.586 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:5898 5.0 5:06cc85ec:::benchmark_data_smithi043_45180_object5897:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:23.586 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:18.581664+0000", 2024-04-26T10:33:23.586 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.941773499, 2024-04-26T10:33:23.586 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012175844999999999, 2024-04-26T10:33:23.586 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.586 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.586 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:23.586 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:23.586 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 5898 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581664+0000", 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581664+0000", 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.587 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581663+0000", 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581712+0000", 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8937999999999998e-05 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581720+0000", 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.588 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581727+0000", 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4980000000000003e-06 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581771+0000", 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4393e-05 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.581911+0000", 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013961299999999999 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.589 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.590 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:23.590 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.582076+0000", 2024-04-26T10:33:23.590 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00016489900000000001 2024-04-26T10:33:23.590 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.590 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.590 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.590 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.585190+0000", 2024-04-26T10:33:23.590 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0031140130000000001 2024-04-26T10:33:23.590 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.590 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.590 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.590 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593763+0000", 2024-04-26T10:33:23.590 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0085732550000000001 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593803+0000", 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0234000000000001e-05 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:18.593840+0000", 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6318e-05 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.591 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:19056 5.e 5:7703dcdb:::benchmark_data_smithi043_45180_object19055:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:22.120244+0000", 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.4031932650000001, 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012725244, 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 19056 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.592 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.120244+0000", 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.120244+0000", 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.120244+0000", 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.593 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.120282+0000", 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8724999999999999e-05 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.120290+0000", 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5000000000000002e-06 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.120295+0000", 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.916e-06 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.594 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.595 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.595 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.123583+0000", 2024-04-26T10:33:23.595 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0032879960000000001 2024-04-26T10:33:23.595 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.595 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.595 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.595 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.123689+0000", 2024-04-26T10:33:23.595 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010644700000000001 2024-04-26T10:33:23.595 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.595 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.595 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:23.595 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.123803+0000", 2024-04-26T10:33:23.595 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000113899 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.127103+0000", 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0032999969999999998 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.132887+0000", 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0057838209999999998 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.596 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.132932+0000", 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5507999999999999e-05 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.132969+0000", 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6888999999999999e-05 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:19058 5.e 5:777f8ad7:::benchmark_data_smithi043_45180_object19057:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:22.120685+0000", 2024-04-26T10:33:23.597 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.4027523959999999, 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012361281, 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 19058 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.120685+0000", 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.598 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.120685+0000", 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.120684+0000", 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.120784+0000", 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.9662999999999998e-05 2024-04-26T10:33:23.599 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.600 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.600 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.600 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.120797+0000", 2024-04-26T10:33:23.600 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3104e-05 2024-04-26T10:33:23.600 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.600 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.600 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.600 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.120802+0000", 2024-04-26T10:33:23.600 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.011e-06 2024-04-26T10:33:23.600 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.600 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.600 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.600 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.127117+0000", 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0063150610000000003 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.127195+0000", 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7669000000000005e-05 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.127275+0000", 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0667999999999994e-05 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.601 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.602 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.130548+0000", 2024-04-26T10:33:23.602 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0032728739999999998 2024-04-26T10:33:23.602 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.602 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.602 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.602 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.132978+0000", 2024-04-26T10:33:23.602 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002429372 2024-04-26T10:33:23.602 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.602 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.602 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.602 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.133013+0000", 2024-04-26T10:33:23.602 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5417999999999999e-05 2024-04-26T10:33:23.602 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.603 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.603 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.603 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.133046+0000", 2024-04-26T10:33:23.603 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3189999999999999e-05 2024-04-26T10:33:23.603 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.603 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.603 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.603 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.603 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.603 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:20558 5.b 5:d77cf81f:::benchmark_data_smithi043_45180_object20557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.603 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:22.622476+0000", 2024-04-26T10:33:23.603 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.90096162599999996, 2024-04-26T10:33:23.603 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013469722, 2024-04-26T10:33:23.604 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.604 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.604 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:23.604 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:23.604 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.604 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 20558 2024-04-26T10:33:23.604 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.604 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.604 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.604 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.604 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.622476+0000", 2024-04-26T10:33:23.604 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.604 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.622476+0000", 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.622475+0000", 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.622532+0000", 2024-04-26T10:33:23.605 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6700999999999998e-05 2024-04-26T10:33:23.606 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.606 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.606 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.606 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.622542+0000", 2024-04-26T10:33:23.606 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0088999999999999e-05 2024-04-26T10:33:23.606 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.606 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.606 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.606 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.622547+0000", 2024-04-26T10:33:23.606 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4990000000000002e-06 2024-04-26T10:33:23.606 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.606 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.606 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.624784+0000", 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0022365509999999998 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.624914+0000", 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012986900000000001 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.625046+0000", 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013208600000000001 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.607 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.627999+0000", 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0029527920000000001 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.635863+0000", 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0078647760000000004 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.635910+0000", 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6088999999999999e-05 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.608 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.635945+0000", 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5848e-05 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:20818 5.8 5:133f54bc:::benchmark_data_smithi043_45180_object20817:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:22.706461+0000", 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.81697615099999998, 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013177767, 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.609 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.610 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:23.610 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:23.610 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.610 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 20818 2024-04-26T10:33:23.610 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.610 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.610 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.610 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.610 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.706461+0000", 2024-04-26T10:33:23.610 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.706461+0000", 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.706461+0000", 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.611 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.706504+0000", 2024-04-26T10:33:23.612 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3408000000000002e-05 2024-04-26T10:33:23.612 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.612 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.612 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.612 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.706509+0000", 2024-04-26T10:33:23.612 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4209999999999997e-06 2024-04-26T10:33:23.612 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.612 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.612 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.612 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.706513+0000", 2024-04-26T10:33:23.612 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9269999999999996e-06 2024-04-26T10:33:23.612 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.612 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.707112+0000", 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00059827000000000003 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.707188+0000", 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5809000000000006e-05 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.707267+0000", 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9697000000000006e-05 2024-04-26T10:33:23.613 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.709718+0000", 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0024504549999999998 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.719574+0000", 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.009855941 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.719602+0000", 2024-04-26T10:33:23.614 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7988e-05 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.719639+0000", 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7329999999999997e-05 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:20824 5.8 5:1a0219ff:::benchmark_data_smithi043_45180_object20823:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:22.708511+0000", 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.81492615999999996, 2024-04-26T10:33:23.615 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.01282267, 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 20824 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.708511+0000", 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.616 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.617 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.617 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.708511+0000", 2024-04-26T10:33:23.617 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.617 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.617 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.617 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.617 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.708511+0000", 2024-04-26T10:33:23.617 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.617 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.617 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.617 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.618 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.708675+0000", 2024-04-26T10:33:23.618 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00016428600000000001 2024-04-26T10:33:23.618 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.618 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.618 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.618 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.708683+0000", 2024-04-26T10:33:23.618 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4940000000000003e-06 2024-04-26T10:33:23.618 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.618 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.618 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.618 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.708690+0000", 2024-04-26T10:33:23.618 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8349999999999998e-06 2024-04-26T10:33:23.618 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.709747+0000", 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0010568330000000001 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.709861+0000", 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011348100000000001 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.709994+0000", 2024-04-26T10:33:23.619 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013374400000000001 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.712432+0000", 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0024375080000000001 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.721255+0000", 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0088236159999999994 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.721299+0000", 2024-04-26T10:33:23.620 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3918000000000002e-05 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.721334+0000", 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4524999999999999e-05 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:22419 5.8 5:10660f00:::benchmark_data_smithi043_45180_object22418:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:23.197679+0000", 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.32575880699999998, 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013402851, 2024-04-26T10:33:23.621 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 22419 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197679+0000", 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.622 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197679+0000", 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197678+0000", 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197748+0000", 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9702000000000005e-05 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.623 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197756+0000", 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5620000000000004e-06 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197761+0000", 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2900000000000002e-06 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197787+0000", 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5051000000000001e-05 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.624 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197861+0000", 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4396999999999999e-05 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197943+0000", 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1972999999999996e-05 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.198997+0000", 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0010536860000000001 2024-04-26T10:33:23.625 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.211028+0000", 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012030997999999999 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.211060+0000", 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.222e-05 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.211081+0000", 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1594e-05 2024-04-26T10:33:23.626 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:22871 5.0 5:02689998:::benchmark_data_smithi043_45180_object22870:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:23.337684+0000", 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.18575361300000001, 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013175107, 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.627 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 22871 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.337684+0000", 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.337684+0000", 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.628 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.337683+0000", 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.337838+0000", 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015477399999999999 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.337846+0000", 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2700000000000004e-06 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.629 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.337852+0000", 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2929999999999997e-06 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.338498+0000", 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00064588500000000001 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.338619+0000", 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012092299999999999 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.630 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.338748+0000", 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012882599999999999 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.340358+0000", 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001610317 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.350791+0000", 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010432459 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.631 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.350819+0000", 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8373000000000001e-05 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.350859+0000", 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9857000000000001e-05 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:22873 5.0 5:01cf3954:::benchmark_data_smithi043_45180_object22872:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.632 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:23.337858+0000", 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.18557974699999999, 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013144856999999999, 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 22873 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.337858+0000", 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.633 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.337858+0000", 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.337857+0000", 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.337969+0000", 2024-04-26T10:33:23.634 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000111735 2024-04-26T10:33:23.635 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.635 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.635 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:23.635 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.337977+0000", 2024-04-26T10:33:23.635 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.038e-06 2024-04-26T10:33:23.635 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.635 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.635 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.638 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.337983+0000", 2024-04-26T10:33:23.638 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5889999999999999e-06 2024-04-26T10:33:23.638 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.638 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.638 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:23.638 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.339409+0000", 2024-04-26T10:33:23.638 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014257359999999999 2024-04-26T10:33:23.638 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.638 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.638 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:23.638 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.339548+0000", 2024-04-26T10:33:23.638 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013925 2024-04-26T10:33:23.638 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.339686+0000", 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013721499999999999 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.347060+0000", 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0073748310000000001 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.350915+0000", 2024-04-26T10:33:23.639 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0038541859999999999 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.350967+0000", 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2818000000000002e-05 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.351002+0000", 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5037999999999999e-05 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:23.641 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:23.641 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:23.644 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:23.642+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:23.744 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:23.742+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:23.765 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:33:23.830 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:23.830 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:23.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.830 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:24364 5.a 5:5e632b27:::benchmark_data_smithi043_45180_object24363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.830 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:23.826899+0000", 2024-04-26T10:33:23.830 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001660126, 2024-04-26T10:33:23.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001688595, 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 24364 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826899+0000", 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826899+0000", 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826897+0000", 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826962+0000", 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4560999999999994e-05 2024-04-26T10:33:23.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:23.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826970+0000", 2024-04-26T10:33:23.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9589999999999995e-06 2024-04-26T10:33:23.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826975+0000", 2024-04-26T10:33:23.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1420000000000001e-06 2024-04-26T10:33:23.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:23.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.827017+0000", 2024-04-26T10:33:23.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2268999999999998e-05 2024-04-26T10:33:23.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:23.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.827153+0000", 2024-04-26T10:33:23.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013542900000000001 2024-04-26T10:33:23.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:23.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.827281+0000", 2024-04-26T10:33:23.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012789799999999999 2024-04-26T10:33:23.835 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.835 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:23.835 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.835 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:24365 5.4 e20/16 5:232cc92c:::benchmark_data_smithi043_45180_object24364:head v 20'1497, mlcod=20'1495)", 2024-04-26T10:33:23.835 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:23.827950+0000", 2024-04-26T10:33:23.835 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00060870100000000001, 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00072193699999999997, 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.827950+0000", 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.827950+0000", 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.827949+0000", 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.828060+0000", 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110361 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.828067+0000", 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6850000000000001e-06 2024-04-26T10:33:23.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.828072+0000", 2024-04-26T10:33:23.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.78e-06 2024-04-26T10:33:23.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:23.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.828102+0000", 2024-04-26T10:33:23.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9696000000000002e-05 2024-04-26T10:33:23.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:23.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.828117+0000", 2024-04-26T10:33:23.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5418999999999999e-05 2024-04-26T10:33:23.842 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.842 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:23.842 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:24351 5.5 5:a2431705:::benchmark_data_smithi043_45180_object24350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:23.823759+0000", 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0047995970000000001, 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0049820239999999998, 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 24351 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:23.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:23.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.823759+0000", 2024-04-26T10:33:23.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:23.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.823759+0000", 2024-04-26T10:33:23.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:23.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.823758+0000", 2024-04-26T10:33:23.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:23.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:23.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.823823+0000", 2024-04-26T10:33:23.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4319000000000005e-05 2024-04-26T10:33:23.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:23.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.823843+0000", 2024-04-26T10:33:23.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9868e-05 2024-04-26T10:33:23.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.823850+0000", 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9480000000000008e-06 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824310+0000", 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00045997600000000002 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824424+0000", 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000113097 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:23.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824541+0000", 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117889 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:24352 5.5 5:a7f3c4fe:::benchmark_data_smithi043_45180_object24351:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:23.824285+0000", 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0042739989999999997, 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045450760000000003, 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:23.849 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:23.850 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.850 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 24352 2024-04-26T10:33:23.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.850 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:23.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:23.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824285+0000", 2024-04-26T10:33:23.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:23.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824285+0000", 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824284+0000", 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824320+0000", 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5688000000000001e-05 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:23.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824328+0000", 2024-04-26T10:33:23.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2309999999999996e-06 2024-04-26T10:33:23.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824335+0000", 2024-04-26T10:33:23.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2679999999999997e-06 2024-04-26T10:33:23.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:23.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.825578+0000", 2024-04-26T10:33:23.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012425050000000001 2024-04-26T10:33:23.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:23.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.825696+0000", 2024-04-26T10:33:23.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117778 2024-04-26T10:33:23.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:23.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.825828+0000", 2024-04-26T10:33:23.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013212599999999999 2024-04-26T10:33:23.855 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.855 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:23.855 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.856 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:24353 5.c 5:361e11c1:::benchmark_data_smithi043_45180_object24352:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.856 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:23.824345+0000", 2024-04-26T10:33:23.856 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0042141959999999999, 2024-04-26T10:33:23.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045759390000000002, 2024-04-26T10:33:23.856 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:23.856 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:23.856 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:23.856 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:23.856 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.857 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 24353 2024-04-26T10:33:23.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.857 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:23.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:23.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824345+0000", 2024-04-26T10:33:23.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:23.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824345+0000", 2024-04-26T10:33:23.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:23.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824344+0000", 2024-04-26T10:33:23.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:23.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824387+0000", 2024-04-26T10:33:23.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2815000000000003e-05 2024-04-26T10:33:23.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824395+0000", 2024-04-26T10:33:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9349999999999994e-06 2024-04-26T10:33:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824402+0000", 2024-04-26T10:33:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2609999999999996e-06 2024-04-26T10:33:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824888+0000", 2024-04-26T10:33:23.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00048641800000000002 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.825018+0000", 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000129441 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.825143+0000", 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000125339 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:23.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.828048+0000", 2024-04-26T10:33:23.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029051049999999998 2024-04-26T10:33:23.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.828859+0000", 2024-04-26T10:33:23.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00081086699999999995 2024-04-26T10:33:23.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:23.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.828904+0000", 2024-04-26T10:33:23.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5024000000000001e-05 2024-04-26T10:33:23.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.862 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:23.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.862 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:24355 5.5 5:abdf350b:::benchmark_data_smithi043_45180_object24354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.862 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:23.824408+0000", 2024-04-26T10:33:23.862 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0041510879999999998, 2024-04-26T10:33:23.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0046031969999999998, 2024-04-26T10:33:23.862 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:23.862 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:23.863 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:23.863 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:23.863 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.863 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 24355 2024-04-26T10:33:23.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.863 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:23.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:23.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824408+0000", 2024-04-26T10:33:23.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:23.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824408+0000", 2024-04-26T10:33:23.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:23.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824407+0000", 2024-04-26T10:33:23.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:23.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824436+0000", 2024-04-26T10:33:23.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9153e-05 2024-04-26T10:33:23.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:23.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824444+0000", 2024-04-26T10:33:23.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.267e-06 2024-04-26T10:33:23.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824449+0000", 2024-04-26T10:33:23.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7590000000000003e-06 2024-04-26T10:33:23.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:23.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826736+0000", 2024-04-26T10:33:23.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022864449999999998 2024-04-26T10:33:23.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:23.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826853+0000", 2024-04-26T10:33:23.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116965 2024-04-26T10:33:23.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:23.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826981+0000", 2024-04-26T10:33:23.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012854199999999999 2024-04-26T10:33:23.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.828995+0000", 2024-04-26T10:33:23.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020141249999999999 2024-04-26T10:33:23.867 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.867 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:23.868 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.868 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:24357 5.c 5:30b34a72:::benchmark_data_smithi043_45180_object24356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:23.868 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:23.824866+0000", 2024-04-26T10:33:23.868 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.003692393, 2024-04-26T10:33:23.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042066159999999998, 2024-04-26T10:33:23.868 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:23.868 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:23.868 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:23.868 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:23.868 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:23.869 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 24357 2024-04-26T10:33:23.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.869 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:23.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:23.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824866+0000", 2024-04-26T10:33:23.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:23.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824866+0000", 2024-04-26T10:33:23.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:23.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824866+0000", 2024-04-26T10:33:23.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:23.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824889+0000", 2024-04-26T10:33:23.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3010000000000002e-05 2024-04-26T10:33:23.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:23.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824896+0000", 2024-04-26T10:33:23.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1319999999999996e-06 2024-04-26T10:33:23.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.824901+0000", 2024-04-26T10:33:23.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.468e-06 2024-04-26T10:33:23.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:23.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.825871+0000", 2024-04-26T10:33:23.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096994900000000001 2024-04-26T10:33:23.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:23.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.825967+0000", 2024-04-26T10:33:23.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5777000000000001e-05 2024-04-26T10:33:23.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:23.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826058+0000", 2024-04-26T10:33:23.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0736999999999995e-05 2024-04-26T10:33:23.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:23.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.829036+0000", 2024-04-26T10:33:23.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029779490000000001 2024-04-26T10:33:23.873 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.873 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:23.873 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.874 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:24360 5.b e20/16 5:d9f07d73:::benchmark_data_smithi043_45180_object24359:head v 20'1532, mlcod=20'1530)", 2024-04-26T10:33:23.874 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:23.825358+0000", 2024-04-26T10:33:23.874 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0032005929999999998, 2024-04-26T10:33:23.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0037710399999999998, 2024-04-26T10:33:23.874 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:23.874 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:23.874 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:23.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:23.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.825358+0000", 2024-04-26T10:33:23.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:23.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.825358+0000", 2024-04-26T10:33:23.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:23.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.825358+0000", 2024-04-26T10:33:23.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:23.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.825384+0000", 2024-04-26T10:33:23.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6159000000000001e-05 2024-04-26T10:33:23.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:23.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.825390+0000", 2024-04-26T10:33:23.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6710000000000002e-06 2024-04-26T10:33:23.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.825396+0000", 2024-04-26T10:33:23.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4929999999999998e-06 2024-04-26T10:33:23.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:23.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826042+0000", 2024-04-26T10:33:23.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00064640300000000004 2024-04-26T10:33:23.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:23.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826061+0000", 2024-04-26T10:33:23.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8471999999999999e-05 2024-04-26T10:33:23.878 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.878 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:23.878 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.878 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:24361 5.0 e20/16 5:01485dec:::benchmark_data_smithi043_45180_object24360:head v 20'1548, mlcod=20'1544)", 2024-04-26T10:33:23.879 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:23.826532+0000", 2024-04-26T10:33:23.879 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.002027147, 2024-04-26T10:33:23.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026327360000000001, 2024-04-26T10:33:23.879 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:23.879 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:23.879 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:23.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:23.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826532+0000", 2024-04-26T10:33:23.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:23.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826532+0000", 2024-04-26T10:33:23.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:23.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:23.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826531+0000", 2024-04-26T10:33:23.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:23.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:23.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826560+0000", 2024-04-26T10:33:23.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9138000000000001e-05 2024-04-26T10:33:23.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:23.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826568+0000", 2024-04-26T10:33:23.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1890000000000007e-06 2024-04-26T10:33:23.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:23.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826575+0000", 2024-04-26T10:33:23.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1569999999999997e-06 2024-04-26T10:33:23.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:23.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826608+0000", 2024-04-26T10:33:23.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3475000000000001e-05 2024-04-26T10:33:23.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:23.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:23.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:23.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:23.826627+0000", 2024-04-26T10:33:23.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8671000000000001e-05 2024-04-26T10:33:23.883 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.883 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:23.883 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.883 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:23.883 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:33:23.883 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 9 2024-04-26T10:33:23.883 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:23.885 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:23.885 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:23.882+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:23.921 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:23.941 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:23.963 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:23.964 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:23.964 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:23.964 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:23.985 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:23.984+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:24.086 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:24.084+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:24.108 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:24.109 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:24.124 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:24.186 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:24.184+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:24.287 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:24.285+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:24.304 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:24.304 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:24.319 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:24.362 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-26T10:33:24.388 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:24.386+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:24.417 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 7 16 26150 26134 233.322 190.25 0.00423769 0.00428296 2024-04-26T10:33:24.489 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:24.489 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:24.489 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:24.488+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:24.502 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:24.590 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:24.589+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:24.671 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:24.671 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:24.685 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:24.691 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:24.690+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:24.792 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:24.791+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:24.890 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:24.890 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:24.893 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:24.892+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:24.902 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:24.994 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:24.993+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:25.073 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:25.073 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:25.087 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:25.095 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:25.093+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:25.196 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:25.195+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:25.257 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:25.257 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:25.269 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:25.310 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:25.309+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:25.397 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:25.396+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:25.417 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 8 16 29099 29083 227.194 184.312 0.00712089 0.00439696 2024-04-26T10:33:25.460 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:33:25.460 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:33:25.460 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-04-26T10:33:25.460 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-04-26T10:33:25.482 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:25.483 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:25.494 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:25.499 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:25.497+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:25.600 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:25.599+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:25.666 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:25.666 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:25.682 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:25.700 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:25.699+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:25.802 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:25.800+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:25.810 INFO:teuthology.orchestra.run.smithi043.stdout:moved 0 / 242 (0%) 2024-04-26T10:33:25.810 INFO:teuthology.orchestra.run.smithi043.stdout:avg 80.6667 2024-04-26T10:33:25.810 INFO:teuthology.orchestra.run.smithi043.stdout:stddev 3.68179 -> 3.68179 (expected baseline 7.33333) 2024-04-26T10:33:25.811 INFO:teuthology.orchestra.run.smithi043.stdout:min osd.1 with 76 -> 76 pgs (0.942149 -> 0.942149 * mean) 2024-04-26T10:33:25.811 INFO:teuthology.orchestra.run.smithi043.stdout:max osd.2 with 85 -> 85 pgs (1.05372 -> 1.05372 * mean) 2024-04-26T10:33:25.811 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:25.811 INFO:teuthology.orchestra.run.smithi043.stdout:oload 1000 2024-04-26T10:33:25.811 INFO:teuthology.orchestra.run.smithi043.stdout:max_change 0.05 2024-04-26T10:33:25.811 INFO:teuthology.orchestra.run.smithi043.stdout:max_change_osds 4 2024-04-26T10:33:25.811 INFO:teuthology.orchestra.run.smithi043.stdout:average_utilization 0.0052 2024-04-26T10:33:25.811 INFO:teuthology.orchestra.run.smithi043.stdout:overload_utilization 0.0522 2024-04-26T10:33:25.813 INFO:teuthology.orchestra.run.smithi043.stderr:no change 2024-04-26T10:33:25.825 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-04-26T10:33:25.826 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 1.0 2024-04-26T10:33:25.902 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:25.902 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:25.903 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:25.901+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:25.915 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:25.976 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:33:26.003 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:26.001+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:26.088 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:26.089 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:26.103 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:26.104 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:26.103+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:26.134 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:26.155 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:26.175 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:26.176 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:26.177 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:26.186 INFO:teuthology.orchestra.run.smithi043.stdout:moved 0 / 242 (0%) 2024-04-26T10:33:26.186 INFO:teuthology.orchestra.run.smithi043.stdout:avg 80.6667 2024-04-26T10:33:26.186 INFO:teuthology.orchestra.run.smithi043.stdout:stddev 3.68179 -> 3.68179 (expected baseline 7.33333) 2024-04-26T10:33:26.186 INFO:teuthology.orchestra.run.smithi043.stdout:min osd.1 with 76 -> 76 pgs (0.942149 -> 0.942149 * mean) 2024-04-26T10:33:26.186 INFO:teuthology.orchestra.run.smithi043.stdout:max osd.2 with 85 -> 85 pgs (1.05372 -> 1.05372 * mean) 2024-04-26T10:33:26.187 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:26.187 INFO:teuthology.orchestra.run.smithi043.stdout:oload 1000 2024-04-26T10:33:26.187 INFO:teuthology.orchestra.run.smithi043.stdout:max_change 1 2024-04-26T10:33:26.187 INFO:teuthology.orchestra.run.smithi043.stdout:max_change_osds 4 2024-04-26T10:33:26.187 INFO:teuthology.orchestra.run.smithi043.stdout:average_utilization 0.0052 2024-04-26T10:33:26.187 INFO:teuthology.orchestra.run.smithi043.stdout:overload_utilization 0.0522 2024-04-26T10:33:26.189 INFO:teuthology.orchestra.run.smithi043.stderr:no change 2024-04-26T10:33:26.201 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-04-26T10:33:26.201 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-04-26T10:33:26.205 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:26.204+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:26.275 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:26.275 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:31472 5.6 e21/16 5:6db3163a:::benchmark_data_smithi043_45180_object31471:head v 21'1952, mlcod=21'1950)", 2024-04-26T10:33:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.272344+0000", 2024-04-26T10:33:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0016858279999999999, 2024-04-26T10:33:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017090510000000001, 2024-04-26T10:33:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272344+0000", 2024-04-26T10:33:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272344+0000", 2024-04-26T10:33:26.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272344+0000", 2024-04-26T10:33:26.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272376+0000", 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2057000000000002e-05 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272382+0000", 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1109999999999996e-06 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272387+0000", 2024-04-26T10:33:26.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7310000000000001e-06 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272414+0000", 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7427e-05 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272427+0000", 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3406e-05 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:31476 5.2 5:405832b5:::benchmark_data_smithi043_45180_object31475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.272556+0000", 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.001473502, 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015494420000000001, 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31476 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272556+0000", 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272556+0000", 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272556+0000", 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272632+0000", 2024-04-26T10:33:26.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6209000000000002e-05 2024-04-26T10:33:26.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272638+0000", 2024-04-26T10:33:26.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4470000000000003e-06 2024-04-26T10:33:26.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272643+0000", 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5839999999999996e-06 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272668+0000", 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4635e-05 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272750+0000", 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2721999999999998e-05 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272874+0000", 2024-04-26T10:33:26.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012410700000000001 2024-04-26T10:33:26.284 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.284 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.284 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.284 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:31478 5.2 5:44d88de0:::benchmark_data_smithi043_45180_object31477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:26.284 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.272767+0000", 2024-04-26T10:33:26.284 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0012631879999999999, 2024-04-26T10:33:26.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013895719999999999, 2024-04-26T10:33:26.284 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31478 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272767+0000", 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272767+0000", 2024-04-26T10:33:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272766+0000", 2024-04-26T10:33:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272852+0000", 2024-04-26T10:33:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6032999999999994e-05 2024-04-26T10:33:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272862+0000", 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0645000000000001e-05 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272870+0000", 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2810000000000003e-06 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273795+0000", 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00092482299999999996 2024-04-26T10:33:26.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273903+0000", 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010807900000000001 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274046+0000", 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014304300000000001 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.288 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:31475 5.c e21/16 5:328fb42b:::benchmark_data_smithi043_45180_object31474:head v 21'1919, mlcod=21'1917)", 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.273304+0000", 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00072628500000000002, 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00091115, 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273304+0000", 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273304+0000", 2024-04-26T10:33:26.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273303+0000", 2024-04-26T10:33:26.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273391+0000", 2024-04-26T10:33:26.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8034000000000005e-05 2024-04-26T10:33:26.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273398+0000", 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5989999999999996e-06 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273403+0000", 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.792e-06 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273442+0000", 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8455999999999999e-05 2024-04-26T10:33:26.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273463+0000", 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0899000000000001e-05 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:31481 5.f 5:fe9822eb:::benchmark_data_smithi043_45180_object31480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.273732+0000", 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00029796400000000001, 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053878599999999997, 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.292 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31481 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273732+0000", 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273732+0000", 2024-04-26T10:33:26.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273731+0000", 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273874+0000", 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142843 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273882+0000", 2024-04-26T10:33:26.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8990000000000001e-06 2024-04-26T10:33:26.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273887+0000", 2024-04-26T10:33:26.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1510000000000003e-06 2024-04-26T10:33:26.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273942+0000", 2024-04-26T10:33:26.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5498999999999998e-05 2024-04-26T10:33:26.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274097+0000", 2024-04-26T10:33:26.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000154859 2024-04-26T10:33:26.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:26.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274258+0000", 2024-04-26T10:33:26.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016052800000000001 2024-04-26T10:33:26.300 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.300 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.300 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop_reply(client.4538.0:31464 5.2 e21/16)", 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.273962+0000", 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 6.8088000000000003e-05, 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039602000000000002, 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273962+0000", 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273962+0000", 2024-04-26T10:33:26.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273961+0000", 2024-04-26T10:33:26.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273965+0000", 2024-04-26T10:33:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2179999999999999e-06 2024-04-26T10:33:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273973+0000", 2024-04-26T10:33:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:33:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273979+0000", 2024-04-26T10:33:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4920000000000001e-06 2024-04-26T10:33:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.303 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:31482 5.7 5:e2c4fc81:::benchmark_data_smithi043_45180_object31481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.273945+0000", 2024-04-26T10:33:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.4379e-05, 2024-04-26T10:33:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047956799999999999, 2024-04-26T10:33:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.304 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31482 2024-04-26T10:33:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273945+0000", 2024-04-26T10:33:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273945+0000", 2024-04-26T10:33:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.273945+0000", 2024-04-26T10:33:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274025+0000", 2024-04-26T10:33:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0000999999999995e-05 2024-04-26T10:33:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274033+0000", 2024-04-26T10:33:26.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8429999999999993e-06 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274039+0000", 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5320000000000003e-06 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274286+0000", 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024671799999999999 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274398+0000", 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011170100000000001 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop_reply(client.4538.0:31468 5.2 e21/16)", 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.274092+0000", 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.999938, 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039969400000000003, 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274092+0000", 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274092+0000", 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274091+0000", 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:26.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274096+0000", 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3020000000000002e-06 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274107+0000", 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0219e-05 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274114+0000", 2024-04-26T10:33:26.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8809999999999998e-06 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:31483 5.7 5.8f8126e7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.274125+0000", 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9999046, 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039706799999999999, 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.311 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31483 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274125+0000", 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274125+0000", 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274124+0000", 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274202+0000", 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7432e-05 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274211+0000", 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0909999999999999e-06 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.274220+0000", 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9539999999999993e-06 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:31464 5.2 5:42526f94:::benchmark_data_smithi043_45180_object31463:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.269258+0000", 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0047721600000000001, 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0052995330000000004, 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:26.314 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31464 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.269258+0000", 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.269258+0000", 2024-04-26T10:33:26.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.269257+0000", 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.269283+0000", 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6534e-05 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.269293+0000", 2024-04-26T10:33:26.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6299999999999993e-06 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.269300+0000", 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3780000000000003e-06 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.269338+0000", 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7783000000000001e-05 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.269425+0000", 2024-04-26T10:33:26.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7391000000000004e-05 2024-04-26T10:33:26.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.269535+0000", 2024-04-26T10:33:26.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109782 2024-04-26T10:33:26.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272087+0000", 2024-04-26T10:33:26.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025523550000000001 2024-04-26T10:33:26.318 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:31468 5.2 5:404066ef:::benchmark_data_smithi043_45180_object31467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.269909+0000", 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0041207450000000003, 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047010899999999998, 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.319 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31468 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.269909+0000", 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.269909+0000", 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.269908+0000", 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.270020+0000", 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111742 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.270028+0000", 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7810000000000005e-06 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.270035+0000", 2024-04-26T10:33:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8460000000000002e-06 2024-04-26T10:33:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.270259+0000", 2024-04-26T10:33:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022429500000000001 2024-04-26T10:33:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.270350+0000", 2024-04-26T10:33:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0917999999999999e-05 2024-04-26T10:33:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.270443+0000", 2024-04-26T10:33:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2921e-05 2024-04-26T10:33:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272094+0000", 2024-04-26T10:33:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016511469999999999 2024-04-26T10:33:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:31473 5.f 5:f8ed0d10:::benchmark_data_smithi043_45180_object31472:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.272219+0000", 2024-04-26T10:33:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0018109409999999999, 2024-04-26T10:33:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002438876, 2024-04-26T10:33:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31473 2024-04-26T10:33:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272219+0000", 2024-04-26T10:33:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272219+0000", 2024-04-26T10:33:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272218+0000", 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272285+0000", 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7049000000000001e-05 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272294+0000", 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4780000000000008e-06 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272299+0000", 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1789999999999999e-06 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272340+0000", 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1362000000000001e-05 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272484+0000", 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014335500000000001 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.272652+0000", 2024-04-26T10:33:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016853699999999999 2024-04-26T10:33:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:33:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 12 2024-04-26T10:33:26.330 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:26.331 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:26.330+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:26.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:26.374 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:33:26.418 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 9 16 31877 31861 221.241 173.625 0.00910467 0.00451565 2024-04-26T10:33:26.432 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:26.430+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:26.499 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:26.499 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:33:26.499 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:33:26.499 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:33:26.500 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:26.514 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:26.533 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:26.532+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:26.600 INFO:teuthology.orchestra.run.smithi043.stdout:moved 0 / 242 (0%) 2024-04-26T10:33:26.600 INFO:teuthology.orchestra.run.smithi043.stdout:avg 80.6667 2024-04-26T10:33:26.600 INFO:teuthology.orchestra.run.smithi043.stdout:stddev 3.68179 -> 3.68179 (expected baseline 7.33333) 2024-04-26T10:33:26.600 INFO:teuthology.orchestra.run.smithi043.stdout:min osd.1 with 76 -> 76 pgs (0.942149 -> 0.942149 * mean) 2024-04-26T10:33:26.601 INFO:teuthology.orchestra.run.smithi043.stdout:max osd.2 with 85 -> 85 pgs (1.05372 -> 1.05372 * mean) 2024-04-26T10:33:26.601 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:26.601 INFO:teuthology.orchestra.run.smithi043.stdout:oload 1000 2024-04-26T10:33:26.601 INFO:teuthology.orchestra.run.smithi043.stdout:max_change 0.05 2024-04-26T10:33:26.601 INFO:teuthology.orchestra.run.smithi043.stdout:max_change_osds 4 2024-04-26T10:33:26.601 INFO:teuthology.orchestra.run.smithi043.stdout:average_utilization 0.0052 2024-04-26T10:33:26.602 INFO:teuthology.orchestra.run.smithi043.stdout:overload_utilization 0.0522 2024-04-26T10:33:26.603 INFO:teuthology.orchestra.run.smithi043.stderr:no change 2024-04-26T10:33:26.615 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-04-26T10:33:26.615 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-04-26T10:33:26.633 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:26.633+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:26.726 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:26.726 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:33:26.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:33:26.726 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:26.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.726 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:26.726 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:26.726 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.728909236, 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017960028999999999, 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993792+0000", 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993800+0000", 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0900000000000005e-06 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993805+0000", 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9919999999999998e-06 2024-04-26T10:33:26.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993809+0000", 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.703e-06 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012428800000000001 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993937+0000", 2024-04-26T10:33:26.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0010000000000003e-06 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006732+0000", 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012794972 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006890+0000", 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015741999999999999 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:26.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007049+0000", 2024-04-26T10:33:26.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159872 2024-04-26T10:33:26.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011426+0000", 2024-04-26T10:33:26.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043764370000000004 2024-04-26T10:33:26.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011667+0000", 2024-04-26T10:33:26.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024095400000000001 2024-04-26T10:33:26.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011712+0000", 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4752000000000001e-05 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011753+0000", 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0995999999999998e-05 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.732 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.728842946999997, 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018053829, 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993861+0000", 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4990000000000001e-06 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993868+0000", 2024-04-26T10:33:26.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7190000000000004e-06 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993873+0000", 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0200000000000002e-06 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993968+0000", 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5310999999999996e-05 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993974+0000", 2024-04-26T10:33:26.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008004+0000", 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014029700000000001 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008126+0000", 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122087 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008229+0000", 2024-04-26T10:33:26.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102358 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011613+0000", 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033843279999999998 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011812+0000", 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000198798 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011871+0000", 2024-04-26T10:33:26.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9283000000000001e-05 2024-04-26T10:33:26.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011913+0000", 2024-04-26T10:33:26.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1798000000000002e-05 2024-04-26T10:33:26.738 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.738 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.738 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.738 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:26.738 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:26.738 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.728812900000001, 2024-04-26T10:33:26.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018338483999999999, 2024-04-26T10:33:26.739 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.739 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.739 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:26.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:26.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:26.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993892+0000", 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.546e-06 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993899+0000", 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993906+0000", 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9820000000000002e-06 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994023+0000", 2024-04-26T10:33:26.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116766 2024-04-26T10:33:26.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:26.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994028+0000", 2024-04-26T10:33:26.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7079999999999996e-06 2024-04-26T10:33:26.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008784+0000", 2024-04-26T10:33:26.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014756833 2024-04-26T10:33:26.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008838+0000", 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3112000000000002e-05 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008957+0000", 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119523 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011618+0000", 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026610330000000001 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012154+0000", 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053582800000000002 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012193+0000", 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9047000000000001e-05 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012227+0000", 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4442e-05 2024-04-26T10:33:26.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:13 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.728770662000002, 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018412833, 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:26.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6139999999999999e-06 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993939+0000", 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3279999999999996e-06 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993949+0000", 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.047e-05 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994066+0000", 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116952 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994071+0000", 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869999999999996e-06 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009196+0000", 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015125148 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009272+0000", 2024-04-26T10:33:26.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5440999999999998e-05 2024-04-26T10:33:26.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:26.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009381+0000", 2024-04-26T10:33:26.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010946399999999999 2024-04-26T10:33:26.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012090+0000", 2024-04-26T10:33:26.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027090700000000001 2024-04-26T10:33:26.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012271+0000", 2024-04-26T10:33:26.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018098699999999999 2024-04-26T10:33:26.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012312+0000", 2024-04-26T10:33:26.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0286e-05 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2276000000000001e-05 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:15 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.728709883000001, 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018433715, 2024-04-26T10:33:26.751 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993995+0000", 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.225e-06 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994001+0000", 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0619999999999997e-06 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994004+0000", 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.422e-06 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994157+0000", 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015285 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1449999999999999e-06 2024-04-26T10:33:26.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009937+0000", 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015774455 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010028+0000", 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0746000000000002e-05 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010174+0000", 2024-04-26T10:33:26.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146682 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012358+0000", 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021837900000000001 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012382+0000", 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3768e-05 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012406+0000", 2024-04-26T10:33:26.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4006999999999999e-05 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012426+0000", 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9896000000000001e-05 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:16 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.728686488000001, 2024-04-26T10:33:26.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020879298000000001, 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994017+0000", 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1459999999999999e-06 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994021+0000", 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2169999999999996e-06 2024-04-26T10:33:26.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994025+0000", 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3450000000000002e-06 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996368+0000", 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002342841 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996374+0000", 2024-04-26T10:33:26.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6590000000000001e-06 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010589+0000", 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014214648999999999 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010670+0000", 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1463000000000003e-05 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:26.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010824+0000", 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000154007 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.013067+0000", 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022428629999999999 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014821+0000", 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017534530000000001 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014860+0000", 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9264000000000002e-05 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014895+0000", 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4619999999999997e-05 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:19 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:26.763 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:26.764 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.728672979000002, 2024-04-26T10:33:26.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018265699, 2024-04-26T10:33:26.764 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.764 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.764 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:26.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994031+0000", 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9980000000000002e-06 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994037+0000", 2024-04-26T10:33:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0100000000000001e-06 2024-04-26T10:33:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994043+0000", 2024-04-26T10:33:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1500000000000004e-06 2024-04-26T10:33:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994085+0000", 2024-04-26T10:33:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2354000000000001e-05 2024-04-26T10:33:26.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994095+0000", 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8749999999999995e-06 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008664+0000", 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01456942 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008786+0000", 2024-04-26T10:33:26.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121735 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008948+0000", 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016180400000000001 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010761+0000", 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018125120000000001 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012205+0000", 2024-04-26T10:33:26.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014441040000000001 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012256+0000", 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1817999999999998e-05 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012295+0000", 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8142000000000002e-05 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.770 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:26.770 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:26.770 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.728623904000003, 2024-04-26T10:33:26.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018349608999999999, 2024-04-26T10:33:26.770 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.770 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.770 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:26.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994081+0000", 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0589999999999998e-06 2024-04-26T10:33:26.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994086+0000", 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1900000000000003e-06 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994090+0000", 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.771e-06 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994139+0000", 2024-04-26T10:33:26.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9737999999999997e-05 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994145+0000", 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2460000000000003e-06 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009213+0000", 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015068834 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009263+0000", 2024-04-26T10:33:26.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9991999999999998e-05 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009347+0000", 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3997000000000002e-05 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012307+0000", 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029601229999999998 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6470000000000001e-05 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012390+0000", 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5893000000000003e-05 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012428+0000", 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7721e-05 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.728603210999999, 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017262810999999999, 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994098+0000", 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994105+0000", 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5599999999999999e-06 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994109+0000", 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5419999999999999e-06 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994115+0000", 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.181e-06 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994169+0000", 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4505000000000001e-05 2024-04-26T10:33:26.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994176+0000", 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9090000000000003e-06 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006451+0000", 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012274571999999999 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006594+0000", 2024-04-26T10:33:26.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014321900000000001 2024-04-26T10:33:26.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006804+0000", 2024-04-26T10:33:26.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020967800000000001 2024-04-26T10:33:26.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011137+0000", 2024-04-26T10:33:26.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043333349999999998 2024-04-26T10:33:26.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011261+0000", 2024-04-26T10:33:26.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012443 2024-04-26T10:33:26.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011317+0000", 2024-04-26T10:33:26.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6093e-05 2024-04-26T10:33:26.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011361+0000", 2024-04-26T10:33:26.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4039000000000003e-05 2024-04-26T10:33:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.728574621999996, 2024-04-26T10:33:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017534645000000001, 2024-04-26T10:33:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994130+0000", 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5530000000000001e-06 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994155+0000", 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4703999999999999e-05 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8650000000000003e-06 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997690+0000", 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035285249999999998 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997697+0000", 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1399999999999997e-06 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003133+0000", 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054364549999999998 2024-04-26T10:33:26.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003272+0000", 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138839 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003879+0000", 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00060699599999999995 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009920+0000", 2024-04-26T10:33:26.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060407209999999998 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011512+0000", 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015920940000000001 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011591+0000", 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9054999999999994e-05 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011662+0000", 2024-04-26T10:33:26.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1095999999999998e-05 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.728492891999998, 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017587693000000001, 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994219+0000", 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0421000000000001e-05 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994226+0000", 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4000000000000003e-06 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994232+0000", 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.575e-06 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997723+0000", 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003491133 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997727+0000", 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5769999999999998e-06 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.004741+0000", 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070140410000000004 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005283+0000", 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054229500000000004 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005451+0000", 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016849700000000001 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010173+0000", 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047220259999999998 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011703+0000", 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015294499999999999 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011752+0000", 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9524999999999998e-05 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011797+0000", 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4205000000000001e-05 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.728464359999997, 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01805445, 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994240+0000", 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4920000000000002e-06 2024-04-26T10:33:26.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994249+0000", 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4810000000000006e-06 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994254+0000", 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3839999999999996e-06 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996056+0000", 2024-04-26T10:33:26.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018018839999999999 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996061+0000", 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8690000000000003e-06 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008974+0000", 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012913127 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009078+0000", 2024-04-26T10:33:26.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010333899999999999 2024-04-26T10:33:26.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009193+0000", 2024-04-26T10:33:26.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011555100000000001 2024-04-26T10:33:26.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011374+0000", 2024-04-26T10:33:26.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002180642 2024-04-26T10:33:26.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012202+0000", 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00082862099999999998 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012254+0000", 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1498000000000001e-05 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012292+0000", 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8071999999999997e-05 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.799 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.728401304000002, 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017896868, 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:26.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994300+0000", 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994303+0000", 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.145e-06 2024-04-26T10:33:26.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994310+0000", 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.345e-06 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994317+0000", 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9e-06 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997746+0000", 2024-04-26T10:33:26.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034290190000000002 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997753+0000", 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2999999999999998e-06 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007898+0000", 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010145207 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008073+0000", 2024-04-26T10:33:26.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017543800000000001 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012197+0000", 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041240950000000004 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17792 5.1 5:8c0814d7:::benchmark_data_smithi043_45180_object17791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0109122060000004, 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017771348999999999, 2024-04-26T10:33:26.804 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17792 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711789+0000", 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711901+0000", 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011175600000000001 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711907+0000", 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3049999999999998e-06 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711911+0000", 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0069999999999999e-06 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711940+0000", 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9088999999999999e-05 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712019+0000", 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9134000000000005e-05 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712105+0000", 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5932000000000003e-05 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713135+0000", 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010300610000000001 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729505+0000", 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016369775999999999 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729539+0000", 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4093e-05 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729561+0000", 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1797000000000002e-05 2024-04-26T10:33:26.809 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17796 5.1 5:8c7c4768:::benchmark_data_smithi043_45180_object17795:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.713511+0000", 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0091905079999997, 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016125401000000001, 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.810 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17796 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713511+0000", 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713511+0000", 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713511+0000", 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713562+0000", 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1384000000000001e-05 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713570+0000", 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7649999999999993e-06 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713575+0000", 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.972e-06 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713599+0000", 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4108e-05 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713681+0000", 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713759+0000", 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8530999999999997e-05 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.719093+0000", 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053339370000000004 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729590+0000", 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010496768 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729617+0000", 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6871000000000001e-05 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729637+0000", 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9690999999999998e-05 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17797 5.1 5:89b74c1f:::benchmark_data_smithi043_45180_object17796:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:26.815 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 5.0090321610000004, 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018126438000000002, 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17797 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713669+0000", 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713706+0000", 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6415000000000003e-05 2024-04-26T10:33:26.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713711+0000", 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2140000000000004e-06 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713715+0000", 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2599999999999999e-06 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714380+0000", 2024-04-26T10:33:26.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066529399999999998 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714509+0000", 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012870500000000001 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714643+0000", 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013370600000000001 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.719195+0000", 2024-04-26T10:33:26.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045520430000000004 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731718+0000", 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012523276999999999 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731776+0000", 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7701000000000002e-05 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731796+0000", 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0398999999999999e-05 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:20229 5.1 5:80792ae8:::benchmark_data_smithi043_45180_object20228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.496587+0000", 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.2261152900000001, 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01704321, 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.821 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 20229 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496587+0000", 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496587+0000", 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496586+0000", 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496656+0000", 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9598999999999996e-05 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496664+0000", 2024-04-26T10:33:26.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0970000000000006e-06 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496669+0000", 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.772e-06 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496871+0000", 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000201635 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496986+0000", 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115359 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.497117+0000", 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013059500000000001 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.499635+0000", 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025181069999999999 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.513544+0000", 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013909127 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.513593+0000", 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8412999999999999e-05 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.513630+0000", 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7066000000000001e-05 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.826 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:20232 5.1 5:8b3933d3:::benchmark_data_smithi043_45180_object20231:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.497177+0000", 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.2255249460000002, 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016535396000000001, 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 20232 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.497177+0000", 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.497177+0000", 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.497176+0000", 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:26.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.497265+0000", 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9050999999999998e-05 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.497277+0000", 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1489e-05 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.497284+0000", 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6860000000000006e-06 2024-04-26T10:33:26.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.497819+0000", 2024-04-26T10:33:26.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053439099999999995 2024-04-26T10:33:26.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.497894+0000", 2024-04-26T10:33:26.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5186999999999997e-05 2024-04-26T10:33:26.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.497977+0000", 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2964000000000001e-05 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.499654+0000", 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001677478 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.513638+0000", 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013983377 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.513680+0000", 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1795000000000002e-05 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.513712+0000", 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2716999999999999e-05 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:31862 5.1 5:8c6fd503:::benchmark_data_smithi043_45180_object31861:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.408786+0000", 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.31391624200000001, 2024-04-26T10:33:26.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015925551, 2024-04-26T10:33:26.833 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.833 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.833 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.833 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.833 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.833 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 31862 2024-04-26T10:33:26.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.833 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.408786+0000", 2024-04-26T10:33:26.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.408786+0000", 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.408785+0000", 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.408811+0000", 2024-04-26T10:33:26.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.614e-05 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.408818+0000", 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1570000000000003e-06 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.408823+0000", 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9969999999999998e-06 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.415800+0000", 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069768920000000002 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.415932+0000", 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013186099999999999 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.416075+0000", 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014331399999999999 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.418853+0000", 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027777539999999999 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.424623+0000", 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005769906 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.424673+0000", 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0173999999999998e-05 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.424711+0000", 2024-04-26T10:33:26.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7892999999999998e-05 2024-04-26T10:33:26.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.838 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.838 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:32140 5.2 5:40538810:::benchmark_data_smithi043_45180_object32139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:26.838 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:26.510184+0000", 2024-04-26T10:33:26.838 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.21251818, 2024-04-26T10:33:26.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015962525000000002, 2024-04-26T10:33:26.838 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:26.838 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 32140 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.510184+0000", 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.510184+0000", 2024-04-26T10:33:26.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.510183+0000", 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.510257+0000", 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3446000000000001e-05 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.510264+0000", 2024-04-26T10:33:26.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4749999999999996e-06 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.510271+0000", 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.511089+0000", 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081794699999999997 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.511178+0000", 2024-04-26T10:33:26.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8925999999999995e-05 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.511257+0000", 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9139000000000002e-05 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.514734+0000", 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003477674 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.526067+0000", 2024-04-26T10:33:26.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011332217 2024-04-26T10:33:26.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:26.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.526110+0000", 2024-04-26T10:33:26.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3544999999999997e-05 2024-04-26T10:33:26.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:26.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:26.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:26.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:26.526146+0000", 2024-04-26T10:33:26.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6094999999999999e-05 2024-04-26T10:33:26.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.843 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:26.844 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:26.844 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:26.845 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:26.844+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:26.845 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:26.946 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:26.945+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:27.017 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:27.017 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:27.017 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.018 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:33611 5.a e21/16 5:5baddd1c:::benchmark_data_smithi043_45180_object33610:head v 21'2145, mlcod=21'2143)", 2024-04-26T10:33:27.018 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.014187+0000", 2024-04-26T10:33:27.018 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0021461150000000001, 2024-04-26T10:33:27.018 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002171236, 2024-04-26T10:33:27.018 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.018 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:27.018 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.018 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.018 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.018 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014187+0000", 2024-04-26T10:33:27.018 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.018 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014187+0000", 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014186+0000", 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014248+0000", 2024-04-26T10:33:27.019 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1427000000000007e-05 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014258+0000", 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8640000000000008e-06 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014263+0000", 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9910000000000002e-06 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.020 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014305+0000", 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2438000000000003e-05 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014328+0000", 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2705999999999999e-05 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:33614 5.d 5:bab93c79:::benchmark_data_smithi043_45180_object33613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.014839+0000", 2024-04-26T10:33:27.021 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001494514, 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001583112, 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 33614 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014839+0000", 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.022 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014839+0000", 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014838+0000", 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014901+0000", 2024-04-26T10:33:27.023 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2673000000000001e-05 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014908+0000", 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8359999999999992e-06 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014913+0000", 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7779999999999998e-06 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.024 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014949+0000", 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5845e-05 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015070+0000", 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000121045 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015205+0000", 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000134697 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.025 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:33615 5.0 5:0b1f63f8:::benchmark_data_smithi043_45180_object33614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.014921+0000", 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001412235, 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001588686, 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 33615 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.026 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014921+0000", 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014921+0000", 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014920+0000", 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.027 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014957+0000", 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6365999999999997e-05 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014961+0000", 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6140000000000002e-06 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014966+0000", 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4000000000000002e-06 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.028 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.014999+0000", 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3662999999999999e-05 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015118+0000", 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011886 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015231+0000", 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112754 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.029 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:33616 5.4 5:28488384:::benchmark_data_smithi043_45180_object33615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.015011+0000", 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001321692, 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00158457, 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 33616 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.030 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.031 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.031 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.031 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015011+0000", 2024-04-26T10:33:27.031 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.031 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.031 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.031 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.031 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015011+0000", 2024-04-26T10:33:27.031 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.031 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.031 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.031 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.031 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015011+0000", 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015056+0000", 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5203000000000001e-05 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015061+0000", 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9960000000000001e-06 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.032 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015065+0000", 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5920000000000001e-06 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015106+0000", 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1427999999999997e-05 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015227+0000", 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000121206 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.033 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015400+0000", 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00017260999999999999 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:33617 5.8 5:1aea921b:::benchmark_data_smithi043_45180_object33616:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.015079+0000", 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0012536769999999999, 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00160253, 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.034 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 33617 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015079+0000", 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015079+0000", 2024-04-26T10:33:27.035 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015079+0000", 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015160+0000", 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0856e-05 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015165+0000", 2024-04-26T10:33:27.036 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6700000000000002e-06 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015169+0000", 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.267e-06 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015200+0000", 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0738000000000003e-05 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015318+0000", 2024-04-26T10:33:27.037 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000118164 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015403+0000", 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5308000000000004e-05 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:33618 5.4 5:2afbd861:::benchmark_data_smithi043_45180_object33617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.015176+0000", 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0011575260000000001, 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015886170000000001, 2024-04-26T10:33:27.038 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 33618 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015176+0000", 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.039 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015176+0000", 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015175+0000", 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015214+0000", 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9078000000000001e-05 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.040 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015221+0000", 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8789999999999997e-06 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.015228+0000", 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2019999999999998e-06 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.016468+0000", 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012397339999999999 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.041 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.016562+0000", 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3644e-05 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.016640+0000", 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7935999999999994e-05 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 6 2024-04-26T10:33:27.042 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:27.043 INFO:tasks.ceph.mgr.y.smithi043.stderr:2024-04-26T10:33:27.017+0000 7f8f7f011700 -1 mgr.server reply reply (1) Operation not permitted no change 2024-04-26T10:33:27.044 INFO:teuthology.orchestra.run.smithi043.stdout:moved 24 / 242 (9.91736%) 2024-04-26T10:33:27.044 INFO:teuthology.orchestra.run.smithi043.stdout:avg 80.6667 2024-04-26T10:33:27.044 INFO:teuthology.orchestra.run.smithi043.stdout:stddev 3.68179 -> 14.197 (expected baseline 7.33333) 2024-04-26T10:33:27.044 INFO:teuthology.orchestra.run.smithi043.stdout:min osd.1 with 76 -> 87 pgs (0.942149 -> 1.07851 * mean) 2024-04-26T10:33:27.044 INFO:teuthology.orchestra.run.smithi043.stdout:max osd.2 with 85 -> 61 pgs (1.05372 -> 0.756198 * mean) 2024-04-26T10:33:27.044 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:27.044 INFO:teuthology.orchestra.run.smithi043.stdout:oload 110 2024-04-26T10:33:27.044 INFO:teuthology.orchestra.run.smithi043.stdout:max_change 1 2024-04-26T10:33:27.044 INFO:teuthology.orchestra.run.smithi043.stdout:max_change_osds 4 2024-04-26T10:33:27.044 INFO:teuthology.orchestra.run.smithi043.stdout:average_utilization 0.0126 2024-04-26T10:33:27.044 INFO:teuthology.orchestra.run.smithi043.stdout:overload_utilization 0.0139 2024-04-26T10:33:27.044 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2 weight 1.0000 -> 0.8063 2024-04-26T10:33:27.045 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:27.046 INFO:teuthology.orchestra.run.smithi043.stderr:no change 2024-04-26T10:33:27.046 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-04-26T10:33:27.046 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2024-04-26T10:33:27.086 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:27.085+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:27.149 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:27.148+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:27.248 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:27.248 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:33:27.248 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:33:27.248 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:33:27.248 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:27.249 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:27.247+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:27.261 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:27.350 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:27.348+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:27.371 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-26T10:33:27.414 INFO:teuthology.orchestra.run.smithi043.stdout:moved 0 / 242 (0%) 2024-04-26T10:33:27.414 INFO:teuthology.orchestra.run.smithi043.stdout:avg 80.6667 2024-04-26T10:33:27.414 INFO:teuthology.orchestra.run.smithi043.stdout:stddev 3.68179 -> 3.68179 (expected baseline 7.33333) 2024-04-26T10:33:27.414 INFO:teuthology.orchestra.run.smithi043.stdout:min osd.1 with 76 -> 76 pgs (0.942149 -> 0.942149 * mean) 2024-04-26T10:33:27.414 INFO:teuthology.orchestra.run.smithi043.stdout:max osd.2 with 85 -> 85 pgs (1.05372 -> 1.05372 * mean) 2024-04-26T10:33:27.414 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:27.414 INFO:teuthology.orchestra.run.smithi043.stdout:oload 1000 2024-04-26T10:33:27.414 INFO:teuthology.orchestra.run.smithi043.stdout:max_change 1 2024-04-26T10:33:27.415 INFO:teuthology.orchestra.run.smithi043.stdout:max_change_osds 4 2024-04-26T10:33:27.415 INFO:teuthology.orchestra.run.smithi043.stdout:average_utilization 0.0126 2024-04-26T10:33:27.415 INFO:teuthology.orchestra.run.smithi043.stdout:overload_utilization 0.1263 2024-04-26T10:33:27.417 INFO:teuthology.orchestra.run.smithi043.stderr:no change 2024-04-26T10:33:27.417 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 10 16 34751 34735 217.078 179.625 0.0061239 0.00460264 2024-04-26T10:33:27.431 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:27.431 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:33:27.431 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:33:27.431 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:27.431 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.431 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:27.431 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994163+0000", 2024-04-26T10:33:27.431 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 35.434233886000001, 2024-04-26T10:33:27.431 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014381321000000001, 2024-04-26T10:33:27.431 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.431 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.431 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994163+0000", 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994163+0000", 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994161+0000", 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999981 2024-04-26T10:33:27.432 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.433 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.433 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.433 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994172+0000", 2024-04-26T10:33:27.433 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0889e-05 2024-04-26T10:33:27.433 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.433 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.433 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.433 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994201+0000", 2024-04-26T10:33:27.433 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9059000000000001e-05 2024-04-26T10:33:27.433 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.433 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.433 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994242+0000", 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1121000000000002e-05 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994597+0000", 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00035472299999999998 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994769+0000", 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000172139 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.434 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994938+0000", 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0001694 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998089+0000", 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0031503640000000001 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008433+0000", 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010344020000000001 2024-04-26T10:33:27.435 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008492+0000", 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9370999999999998e-05 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008544+0000", 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2030999999999997e-05 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.436 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994299+0000", 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 35.434097577999999, 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014404745, 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994299+0000", 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.437 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994299+0000", 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994298+0000", 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994305+0000", 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.063e-06 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.438 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994328+0000", 2024-04-26T10:33:27.439 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2819e-05 2024-04-26T10:33:27.439 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.439 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.439 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.439 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994345+0000", 2024-04-26T10:33:27.439 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6952e-05 2024-04-26T10:33:27.439 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.439 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.439 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.439 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994863+0000", 2024-04-26T10:33:27.439 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000518192 2024-04-26T10:33:27.439 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994990+0000", 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000126802 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995146+0000", 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015556700000000001 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998096+0000", 2024-04-26T10:33:27.440 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0029506799999999998 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008616+0000", 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010520102999999999 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008664+0000", 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7219000000000003e-05 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008704+0000", 2024-04-26T10:33:27.441 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0330000000000002e-05 2024-04-26T10:33:27.442 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.442 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.442 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.442 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.442 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.442 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:17 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:27.442 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994833+0000", 2024-04-26T10:33:27.442 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 35.433564048000001, 2024-04-26T10:33:27.442 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014019953999999999, 2024-04-26T10:33:27.442 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.442 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.442 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994833+0000", 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994833+0000", 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994832+0000", 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:27.443 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994845+0000", 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3159999999999999e-05 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994855+0000", 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0045e-05 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994863+0000", 2024-04-26T10:33:27.444 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1750000000000005e-06 2024-04-26T10:33:27.445 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.445 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.445 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.445 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995186+0000", 2024-04-26T10:33:27.445 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00032241399999999998 2024-04-26T10:33:27.445 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.445 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.445 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.445 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995240+0000", 2024-04-26T10:33:27.445 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4054000000000001e-05 2024-04-26T10:33:27.445 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.445 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.445 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:27.446 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995318+0000", 2024-04-26T10:33:27.446 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8665999999999995e-05 2024-04-26T10:33:27.446 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.446 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.446 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.446 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998102+0000", 2024-04-26T10:33:27.446 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027840830000000001 2024-04-26T10:33:27.446 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.446 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.446 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.446 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008616+0000", 2024-04-26T10:33:27.446 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010513623999999999 2024-04-26T10:33:27.446 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008663+0000", 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7172000000000002e-05 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008853+0000", 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00018943200000000001 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.447 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:18 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 35.433527456999997, 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014077793999999999, 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.448 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:27.449 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.449 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.449 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.449 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.449 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:27.449 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.449 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.449 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.449 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.449 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994874+0000", 2024-04-26T10:33:27.449 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5509999999999999e-06 2024-04-26T10:33:27.449 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.449 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994881+0000", 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8979999999999999e-06 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994889+0000", 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995378+0000", 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00048941399999999997 2024-04-26T10:33:27.450 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995429+0000", 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0878000000000003e-05 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995513+0000", 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4412000000000004e-05 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998109+0000", 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0025955319999999998 2024-04-26T10:33:27.451 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008861+0000", 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010752421999999999 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008909+0000", 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7788999999999999e-05 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008947+0000", 2024-04-26T10:33:27.452 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7888e-05 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994894+0000", 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 35.433502935999996, 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013916404, 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.453 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994894+0000", 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994894+0000", 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994893+0000", 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.454 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994897+0000", 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7299999999999999e-06 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994904+0000", 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6270000000000002e-06 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994909+0000", 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6760000000000004e-06 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.455 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996220+0000", 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001310192 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996370+0000", 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015071099999999999 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.996516+0000", 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014541200000000001 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.456 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998074+0000", 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015584539999999999 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008719+0000", 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010645116 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008760+0000", 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0284000000000003e-05 2024-04-26T10:33:27.457 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008810+0000", 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0662999999999999e-05 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:20558 5.b 5:d77cf81f:::benchmark_data_smithi043_45180_object20557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:22.622476+0000", 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.8059210429999997, 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013469722, 2024-04-26T10:33:27.458 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 20558 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.622476+0000", 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.459 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.622476+0000", 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.622475+0000", 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.622532+0000", 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6700999999999998e-05 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.460 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.461 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.622542+0000", 2024-04-26T10:33:27.461 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0088999999999999e-05 2024-04-26T10:33:27.461 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.461 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.461 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.461 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.622547+0000", 2024-04-26T10:33:27.461 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4990000000000002e-06 2024-04-26T10:33:27.461 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.461 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.461 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.461 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.624784+0000", 2024-04-26T10:33:27.461 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0022365509999999998 2024-04-26T10:33:27.461 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.624914+0000", 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012986900000000001 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.625046+0000", 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013208600000000001 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.627999+0000", 2024-04-26T10:33:27.462 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0029527920000000001 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.635863+0000", 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0078647760000000004 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.635910+0000", 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6088999999999999e-05 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:22.635945+0000", 2024-04-26T10:33:27.463 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5848e-05 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:22419 5.8 5:10660f00:::benchmark_data_smithi043_45180_object22418:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:23.197679+0000", 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.2307182240000003, 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013402851, 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.464 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 22419 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197679+0000", 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197679+0000", 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.465 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197678+0000", 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197748+0000", 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9702000000000005e-05 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197756+0000", 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5620000000000004e-06 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.466 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197761+0000", 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2900000000000002e-06 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197787+0000", 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5051000000000001e-05 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197861+0000", 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4396999999999999e-05 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.467 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.197943+0000", 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1972999999999996e-05 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.198997+0000", 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0010536860000000001 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.211028+0000", 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012030997999999999 2024-04-26T10:33:27.468 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.211060+0000", 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.222e-05 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:23.211081+0000", 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1594e-05 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.469 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:31403 5.d 5:b3751861:::benchmark_data_smithi043_45180_object31402:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.470 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.243061+0000", 2024-04-26T10:33:27.470 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.1853360980000001, 2024-04-26T10:33:27.470 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.015570651, 2024-04-26T10:33:27.470 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.470 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.470 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.470 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.470 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.470 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 31403 2024-04-26T10:33:27.470 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.470 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.470 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.470 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243061+0000", 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243061+0000", 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243060+0000", 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.471 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243105+0000", 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4527999999999998e-05 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243113+0000", 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9359999999999999e-06 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243119+0000", 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2539999999999998e-06 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.472 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.247180+0000", 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.004060953 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.247314+0000", 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013399700000000001 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.247449+0000", 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000135127 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.473 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.250337+0000", 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0028879499999999998 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.258539+0000", 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0082021630000000002 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.258590+0000", 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0630000000000001e-05 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.474 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.258631+0000", 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1702999999999997e-05 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:31405 5.d 5:b6ecb5fe:::benchmark_data_smithi043_45180_object31404:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.243137+0000", 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.18525993, 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.015575868, 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.475 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 31405 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243137+0000", 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243137+0000", 2024-04-26T10:33:27.476 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243136+0000", 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243163+0000", 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6684999999999999e-05 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243173+0000", 2024-04-26T10:33:27.477 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7750000000000004e-06 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243179+0000", 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2709999999999998e-06 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.250351+0000", 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0071723619999999998 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.478 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.250426+0000", 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4312000000000003e-05 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.250506+0000", 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0354999999999999e-05 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.255758+0000", 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052520850000000001 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.479 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.258640+0000", 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002882463 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.258680+0000", 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9702e-05 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.258713+0000", 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.480 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:31767 5.d 5:bdbffcf5:::benchmark_data_smithi043_45180_object31766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.367960+0000", 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.060437058, 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013427122999999999, 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 31767 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.481 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.367960+0000", 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.367960+0000", 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.367959+0000", 2024-04-26T10:33:27.482 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.368045+0000", 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5348999999999999e-05 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.368051+0000", 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6989999999999997e-06 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.368058+0000", 2024-04-26T10:33:27.483 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7440000000000001e-06 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.368091+0000", 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2685999999999998e-05 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.368169+0000", 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8398000000000004e-05 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:27.484 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.368255+0000", 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007000000000005e-05 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.370730+0000", 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0024751220000000002 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381315+0000", 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010584959999999999 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.485 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381351+0000", 2024-04-26T10:33:27.486 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6191e-05 2024-04-26T10:33:27.486 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.486 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.486 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.486 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381387+0000", 2024-04-26T10:33:27.486 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5408999999999999e-05 2024-04-26T10:33:27.486 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.486 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.486 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.486 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.486 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.486 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:31794 5.b 5:de40b8b9:::benchmark_data_smithi043_45180_object31793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.486 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.381534+0000", 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.046862784, 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014347876000000001, 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 31794 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381534+0000", 2024-04-26T10:33:27.487 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.488 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.488 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.488 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.488 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381534+0000", 2024-04-26T10:33:27.488 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.488 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.488 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.488 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.488 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381533+0000", 2024-04-26T10:33:27.488 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.488 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.488 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.489 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.489 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381593+0000", 2024-04-26T10:33:27.489 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9723999999999999e-05 2024-04-26T10:33:27.489 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.489 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.489 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.489 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381599+0000", 2024-04-26T10:33:27.489 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0870000000000003e-06 2024-04-26T10:33:27.489 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.489 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.489 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.489 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381603+0000", 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5300000000000001e-06 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.387339+0000", 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0057357579999999997 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.387421+0000", 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2738999999999995e-05 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.490 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.387500+0000", 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8405999999999994e-05 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.389239+0000", 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017392620000000001 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.395811+0000", 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006571637 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.491 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.395848+0000", 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7728000000000002e-05 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.395882+0000", 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3491000000000002e-05 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:32372 5.b 5:d4532611:::benchmark_data_smithi043_45180_object32371:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.492 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.592341+0000", 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.83605525400000003, 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014138509, 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 32372 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.592341+0000", 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.493 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.592341+0000", 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.592341+0000", 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.592365+0000", 2024-04-26T10:33:27.494 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4273e-05 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.592372+0000", 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8340000000000001e-06 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.592378+0000", 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.463e-06 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.594380+0000", 2024-04-26T10:33:27.495 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020027500000000002 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.594459+0000", 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8895999999999998e-05 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.594539+0000", 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0022000000000001e-05 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.600466+0000", 2024-04-26T10:33:27.496 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059269450000000003 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.606396+0000", 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059302620000000004 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.606445+0000", 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8677000000000002e-05 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.497 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.606480+0000", 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4912e-05 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:32381 5.e 5:79c4f0f0:::benchmark_data_smithi043_45180_object32380:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.599888+0000", 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.82850922699999996, 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013288240999999999, 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.498 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 32381 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.599888+0000", 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.599888+0000", 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.499 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.599887+0000", 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.599972+0000", 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4685999999999995e-05 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.599978+0000", 2024-04-26T10:33:27.500 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9429999999999997e-06 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.599982+0000", 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.878e-06 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.600017+0000", 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5892999999999997e-05 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.501 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.600098+0000", 2024-04-26T10:33:27.502 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0767999999999996e-05 2024-04-26T10:33:27.502 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.502 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.502 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.502 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.600201+0000", 2024-04-26T10:33:27.502 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000102636 2024-04-26T10:33:27.502 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.502 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.502 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.502 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.606429+0000", 2024-04-26T10:33:27.502 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0062280310000000002 2024-04-26T10:33:27.502 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.502 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.613127+0000", 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066981189999999998 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.613155+0000", 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8050000000000001e-05 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.613176+0000", 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0678000000000001e-05 2024-04-26T10:33:27.503 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:32531 5.4 5:26c5d6b3:::benchmark_data_smithi043_45180_object32530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.653810+0000", 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.77458655200000004, 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014203341, 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.504 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 32531 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653810+0000", 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653810+0000", 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.505 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.506 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653809+0000", 2024-04-26T10:33:27.506 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:27.506 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.506 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.506 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.506 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653879+0000", 2024-04-26T10:33:27.506 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9739000000000004e-05 2024-04-26T10:33:27.506 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.506 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.506 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.506 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653895+0000", 2024-04-26T10:33:27.506 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5637e-05 2024-04-26T10:33:27.506 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653900+0000", 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2449999999999998e-06 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653924+0000", 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4087000000000002e-05 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653997+0000", 2024-04-26T10:33:27.507 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2683999999999997e-05 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.654073+0000", 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6110000000000001e-05 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.658892+0000", 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0048186749999999997 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.508 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.667933+0000", 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0090412989999999992 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.667976+0000", 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3436000000000002e-05 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.668014+0000", 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7194999999999999e-05 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.509 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.510 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.510 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:33192 5.0 5:0f3efe62:::benchmark_data_smithi043_45180_object33191:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.510 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.868663+0000", 2024-04-26T10:33:27.510 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.55973409699999999, 2024-04-26T10:33:27.510 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014300764000000001, 2024-04-26T10:33:27.510 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.510 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.510 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.510 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.510 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.510 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 33192 2024-04-26T10:33:27.510 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.510 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.511 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.511 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.511 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.868663+0000", 2024-04-26T10:33:27.511 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.511 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.511 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.511 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.511 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.868663+0000", 2024-04-26T10:33:27.511 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.511 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.511 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.511 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.511 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.868662+0000", 2024-04-26T10:33:27.512 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.512 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.512 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.512 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.512 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.868707+0000", 2024-04-26T10:33:27.512 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4928000000000001e-05 2024-04-26T10:33:27.512 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.512 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.512 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.512 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.868716+0000", 2024-04-26T10:33:27.512 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6170000000000007e-06 2024-04-26T10:33:27.512 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.512 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.868722+0000", 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4749999999999998e-06 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.870814+0000", 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020915590000000002 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.870939+0000", 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012513199999999999 2024-04-26T10:33:27.513 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.871065+0000", 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012621799999999999 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.876279+0000", 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052140870000000001 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.882883+0000", 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066035410000000001 2024-04-26T10:33:27.514 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.882920+0000", 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7546000000000003e-05 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.882963+0000", 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3319999999999999e-05 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.515 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:33291 5.e 5:765c5d74:::benchmark_data_smithi043_45180_object33290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.905255+0000", 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.52314196599999996, 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013902981, 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 33291 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.516 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.905255+0000", 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.905255+0000", 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.905254+0000", 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.517 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.518 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.518 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.905340+0000", 2024-04-26T10:33:27.518 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5499000000000003e-05 2024-04-26T10:33:27.518 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.518 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.518 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.518 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.905353+0000", 2024-04-26T10:33:27.518 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3623e-05 2024-04-26T10:33:27.518 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.518 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.518 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.518 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.905358+0000", 2024-04-26T10:33:27.518 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5789999999999997e-06 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.907997+0000", 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002639457 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.908081+0000", 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3790999999999998e-05 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.519 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.908168+0000", 2024-04-26T10:33:27.520 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6652999999999999e-05 2024-04-26T10:33:27.520 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.520 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.520 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.520 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.913699+0000", 2024-04-26T10:33:27.520 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0055312360000000001 2024-04-26T10:33:27.520 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.520 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.520 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.520 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.919076+0000", 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0053772619999999998 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.919118+0000", 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2150000000000001e-05 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.919158+0000", 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9385000000000003e-05 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.521 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.522 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.522 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:33301 5.8 5:1895c164:::benchmark_data_smithi043_45180_object33300:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:27.522 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.911024+0000", 2024-04-26T10:33:27.522 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.51737233800000004, 2024-04-26T10:33:27.522 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013648741000000001, 2024-04-26T10:33:27.522 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.522 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.522 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.522 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.522 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.522 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 33301 2024-04-26T10:33:27.522 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.522 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.523 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.523 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.523 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.911024+0000", 2024-04-26T10:33:27.523 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.527 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.911024+0000", 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.911024+0000", 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.911100+0000", 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5956000000000003e-05 2024-04-26T10:33:27.528 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.529 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.529 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.911106+0000", 2024-04-26T10:33:27.529 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8470000000000001e-06 2024-04-26T10:33:27.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.529 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.529 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.911110+0000", 2024-04-26T10:33:27.529 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2390000000000004e-06 2024-04-26T10:33:27.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.529 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.529 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.913664+0000", 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0025544299999999999 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.913775+0000", 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000110321 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.913897+0000", 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012221000000000001 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.919172+0000", 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052753629999999999 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.924626+0000", 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0054535729999999998 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.924653+0000", 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6914e-05 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.531 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.924673+0000", 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0466e-05 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:34653 5.4 5:27104fda:::benchmark_data_smithi043_45180_object34652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.378611+0000", 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.049785310999999999, 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014296991, 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.532 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 34653 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378611+0000", 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378611+0000", 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.533 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378610+0000", 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378729+0000", 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000119157 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378738+0000", 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4209999999999995e-06 2024-04-26T10:33:27.534 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378744+0000", 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5729999999999996e-06 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378783+0000", 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8943999999999998e-05 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378922+0000", 2024-04-26T10:33:27.535 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013840099999999999 2024-04-26T10:33:27.536 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.536 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.536 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.536 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.379059+0000", 2024-04-26T10:33:27.536 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013718899999999999 2024-04-26T10:33:27.536 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.536 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.536 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.536 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.386674+0000", 2024-04-26T10:33:27.536 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0076146870000000002 2024-04-26T10:33:27.536 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.536 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.536 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.537 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.392815+0000", 2024-04-26T10:33:27.537 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0061409589999999997 2024-04-26T10:33:27.537 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.537 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.537 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.537 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.392866+0000", 2024-04-26T10:33:27.537 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1248999999999997e-05 2024-04-26T10:33:27.537 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.537 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.537 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.537 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.392908+0000", 2024-04-26T10:33:27.537 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2602000000000003e-05 2024-04-26T10:33:27.537 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.538 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.538 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.538 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.538 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.538 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:34704 5.0 5:0a1e195d:::benchmark_data_smithi043_45180_object34703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:27.538 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.399336+0000", 2024-04-26T10:33:27.538 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.029060875, 2024-04-26T10:33:27.538 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013871563, 2024-04-26T10:33:27.538 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.538 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.538 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.538 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.538 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 34704 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.399336+0000", 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.399336+0000", 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.539 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.399335+0000", 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.399356+0000", 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0248999999999999e-05 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.399361+0000", 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.339e-06 2024-04-26T10:33:27.540 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.399365+0000", 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.568e-06 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.401467+0000", 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002102273 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.401579+0000", 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112457 2024-04-26T10:33:27.541 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.401701+0000", 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000121883 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.405127+0000", 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0034261579999999999 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.413117+0000", 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0079900930000000002 2024-04-26T10:33:27.542 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.543 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.543 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.543 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.413169+0000", 2024-04-26T10:33:27.543 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1635999999999998e-05 2024-04-26T10:33:27.543 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.543 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.543 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.543 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.413207+0000", 2024-04-26T10:33:27.543 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8355000000000001e-05 2024-04-26T10:33:27.543 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.543 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.543 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.543 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:34708 5.8 5:1dd7f816:::benchmark_data_smithi043_45180_object34707:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.399615+0000", 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.028781844000000001, 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013690631999999999, 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 34708 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:27.544 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.399615+0000", 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.399615+0000", 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.399614+0000", 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:27.545 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.399754+0000", 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000139763 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.399764+0000", 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6560000000000004e-06 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.399776+0000", 2024-04-26T10:33:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2454e-05 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.404431+0000", 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0046553710000000002 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.404515+0000", 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3580999999999998e-05 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:27.547 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.404609+0000", 2024-04-26T10:33:27.548 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.4442000000000001e-05 2024-04-26T10:33:27.548 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.548 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.548 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.548 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.408918+0000", 2024-04-26T10:33:27.548 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0043087510000000004 2024-04-26T10:33:27.548 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.548 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.548 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:27.548 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.413219+0000", 2024-04-26T10:33:27.548 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0043007560000000002 2024-04-26T10:33:27.548 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.548 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.413260+0000", 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0938e-05 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.413306+0000", 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5729000000000002e-05 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:27.549 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:27.551 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:27.550+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:27.552 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:27.652 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:27.650+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:27.739 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:27.739 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:27.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.739 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35621 5.0 e22/16 5:05e8438f:::benchmark_data_smithi043_45180_object35620:head v 22'2237, mlcod=22'2235)", 2024-04-26T10:33:27.739 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.734118+0000", 2024-04-26T10:33:27.739 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0028108669999999999, 2024-04-26T10:33:27.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028290199999999998, 2024-04-26T10:33:27.739 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.739 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:27.739 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734118+0000", 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734118+0000", 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734117+0000", 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734147+0000", 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9428e-05 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734157+0000", 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0567999999999999e-05 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734164+0000", 2024-04-26T10:33:27.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3420000000000002e-06 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734202+0000", 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7295999999999997e-05 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734221+0000", 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9300000000000002e-05 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.743 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35616 5.4 e22/16 5:25640862:::benchmark_data_smithi043_45180_object35615:head v 22'2201, mlcod=22'2198)", 2024-04-26T10:33:27.743 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.734181+0000", 2024-04-26T10:33:27.743 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0027479240000000001, 2024-04-26T10:33:27.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028156420000000001, 2024-04-26T10:33:27.743 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.743 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:27.743 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734181+0000", 2024-04-26T10:33:27.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734181+0000", 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734180+0000", 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734215+0000", 2024-04-26T10:33:27.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4468999999999998e-05 2024-04-26T10:33:27.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734222+0000", 2024-04-26T10:33:27.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:33:27.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734227+0000", 2024-04-26T10:33:27.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0320000000000003e-06 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734259+0000", 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1445999999999997e-05 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734276+0000", 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7272999999999999e-05 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35615 5.b e22/16 5:d7583d6f:::benchmark_data_smithi043_45180_object35614:head v 22'2254, mlcod=22'2251)", 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.734236+0000", 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0026925949999999999, 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002814258, 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734236+0000", 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734236+0000", 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734236+0000", 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734267+0000", 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1106999999999999e-05 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734274+0000", 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9260000000000003e-06 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734279+0000", 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8439999999999997e-06 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734393+0000", 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114194 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734415+0000", 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1999999999999999e-05 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35618 5.b e22/16)", 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.734290+0000", 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0026386169999999998, 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028182419999999999, 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.750 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734290+0000", 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734290+0000", 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734290+0000", 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734316+0000", 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6407e-05 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734323+0000", 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9800000000000001e-06 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734328+0000", 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7419999999999997e-06 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.737100+0000", 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027722929999999999 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35625 5.a 5:584f60ba:::benchmark_data_smithi043_45180_object35624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.734530+0000", 2024-04-26T10:33:27.753 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0023986989999999998, 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002643079, 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35625 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734530+0000", 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734530+0000", 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734529+0000", 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734597+0000", 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7682999999999996e-05 2024-04-26T10:33:27.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734607+0000", 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0185e-05 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734613+0000", 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2639999999999997e-06 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734656+0000", 2024-04-26T10:33:27.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2719999999999998e-05 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734783+0000", 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012687899999999999 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734911+0000", 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000128563 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35627 5.a 5.a39a303a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.734622+0000", 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0023063129999999999, 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026755659999999999, 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35627 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734622+0000", 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734622+0000", 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734622+0000", 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734655+0000", 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3068999999999998e-05 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734662+0000", 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9070000000000001e-06 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734667+0000", 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0289999999999996e-06 2024-04-26T10:33:27.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.737281+0000", 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026141200000000002 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35628 5.5 5:adf33549:::benchmark_data_smithi043_45180_object35627:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.734672+0000", 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0022566550000000002, 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00269995, 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.761 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35628 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734672+0000", 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734672+0000", 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734671+0000", 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734723+0000", 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1983e-05 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734731+0000", 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9449999999999993e-06 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734737+0000", 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3029999999999999e-06 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734793+0000", 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6768000000000003e-05 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734868+0000", 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4661999999999998e-05 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734945+0000", 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7212999999999994e-05 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.737279+0000", 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023336590000000001 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.765 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.766 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35629 5.3 5:c3d2e16a:::benchmark_data_smithi043_45180_object35628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:27.766 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.734742+0000", 2024-04-26T10:33:27.766 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0021868059999999999, 2024-04-26T10:33:27.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027429350000000002, 2024-04-26T10:33:27.766 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.766 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:27.766 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:27.766 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:27.766 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.766 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35629 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734742+0000", 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734742+0000", 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734741+0000", 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734769+0000", 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7226e-05 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734775+0000", 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3860000000000004e-06 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734781+0000", 2024-04-26T10:33:27.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9850000000000003e-06 2024-04-26T10:33:27.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:27.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.737088+0000", 2024-04-26T10:33:27.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023065690000000001 2024-04-26T10:33:27.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:27.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.737195+0000", 2024-04-26T10:33:27.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010702800000000001 2024-04-26T10:33:27.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:27.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.737306+0000", 2024-04-26T10:33:27.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011161499999999999 2024-04-26T10:33:27.770 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.770 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.770 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.770 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35626 5.7 e22/16 5:ed752dfc:::benchmark_data_smithi043_45180_object35625:head v 22'2155, mlcod=22'2153)", 2024-04-26T10:33:27.770 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.734969+0000", 2024-04-26T10:33:27.770 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0019599610000000001, 2024-04-26T10:33:27.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025800409999999999, 2024-04-26T10:33:27.770 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.771 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:27.771 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734969+0000", 2024-04-26T10:33:27.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734969+0000", 2024-04-26T10:33:27.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734968+0000", 2024-04-26T10:33:27.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.735054+0000", 2024-04-26T10:33:27.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5706999999999998e-05 2024-04-26T10:33:27.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.735064+0000", 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7249999999999992e-06 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.735070+0000", 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6320000000000002e-06 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.735119+0000", 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8628999999999998e-05 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:27.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.735142+0000", 2024-04-26T10:33:27.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3017e-05 2024-04-26T10:33:27.774 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.774 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.774 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.774 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35625 5.a e22/16)", 2024-04-26T10:33:27.774 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.736859+0000", 2024-04-26T10:33:27.774 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.9324000000000002e-05, 2024-04-26T10:33:27.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00072037299999999996, 2024-04-26T10:33:27.774 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.774 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.736859+0000", 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.736859+0000", 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.736859+0000", 2024-04-26T10:33:27.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.736865+0000", 2024-04-26T10:33:27.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.263e-06 2024-04-26T10:33:27.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.736876+0000", 2024-04-26T10:33:27.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1209999999999999e-05 2024-04-26T10:33:27.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.736883+0000", 2024-04-26T10:33:27.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7950000000000002e-06 2024-04-26T10:33:27.777 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.777 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.777 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.777 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35619 5.a 5:5d67cbe3:::benchmark_data_smithi043_45180_object35618:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:27.777 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.730836+0000", 2024-04-26T10:33:27.777 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.006092699, 2024-04-26T10:33:27.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067741290000000003, 2024-04-26T10:33:27.777 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.777 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:27.778 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:27.778 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:27.778 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.778 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35619 2024-04-26T10:33:27.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.778 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.730836+0000", 2024-04-26T10:33:27.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.730836+0000", 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.730835+0000", 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.730999+0000", 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000163752 2024-04-26T10:33:27.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.731009+0000", 2024-04-26T10:33:27.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9189999999999994e-06 2024-04-26T10:33:27.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.731015+0000", 2024-04-26T10:33:27.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5230000000000001e-06 2024-04-26T10:33:27.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:27.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.731063+0000", 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7373999999999997e-05 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.731185+0000", 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012236199999999999 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.731317+0000", 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013174000000000001 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734443+0000", 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031264019999999999 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35614 5.2 e22/16 5:43d0ff5d:::benchmark_data_smithi043_45180_object35613:head v 22'2261, mlcod=22'2259)", 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.732351+0000", 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0045781049999999998, 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053128409999999996, 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:27.782 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732351+0000", 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732351+0000", 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732350+0000", 2024-04-26T10:33:27.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732389+0000", 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8538000000000003e-05 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732405+0000", 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6169999999999999e-05 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732411+0000", 2024-04-26T10:33:27.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.55e-06 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732440+0000", 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9096999999999999e-05 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732457+0000", 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6541e-05 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35622 5.5 5:aaa28549:::benchmark_data_smithi043_45180_object35621:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.732468+0000", 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0044606969999999996, 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0052311140000000002, 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35622 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732468+0000", 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732468+0000", 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732467+0000", 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732496+0000", 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8827999999999999e-05 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732505+0000", 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4380000000000001e-06 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732512+0000", 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732606+0000", 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3678000000000007e-05 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732753+0000", 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014731100000000001 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.732917+0000", 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016384400000000001 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.734778+0000", 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018611330000000001 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35624 5.2 e22/16 5:45e506bd:::benchmark_data_smithi043_45180_object35623:head v 22'2262, mlcod=22'2259)", 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.733203+0000", 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0037252040000000002, 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045394700000000003, 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:27.790 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.733203+0000", 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.733203+0000", 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.733203+0000", 2024-04-26T10:33:27.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.733294+0000", 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0635000000000002e-05 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.733302+0000", 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3629999999999994e-06 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.733307+0000", 2024-04-26T10:33:27.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1410000000000004e-06 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.733858+0000", 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00055098600000000005 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.733876+0000", 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8226000000000001e-05 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:27.793 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:33:27.794 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 14 2024-04-26T10:33:27.794 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:27.795 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:27.793+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:27.795 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:27.896 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:27.895+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:27.936 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:27.936 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:33:27.936 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:33:27.936 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:33:27.936 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:27.953 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:27.997 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:27.996+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:28.098 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:28.097+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:28.137 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:28.137 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:33:28.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:33:28.137 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:28.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.137 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:28.137 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993605+0000", 2024-04-26T10:33:28.137 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.139818777999999, 2024-04-26T10:33:28.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017888707, 2024-04-26T10:33:28.137 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.137 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.137 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993605+0000", 2024-04-26T10:33:28.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993605+0000", 2024-04-26T10:33:28.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993604+0000", 2024-04-26T10:33:28.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:28.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993612+0000", 2024-04-26T10:33:28.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:33:28.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993623+0000", 2024-04-26T10:33:28.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.117e-05 2024-04-26T10:33:28.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993640+0000", 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7095000000000001e-05 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993699+0000", 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9123000000000003e-05 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993704+0000", 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3140000000000003e-06 2024-04-26T10:33:28.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.002866+0000", 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0091614869999999994 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.003153+0000", 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028684400000000002 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.003399+0000", 2024-04-26T10:33:28.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024633100000000002 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005747+0000", 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023480139999999998 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011388+0000", 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056412750000000003 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011447+0000", 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8443000000000003e-05 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011494+0000", 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6814000000000003e-05 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:10 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:28.143 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.139762062000003, 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018785385000000002, 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993661+0000", 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993667+0000", 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9120000000000003e-06 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993676+0000", 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0270000000000001e-06 2024-04-26T10:33:28.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993681+0000", 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9919999999999998e-06 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993763+0000", 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2799999999999993e-05 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993768+0000", 2024-04-26T10:33:28.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9409999999999998e-06 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004133+0000", 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01036455 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004220+0000", 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7394999999999999e-05 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:28.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004343+0000", 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012254900000000001 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005750+0000", 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001406991 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012396+0000", 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0066459129999999998 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012422+0000", 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6182000000000001e-05 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012447+0000", 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4981e-05 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:28.149 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993685+0000", 2024-04-26T10:33:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.139738370000003, 2024-04-26T10:33:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014631474, 2024-04-26T10:33:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993685+0000", 2024-04-26T10:33:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993685+0000", 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993685+0000", 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993687+0000", 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2220000000000001e-06 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993691+0000", 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7979999999999999e-06 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993694+0000", 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4319999999999999e-06 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993750+0000", 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5447e-05 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993755+0000", 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.87e-06 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005448+0000", 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011693301 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005552+0000", 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010411 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005664+0000", 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111926 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006535+0000", 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00087124700000000002 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008226+0000", 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016902729999999999 2024-04-26T10:33:28.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008270+0000", 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4755000000000001e-05 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008317+0000", 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6375000000000002e-05 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993699+0000", 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.139725060000004, 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014757767, 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993699+0000", 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993699+0000", 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993698+0000", 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993704+0000", 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6760000000000004e-06 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993708+0000", 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8840000000000004e-06 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993713+0000", 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7079999999999996e-06 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993776+0000", 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3637000000000001e-05 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7164999999999999e-05 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005913+0000", 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012119237999999999 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005960+0000", 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7138999999999997e-05 2024-04-26T10:33:28.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006042+0000", 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2204000000000001e-05 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006543+0000", 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00050083300000000001 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008364+0000", 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018215729999999999 2024-04-26T10:33:28.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008406+0000", 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2077999999999999e-05 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.008456+0000", 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9950000000000001e-05 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.162 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:28.162 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:28.162 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.139704496999997, 2024-04-26T10:33:28.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018863001000000001, 2024-04-26T10:33:28.162 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.162 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.162 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:28.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:28.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:28.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:28.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993722+0000", 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7630000000000001e-06 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993726+0000", 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9999999999999998e-06 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993729+0000", 2024-04-26T10:33:28.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3210000000000001e-06 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993795+0000", 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5903999999999998e-05 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993798+0000", 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004680+0000", 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010881823000000001 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004804+0000", 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012401 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005121+0000", 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031651100000000001 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006210+0000", 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010888930000000001 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012493+0000", 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062830630000000002 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012543+0000", 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0331999999999999e-05 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012582+0000", 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9230999999999998e-05 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993760+0000", 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.139663591000001, 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017241877999999999, 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.168 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993760+0000", 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993760+0000", 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993760+0000", 2024-04-26T10:33:28.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993763+0000", 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3419999999999999e-06 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993779+0000", 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6331e-05 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993786+0000", 2024-04-26T10:33:28.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8299999999999998e-06 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993826+0000", 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9947000000000002e-05 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993831+0000", 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7500000000000003e-06 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.000042+0000", 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.006211299 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.000240+0000", 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000197715 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.000529+0000", 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028910699999999998 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004479+0000", 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039500250000000002 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.010951+0000", 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064716210000000003 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.010979+0000", 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7946e-05 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011002+0000", 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3388e-05 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993797+0000", 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.139627044000001, 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017310459, 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:28.174 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993797+0000", 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993797+0000", 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993796+0000", 2024-04-26T10:33:28.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993800+0000", 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5899999999999999e-06 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993806+0000", 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6189999999999996e-06 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993818+0000", 2024-04-26T10:33:28.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2339e-05 2024-04-26T10:33:28.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993853+0000", 2024-04-26T10:33:28.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4987999999999998e-05 2024-04-26T10:33:28.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:28.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993856+0000", 2024-04-26T10:33:28.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5160000000000001e-06 2024-04-26T10:33:28.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001544+0000", 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076884620000000001 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001688+0000", 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014332200000000001 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011107+0000", 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0094193209999999996 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.178 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.139586285999997, 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018824634, 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:28.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993841+0000", 2024-04-26T10:33:28.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3059999999999999e-06 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993849+0000", 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993855+0000", 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9479999999999996e-06 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993885+0000", 2024-04-26T10:33:28.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9798000000000002e-05 2024-04-26T10:33:28.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:28.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993891+0000", 2024-04-26T10:33:28.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2689999999999996e-06 2024-04-26T10:33:28.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005459+0000", 2024-04-26T10:33:28.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011567898 2024-04-26T10:33:28.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005556+0000", 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7751999999999995e-05 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012662+0000", 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071055830000000004 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993864+0000", 2024-04-26T10:33:28.183 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 36.139559963000004, 2024-04-26T10:33:28.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01335422, 2024-04-26T10:33:28.184 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.184 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:28.184 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993864+0000", 2024-04-26T10:33:28.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993864+0000", 2024-04-26T10:33:28.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993863+0000", 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993879+0000", 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5279000000000001e-05 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993887+0000", 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9959999999999993e-06 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993898+0000", 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1712000000000001e-05 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993923+0000", 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4893e-05 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993926+0000", 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2959999999999999e-06 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001993+0000", 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080661759999999996 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.002082+0000", 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9689000000000001e-05 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.007218+0000", 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.005135667 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:5891 5.a 5:5d67d644:::benchmark_data_smithi043_45180_object5890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:18.580781+0000", 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.5526427849999997, 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013237369000000001, 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.188 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 5891 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.580781+0000", 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.580781+0000", 2024-04-26T10:33:28.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.580773+0000", 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999924 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.580870+0000", 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6854999999999993e-05 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.580881+0000", 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0519999999999999e-05 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.580888+0000", 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5079999999999999e-06 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.581133+0000", 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024513200000000001 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.581226+0000", 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2795999999999997e-05 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.581379+0000", 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015320899999999999 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.585102+0000", 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0037228679999999998 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.593935+0000", 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0088329540000000005 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.593982+0000", 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6415999999999997e-05 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:18.594018+0000", 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6675999999999999e-05 2024-04-26T10:33:28.193 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.194 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.194 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.194 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:20222 5.6 5:6bfd9c6b:::benchmark_data_smithi043_45180_object20221:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:28.194 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:22.496274+0000", 2024-04-26T10:33:28.194 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.6371492659999998, 2024-04-26T10:33:28.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016636633000000001, 2024-04-26T10:33:28.194 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.194 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.194 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:28.194 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:28.194 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 20222 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496274+0000", 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496274+0000", 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496274+0000", 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496467+0000", 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019352900000000001 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496477+0000", 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6039999999999999e-06 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496504+0000", 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6982e-05 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496535+0000", 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0814e-05 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496627+0000", 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2155000000000001e-05 2024-04-26T10:33:28.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496781+0000", 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153826 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.499688+0000", 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029076890000000002 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.512826+0000", 2024-04-26T10:33:28.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013137818000000001 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.512876+0000", 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9941000000000002e-05 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.512911+0000", 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5065999999999999e-05 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:20225 5.6 5:68ea3e4f:::benchmark_data_smithi043_45180_object20224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:22.496515+0000", 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.6369089680000002, 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.016486530999999999, 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 20225 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496515+0000", 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496515+0000", 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496514+0000", 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496629+0000", 2024-04-26T10:33:28.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011466700000000001 2024-04-26T10:33:28.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496637+0000", 2024-04-26T10:33:28.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1189999999999997e-06 2024-04-26T10:33:28.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.496659+0000", 2024-04-26T10:33:28.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1977999999999999e-05 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.498258+0000", 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001598808 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.498338+0000", 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0238e-05 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.498415+0000", 2024-04-26T10:33:28.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7509999999999995e-05 2024-04-26T10:33:28.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.499691+0000", 2024-04-26T10:33:28.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012761090000000001 2024-04-26T10:33:28.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.512949+0000", 2024-04-26T10:33:28.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013257348 2024-04-26T10:33:28.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.512979+0000", 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9967e-05 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.513001+0000", 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2509000000000001e-05 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:20233 5.6 5:64933303:::benchmark_data_smithi043_45180_object20232:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:22.497443+0000", 2024-04-26T10:33:28.205 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.6359808469999999, 2024-04-26T10:33:28.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01562504, 2024-04-26T10:33:28.206 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.206 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.206 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:28.206 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:28.206 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:28.206 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 20233 2024-04-26T10:33:28.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.206 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.497443+0000", 2024-04-26T10:33:28.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.497443+0000", 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.497442+0000", 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.497508+0000", 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6074000000000005e-05 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.497515+0000", 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4150000000000004e-06 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.497520+0000", 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1250000000000001e-06 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.499004+0000", 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001484415 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.499100+0000", 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5754000000000005e-05 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.499182+0000", 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1619000000000006e-05 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.500468+0000", 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001286087 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.513026+0000", 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012558725 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.513051+0000", 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5012999999999999e-05 2024-04-26T10:33:28.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:22.513068+0000", 2024-04-26T10:33:28.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6438000000000001e-05 2024-04-26T10:33:28.211 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.211 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.211 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.211 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:31758 5.c 5:37fffdcd:::benchmark_data_smithi043_45180_object31757:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:28.211 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:26.366480+0000", 2024-04-26T10:33:28.211 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.7669438669999999, 2024-04-26T10:33:28.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012982327, 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 31758 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.366480+0000", 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.366480+0000", 2024-04-26T10:33:28.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.366479+0000", 2024-04-26T10:33:28.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:28.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.366550+0000", 2024-04-26T10:33:28.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1186000000000006e-05 2024-04-26T10:33:28.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.366559+0000", 2024-04-26T10:33:28.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3899999999999993e-06 2024-04-26T10:33:28.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.366566+0000", 2024-04-26T10:33:28.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7710000000000001e-06 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.366598+0000", 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1992999999999997e-05 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.366711+0000", 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011333 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:28.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.366845+0000", 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000134566 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.369082+0000", 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022365570000000001 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.379384+0000", 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01030211 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.379426+0000", 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2039000000000002e-05 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.379462+0000", 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6015e-05 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:32138 5.a 5:5aa17a08:::benchmark_data_smithi043_45180_object32137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:26.509281+0000", 2024-04-26T10:33:28.217 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.6241428920000001, 2024-04-26T10:33:28.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018407257999999999, 2024-04-26T10:33:28.218 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.218 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.218 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:28.218 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:28.218 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:28.218 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 32138 2024-04-26T10:33:28.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.218 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509281+0000", 2024-04-26T10:33:28.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509281+0000", 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509280+0000", 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509321+0000", 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0992999999999999e-05 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509329+0000", 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2570000000000007e-06 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509335+0000", 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9529999999999996e-06 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.520295+0000", 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010959391000000001 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.520384+0000", 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9306000000000002e-05 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.520486+0000", 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010165100000000001 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.526101+0000", 2024-04-26T10:33:28.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056154359999999997 2024-04-26T10:33:28.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.527595+0000", 2024-04-26T10:33:28.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014940649999999999 2024-04-26T10:33:28.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.527649+0000", 2024-04-26T10:33:28.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4283999999999997e-05 2024-04-26T10:33:28.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.527688+0000", 2024-04-26T10:33:28.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8699999999999999e-05 2024-04-26T10:33:28.223 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.223 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.223 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.223 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:32140 5.2 e21/16 5:40538810:::benchmark_data_smithi043_45180_object32139:head v 21'2018, mlcod=21'2014)", 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:26.511414+0000", 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.6220092429999999, 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014610494999999999, 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.511414+0000", 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.511414+0000", 2024-04-26T10:33:28.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.511414+0000", 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.511481+0000", 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7020000000000005e-05 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.511487+0000", 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4969999999999998e-06 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.511491+0000", 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8120000000000001e-06 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.514545+0000", 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030540720000000001 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.514563+0000", 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7941999999999999e-05 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.525994+0000", 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011430713 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.526025+0000", 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0929000000000002e-05 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.227 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:32143 5.2 e21/16 5:44592b93:::benchmark_data_smithi043_45180_object32142:head v 21'2019, mlcod=21'2014)", 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:26.512484+0000", 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.6209394289999999, 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013565003000000001, 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.512484+0000", 2024-04-26T10:33:28.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.512484+0000", 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.512484+0000", 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.512552+0000", 2024-04-26T10:33:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7991999999999995e-05 2024-04-26T10:33:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.512559+0000", 2024-04-26T10:33:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2690000000000002e-06 2024-04-26T10:33:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.512563+0000", 2024-04-26T10:33:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2019999999999997e-06 2024-04-26T10:33:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.516718+0000", 2024-04-26T10:33:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0041543730000000003 2024-04-26T10:33:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.516729+0000", 2024-04-26T10:33:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1479e-05 2024-04-26T10:33:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.526028+0000", 2024-04-26T10:33:28.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0092988199999999993 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.526049+0000", 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.137e-05 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:32382 5.2 e21/16 5:457fc936:::benchmark_data_smithi043_45180_object32381:head v 21'2035, mlcod=21'2033)", 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:26.600308+0000", 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 1.533115961, 2024-04-26T10:33:28.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014433322, 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.600308+0000", 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.600308+0000", 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.600307+0000", 2024-04-26T10:33:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.600367+0000", 2024-04-26T10:33:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9290999999999999e-05 2024-04-26T10:33:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.600372+0000", 2024-04-26T10:33:28.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8340000000000004e-06 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.600376+0000", 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1939999999999998e-06 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.600407+0000", 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1029999999999999e-05 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.600418+0000", 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1389999999999999e-05 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.614718+0000", 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014299706000000001 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.614741+0000", 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3269999999999999e-05 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.236 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35633 5.c 5:3cac6cc6:::benchmark_data_smithi043_45180_object35632:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.738444+0000", 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.39497924600000001, 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014807852, 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35633 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.237 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738444+0000", 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738444+0000", 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738443+0000", 2024-04-26T10:33:28.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738504+0000", 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0727999999999999e-05 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738515+0000", 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0679000000000001e-05 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738521+0000", 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3470000000000004e-06 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738562+0000", 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1145e-05 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738704+0000", 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000141318 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:28.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738842+0000", 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000137968 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.740980+0000", 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021385309999999999 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.753201+0000", 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012220963 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.753230+0000", 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9104000000000001e-05 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.753252+0000", 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2141999999999999e-05 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35635 5.5 5:a1c40acb:::benchmark_data_smithi043_45180_object35634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.738595+0000", 2024-04-26T10:33:28.242 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.39482895099999998, 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.014743476, 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35635 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738595+0000", 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738595+0000", 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738594+0000", 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738680+0000", 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6077999999999998e-05 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738687+0000", 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7000000000000002e-06 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738693+0000", 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9529999999999996e-06 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738727+0000", 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3819000000000003e-05 2024-04-26T10:33:28.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738841+0000", 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114629 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.738964+0000", 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012256499999999999 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.740964+0000", 2024-04-26T10:33:28.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020003149999999999 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.753266+0000", 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012301595 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.753303+0000", 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6928999999999998e-05 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.753338+0000", 2024-04-26T10:33:28.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5583000000000001e-05 2024-04-26T10:33:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:28.248 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:28.248 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:28.248 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:33:28.250 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:28.248+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:28.250 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:28.351 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:28.349+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:28.409 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:28.418 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 11 16 37203 37187 211.274 153.25 0.00335282 0.00473023 2024-04-26T10:33:28.424 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:28.425 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:28.429 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:28.439 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:28.450 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:28.451 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:28.450+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:28.451 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:28.451 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:28.452 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:28.552 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:28.550+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:28.612 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:28.613 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:28.627 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:28.669 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:28.667+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:28.753 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:28.752+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:28.831 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:28.831 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:28.843 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:28.854 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:28.852+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:28.959 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:28.953+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:29.005 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:29.005 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:29.015 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:29.055 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:29.054+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:29.156 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:29.154+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:29.226 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:29.226 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:29.239 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:29.257 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:29.255+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:29.358 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:29.357+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:29.384 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:33:29.407 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:29.407 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:29.417 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:29.418 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 12 16 39573 39557 206.011 148.125 0.00528134 0.00483556 2024-04-26T10:33:29.459 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:29.457+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:29.560 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:29.558+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:29.591 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:29.591 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:29.608 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:29.661 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:29.660+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:29.762 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:29.760+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:29.792 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:29.792 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:29.808 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:29.862 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:29.861+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:29.963 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:29.962+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:30.027 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:30.027 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:30.041 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:30.064 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:30.063+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:30.165 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:30.164+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:30.213 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:30.213 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:30.227 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:30.266 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:30.265+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:30.367 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:30.366+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:30.378 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-26T10:33:30.401 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:30.401 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:30.415 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:30.418 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 13 15 42138 42123 202.499 160.375 0.00421816 0.00493529 2024-04-26T10:33:30.463 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:33:30.468 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:30.467+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:30.569 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:30.567+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:30.580 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:30.580 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:30.595 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:30.615 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:30.637 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:30.658 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:30.659 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:30.659 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:30.659 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:30.670 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:30.668+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:30.763 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:30.763 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:30.763 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.763 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:42965 5.0 5:0ab74742:::benchmark_data_smithi043_45180_object42964:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:30.763 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:30.757463+0000", 2024-04-26T10:33:30.763 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0043712530000000003, 2024-04-26T10:33:30.763 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0043978020000000001, 2024-04-26T10:33:30.764 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:30.764 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:30.764 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:30.764 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:30.764 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:30.764 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 42965 2024-04-26T10:33:30.764 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.764 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:30.764 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.764 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:30.764 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757463+0000", 2024-04-26T10:33:30.764 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.764 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757463+0000", 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757462+0000", 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757572+0000", 2024-04-26T10:33:30.765 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011064 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757582+0000", 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6569999999999992e-06 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757588+0000", 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8590000000000001e-06 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:30.766 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757623+0000", 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4798999999999997e-05 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757749+0000", 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012607100000000001 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757886+0000", 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013733300000000001 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.767 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759918+0000", 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020318089999999999 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.761797+0000", 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001878652 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.761845+0000", 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7929000000000001e-05 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:30.768 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.769 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.769 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.769 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:42966 5.d 5:bfe99d68:::benchmark_data_smithi043_45180_object42965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:30.769 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:30.757738+0000", 2024-04-26T10:33:30.769 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0040957169999999996, 2024-04-26T10:33:30.769 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0042062610000000002, 2024-04-26T10:33:30.769 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:30.769 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:30.769 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:30.769 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:30.769 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:30.769 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 42966 2024-04-26T10:33:30.769 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.770 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:30.770 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.770 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:30.770 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757738+0000", 2024-04-26T10:33:30.770 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.770 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.770 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.770 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:30.770 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757738+0000", 2024-04-26T10:33:30.770 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.770 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.770 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.770 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757737+0000", 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757801+0000", 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4012999999999999e-05 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757806+0000", 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9760000000000003e-06 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.771 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757813+0000", 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6610000000000003e-06 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757840+0000", 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6859000000000002e-05 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757926+0000", 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6125000000000006e-05 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.772 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.758052+0000", 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012611 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.761826+0000", 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037739169999999999 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.773 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:42964 5.a e23/16 5:505a37c2:::benchmark_data_smithi043_45180_object42963:head v 23'2761, mlcod=23'2757)", 2024-04-26T10:33:30.774 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:30.758000+0000", 2024-04-26T10:33:30.774 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0038342039999999999, 2024-04-26T10:33:30.774 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0039919930000000001, 2024-04-26T10:33:30.774 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:30.774 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:30.774 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:30.774 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.774 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:30.774 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.758000+0000", 2024-04-26T10:33:30.774 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.774 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.774 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.774 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.758000+0000", 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.757999+0000", 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.758052+0000", 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3431999999999999e-05 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.775 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.758063+0000", 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0494e-05 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.758071+0000", 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8620000000000003e-06 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759128+0000", 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0010576870000000001 2024-04-26T10:33:30.776 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.777 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.777 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:30.777 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759155+0000", 2024-04-26T10:33:30.777 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6444e-05 2024-04-26T10:33:30.777 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.777 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:30.777 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.777 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.777 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.777 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:42968 5.d 5:b109bc4e:::benchmark_data_smithi043_45180_object42967:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:30.777 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:30.758312+0000", 2024-04-26T10:33:30.777 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0035215720000000002, 2024-04-26T10:33:30.777 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037281670000000001, 2024-04-26T10:33:30.778 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:30.778 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:30.778 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:30.778 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:30.778 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:30.778 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 42968 2024-04-26T10:33:30.778 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.778 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:30.778 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.778 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:30.778 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.758312+0000", 2024-04-26T10:33:30.778 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.778 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.758312+0000", 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.758311+0000", 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.758422+0000", 2024-04-26T10:33:30.779 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000110776 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.758433+0000", 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0852e-05 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.758444+0000", 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0691e-05 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:30.780 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759314+0000", 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00087051499999999998 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759441+0000", 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000126928 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759552+0000", 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011124399999999999 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.781 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:30.782 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.761836+0000", 2024-04-26T10:33:30.782 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002283073 2024-04-26T10:33:30.782 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.782 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:30.782 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.782 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.782 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.782 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:42971 5.d 5:b5756092:::benchmark_data_smithi043_45180_object42970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:30.782 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:30.759594+0000", 2024-04-26T10:33:30.782 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0022398299999999999, 2024-04-26T10:33:30.782 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0025064240000000002, 2024-04-26T10:33:30.782 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:30.782 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 42971 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759594+0000", 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:30.783 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759594+0000", 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759593+0000", 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759617+0000", 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3592999999999999e-05 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:30.784 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759625+0000", 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4190000000000002e-06 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759631+0000", 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2279999999999998e-06 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.760498+0000", 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00086744299999999997 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.785 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.760619+0000", 2024-04-26T10:33:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012138000000000001 2024-04-26T10:33:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.760744+0000", 2024-04-26T10:33:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012417799999999999 2024-04-26T10:33:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.786 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:42969 5.a e23/16 5:5317cd53:::benchmark_data_smithi043_45180_object42968:head v 23'2762, mlcod=23'2758)", 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:30.759674+0000", 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0021595999999999998, 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0024866110000000001, 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759674+0000", 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759674+0000", 2024-04-26T10:33:30.787 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759674+0000", 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759743+0000", 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9366e-05 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:30.788 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759753+0000", 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.005e-05 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.759759+0000", 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7300000000000002e-06 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.760543+0000", 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00078470099999999995 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:30.789 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.760565+0000", 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1786000000000001e-05 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:42973 5.9 e23/16 5:9c693b68:::benchmark_data_smithi043_45180_object42972:head v 23'2713, mlcod=23'2711)", 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:30.760221+0000", 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001612846, 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019844680000000001, 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:30.790 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.760221+0000", 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.760221+0000", 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.760220+0000", 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:30.791 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.760290+0000", 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9867e-05 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.760300+0000", 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.013e-05 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.760307+0000", 2024-04-26T10:33:30.792 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0570000000000004e-06 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.760344+0000", 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6953999999999999e-05 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.760363+0000", 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.8413000000000001e-05 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.793 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:42970 5.a e23/16 5:57ce8186:::benchmark_data_smithi043_45180_object42969:head v 23'2763, mlcod=23'2758)", 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:30.761925+0000", 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4294967295.9999084, 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00035017300000000001, 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.761925+0000", 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.794 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.761925+0000", 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.761925+0000", 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.762000+0000", 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5424000000000002e-05 2024-04-26T10:33:30.795 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.762008+0000", 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5800000000000003e-06 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.762013+0000", 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1529999999999996e-06 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.762040+0000", 2024-04-26T10:33:30.796 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6990000000000001e-05 2024-04-26T10:33:30.797 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:30.797 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:30.797 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:30.797 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.762054+0000", 2024-04-26T10:33:30.797 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4095e-05 2024-04-26T10:33:30.797 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.797 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:30.797 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.797 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:30.797 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:33:30.797 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 8 2024-04-26T10:33:30.797 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:30.799 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:30.799 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:30.798+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:30.900 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:30.898+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:30.971 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:30.971 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:33:30.971 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:33:30.971 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:33:30.971 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:30.986 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:31.000 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:30.999+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:31.101 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:31.099+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:31.155 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:31.155 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:33:31.155 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:33:31.156 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:31.156 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.156 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:31.156 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994163+0000", 2024-04-26T10:33:31.156 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 39.157760881999998, 2024-04-26T10:33:31.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014381321000000001, 2024-04-26T10:33:31.156 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.156 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.156 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.156 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.156 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994163+0000", 2024-04-26T10:33:31.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994163+0000", 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994161+0000", 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999981 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994172+0000", 2024-04-26T10:33:31.157 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0889e-05 2024-04-26T10:33:31.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.158 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.158 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994201+0000", 2024-04-26T10:33:31.158 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9059000000000001e-05 2024-04-26T10:33:31.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.158 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.158 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994242+0000", 2024-04-26T10:33:31.158 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1121000000000002e-05 2024-04-26T10:33:31.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.158 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.159 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994597+0000", 2024-04-26T10:33:31.159 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00035472299999999998 2024-04-26T10:33:31.159 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.159 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.159 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.159 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994769+0000", 2024-04-26T10:33:31.159 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000172139 2024-04-26T10:33:31.159 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.159 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.159 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.159 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994938+0000", 2024-04-26T10:33:31.159 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0001694 2024-04-26T10:33:31.159 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998089+0000", 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0031503640000000001 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008433+0000", 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010344020000000001 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008492+0000", 2024-04-26T10:33:31.160 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9370999999999998e-05 2024-04-26T10:33:31.161 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.161 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008544+0000", 2024-04-26T10:33:31.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2030999999999997e-05 2024-04-26T10:33:31.161 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.161 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.161 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.161 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.161 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:11 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:31.161 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994299+0000", 2024-04-26T10:33:31.161 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 39.157624574000003, 2024-04-26T10:33:31.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014404745, 2024-04-26T10:33:31.162 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.162 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.162 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994299+0000", 2024-04-26T10:33:31.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994299+0000", 2024-04-26T10:33:31.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994298+0000", 2024-04-26T10:33:31.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994305+0000", 2024-04-26T10:33:31.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.063e-06 2024-04-26T10:33:31.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994328+0000", 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2819e-05 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994345+0000", 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6952e-05 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994863+0000", 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000518192 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994990+0000", 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000126802 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995146+0000", 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015556700000000001 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998096+0000", 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0029506799999999998 2024-04-26T10:33:31.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008616+0000", 2024-04-26T10:33:31.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010520102999999999 2024-04-26T10:33:31.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008664+0000", 2024-04-26T10:33:31.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7219000000000003e-05 2024-04-26T10:33:31.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008704+0000", 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0330000000000002e-05 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(mds.0.3:18 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 39.157054453000001, 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014077793999999999, 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994869+0000", 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994874+0000", 2024-04-26T10:33:31.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5509999999999999e-06 2024-04-26T10:33:31.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994881+0000", 2024-04-26T10:33:31.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8979999999999999e-06 2024-04-26T10:33:31.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.994889+0000", 2024-04-26T10:33:31.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995378+0000", 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00048941399999999997 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995429+0000", 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0878000000000003e-05 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.995513+0000", 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4412000000000004e-05 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:51.998109+0000", 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0025955319999999998 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008861+0000", 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010752421999999999 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.171 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008909+0000", 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7788999999999999e-05 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:32:52.008947+0000", 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7888e-05 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:31403 5.d 5:b3751861:::benchmark_data_smithi043_45180_object31402:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:31.172 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.243061+0000", 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.908863094, 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.015570651, 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 31403 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243061+0000", 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243061+0000", 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243060+0000", 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243105+0000", 2024-04-26T10:33:31.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4527999999999998e-05 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243113+0000", 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9359999999999999e-06 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243119+0000", 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2539999999999998e-06 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.247180+0000", 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.004060953 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.247314+0000", 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013399700000000001 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.247449+0000", 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000135127 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.250337+0000", 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0028879499999999998 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.258539+0000", 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0082021630000000002 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.258590+0000", 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0630000000000001e-05 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.258631+0000", 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1702999999999997e-05 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:31405 5.d 5:b6ecb5fe:::benchmark_data_smithi043_45180_object31404:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.243137+0000", 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.9087869260000003, 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.015575868, 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.178 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 31405 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243137+0000", 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243137+0000", 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243136+0000", 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243163+0000", 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6684999999999999e-05 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243173+0000", 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7750000000000004e-06 2024-04-26T10:33:31.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.243179+0000", 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2709999999999998e-06 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.250351+0000", 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0071723619999999998 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.250426+0000", 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4312000000000003e-05 2024-04-26T10:33:31.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.250506+0000", 2024-04-26T10:33:31.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0354999999999999e-05 2024-04-26T10:33:31.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.255758+0000", 2024-04-26T10:33:31.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052520850000000001 2024-04-26T10:33:31.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.258640+0000", 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002882463 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.258680+0000", 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9702e-05 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.258713+0000", 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.183 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:31794 5.b 5:de40b8b9:::benchmark_data_smithi043_45180_object31793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.381534+0000", 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.7703897800000004, 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014347876000000001, 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 31794 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381534+0000", 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381534+0000", 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381533+0000", 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381593+0000", 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9723999999999999e-05 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381599+0000", 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0870000000000003e-06 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.381603+0000", 2024-04-26T10:33:31.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5300000000000001e-06 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.387339+0000", 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0057357579999999997 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.387421+0000", 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2738999999999995e-05 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:31.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.387500+0000", 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8405999999999994e-05 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.389239+0000", 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017392620000000001 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.395811+0000", 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006571637 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.395848+0000", 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7728000000000002e-05 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.395882+0000", 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3491000000000002e-05 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:32372 5.b 5:d4532611:::benchmark_data_smithi043_45180_object32371:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.592341+0000", 2024-04-26T10:33:31.189 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.5595822500000001, 2024-04-26T10:33:31.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014138509, 2024-04-26T10:33:31.190 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.190 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.190 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.190 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.190 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.190 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 32372 2024-04-26T10:33:31.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.190 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.592341+0000", 2024-04-26T10:33:31.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.592341+0000", 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.592341+0000", 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.592365+0000", 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4273e-05 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.592372+0000", 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8340000000000001e-06 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.592378+0000", 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.463e-06 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.594380+0000", 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020027500000000002 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.594459+0000", 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8895999999999998e-05 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.594539+0000", 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0022000000000001e-05 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.600466+0000", 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059269450000000003 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.606396+0000", 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059302620000000004 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.606445+0000", 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8677000000000002e-05 2024-04-26T10:33:31.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.606480+0000", 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4912e-05 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:32531 5.4 5:26c5d6b3:::benchmark_data_smithi043_45180_object32530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.653810+0000", 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.4981135480000001, 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014203341, 2024-04-26T10:33:31.195 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 32531 2024-04-26T10:33:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653810+0000", 2024-04-26T10:33:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653810+0000", 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653809+0000", 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653879+0000", 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9739000000000004e-05 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653895+0000", 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5637e-05 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653900+0000", 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2449999999999998e-06 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653924+0000", 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4087000000000002e-05 2024-04-26T10:33:31.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.653997+0000", 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2683999999999997e-05 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.654073+0000", 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6110000000000001e-05 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.658892+0000", 2024-04-26T10:33:31.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0048186749999999997 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.667933+0000", 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0090412989999999992 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.667976+0000", 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3436000000000002e-05 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.668014+0000", 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7194999999999999e-05 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:33192 5.0 5:0f3efe62:::benchmark_data_smithi043_45180_object33191:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:26.868663+0000", 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.2832610930000001, 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014300764000000001, 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.202 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.202 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 33192 2024-04-26T10:33:31.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.202 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.868663+0000", 2024-04-26T10:33:31.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.868663+0000", 2024-04-26T10:33:31.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.868662+0000", 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.868707+0000", 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4928000000000001e-05 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.868716+0000", 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6170000000000007e-06 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.868722+0000", 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4749999999999998e-06 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.870814+0000", 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020915590000000002 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.870939+0000", 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012513199999999999 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.871065+0000", 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012621799999999999 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.876279+0000", 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052140870000000001 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.882883+0000", 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066035410000000001 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.882920+0000", 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7546000000000003e-05 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:26.882963+0000", 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3319999999999999e-05 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.206 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:34653 5.4 5:27104fda:::benchmark_data_smithi043_45180_object34652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.378611+0000", 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 3.7733123069999999, 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014296991, 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 34653 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.207 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378611+0000", 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378611+0000", 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378610+0000", 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378729+0000", 2024-04-26T10:33:31.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000119157 2024-04-26T10:33:31.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378738+0000", 2024-04-26T10:33:31.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4209999999999995e-06 2024-04-26T10:33:31.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378744+0000", 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5729999999999996e-06 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378783+0000", 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8943999999999998e-05 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.378922+0000", 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013840099999999999 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:31.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.379059+0000", 2024-04-26T10:33:31.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013718899999999999 2024-04-26T10:33:31.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.386674+0000", 2024-04-26T10:33:31.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0076146870000000002 2024-04-26T10:33:31.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.392815+0000", 2024-04-26T10:33:31.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0061409589999999997 2024-04-26T10:33:31.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.392866+0000", 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1248999999999997e-05 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.392908+0000", 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2602000000000003e-05 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 3.3519586430000001, 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.213 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:33:31.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:33:31.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:33:31.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:33:31.218 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.218 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.218 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.218 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:31.218 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:31.218 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 3.3511305629999999, 2024-04-26T10:33:31.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:33:31.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:33:31.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:33:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:33:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:33:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:33:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:33:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:33:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:33:31.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:33:31.224 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.224 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.224 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 3.3502014999999998, 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.225 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:31.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:31.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:33:31.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 3.3495160589999999, 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:33:31.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:33:31.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:33:31.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:33:31.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:31.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:33:31.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:33:31.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:33:31.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:33:31.236 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.236 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.236 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.236 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:36694 5.f e22/16 5:f1c75ca5:::benchmark_data_smithi043_45180_object36693:head v 22'2274, mlcod=22'2271)", 2024-04-26T10:33:31.236 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:28.236941+0000", 2024-04-26T10:33:31.236 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 2.914982363, 2024-04-26T10:33:31.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.016013478000000001, 2024-04-26T10:33:31.236 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.236 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.237 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:28.236941+0000", 2024-04-26T10:33:31.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:28.236941+0000", 2024-04-26T10:33:31.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:28.236941+0000", 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:28.236998+0000", 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7141000000000001e-05 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:28.237005+0000", 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7000000000000002e-06 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:28.237009+0000", 2024-04-26T10:33:31.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7770000000000002e-06 2024-04-26T10:33:31.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:28.239279+0000", 2024-04-26T10:33:31.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0022692630000000001 2024-04-26T10:33:31.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:28.239291+0000", 2024-04-26T10:33:31.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2067e-05 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:28.252919+0000", 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013627975000000001 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:28.252955+0000", 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6146999999999998e-05 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:42782 5.0 5:0b07ba09:::benchmark_data_smithi043_45180_object42781:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:30.678828+0000", 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.47309600299999999, 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014180302000000001, 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 42782 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.678828+0000", 2024-04-26T10:33:31.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.678828+0000", 2024-04-26T10:33:31.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.678827+0000", 2024-04-26T10:33:31.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.678895+0000", 2024-04-26T10:33:31.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7691e-05 2024-04-26T10:33:31.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.678902+0000", 2024-04-26T10:33:31.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4440000000000002e-06 2024-04-26T10:33:31.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.678908+0000", 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1209999999999998e-06 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.678939+0000", 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1537e-05 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.679046+0000", 2024-04-26T10:33:31.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010655899999999999 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.679173+0000", 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012757900000000001 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.682552+0000", 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0033791519999999999 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.692934+0000", 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010381177 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.692976+0000", 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2286999999999997e-05 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.693008+0000", 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2184000000000002e-05 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:43101 5.8 5:1e60ece2:::benchmark_data_smithi043_45180_object43100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:30.808402+0000", 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.343521299, 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.015123054, 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 43101 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.808402+0000", 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.808402+0000", 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.808402+0000", 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.808427+0000", 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4961999999999999e-05 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.808434+0000", 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0230000000000004e-06 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.808440+0000", 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7869999999999998e-06 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.809914+0000", 2024-04-26T10:33:31.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001474433 2024-04-26T10:33:31.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.810077+0000", 2024-04-26T10:33:31.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000162435 2024-04-26T10:33:31.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:31.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.810228+0000", 2024-04-26T10:33:31.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015100500000000001 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.815856+0000", 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0056285249999999997 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.823442+0000", 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0075864310000000003 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.823488+0000", 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5942000000000002e-05 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:30.823526+0000", 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7079999999999997e-05 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:43638 5.b 5:d77b1edb:::benchmark_data_smithi043_45180_object43637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:31.017910+0000", 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.13401348699999999, 2024-04-26T10:33:31.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.016323453000000002, 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 43638 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.017910+0000", 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.017910+0000", 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.017909+0000", 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.017941+0000", 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2060000000000001e-05 2024-04-26T10:33:31.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.017951+0000", 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.9299999999999998e-06 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.017959+0000", 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1850000000000004e-06 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.019239+0000", 2024-04-26T10:33:31.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012798289999999999 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.019360+0000", 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120501 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.019486+0000", 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012626900000000001 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.022969+0000", 2024-04-26T10:33:31.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0034828699999999999 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.034156+0000", 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.011187496999999999 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.034197+0000", 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0667000000000002e-05 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.034234+0000", 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6835000000000002e-05 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:43644 5.4 5:2b579016:::benchmark_data_smithi043_45180_object43643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:31.019021+0000", 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.132902564, 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.016895422, 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.258 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 43644 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.019021+0000", 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.019021+0000", 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.019014+0000", 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999924 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.019060+0000", 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6304000000000003e-05 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.019067+0000", 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3420000000000002e-06 2024-04-26T10:33:31.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.019074+0000", 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5030000000000002e-06 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.020726+0000", 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016526609999999999 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.020840+0000", 2024-04-26T10:33:31.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011318499999999999 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.020959+0000", 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011911100000000001 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.034073+0000", 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.013114438000000001 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.035845+0000", 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017715439999999999 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.035884+0000", 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9295000000000002e-05 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.035917+0000", 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2540999999999999e-05 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.263 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:43924 5.d 5:bf029bae:::benchmark_data_smithi043_45180_object43923:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:31.130478+0000", 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.021445526999999999, 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014566838, 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 43924 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.130478+0000", 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.130478+0000", 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.130478+0000", 2024-04-26T10:33:31.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.130541+0000", 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3779e-05 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.130549+0000", 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8399999999999995e-06 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.130557+0000", 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6559999999999992e-06 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.131866+0000", 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013089919999999999 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.131996+0000", 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000129658 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.132149+0000", 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000153311 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.134466+0000", 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0023169050000000002 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.144989+0000", 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010523489 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:31.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.145019+0000", 2024-04-26T10:33:31.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9932000000000001e-05 2024-04-26T10:33:31.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:31.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:31.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:31.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:31.145045+0000", 2024-04-26T10:33:31.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5816000000000002e-05 2024-04-26T10:33:31.269 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.269 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.269 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.269 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:31.269 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:31.269 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:31.271 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:31.270+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:31.271 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:31.372 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:31.371+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:31.418 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 14 16 44620 44604 199.109 155.062 0.00605049 0.0050193 2024-04-26T10:33:31.459 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:31.459 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:31.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.459 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:44697 5.3 5:cea15f5f:::benchmark_data_smithi043_45180_object44696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:31.459 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:31.450179+0000", 2024-04-26T10:33:31.459 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0044086200000000002, 2024-04-26T10:33:31.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044389649999999996, 2024-04-26T10:33:31.459 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.459 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:31.459 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:31.459 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 44697 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.450179+0000", 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.450179+0000", 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.450178+0000", 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.450273+0000", 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5099000000000005e-05 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.450284+0000", 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0813e-05 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.450292+0000", 2024-04-26T10:33:31.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7579999999999992e-06 2024-04-26T10:33:31.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.452602+0000", 2024-04-26T10:33:31.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023101350000000001 2024-04-26T10:33:31.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.452716+0000", 2024-04-26T10:33:31.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011444599999999999 2024-04-26T10:33:31.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.452833+0000", 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000116909 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:44703 5.c 5:3688032a:::benchmark_data_smithi043_45180_object44702:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:31.451658+0000", 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0029294310000000001, 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003053053, 2024-04-26T10:33:31.463 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 44703 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.451658+0000", 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.451658+0000", 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.451657+0000", 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.451802+0000", 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014525200000000001 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.451811+0000", 2024-04-26T10:33:31.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9549999999999998e-06 2024-04-26T10:33:31.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.451817+0000", 2024-04-26T10:33:31.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3319999999999999e-06 2024-04-26T10:33:31.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.451848+0000", 2024-04-26T10:33:31.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1368000000000002e-05 2024-04-26T10:33:31.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.451926+0000", 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7812999999999995e-05 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.452015+0000", 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9157e-05 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.454579+0000", 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025641969999999998 2024-04-26T10:33:31.467 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:44704 5.e e23/16 5:7c3eae88:::benchmark_data_smithi043_45180_object44703:head v 23'2775, mlcod=23'2772)", 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:31.452233+0000", 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0023543230000000002, 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025586699999999999, 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.452233+0000", 2024-04-26T10:33:31.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.452233+0000", 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.452233+0000", 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453643+0000", 2024-04-26T10:33:31.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014098229999999999 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453654+0000", 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1338000000000001e-05 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453659+0000", 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0100000000000003e-06 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453694+0000", 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4619000000000002e-05 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453711+0000", 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.713e-05 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:44705 5.e e23/16)", 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:31.453787+0000", 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00080055499999999999, 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001062295, 2024-04-26T10:33:31.471 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453787+0000", 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453787+0000", 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453786+0000", 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453884+0000", 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8107000000000001e-05 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453891+0000", 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5230000000000001e-06 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453895+0000", 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4270000000000001e-06 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:44706 5.4 e23/16 5:266b1534:::benchmark_data_smithi043_45180_object44705:head v 23'2763, mlcod=23'2761)", 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:31.453902+0000", 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00068543599999999999, 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010024669999999999, 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:31.474 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453902+0000", 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453902+0000", 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453902+0000", 2024-04-26T10:33:31.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453927+0000", 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5313e-05 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453931+0000", 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0579999999999999e-06 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453934+0000", 2024-04-26T10:33:31.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9809999999999999e-06 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453964+0000", 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0066e-05 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.453984+0000", 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9660000000000002e-05 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.478 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:44707 5.a 5:5475439e:::benchmark_data_smithi043_45180_object44706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:31.478 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:31.454491+0000", 2024-04-26T10:33:31.478 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.6094000000000005e-05, 2024-04-26T10:33:31.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00047541899999999998, 2024-04-26T10:33:31.478 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.478 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:31.478 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:31.478 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:31.478 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.478 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 44707 2024-04-26T10:33:31.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.478 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.454491+0000", 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.454491+0000", 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.454491+0000", 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.454547+0000", 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6335999999999997e-05 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.454580+0000", 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3065000000000003e-05 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.454590+0000", 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8039999999999996e-06 2024-04-26T10:33:31.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.454694+0000", 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010388200000000001 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.454823+0000", 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012945099999999999 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:31.454962+0000", 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000139388 2024-04-26T10:33:31.481 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.482 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.482 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:33:31.482 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 6 2024-04-26T10:33:31.482 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:31.483 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:31.482+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:31.484 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:31.584 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:31.583+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:31.668 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:31.669 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:33:31.669 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:33:31.669 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:33:31.669 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:31.682 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:31.724 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:31.723+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:31.787 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:31.785+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:31.887 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:31.886+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:31.908 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:31.908 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:33:31.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:33:31.908 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:31.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.908 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993605+0000", 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.91149747, 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017888707, 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993605+0000", 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993605+0000", 2024-04-26T10:33:31.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993604+0000", 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993612+0000", 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9189999999999999e-06 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993623+0000", 2024-04-26T10:33:31.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.117e-05 2024-04-26T10:33:31.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993640+0000", 2024-04-26T10:33:31.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7095000000000001e-05 2024-04-26T10:33:31.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993699+0000", 2024-04-26T10:33:31.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9123000000000003e-05 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op must wait for map", 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993704+0000", 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3140000000000003e-06 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.002866+0000", 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0091614869999999994 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.003153+0000", 2024-04-26T10:33:31.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028684400000000002 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.003399+0000", 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024633100000000002 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005747+0000", 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023480139999999998 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011388+0000", 2024-04-26T10:33:31.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056412750000000003 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011447+0000", 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8443000000000003e-05 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011494+0000", 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6814000000000003e-05 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:10 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.911440753999997, 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018785385000000002, 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993661+0000", 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993667+0000", 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9120000000000003e-06 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993676+0000", 2024-04-26T10:33:31.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0270000000000001e-06 2024-04-26T10:33:31.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993681+0000", 2024-04-26T10:33:31.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9919999999999998e-06 2024-04-26T10:33:31.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993763+0000", 2024-04-26T10:33:31.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2799999999999993e-05 2024-04-26T10:33:31.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993768+0000", 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9409999999999998e-06 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004133+0000", 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01036455 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004220+0000", 2024-04-26T10:33:31.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7394999999999999e-05 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004343+0000", 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012254900000000001 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005750+0000", 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001406991 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012396+0000", 2024-04-26T10:33:31.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0066459129999999998 2024-04-26T10:33:31.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012422+0000", 2024-04-26T10:33:31.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6182000000000001e-05 2024-04-26T10:33:31.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012447+0000", 2024-04-26T10:33:31.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4981e-05 2024-04-26T10:33:31.920 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.911383188999999, 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018863001000000001, 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:31.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:31.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:31.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993722+0000", 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7630000000000001e-06 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993726+0000", 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9999999999999998e-06 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993729+0000", 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3210000000000001e-06 2024-04-26T10:33:31.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993795+0000", 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5903999999999998e-05 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993798+0000", 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004680+0000", 2024-04-26T10:33:31.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010881823000000001 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004804+0000", 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012401 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005121+0000", 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031651100000000001 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006210+0000", 2024-04-26T10:33:31.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010888930000000001 2024-04-26T10:33:31.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012493+0000", 2024-04-26T10:33:31.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062830630000000002 2024-04-26T10:33:31.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012543+0000", 2024-04-26T10:33:31.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0331999999999999e-05 2024-04-26T10:33:31.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012582+0000", 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9230999999999998e-05 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993797+0000", 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.911305736000003, 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017310459, 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:31.927 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993797+0000", 2024-04-26T10:33:31.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993797+0000", 2024-04-26T10:33:31.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993796+0000", 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993800+0000", 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5899999999999999e-06 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993806+0000", 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6189999999999996e-06 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993818+0000", 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2339e-05 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993853+0000", 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4987999999999998e-05 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993856+0000", 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5160000000000001e-06 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001544+0000", 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076884620000000001 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.001688+0000", 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014332200000000001 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.011107+0000", 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0094193209999999996 2024-04-26T10:33:31.931 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.911264977999998, 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018824634, 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993841+0000", 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3059999999999999e-06 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993849+0000", 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993855+0000", 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9479999999999996e-06 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993885+0000", 2024-04-26T10:33:31.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9798000000000002e-05 2024-04-26T10:33:31.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:31.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993891+0000", 2024-04-26T10:33:31.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2689999999999996e-06 2024-04-26T10:33:31.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005459+0000", 2024-04-26T10:33:31.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011567898 2024-04-26T10:33:31.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005556+0000", 2024-04-26T10:33:31.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7751999999999995e-05 2024-04-26T10:33:31.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012662+0000", 2024-04-26T10:33:31.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071055830000000004 2024-04-26T10:33:31.936 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.936 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.936 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:32138 5.a 5:5aa17a08:::benchmark_data_smithi043_45180_object32137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:26.509281+0000", 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.3958215840000001, 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018407257999999999, 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 32138 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509281+0000", 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509281+0000", 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509280+0000", 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509321+0000", 2024-04-26T10:33:31.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0992999999999999e-05 2024-04-26T10:33:31.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509329+0000", 2024-04-26T10:33:31.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2570000000000007e-06 2024-04-26T10:33:31.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509335+0000", 2024-04-26T10:33:31.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9529999999999996e-06 2024-04-26T10:33:31.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.520295+0000", 2024-04-26T10:33:31.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010959391000000001 2024-04-26T10:33:31.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.520384+0000", 2024-04-26T10:33:31.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9306000000000002e-05 2024-04-26T10:33:31.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.520486+0000", 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010165100000000001 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.526101+0000", 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056154359999999997 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.527595+0000", 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014940649999999999 2024-04-26T10:33:31.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.527649+0000", 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4283999999999997e-05 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.527688+0000", 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8699999999999999e-05 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.942 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1044334750000004, 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1044324899999998, 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:33:31.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:33:31.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:33:31.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:33:31.952 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.952 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.952 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.952 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:31.952 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:31.952 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.104363867, 2024-04-26T10:33:31.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:33:31.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:33:31.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:33:31.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:33:31.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1043120870000003, 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:31.958 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:33:31.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:33:31.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:33:31.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:33:31.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:33:31.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:33:31.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:31.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:33:31.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:33:31.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:33:31.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:33:31.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:33:31.963 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.963 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.963 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1042522369999999, 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:31.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:33:31.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:33:31.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:33:31.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:33:31.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:33:31.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:33:31.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.969 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:31.970 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:31.970 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1025395329999998, 2024-04-26T10:33:31.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:33:31.970 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.970 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.970 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:31.970 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:31.970 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.970 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:33:31.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.970 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:33:31.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:33:31.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:33:31.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:33:31.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:33:31.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:31.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:33:31.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:33:31.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:33:31.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:33:31.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:31.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:33:31.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:33:31.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:33:31.975 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1024244660000004, 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:33:31.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:33:31.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:33:31.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:33:31.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:33:31.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:33:31.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:33:31.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:33:31.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:33:31.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:33:31.979 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1023313259999998, 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.980 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.985 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1021371660000003, 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:33:31.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:33:31.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:33:31.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:33:31.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:33:31.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:33:31.989 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.989 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1009297980000001, 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:31.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:33:31.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1001208900000004, 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:31.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.995 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:31.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:33:31.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:33:31.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:31.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:33:31.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:33:31.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:31.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:33:31.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:33:31.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:33:31.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:31.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:33:31.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:33:31.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:31.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:33:31.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:33:31.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:31.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1000173520000001, 2024-04-26T10:33:31.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.000 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:32.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:33:32.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:33:32.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:33:32.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:33:32.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:32.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:33:32.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:33:32.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:32.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:33:32.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:33:32.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:32.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:32.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:33:32.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:33:32.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:33:32.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:32.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:33:32.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:33:32.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:32.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:33:32.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:33:32.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.0999404789999998, 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:32.005 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:32.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:32.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:33:32.010 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.0998250949999999, 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:32.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:32.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:32.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:32.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:32.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:32.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:32.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:32.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:33:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:33:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:33:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:33:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:33:32.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:32.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:33:32.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:33:32.015 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:32.015 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:32.015 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:32.015 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:32.015 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:32.015 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:32.016 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:32.015+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:32.017 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:32.117 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:32.115+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:32.187 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:32.187 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:32.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.187 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:46509 5.f 5:f331a600:::benchmark_data_smithi043_45180_object46508:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:32.187 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:32.179783+0000", 2024-04-26T10:33:32.187 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0050116129999999998, 2024-04-26T10:33:32.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0050390360000000002, 2024-04-26T10:33:32.187 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.187 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:32.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.187 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 46509 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.179783+0000", 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.179783+0000", 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.179782+0000", 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.179833+0000", 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0649000000000002e-05 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.179841+0000", 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6969999999999999e-06 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.179847+0000", 2024-04-26T10:33:32.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5550000000000002e-06 2024-04-26T10:33:32.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.180493+0000", 2024-04-26T10:33:32.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00064623199999999995 2024-04-26T10:33:32.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.180641+0000", 2024-04-26T10:33:32.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000147515 2024-04-26T10:33:32.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.180783+0000", 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014276499999999999 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182132+0000", 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013482329999999999 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.191 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:46510 5.1 5:80c625e6:::benchmark_data_smithi043_45180_object46509:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:32.179852+0000", 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0049422980000000004, 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0050743890000000003, 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 46510 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.179852+0000", 2024-04-26T10:33:32.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.179852+0000", 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.179851+0000", 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.179892+0000", 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0568000000000002e-05 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.179898+0000", 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5300000000000004e-06 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.179901+0000", 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5020000000000001e-06 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.179930+0000", 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8731e-05 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.180007+0000", 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7278000000000001e-05 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.180082+0000", 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4962000000000005e-05 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183729+0000", 2024-04-26T10:33:32.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036469599999999999 2024-04-26T10:33:32.196 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.196 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.196 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.196 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:46515 5.1 5:848622ce:::benchmark_data_smithi043_45180_object46514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:32.196 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:32.181992+0000", 2024-04-26T10:33:32.196 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0028020269999999999, 2024-04-26T10:33:32.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00302133, 2024-04-26T10:33:32.196 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 46515 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.181992+0000", 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.181992+0000", 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.181991+0000", 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182069+0000", 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7608999999999995e-05 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182079+0000", 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7869999999999996e-06 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182088+0000", 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8439999999999993e-06 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182120+0000", 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1668999999999998e-05 2024-04-26T10:33:32.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182221+0000", 2024-04-26T10:33:32.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010111900000000001 2024-04-26T10:33:32.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:32.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182341+0000", 2024-04-26T10:33:32.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120201 2024-04-26T10:33:32.200 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.200 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.200 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:46514 5.6 e23/16 5:6c6bbd40:::benchmark_data_smithi043_45180_object46513:head v 23'2879, mlcod=23'2877)", 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:32.182025+0000", 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0027689279999999999, 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003061032, 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182025+0000", 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182025+0000", 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182025+0000", 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182122+0000", 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7551000000000002e-05 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182130+0000", 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8690000000000004e-06 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182135+0000", 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6179999999999997e-06 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182167+0000", 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1860999999999999e-05 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182189+0000", 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2076e-05 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:46512 5.3 e23/16 5:cac78db4:::benchmark_data_smithi043_45180_object46511:head v 23'2953, mlcod=23'2950)", 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:32.182141+0000", 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0026526890000000002, 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00300125, 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:32.204 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182141+0000", 2024-04-26T10:33:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182141+0000", 2024-04-26T10:33:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182141+0000", 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182182+0000", 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0479000000000003e-05 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182192+0000", 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0847e-05 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182196+0000", 2024-04-26T10:33:32.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3909999999999998e-06 2024-04-26T10:33:32.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182228+0000", 2024-04-26T10:33:32.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2305000000000003e-05 2024-04-26T10:33:32.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182248+0000", 2024-04-26T10:33:32.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9465000000000001e-05 2024-04-26T10:33:32.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.208 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.208 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.208 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:46518 5.7 5:e9b989f4:::benchmark_data_smithi043_45180_object46517:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:32.208 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:32.182171+0000", 2024-04-26T10:33:32.208 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0026233820000000001, 2024-04-26T10:33:32.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003035584, 2024-04-26T10:33:32.208 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.208 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:32.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 46518 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182171+0000", 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182171+0000", 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182170+0000", 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182248+0000", 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7859000000000001e-05 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182253+0000", 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4609999999999999e-06 2024-04-26T10:33:32.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182257+0000", 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.653e-06 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182292+0000", 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5478000000000002e-05 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182417+0000", 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124855 2024-04-26T10:33:32.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.182564+0000", 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146491 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:46517 5.6 e23/16 5:6c5711f5:::benchmark_data_smithi043_45180_object46516:head v 23'2880, mlcod=23'2877)", 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:32.183509+0000", 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0012847170000000001, 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001766194, 2024-04-26T10:33:32.212 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.213 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:32.213 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183509+0000", 2024-04-26T10:33:32.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183509+0000", 2024-04-26T10:33:32.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183509+0000", 2024-04-26T10:33:32.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183567+0000", 2024-04-26T10:33:32.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7726000000000003e-05 2024-04-26T10:33:32.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183576+0000", 2024-04-26T10:33:32.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4890000000000001e-06 2024-04-26T10:33:32.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183582+0000", 2024-04-26T10:33:32.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9680000000000003e-06 2024-04-26T10:33:32.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183716+0000", 2024-04-26T10:33:32.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013376999999999999 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183733+0000", 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7498000000000001e-05 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:46520 5.1 5:83e47a41:::benchmark_data_smithi043_45180_object46519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:32.183727+0000", 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0010667230000000001, 2024-04-26T10:33:32.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001610766, 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 46520 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183727+0000", 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183727+0000", 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183726+0000", 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183797+0000", 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0176e-05 2024-04-26T10:33:32.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183804+0000", 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7540000000000006e-06 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183809+0000", 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1660000000000002e-06 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183837+0000", 2024-04-26T10:33:32.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7849000000000001e-05 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183944+0000", 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106329 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184058+0000", 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011396 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:46521 5.2 5:411d14e3:::benchmark_data_smithi043_45180_object46520:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:32.183896+0000", 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00089772400000000003, 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015162559999999999, 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 46521 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183896+0000", 2024-04-26T10:33:32.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183896+0000", 2024-04-26T10:33:32.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183896+0000", 2024-04-26T10:33:32.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183983+0000", 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7145999999999995e-05 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183992+0000", 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0890000000000006e-06 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.183999+0000", 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.43e-06 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184036+0000", 2024-04-26T10:33:32.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6346000000000001e-05 2024-04-26T10:33:32.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184163+0000", 2024-04-26T10:33:32.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012683099999999999 2024-04-26T10:33:32.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:32.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184287+0000", 2024-04-26T10:33:32.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012407600000000001 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:46522 5.f 5:f3bfbb4e:::benchmark_data_smithi043_45180_object46521:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:32.184044+0000", 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00075013100000000002, 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014584330000000001, 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.225 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.226 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 46522 2024-04-26T10:33:32.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.226 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184044+0000", 2024-04-26T10:33:32.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184044+0000", 2024-04-26T10:33:32.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184043+0000", 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184136+0000", 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2332999999999998e-05 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184144+0000", 2024-04-26T10:33:32.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3359999999999995e-06 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184151+0000", 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8580000000000002e-06 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184198+0000", 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7175000000000001e-05 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184334+0000", 2024-04-26T10:33:32.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000135983 2024-04-26T10:33:32.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:32.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184478+0000", 2024-04-26T10:33:32.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014410599999999999 2024-04-26T10:33:32.229 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.229 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.229 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.229 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:46523 5.3 e23/16 5:c5260900:::benchmark_data_smithi043_45180_object46522:head v 23'2954, mlcod=23'2951)", 2024-04-26T10:33:32.229 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:32.184667+0000", 2024-04-26T10:33:32.230 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.000126809, 2024-04-26T10:33:32.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00091456299999999996, 2024-04-26T10:33:32.230 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.230 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:32.230 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184667+0000", 2024-04-26T10:33:32.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184667+0000", 2024-04-26T10:33:32.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184667+0000", 2024-04-26T10:33:32.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184790+0000", 2024-04-26T10:33:32.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123323 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184800+0000", 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5640000000000002e-06 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184806+0000", 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.852e-06 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184847+0000", 2024-04-26T10:33:32.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1727999999999998e-05 2024-04-26T10:33:32.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.184869+0000", 2024-04-26T10:33:32.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1916000000000002e-05 2024-04-26T10:33:32.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.233 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.233 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop_reply(client.4538.0:46509 5.f e23/16)", 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:32.185556+0000", 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.999238, 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5853000000000006e-05, 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.185556+0000", 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.185556+0000", 2024-04-26T10:33:32.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.185555+0000", 2024-04-26T10:33:32.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.185559+0000", 2024-04-26T10:33:32.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6940000000000001e-06 2024-04-26T10:33:32.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.185566+0000", 2024-04-26T10:33:32.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8920000000000003e-06 2024-04-26T10:33:32.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.185571+0000", 2024-04-26T10:33:32.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8670000000000002e-06 2024-04-26T10:33:32.236 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.237 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.237 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:33:32.237 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 12 2024-04-26T10:33:32.237 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:32.239 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:32.240 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:32.236+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:32.339 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:32.337+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:32.391 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:33:32.418 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 15 16 47097 47081 196.155 154.812 0.0033283 0.00509484 2024-04-26T10:33:32.429 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:33:32.429 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:33:32.430 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T10:33:32.430 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T10:33:32.430 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T10:33:32.430 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T10:33:32.451 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:32.451 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:33:32.451 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:33:32.451 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:33:32.451 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:32.466 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:32.473 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:32.472+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:32.541 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:32.540+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:32.601 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:32.602 INFO:teuthology.orchestra.run.smithi186.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T10:33:32.602 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:32.639 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:32.639 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:33:32.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:33:32.639 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:32.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.639 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:32.639 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:32.639 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.642092853000001, 2024-04-26T10:33:32.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017960028999999999, 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993792+0000", 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993800+0000", 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0900000000000005e-06 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993805+0000", 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9919999999999998e-06 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993809+0000", 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.703e-06 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012428800000000001 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993937+0000", 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0010000000000003e-06 2024-04-26T10:33:32.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006732+0000", 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012794972 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006890+0000", 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015741999999999999 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007049+0000", 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159872 2024-04-26T10:33:32.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011426+0000", 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043764370000000004 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011667+0000", 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024095400000000001 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011712+0000", 2024-04-26T10:33:32.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4752000000000001e-05 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011753+0000", 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0995999999999998e-05 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.642026563999998, 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018053829, 2024-04-26T10:33:32.645 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993861+0000", 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4990000000000001e-06 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993868+0000", 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7190000000000004e-06 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993873+0000", 2024-04-26T10:33:32.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0200000000000002e-06 2024-04-26T10:33:32.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993968+0000", 2024-04-26T10:33:32.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5310999999999996e-05 2024-04-26T10:33:32.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:32.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993974+0000", 2024-04-26T10:33:32.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:33:32.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008004+0000", 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014029700000000001 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008126+0000", 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122087 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008229+0000", 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102358 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011613+0000", 2024-04-26T10:33:32.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033843279999999998 2024-04-26T10:33:32.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011812+0000", 2024-04-26T10:33:32.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000198798 2024-04-26T10:33:32.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011871+0000", 2024-04-26T10:33:32.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9283000000000001e-05 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011913+0000", 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1798000000000002e-05 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.641996517000003, 2024-04-26T10:33:32.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018338483999999999, 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993892+0000", 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.546e-06 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993899+0000", 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:33:32.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993906+0000", 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9820000000000002e-06 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994023+0000", 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116766 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994028+0000", 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7079999999999996e-06 2024-04-26T10:33:32.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008784+0000", 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014756833 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008838+0000", 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3112000000000002e-05 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008957+0000", 2024-04-26T10:33:32.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119523 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011618+0000", 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026610330000000001 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012154+0000", 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053582800000000002 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012193+0000", 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9047000000000001e-05 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012227+0000", 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4442e-05 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:13 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:32.657 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.641954278999997, 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018412833, 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:32.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:32.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6139999999999999e-06 2024-04-26T10:33:32.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993939+0000", 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3279999999999996e-06 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993949+0000", 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.047e-05 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994066+0000", 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116952 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:32.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994071+0000", 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869999999999996e-06 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009196+0000", 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015125148 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009272+0000", 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5440999999999998e-05 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:32.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009381+0000", 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010946399999999999 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012090+0000", 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027090700000000001 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012271+0000", 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018098699999999999 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012312+0000", 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0286e-05 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2276000000000001e-05 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:15 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:32.663 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.641893500000002, 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018433715, 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993995+0000", 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.225e-06 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994001+0000", 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0619999999999997e-06 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994004+0000", 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.422e-06 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994157+0000", 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015285 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1449999999999999e-06 2024-04-26T10:33:32.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009937+0000", 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015774455 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010028+0000", 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0746000000000002e-05 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010174+0000", 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146682 2024-04-26T10:33:32.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012358+0000", 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021837900000000001 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012382+0000", 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3768e-05 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012406+0000", 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4006999999999999e-05 2024-04-26T10:33:32.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012426+0000", 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9896000000000001e-05 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:16 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.641870105000002, 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020879298000000001, 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.669 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:32.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994017+0000", 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1459999999999999e-06 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994021+0000", 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2169999999999996e-06 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994025+0000", 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3450000000000002e-06 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996368+0000", 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002342841 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996374+0000", 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6590000000000001e-06 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010589+0000", 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014214648999999999 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010670+0000", 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1463000000000003e-05 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010824+0000", 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000154007 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.013067+0000", 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022428629999999999 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014821+0000", 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017534530000000001 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014860+0000", 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9264000000000002e-05 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014895+0000", 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4619999999999997e-05 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:19 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.641856595999997, 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018265699, 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.675 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994031+0000", 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9980000000000002e-06 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994037+0000", 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0100000000000001e-06 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994043+0000", 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1500000000000004e-06 2024-04-26T10:33:32.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994085+0000", 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2354000000000001e-05 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994095+0000", 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8749999999999995e-06 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008664+0000", 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01456942 2024-04-26T10:33:32.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008786+0000", 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121735 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008948+0000", 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016180400000000001 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010761+0000", 2024-04-26T10:33:32.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018125120000000001 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012205+0000", 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014441040000000001 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012256+0000", 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1817999999999998e-05 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012295+0000", 2024-04-26T10:33:32.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8142000000000002e-05 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.641807520999997, 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018349608999999999, 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994081+0000", 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0589999999999998e-06 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994086+0000", 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1900000000000003e-06 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994090+0000", 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.771e-06 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994139+0000", 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9737999999999997e-05 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994145+0000", 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2460000000000003e-06 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009213+0000", 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015068834 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009263+0000", 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9991999999999998e-05 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009347+0000", 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3997000000000002e-05 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012307+0000", 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029601229999999998 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6470000000000001e-05 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012390+0000", 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5893000000000003e-05 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012428+0000", 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7721e-05 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.686 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.641786828000001, 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017262810999999999, 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:32.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994098+0000", 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994105+0000", 2024-04-26T10:33:32.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5599999999999999e-06 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994109+0000", 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5419999999999999e-06 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994115+0000", 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.181e-06 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994169+0000", 2024-04-26T10:33:32.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4505000000000001e-05 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994176+0000", 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9090000000000003e-06 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006451+0000", 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012274571999999999 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006594+0000", 2024-04-26T10:33:32.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014321900000000001 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006804+0000", 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020967800000000001 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011137+0000", 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043333349999999998 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011261+0000", 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012443 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011317+0000", 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6093e-05 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011361+0000", 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4039000000000003e-05 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.692 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.641758238999998, 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017534645000000001, 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994130+0000", 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5530000000000001e-06 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994155+0000", 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4703999999999999e-05 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8650000000000003e-06 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997690+0000", 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035285249999999998 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997697+0000", 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1399999999999997e-06 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003133+0000", 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054364549999999998 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003272+0000", 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138839 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003879+0000", 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00060699599999999995 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009920+0000", 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060407209999999998 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011512+0000", 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015920940000000001 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011591+0000", 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9054999999999994e-05 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011662+0000", 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1095999999999998e-05 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:32.698 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.641676509, 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017587693000000001, 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994219+0000", 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0421000000000001e-05 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994226+0000", 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4000000000000003e-06 2024-04-26T10:33:32.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994232+0000", 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.575e-06 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997723+0000", 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003491133 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997727+0000", 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5769999999999998e-06 2024-04-26T10:33:32.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.004741+0000", 2024-04-26T10:33:32.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070140410000000004 2024-04-26T10:33:32.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005283+0000", 2024-04-26T10:33:32.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054229500000000004 2024-04-26T10:33:32.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:32.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005451+0000", 2024-04-26T10:33:32.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016849700000000001 2024-04-26T10:33:32.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010173+0000", 2024-04-26T10:33:32.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047220259999999998 2024-04-26T10:33:32.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011703+0000", 2024-04-26T10:33:32.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015294499999999999 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011752+0000", 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9524999999999998e-05 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011797+0000", 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4205000000000001e-05 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.641647976999998, 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01805445, 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994240+0000", 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4920000000000002e-06 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994249+0000", 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4810000000000006e-06 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994254+0000", 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3839999999999996e-06 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996056+0000", 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018018839999999999 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996061+0000", 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8690000000000003e-06 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008974+0000", 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012913127 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009078+0000", 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010333899999999999 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009193+0000", 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011555100000000001 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011374+0000", 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002180642 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012202+0000", 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00082862099999999998 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012254+0000", 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1498000000000001e-05 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012292+0000", 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8071999999999997e-05 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:32.710 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.641584921000003, 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017896868, 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994300+0000", 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994303+0000", 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.145e-06 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994310+0000", 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.345e-06 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994317+0000", 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9e-06 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997746+0000", 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034290190000000002 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997753+0000", 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2999999999999998e-06 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007898+0000", 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010145207 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008073+0000", 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017543800000000001 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012197+0000", 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041240950000000004 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.714 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17792 5.1 5:8c0814d7:::benchmark_data_smithi043_45180_object17791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.924095823, 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017771348999999999, 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17792 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.715 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711789+0000", 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711901+0000", 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011175600000000001 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711907+0000", 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3049999999999998e-06 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711911+0000", 2024-04-26T10:33:32.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0069999999999999e-06 2024-04-26T10:33:32.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711940+0000", 2024-04-26T10:33:32.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9088999999999999e-05 2024-04-26T10:33:32.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712019+0000", 2024-04-26T10:33:32.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9134000000000005e-05 2024-04-26T10:33:32.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712105+0000", 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5932000000000003e-05 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713135+0000", 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010300610000000001 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729505+0000", 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016369775999999999 2024-04-26T10:33:32.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729539+0000", 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4093e-05 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729561+0000", 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1797000000000002e-05 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.720 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17797 5.1 5:89b74c1f:::benchmark_data_smithi043_45180_object17796:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.922215778, 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018126438000000002, 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17797 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713669+0000", 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713706+0000", 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6415000000000003e-05 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713711+0000", 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2140000000000004e-06 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713715+0000", 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2599999999999999e-06 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714380+0000", 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066529399999999998 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714509+0000", 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012870500000000001 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714643+0000", 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013370600000000001 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.719195+0000", 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045520430000000004 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731718+0000", 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012523276999999999 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731776+0000", 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7701000000000002e-05 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731796+0000", 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0398999999999999e-05 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:20229 5.1 5:80792ae8:::benchmark_data_smithi043_45180_object20228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.496587+0000", 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.139298907000001, 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01704321, 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 20229 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496587+0000", 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496587+0000", 2024-04-26T10:33:32.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496586+0000", 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496656+0000", 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9598999999999996e-05 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496664+0000", 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0970000000000006e-06 2024-04-26T10:33:32.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496669+0000", 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.772e-06 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496871+0000", 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000201635 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496986+0000", 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115359 2024-04-26T10:33:32.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.497117+0000", 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013059500000000001 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.499635+0000", 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025181069999999999 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.513544+0000", 2024-04-26T10:33:32.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013909127 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.513593+0000", 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8412999999999999e-05 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.513630+0000", 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7066000000000001e-05 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.835774979, 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:33:32.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:36694 5.f 5:f1c75ca5:::benchmark_data_smithi043_45180_object36693:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:28.235621+0000", 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.4002648989999997, 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017516515, 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 36694 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235621+0000", 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235621+0000", 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235620+0000", 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235651+0000", 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1306000000000001e-05 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235659+0000", 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2289999999999997e-06 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235664+0000", 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7339999999999996e-06 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.236634+0000", 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00096991099999999995 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.236720+0000", 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000003e-05 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.236807+0000", 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7523999999999998e-05 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.239948+0000", 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031408540000000002 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.253035+0000", 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013086956 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.253091+0000", 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5745999999999998e-05 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.253137+0000", 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6162000000000003e-05 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:45737 5.f 5:fb5333d2:::benchmark_data_smithi043_45180_object45736:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:32.742 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:31.872305+0000", 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.76358051000000005, 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016681468000000001, 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 45737 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:31.872305+0000", 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:31.872305+0000", 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:31.872304+0000", 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:31.872388+0000", 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4756e-05 2024-04-26T10:33:32.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:31.872395+0000", 2024-04-26T10:33:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7159999999999997e-06 2024-04-26T10:33:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:31.872400+0000", 2024-04-26T10:33:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4830000000000001e-06 2024-04-26T10:33:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:31.872430+0000", 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0477e-05 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:31.872528+0000", 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7972000000000003e-05 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:31.872634+0000", 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105771 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:31.878881+0000", 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0062472639999999998 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:31.888935+0000", 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010053616 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:31.888965+0000", 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0179e-05 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:31.888986+0000", 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1574e-05 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:46396 5.f 5:ffda636e:::benchmark_data_smithi043_45180_object46395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:32.134114+0000", 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.501771886, 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016627814000000001, 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:32.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 46396 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.134114+0000", 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.134114+0000", 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:32.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.134113+0000", 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.134224+0000", 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111437 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.134236+0000", 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1552999999999999e-05 2024-04-26T10:33:32.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.134244+0000", 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4959999999999996e-06 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.137389+0000", 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003144806 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.137472+0000", 2024-04-26T10:33:32.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3316e-05 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.137563+0000", 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0857000000000001e-05 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.139656+0000", 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002092301 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:32.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.150659+0000", 2024-04-26T10:33:32.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011003117999999999 2024-04-26T10:33:32.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:32.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.150710+0000", 2024-04-26T10:33:32.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1536999999999998e-05 2024-04-26T10:33:32.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:32.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:32.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:32.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:32.150741+0000", 2024-04-26T10:33:32.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1140999999999999e-05 2024-04-26T10:33:32.753 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.753 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:32.754 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:32.754 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:32.754 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:33:32.756 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:32.754+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:32.756 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:32.856 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:32.855+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:32.906 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:32.926 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:32.930 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:32.930 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:32.947 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:32.947 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:32.948 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:32.948 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:32.948 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:32.959 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:32.958+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:33.058 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:33.057+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:33.119 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:33.119 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:33.132 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:33.176 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:33.175+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:33.261 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:33.259+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:33.299 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:33.300 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:33.313 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:33.361 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:33.360+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:33.388 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-26T10:33:33.418 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 16 16 49521 49505 193.363 151.5 0.00625183 0.0051688 2024-04-26T10:33:33.462 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:33.462+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:33.506 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:33.506 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:33.520 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:33.564 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:33.562+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:33.665 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:33.664+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:33.708 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:33.709 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:33.724 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:33.766 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:33.765+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:33.866 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:33.865+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:33.956 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:33.956 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:33.966 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:33.967 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:33.966+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:34.068 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:34.067+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:34.134 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:34.134 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:34.147 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:34.168 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:34.168+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:34.269 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:34.268+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:34.318 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:34.319 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:34.333 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:34.370 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:34.369+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:34.418 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 17 16 51855 51839 190.569 145.875 0.00265384 0.00524356 2024-04-26T10:33:34.471 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:34.470+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:34.550 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:34.550 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:34.564 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:34.571 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:34.571+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:34.672 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:34.672+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:34.734 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:34.734 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:34.749 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:34.773 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:34.772+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:34.874 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:34.873+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:34.915 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:34.915 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:34.929 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:34.959 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:33:34.975 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:34.973+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:35.075 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:35.074+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:35.101 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:35.101 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:35.111 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:35.115 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:35.131 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:35.151 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:35.152 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:35.152 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:35.152 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:35.176 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:35.176+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:35.277 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:35.277+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:35.298 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:35.298 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:35.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.298 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:53874 5.2 e24/16)", 2024-04-26T10:33:35.298 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:35.295927+0000", 2024-04-26T10:33:35.298 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00034041399999999998, 2024-04-26T10:33:35.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035859800000000001, 2024-04-26T10:33:35.299 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.299 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:35.299 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295927+0000", 2024-04-26T10:33:35.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295927+0000", 2024-04-26T10:33:35.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295927+0000", 2024-04-26T10:33:35.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295990+0000", 2024-04-26T10:33:35.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2614999999999996e-05 2024-04-26T10:33:35.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295998+0000", 2024-04-26T10:33:35.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8689999999999993e-06 2024-04-26T10:33:35.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.296005+0000", 2024-04-26T10:33:35.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6760000000000001e-06 2024-04-26T10:33:35.301 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.301 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.301 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.302 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:53876 5.4 e24/16)", 2024-04-26T10:33:35.302 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:35.296056+0000", 2024-04-26T10:33:35.302 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00021188199999999999, 2024-04-26T10:33:35.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027978999999999998, 2024-04-26T10:33:35.302 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.302 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:35.302 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.296056+0000", 2024-04-26T10:33:35.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.296056+0000", 2024-04-26T10:33:35.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.296055+0000", 2024-04-26T10:33:35.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.296117+0000", 2024-04-26T10:33:35.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1122000000000002e-05 2024-04-26T10:33:35.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.296125+0000", 2024-04-26T10:33:35.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4300000000000006e-06 2024-04-26T10:33:35.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.296131+0000", 2024-04-26T10:33:35.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.251e-06 2024-04-26T10:33:35.305 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.305 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.305 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.305 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:53857 5.e e24/16 5:70925293:::benchmark_data_smithi043_45180_object53856:head v 24'3353, mlcod=24'3351)", 2024-04-26T10:33:35.305 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:35.289119+0000", 2024-04-26T10:33:35.305 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0071492639999999998, 2024-04-26T10:33:35.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072727620000000003, 2024-04-26T10:33:35.305 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.305 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:35.305 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289119+0000", 2024-04-26T10:33:35.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289119+0000", 2024-04-26T10:33:35.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289118+0000", 2024-04-26T10:33:35.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289175+0000", 2024-04-26T10:33:35.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6657000000000003e-05 2024-04-26T10:33:35.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289183+0000", 2024-04-26T10:33:35.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:33:35.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289189+0000", 2024-04-26T10:33:35.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9020000000000004e-06 2024-04-26T10:33:35.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289215+0000", 2024-04-26T10:33:35.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6352000000000001e-05 2024-04-26T10:33:35.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289227+0000", 2024-04-26T10:33:35.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2591e-05 2024-04-26T10:33:35.309 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.309 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.309 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.309 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:53859 5.b e24/16 5:d2be509d:::benchmark_data_smithi043_45180_object53858:head v 24'3412, mlcod=24'3410)", 2024-04-26T10:33:35.309 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:35.289207+0000", 2024-04-26T10:33:35.309 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0070610810000000003, 2024-04-26T10:33:35.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072449039999999999, 2024-04-26T10:33:35.310 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.310 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:35.310 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289207+0000", 2024-04-26T10:33:35.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289207+0000", 2024-04-26T10:33:35.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289206+0000", 2024-04-26T10:33:35.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289229+0000", 2024-04-26T10:33:35.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2532e-05 2024-04-26T10:33:35.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289236+0000", 2024-04-26T10:33:35.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.435e-06 2024-04-26T10:33:35.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289240+0000", 2024-04-26T10:33:35.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5839999999999999e-06 2024-04-26T10:33:35.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289269+0000", 2024-04-26T10:33:35.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8779999999999999e-05 2024-04-26T10:33:35.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289285+0000", 2024-04-26T10:33:35.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6237999999999999e-05 2024-04-26T10:33:35.315 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.315 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.315 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.315 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:53866 5.3 5:c19f901b:::benchmark_data_smithi043_45180_object53865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:35.315 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:35.289596+0000", 2024-04-26T10:33:35.315 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0066715400000000001, 2024-04-26T10:33:35.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069204540000000004, 2024-04-26T10:33:35.315 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.315 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:35.315 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.316 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.316 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.316 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 53866 2024-04-26T10:33:35.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.316 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289596+0000", 2024-04-26T10:33:35.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289596+0000", 2024-04-26T10:33:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289596+0000", 2024-04-26T10:33:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289639+0000", 2024-04-26T10:33:35.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3232000000000002e-05 2024-04-26T10:33:35.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289650+0000", 2024-04-26T10:33:35.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.043e-05 2024-04-26T10:33:35.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289656+0000", 2024-04-26T10:33:35.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3690000000000003e-06 2024-04-26T10:33:35.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.290087+0000", 2024-04-26T10:33:35.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00043066399999999998 2024-04-26T10:33:35.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.290206+0000", 2024-04-26T10:33:35.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119646 2024-04-26T10:33:35.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:35.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.290335+0000", 2024-04-26T10:33:35.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012887900000000001 2024-04-26T10:33:35.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.296474+0000", 2024-04-26T10:33:35.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0061388359999999999 2024-04-26T10:33:35.320 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.320 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.320 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.321 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:53856 5.4 e24/16 5:28102f0f:::benchmark_data_smithi043_45180_object53855:head v 24'3318, mlcod=24'3315)", 2024-04-26T10:33:35.321 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:35.289688+0000", 2024-04-26T10:33:35.321 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.006580069, 2024-04-26T10:33:35.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069136509999999998, 2024-04-26T10:33:35.321 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.321 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:35.321 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289688+0000", 2024-04-26T10:33:35.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289688+0000", 2024-04-26T10:33:35.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289687+0000", 2024-04-26T10:33:35.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289770+0000", 2024-04-26T10:33:35.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3040000000000005e-05 2024-04-26T10:33:35.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289777+0000", 2024-04-26T10:33:35.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0110000000000003e-06 2024-04-26T10:33:35.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.323 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.323 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.323 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.289782+0000", 2024-04-26T10:33:35.323 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6999999999999999e-06 2024-04-26T10:33:35.323 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.290895+0000", 2024-04-26T10:33:35.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011126230000000001 2024-04-26T10:33:35.324 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.324 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.324 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.324 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.290913+0000", 2024-04-26T10:33:35.324 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8664999999999998e-05 2024-04-26T10:33:35.324 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.324 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.324 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.325 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.325 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:53861 5.e e24/16 5:79504639:::benchmark_data_smithi043_45180_object53860:head v 24'3354, mlcod=24'3351)", 2024-04-26T10:33:35.325 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:35.291430+0000", 2024-04-26T10:33:35.325 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0048375149999999997, 2024-04-26T10:33:35.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0052362329999999999, 2024-04-26T10:33:35.325 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.325 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:35.325 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.325 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.325 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.325 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.291430+0000", 2024-04-26T10:33:35.325 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.291430+0000", 2024-04-26T10:33:35.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.326 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.326 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.326 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.291430+0000", 2024-04-26T10:33:35.326 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.326 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.291454+0000", 2024-04-26T10:33:35.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3726999999999998e-05 2024-04-26T10:33:35.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.327 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.291461+0000", 2024-04-26T10:33:35.327 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3520000000000001e-06 2024-04-26T10:33:35.327 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.327 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.327 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.291466+0000", 2024-04-26T10:33:35.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3009999999999997e-06 2024-04-26T10:33:35.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.294704+0000", 2024-04-26T10:33:35.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003237953 2024-04-26T10:33:35.328 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.328 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.328 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.328 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.294718+0000", 2024-04-26T10:33:35.328 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3505e-05 2024-04-26T10:33:35.329 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.329 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.329 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.329 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.329 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.329 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:53869 5.2 e24/16 5:458fc18c:::benchmark_data_smithi043_45180_object53868:head v 24'3403, mlcod=24'3401)", 2024-04-26T10:33:35.329 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:35.292197+0000", 2024-04-26T10:33:35.329 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0040707720000000003, 2024-04-26T10:33:35.329 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045270930000000003, 2024-04-26T10:33:35.329 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.329 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:35.329 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.292197+0000", 2024-04-26T10:33:35.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.330 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.292197+0000", 2024-04-26T10:33:35.330 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.330 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.330 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.330 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.292197+0000", 2024-04-26T10:33:35.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.292262+0000", 2024-04-26T10:33:35.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5648000000000006e-05 2024-04-26T10:33:35.331 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.331 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.331 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.292269+0000", 2024-04-26T10:33:35.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0559999999999999e-06 2024-04-26T10:33:35.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.292274+0000", 2024-04-26T10:33:35.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.617e-06 2024-04-26T10:33:35.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.292312+0000", 2024-04-26T10:33:35.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.854e-05 2024-04-26T10:33:35.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.292332+0000", 2024-04-26T10:33:35.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9480999999999999e-05 2024-04-26T10:33:35.333 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.333 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.333 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.333 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:53872 5.3 5:cba10691:::benchmark_data_smithi043_45180_object53871:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:35.333 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:35.293873+0000", 2024-04-26T10:33:35.333 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.002395089, 2024-04-26T10:33:35.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029159870000000001, 2024-04-26T10:33:35.334 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.334 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:35.334 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.334 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.334 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.334 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 53872 2024-04-26T10:33:35.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.334 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.293873+0000", 2024-04-26T10:33:35.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.293873+0000", 2024-04-26T10:33:35.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.293871+0000", 2024-04-26T10:33:35.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:35.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.293959+0000", 2024-04-26T10:33:35.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7445e-05 2024-04-26T10:33:35.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.293970+0000", 2024-04-26T10:33:35.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1579999999999999e-05 2024-04-26T10:33:35.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.293976+0000", 2024-04-26T10:33:35.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8109999999999999e-06 2024-04-26T10:33:35.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.294010+0000", 2024-04-26T10:33:35.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3801999999999999e-05 2024-04-26T10:33:35.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.338 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.294101+0000", 2024-04-26T10:33:35.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0487000000000003e-05 2024-04-26T10:33:35.338 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.338 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.338 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:35.338 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.294206+0000", 2024-04-26T10:33:35.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010547 2024-04-26T10:33:35.338 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.338 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.338 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.339 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.296557+0000", 2024-04-26T10:33:35.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023506439999999998 2024-04-26T10:33:35.339 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.339 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.339 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.339 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:53871 5.2 e24/16 5:436a5977:::benchmark_data_smithi043_45180_object53870:head v 24'3404, mlcod=24'3401)", 2024-04-26T10:33:35.339 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:35.294175+0000", 2024-04-26T10:33:35.339 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0020929630000000002, 2024-04-26T10:33:35.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002697811, 2024-04-26T10:33:35.340 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.340 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:35.340 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.294175+0000", 2024-04-26T10:33:35.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.294175+0000", 2024-04-26T10:33:35.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.294174+0000", 2024-04-26T10:33:35.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.294238+0000", 2024-04-26T10:33:35.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3298000000000003e-05 2024-04-26T10:33:35.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.294247+0000", 2024-04-26T10:33:35.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:33:35.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.294255+0000", 2024-04-26T10:33:35.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.525e-06 2024-04-26T10:33:35.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.294940+0000", 2024-04-26T10:33:35.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00068513999999999999 2024-04-26T10:33:35.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.343 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.343 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.294957+0000", 2024-04-26T10:33:35.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6939000000000002e-05 2024-04-26T10:33:35.343 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.343 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.343 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.344 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:53873 5.1 e24/16 5:8cce05b0:::benchmark_data_smithi043_45180_object53872:head v 24'3369, mlcod=24'3367)", 2024-04-26T10:33:35.344 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:35.295504+0000", 2024-04-26T10:33:35.344 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00076411100000000004, 2024-04-26T10:33:35.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014270109999999999, 2024-04-26T10:33:35.344 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.344 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:35.344 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295504+0000", 2024-04-26T10:33:35.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295504+0000", 2024-04-26T10:33:35.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295503+0000", 2024-04-26T10:33:35.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295563+0000", 2024-04-26T10:33:35.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0359999999999998e-05 2024-04-26T10:33:35.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295572+0000", 2024-04-26T10:33:35.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8310000000000007e-06 2024-04-26T10:33:35.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295578+0000", 2024-04-26T10:33:35.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:33:35.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295630+0000", 2024-04-26T10:33:35.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1777999999999998e-05 2024-04-26T10:33:35.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295656+0000", 2024-04-26T10:33:35.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6489999999999999e-05 2024-04-26T10:33:35.348 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.348 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.348 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.348 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:53875 5.8 e24/16 5:1bd31352:::benchmark_data_smithi043_45180_object53874:head v 24'3368, mlcod=24'3366)", 2024-04-26T10:33:35.348 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:35.295782+0000", 2024-04-26T10:33:35.348 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00048590100000000001, 2024-04-26T10:33:35.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012065870000000001, 2024-04-26T10:33:35.349 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.349 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:35.349 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295782+0000", 2024-04-26T10:33:35.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295782+0000", 2024-04-26T10:33:35.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295781+0000", 2024-04-26T10:33:35.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295834+0000", 2024-04-26T10:33:35.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2985000000000002e-05 2024-04-26T10:33:35.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295842+0000", 2024-04-26T10:33:35.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:33:35.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295848+0000", 2024-04-26T10:33:35.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6699999999999999e-06 2024-04-26T10:33:35.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295891+0000", 2024-04-26T10:33:35.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2715e-05 2024-04-26T10:33:35.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:35.295913+0000", 2024-04-26T10:33:35.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.181e-05 2024-04-26T10:33:35.352 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.352 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.352 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.353 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.353 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:33:35.353 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 12 2024-04-26T10:33:35.353 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:35.354 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:35.400 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:35.398+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:35.400 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:33:35.418 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 18 16 54159 54143 187.981 144 0.00614361 0.00531642 2024-04-26T10:33:35.480 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:35.479+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:35.536 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:35.536 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:33:35.536 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:33:35.536 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:33:35.536 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:35.551 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:35.581 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:35.580+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:35.681 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:35.680+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:35.780 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:35.780 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:33:35.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:33:35.780 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:35.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.780 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:10 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:35.780 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:35.780 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.783116815, 2024-04-26T10:33:35.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018785385000000002, 2024-04-26T10:33:35.780 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.780 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.780 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:35.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993662+0000", 2024-04-26T10:33:35.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993661+0000", 2024-04-26T10:33:35.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:35.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993667+0000", 2024-04-26T10:33:35.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9120000000000003e-06 2024-04-26T10:33:35.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993676+0000", 2024-04-26T10:33:35.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0270000000000001e-06 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993681+0000", 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9919999999999998e-06 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993763+0000", 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2799999999999993e-05 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993768+0000", 2024-04-26T10:33:35.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9409999999999998e-06 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004133+0000", 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.01036455 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004220+0000", 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7394999999999999e-05 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:35.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004343+0000", 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012254900000000001 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005750+0000", 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001406991 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012396+0000", 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0066459129999999998 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012422+0000", 2024-04-26T10:33:35.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6182000000000001e-05 2024-04-26T10:33:35.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012447+0000", 2024-04-26T10:33:35.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4981e-05 2024-04-26T10:33:35.786 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.786 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.786 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.786 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:35.786 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.783059250000001, 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018863001000000001, 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993719+0000", 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993722+0000", 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7630000000000001e-06 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993726+0000", 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9999999999999998e-06 2024-04-26T10:33:35.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993729+0000", 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3210000000000001e-06 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993795+0000", 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5903999999999998e-05 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993798+0000", 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:33:35.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004680+0000", 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010881823000000001 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.004804+0000", 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012401 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005121+0000", 2024-04-26T10:33:35.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031651100000000001 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.006210+0000", 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010888930000000001 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012493+0000", 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062830630000000002 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012543+0000", 2024-04-26T10:33:35.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0331999999999999e-05 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012582+0000", 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9230999999999998e-05 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.782941039000001, 2024-04-26T10:33:35.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018824634, 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993837+0000", 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993841+0000", 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3059999999999999e-06 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993849+0000", 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993855+0000", 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9479999999999996e-06 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993885+0000", 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9798000000000002e-05 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:51.993891+0000", 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2689999999999996e-06 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005459+0000", 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.011567898 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.005556+0000", 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7751999999999995e-05 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:32:52.012662+0000", 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0071055830000000004 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.796 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:32138 5.a 5:5aa17a08:::benchmark_data_smithi043_45180_object32137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:26.509281+0000", 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.2674976450000006, 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018407257999999999, 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 32138 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509281+0000", 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509281+0000", 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509280+0000", 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509321+0000", 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0992999999999999e-05 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509329+0000", 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2570000000000007e-06 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.509335+0000", 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9529999999999996e-06 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.520295+0000", 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010959391000000001 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.520384+0000", 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9306000000000002e-05 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.520486+0000", 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010165100000000001 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.526101+0000", 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056154359999999997 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.527595+0000", 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014940649999999999 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.527649+0000", 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4283999999999997e-05 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:26.527688+0000", 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8699999999999999e-05 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.9761095360000001, 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.802 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:33:35.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:33:35.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:35.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:33:35.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:33:35.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:33:35.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:33:35.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.9761085510000003, 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.811 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.9760399279999996, 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:33:35.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:33:35.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:33:35.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:35.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.9759881479999999, 2024-04-26T10:33:35.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:33:35.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:33:35.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:33:35.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.9759282980000004, 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.823 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:35.828 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.9742155940000004, 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:33:35.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:33:35.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:33:35.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:33:35.833 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.974100527, 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:35.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:33:35.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:33:35.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:33:35.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.9740073870000003, 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.838 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:33:35.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.9738132269999999, 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:33:35.843 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.9726058589999997, 2024-04-26T10:33:35.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.971796951, 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.851 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:33:35.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:35.856 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.9716934129999997, 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:33:35.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:33:35.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:33:35.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.9716165400000003, 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.862 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:35.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 7.9715011560000004, 2024-04-26T10:33:35.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:48295 5.a 5:5d08b1be:::benchmark_data_smithi043_45180_object48294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.8826399629999999, 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020783243999999999, 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.871 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 48295 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894137+0000", 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894198+0000", 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0192999999999998e-05 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894209+0000", 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1486e-05 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894217+0000", 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1370000000000002e-06 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894251+0000", 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3636000000000001e-05 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894361+0000", 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010988 2024-04-26T10:33:35.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894441+0000", 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0549000000000004e-05 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.897398+0000", 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002956232 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914869+0000", 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017471582999999999 2024-04-26T10:33:35.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914901+0000", 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1578999999999997e-05 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914922+0000", 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0965999999999999e-05 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:48299 5.a 5:5776ea42:::benchmark_data_smithi043_45180_object48298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:35.876 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.881944163, 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020205178000000001, 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 48299 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894907+0000", 2024-04-26T10:33:35.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3622999999999996e-05 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894914+0000", 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894918+0000", 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8e-06 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.895863+0000", 2024-04-26T10:33:35.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00094444799999999997 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.895976+0000", 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000113736 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.896101+0000", 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012477699999999999 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.899956+0000", 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038552539999999998 2024-04-26T10:33:35.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914959+0000", 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015002991 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.915007+0000", 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7404999999999998e-05 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.915039+0000", 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2750000000000003e-05 2024-04-26T10:33:35.881 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.882 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:35.882 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:35.882 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:35.883 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:35.882+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:35.884 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:35.984 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:35.982+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:36.061 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:36.061 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:36.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.061 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:55594 5.9 5:9bf9120f:::benchmark_data_smithi043_45180_object55593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:36.061 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:36.055784+0000", 2024-04-26T10:33:36.061 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.004028027, 2024-04-26T10:33:36.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040490190000000001, 2024-04-26T10:33:36.061 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.062 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:36.062 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.062 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.062 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.062 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 55594 2024-04-26T10:33:36.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.062 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.055784+0000", 2024-04-26T10:33:36.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.055784+0000", 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.055783+0000", 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.055804+0000", 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0594e-05 2024-04-26T10:33:36.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.055813+0000", 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3179999999999996e-06 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.055820+0000", 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4379999999999998e-06 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.055858+0000", 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8189999999999999e-05 2024-04-26T10:33:36.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.055965+0000", 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106996 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056132+0000", 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016636799999999999 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.065 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:55600 5.2 5:4eee1b18:::benchmark_data_smithi043_45180_object55599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:36.055961+0000", 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0038502570000000002, 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039559920000000002, 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 55600 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.055961+0000", 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.055961+0000", 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.055961+0000", 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056084+0000", 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123423 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056096+0000", 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1432e-05 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056104+0000", 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9889999999999992e-06 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056146+0000", 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2700000000000001e-05 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056275+0000", 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012878799999999999 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056415+0000", 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000139474 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.059896+0000", 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034815599999999999 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:55601 5.7 5:e7f0bb18:::benchmark_data_smithi043_45180_object55600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:36.056119+0000", 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0036925930000000001, 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038916350000000001, 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:36.070 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 55601 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056119+0000", 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056119+0000", 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056118+0000", 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056219+0000", 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100825 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056231+0000", 2024-04-26T10:33:36.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2068e-05 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056248+0000", 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6702999999999999e-05 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056292+0000", 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3690999999999999e-05 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056395+0000", 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103578 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056510+0000", 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011485 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:55602 5.7 5:e9dbee2f:::benchmark_data_smithi043_45180_object55601:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:36.056262+0000", 2024-04-26T10:33:36.074 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0035498679999999999, 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038289909999999999, 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 55602 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056262+0000", 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056262+0000", 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056261+0000", 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056316+0000", 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4592000000000002e-05 2024-04-26T10:33:36.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056343+0000", 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7015000000000001e-05 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056355+0000", 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2709e-05 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.058277+0000", 2024-04-26T10:33:36.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001921175 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.058400+0000", 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012318400000000001 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.058553+0000", 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153435 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:55597 5.d e24/16 5:b4fd2d01:::benchmark_data_smithi043_45180_object55596:head v 24'3511, mlcod=24'3508)", 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:36.056280+0000", 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.003531677, 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038895280000000002, 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056280+0000", 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056280+0000", 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056279+0000", 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056409+0000", 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012931499999999999 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056418+0000", 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2129999999999997e-06 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056424+0000", 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4969999999999998e-06 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056456+0000", 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1837e-05 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056477+0000", 2024-04-26T10:33:36.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0973999999999999e-05 2024-04-26T10:33:36.082 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.082 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.082 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.082 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:55604 5.9 5:9becc4c3:::benchmark_data_smithi043_45180_object55603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:36.082 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:36.056370+0000", 2024-04-26T10:33:36.082 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0034418109999999999, 2024-04-26T10:33:36.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038687180000000002, 2024-04-26T10:33:36.082 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.082 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:36.082 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 55604 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056370+0000", 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056370+0000", 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056369+0000", 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056434+0000", 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4574999999999998e-05 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056449+0000", 2024-04-26T10:33:36.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5082999999999999e-05 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056456+0000", 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6669999999999999e-06 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.058029+0000", 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015736840000000001 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.058182+0000", 2024-04-26T10:33:36.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152979 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.058334+0000", 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015146100000000001 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:55599 5.3 e24/16 5:cd11e2a0:::benchmark_data_smithi043_45180_object55598:head v 24'3510, mlcod=24'3508)", 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:36.056748+0000", 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0030640810000000002, 2024-04-26T10:33:36.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035744650000000002, 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056748+0000", 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056748+0000", 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056747+0000", 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056841+0000", 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3987999999999995e-05 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056850+0000", 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9509999999999995e-06 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056856+0000", 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1279999999999996e-06 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.058006+0000", 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001149457 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.058025+0000", 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8892000000000001e-05 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.089 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:55589 5.f 5:f5abed98:::benchmark_data_smithi043_45180_object55588:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:36.052919+0000", 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0068929450000000001, 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0074426049999999997, 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 55589 2024-04-26T10:33:36.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.052919+0000", 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.052919+0000", 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.052918+0000", 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.052986+0000", 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7933000000000002e-05 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.052994+0000", 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9549999999999992e-06 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.052999+0000", 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.87e-06 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.053040+0000", 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1412999999999998e-05 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.053194+0000", 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153506 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:36.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.053358+0000", 2024-04-26T10:33:36.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000164883 2024-04-26T10:33:36.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.056023+0000", 2024-04-26T10:33:36.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026641009999999999 2024-04-26T10:33:36.094 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.094 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.094 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.094 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:55593 5.2 5:414a1505:::benchmark_data_smithi043_45180_object55592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:36.094 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:36.053013+0000", 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0067988739999999999, 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073949580000000001, 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 55593 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.053013+0000", 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.053013+0000", 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.053012+0000", 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.053109+0000", 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6887999999999998e-05 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.053115+0000", 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9689999999999999e-06 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.053119+0000", 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6909999999999999e-06 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.053155+0000", 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6316999999999998e-05 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.053284+0000", 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012898099999999999 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.053419+0000", 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013471499999999999 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.055188+0000", 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001769231 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.098 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.099 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.099 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.099 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:33:36.099 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 9 2024-04-26T10:33:36.099 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:36.100 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:36.099+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:36.101 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:36.201 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:36.200+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:36.272 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:36.272 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:33:36.272 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:33:36.272 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:33:36.272 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:36.286 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:36.331 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:36.330+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:36.394 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-26T10:33:36.401 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:36.401+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:36.418 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 19 16 56416 56400 185.511 141.062 0.00295287 0.00538686 2024-04-26T10:33:36.459 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:36.459 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:33:36.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:33:36.459 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.462578794999999, 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017960028999999999, 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993792+0000", 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993800+0000", 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0900000000000005e-06 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993805+0000", 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9919999999999998e-06 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993809+0000", 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.703e-06 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012428800000000001 2024-04-26T10:33:36.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:36.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993937+0000", 2024-04-26T10:33:36.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0010000000000003e-06 2024-04-26T10:33:36.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006732+0000", 2024-04-26T10:33:36.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012794972 2024-04-26T10:33:36.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006890+0000", 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015741999999999999 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007049+0000", 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159872 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011426+0000", 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043764370000000004 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011667+0000", 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024095400000000001 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011712+0000", 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4752000000000001e-05 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011753+0000", 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0995999999999998e-05 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.465 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.462512506000003, 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018053829, 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:36.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993861+0000", 2024-04-26T10:33:36.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4990000000000001e-06 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993868+0000", 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7190000000000004e-06 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993873+0000", 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0200000000000002e-06 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993968+0000", 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5310999999999996e-05 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993974+0000", 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008004+0000", 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014029700000000001 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008126+0000", 2024-04-26T10:33:36.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122087 2024-04-26T10:33:36.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:36.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008229+0000", 2024-04-26T10:33:36.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102358 2024-04-26T10:33:36.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011613+0000", 2024-04-26T10:33:36.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033843279999999998 2024-04-26T10:33:36.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011812+0000", 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000198798 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011871+0000", 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9283000000000001e-05 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011913+0000", 2024-04-26T10:33:36.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1798000000000002e-05 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.462482459, 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018338483999999999, 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993892+0000", 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.546e-06 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993899+0000", 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993906+0000", 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9820000000000002e-06 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994023+0000", 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116766 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994028+0000", 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7079999999999996e-06 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008784+0000", 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014756833 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008838+0000", 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3112000000000002e-05 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008957+0000", 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119523 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011618+0000", 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026610330000000001 2024-04-26T10:33:36.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012154+0000", 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053582800000000002 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012193+0000", 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9047000000000001e-05 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012227+0000", 2024-04-26T10:33:36.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4442e-05 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:13 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.462440221000001, 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018412833, 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6139999999999999e-06 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993939+0000", 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3279999999999996e-06 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993949+0000", 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.047e-05 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994066+0000", 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116952 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994071+0000", 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869999999999996e-06 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009196+0000", 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015125148 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009272+0000", 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5440999999999998e-05 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009381+0000", 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010946399999999999 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012090+0000", 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027090700000000001 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012271+0000", 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018098699999999999 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012312+0000", 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0286e-05 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2276000000000001e-05 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.483 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:15 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.462379442, 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018433715, 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993995+0000", 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.225e-06 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994001+0000", 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0619999999999997e-06 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994004+0000", 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.422e-06 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994157+0000", 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015285 2024-04-26T10:33:36.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1449999999999999e-06 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009937+0000", 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015774455 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010028+0000", 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0746000000000002e-05 2024-04-26T10:33:36.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010174+0000", 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146682 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012358+0000", 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021837900000000001 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012382+0000", 2024-04-26T10:33:36.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3768e-05 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012406+0000", 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4006999999999999e-05 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012426+0000", 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9896000000000001e-05 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:16 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.462356047, 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020879298000000001, 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994017+0000", 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1459999999999999e-06 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994021+0000", 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2169999999999996e-06 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994025+0000", 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3450000000000002e-06 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996368+0000", 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002342841 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996374+0000", 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6590000000000001e-06 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010589+0000", 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014214648999999999 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010670+0000", 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1463000000000003e-05 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010824+0000", 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000154007 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.013067+0000", 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022428629999999999 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014821+0000", 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017534530000000001 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014860+0000", 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9264000000000002e-05 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014895+0000", 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4619999999999997e-05 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:19 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.462342538000001, 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018265699, 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994031+0000", 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9980000000000002e-06 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994037+0000", 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0100000000000001e-06 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994043+0000", 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1500000000000004e-06 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994085+0000", 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2354000000000001e-05 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994095+0000", 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8749999999999995e-06 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008664+0000", 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01456942 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008786+0000", 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121735 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008948+0000", 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016180400000000001 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010761+0000", 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018125120000000001 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012205+0000", 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014441040000000001 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012256+0000", 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1817999999999998e-05 2024-04-26T10:33:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012295+0000", 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8142000000000002e-05 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.462293463000002, 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018349608999999999, 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994081+0000", 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0589999999999998e-06 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994086+0000", 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1900000000000003e-06 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994090+0000", 2024-04-26T10:33:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.771e-06 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994139+0000", 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9737999999999997e-05 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994145+0000", 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2460000000000003e-06 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009213+0000", 2024-04-26T10:33:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015068834 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009263+0000", 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9991999999999998e-05 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009347+0000", 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3997000000000002e-05 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012307+0000", 2024-04-26T10:33:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029601229999999998 2024-04-26T10:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6470000000000001e-05 2024-04-26T10:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012390+0000", 2024-04-26T10:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5893000000000003e-05 2024-04-26T10:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012428+0000", 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7721e-05 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.462272769999998, 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017262810999999999, 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994099+0000", 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994098+0000", 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994105+0000", 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5599999999999999e-06 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994109+0000", 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5419999999999999e-06 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994115+0000", 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.181e-06 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994169+0000", 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4505000000000001e-05 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994176+0000", 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9090000000000003e-06 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006451+0000", 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012274571999999999 2024-04-26T10:33:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006594+0000", 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014321900000000001 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006804+0000", 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020967800000000001 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011137+0000", 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043333349999999998 2024-04-26T10:33:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011261+0000", 2024-04-26T10:33:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012443 2024-04-26T10:33:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011317+0000", 2024-04-26T10:33:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6093e-05 2024-04-26T10:33:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011361+0000", 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4039000000000003e-05 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.462244181000003, 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017534645000000001, 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994130+0000", 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5530000000000001e-06 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994155+0000", 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4703999999999999e-05 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8650000000000003e-06 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997690+0000", 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035285249999999998 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997697+0000", 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1399999999999997e-06 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003133+0000", 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054364549999999998 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003272+0000", 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138839 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003879+0000", 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00060699599999999995 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009920+0000", 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060407209999999998 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011512+0000", 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015920940000000001 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011591+0000", 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9054999999999994e-05 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011662+0000", 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1095999999999998e-05 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.462162450999998, 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017587693000000001, 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994219+0000", 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0421000000000001e-05 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994226+0000", 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4000000000000003e-06 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994232+0000", 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.575e-06 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997723+0000", 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003491133 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997727+0000", 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5769999999999998e-06 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.004741+0000", 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070140410000000004 2024-04-26T10:33:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005283+0000", 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054229500000000004 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005451+0000", 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016849700000000001 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010173+0000", 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047220259999999998 2024-04-26T10:33:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011703+0000", 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015294499999999999 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011752+0000", 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9524999999999998e-05 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011797+0000", 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4205000000000001e-05 2024-04-26T10:33:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.462133919000003, 2024-04-26T10:33:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01805445, 2024-04-26T10:33:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994240+0000", 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4920000000000002e-06 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994249+0000", 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4810000000000006e-06 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994254+0000", 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3839999999999996e-06 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996056+0000", 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018018839999999999 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996061+0000", 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8690000000000003e-06 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008974+0000", 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012913127 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009078+0000", 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010333899999999999 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009193+0000", 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011555100000000001 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011374+0000", 2024-04-26T10:33:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002180642 2024-04-26T10:33:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012202+0000", 2024-04-26T10:33:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00082862099999999998 2024-04-26T10:33:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012254+0000", 2024-04-26T10:33:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1498000000000001e-05 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012292+0000", 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8071999999999997e-05 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.462070863000001, 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017896868, 2024-04-26T10:33:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994300+0000", 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994303+0000", 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.145e-06 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994310+0000", 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.345e-06 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994317+0000", 2024-04-26T10:33:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9e-06 2024-04-26T10:33:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997746+0000", 2024-04-26T10:33:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034290190000000002 2024-04-26T10:33:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997753+0000", 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2999999999999998e-06 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007898+0000", 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010145207 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008073+0000", 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017543800000000001 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012197+0000", 2024-04-26T10:33:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041240950000000004 2024-04-26T10:33:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17792 5.1 5:8c0814d7:::benchmark_data_smithi043_45180_object17791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.744581765, 2024-04-26T10:33:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017771348999999999, 2024-04-26T10:33:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17792 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711789+0000", 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711901+0000", 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011175600000000001 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711907+0000", 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3049999999999998e-06 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711911+0000", 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0069999999999999e-06 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711940+0000", 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9088999999999999e-05 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712019+0000", 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9134000000000005e-05 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712105+0000", 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5932000000000003e-05 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713135+0000", 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010300610000000001 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729505+0000", 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016369775999999999 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729539+0000", 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4093e-05 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729561+0000", 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1797000000000002e-05 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17797 5.1 5:89b74c1f:::benchmark_data_smithi043_45180_object17796:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.742701719999999, 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018126438000000002, 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17797 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713669+0000", 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713706+0000", 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6415000000000003e-05 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713711+0000", 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2140000000000004e-06 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713715+0000", 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2599999999999999e-06 2024-04-26T10:33:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714380+0000", 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066529399999999998 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714509+0000", 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012870500000000001 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714643+0000", 2024-04-26T10:33:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013370600000000001 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.719195+0000", 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045520430000000004 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731718+0000", 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012523276999999999 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731776+0000", 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7701000000000002e-05 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731796+0000", 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0398999999999999e-05 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:20229 5.1 5:80792ae8:::benchmark_data_smithi043_45180_object20228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:22.496587+0000", 2024-04-26T10:33:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.959784849, 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01704321, 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 20229 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496587+0000", 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496587+0000", 2024-04-26T10:33:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496586+0000", 2024-04-26T10:33:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496656+0000", 2024-04-26T10:33:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9598999999999996e-05 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496664+0000", 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0970000000000006e-06 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496669+0000", 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.772e-06 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496871+0000", 2024-04-26T10:33:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000201635 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.496986+0000", 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115359 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.497117+0000", 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013059500000000001 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.499635+0000", 2024-04-26T10:33:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025181069999999999 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.513544+0000", 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013909127 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.513593+0000", 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8412999999999999e-05 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:22.513630+0000", 2024-04-26T10:33:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7066000000000001e-05 2024-04-26T10:33:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.6562609209999994, 2024-04-26T10:33:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:33:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:33:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:36694 5.f 5:f1c75ca5:::benchmark_data_smithi043_45180_object36693:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:28.235621+0000", 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.2207508409999992, 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017516515, 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 36694 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235621+0000", 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235621+0000", 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235620+0000", 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235651+0000", 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1306000000000001e-05 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235659+0000", 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2289999999999997e-06 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235664+0000", 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7339999999999996e-06 2024-04-26T10:33:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.236634+0000", 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00096991099999999995 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.236720+0000", 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000003e-05 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.236807+0000", 2024-04-26T10:33:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7523999999999998e-05 2024-04-26T10:33:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.239948+0000", 2024-04-26T10:33:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031408540000000002 2024-04-26T10:33:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.253035+0000", 2024-04-26T10:33:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013086956 2024-04-26T10:33:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.253091+0000", 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5745999999999998e-05 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.253137+0000", 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6162000000000003e-05 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:54323 5.2 5:4d58cd13:::benchmark_data_smithi043_45180_object54322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.96754939900000003, 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020404963000000002, 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54323 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488886+0000", 2024-04-26T10:33:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4800000000000003e-05 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488898+0000", 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1567e-05 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488905+0000", 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4529999999999996e-06 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.491748+0000", 2024-04-26T10:33:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002842528 2024-04-26T10:33:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.491858+0000", 2024-04-26T10:33:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109716 2024-04-26T10:33:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.492007+0000", 2024-04-26T10:33:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149529 2024-04-26T10:33:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.494891+0000", 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002883301 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509167+0000", 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014276494000000001 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509200+0000", 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3229999999999999e-05 2024-04-26T10:33:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509227+0000", 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6709000000000001e-05 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:54326 5.2 5:45ded667:::benchmark_data_smithi043_45180_object54325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:35.488913+0000", 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.96745825399999996, 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020409051000000001, 2024-04-26T10:33:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54326 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488913+0000", 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488913+0000", 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488912+0000", 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488939+0000", 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6954999999999999e-05 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488946+0000", 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1709999999999996e-06 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488952+0000", 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.493460+0000", 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045077529999999998 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.493593+0000", 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133681 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.493751+0000", 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000157107 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.495206+0000", 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001455256 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509263+0000", 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014056788000000001 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509292+0000", 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9467000000000001e-05 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509322+0000", 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0176999999999999e-05 2024-04-26T10:33:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:36.577 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:36.578 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:36.579 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:36.577+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:36.679 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:36.678+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:36.748 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:36.748 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:36.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.748 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:57172 5.9 e25/16 5:94a4ab32:::benchmark_data_smithi043_45180_object57171:head v 25'3584, mlcod=25'3580)", 2024-04-26T10:33:36.748 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.738359+0000", 2024-04-26T10:33:36.748 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0077465600000000004, 2024-04-26T10:33:36.748 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0077720059999999997, 2024-04-26T10:33:36.748 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:36.748 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:36.748 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:36.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:36.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.738359+0000", 2024-04-26T10:33:36.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:36.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.738359+0000", 2024-04-26T10:33:36.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:36.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.738359+0000", 2024-04-26T10:33:36.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967296 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.738388+0000", 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8781000000000001e-05 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.738393+0000", 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.853e-06 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.738396+0000", 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2260000000000001e-06 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.738430+0000", 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3868999999999997e-05 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.738449+0000", 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9045000000000001e-05 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:36.751 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:57174 5.a e25/16 5:5a2aa9ae:::benchmark_data_smithi043_45180_object57173:head v 25'3629, mlcod=25'3626)", 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.739051+0000", 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0070552590000000004, 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0071550429999999998, 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.739051+0000", 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.739051+0000", 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.739050+0000", 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.739144+0000", 2024-04-26T10:33:36.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.4025999999999997e-05 2024-04-26T10:33:36.754 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.754 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.754 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:36.754 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.739153+0000", 2024-04-26T10:33:36.754 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7849999999999997e-06 2024-04-26T10:33:36.754 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.754 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.754 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.754 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.739159+0000", 2024-04-26T10:33:36.754 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2500000000000003e-06 2024-04-26T10:33:36.754 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.754 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.754 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.739183+0000", 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3672999999999998e-05 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.739194+0000", 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1936000000000001e-05 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:57177 5.9 e25/16 5:96eca674:::benchmark_data_smithi043_45180_object57176:head v 25'3585, mlcod=25'3580)", 2024-04-26T10:33:36.755 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.740579+0000", 2024-04-26T10:33:36.756 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00552696, 2024-04-26T10:33:36.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0056838169999999999, 2024-04-26T10:33:36.756 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:36.756 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:36.756 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:36.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:36.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740579+0000", 2024-04-26T10:33:36.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:36.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740579+0000", 2024-04-26T10:33:36.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.757 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.757 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:36.757 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740578+0000", 2024-04-26T10:33:36.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.757 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.757 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:36.757 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740646+0000", 2024-04-26T10:33:36.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7521999999999995e-05 2024-04-26T10:33:36.757 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740653+0000", 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6799999999999993e-06 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740658+0000", 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6569999999999996e-06 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740691+0000", 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3099000000000003e-05 2024-04-26T10:33:36.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.759 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:36.759 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740711+0000", 2024-04-26T10:33:36.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0027999999999999e-05 2024-04-26T10:33:36.759 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.759 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:36.759 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.759 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.759 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:57178 5.8 5:16daefa2:::benchmark_data_smithi043_45180_object57177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.740693+0000", 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0054123280000000001, 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0056165679999999997, 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 57178 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:36.760 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740693+0000", 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740693+0000", 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740692+0000", 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.761 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:36.762 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740776+0000", 2024-04-26T10:33:36.762 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3817000000000001e-05 2024-04-26T10:33:36.762 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.762 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.762 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:36.762 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740782+0000", 2024-04-26T10:33:36.762 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0090000000000004e-06 2024-04-26T10:33:36.762 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.762 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.762 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.762 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740787+0000", 2024-04-26T10:33:36.762 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6249999999999998e-06 2024-04-26T10:33:36.762 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.763 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.763 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:36.763 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740816+0000", 2024-04-26T10:33:36.763 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9366999999999999e-05 2024-04-26T10:33:36.763 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.763 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.763 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:36.763 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740908+0000", 2024-04-26T10:33:36.763 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2285000000000002e-05 2024-04-26T10:33:36.763 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.763 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.763 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.763 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.740992+0000", 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3163000000000003e-05 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743258+0000", 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0022664600000000001 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:57179 5.a e25/16 5:52ca5fc5:::benchmark_data_smithi043_45180_object57178:head v 25'3630, mlcod=25'3627)", 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.741386+0000", 2024-04-26T10:33:36.764 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.004719315, 2024-04-26T10:33:36.765 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0050029970000000003, 2024-04-26T10:33:36.765 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:36.765 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:36.765 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:36.765 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.765 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:36.765 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.741386+0000", 2024-04-26T10:33:36.765 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.765 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.765 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.765 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:36.765 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.741386+0000", 2024-04-26T10:33:36.765 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.766 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.766 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.766 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:36.766 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.741386+0000", 2024-04-26T10:33:36.766 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.766 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.767 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.767 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:36.767 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.741486+0000", 2024-04-26T10:33:36.767 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100146 2024-04-26T10:33:36.767 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.767 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.767 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:36.767 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.741494+0000", 2024-04-26T10:33:36.768 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5519999999999999e-06 2024-04-26T10:33:36.768 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.768 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.768 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.768 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.741500+0000", 2024-04-26T10:33:36.768 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8680000000000004e-06 2024-04-26T10:33:36.768 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.768 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.768 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:36.768 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.741532+0000", 2024-04-26T10:33:36.768 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1977000000000002e-05 2024-04-26T10:33:36.768 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.768 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.769 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:36.769 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.741552+0000", 2024-04-26T10:33:36.769 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0242e-05 2024-04-26T10:33:36.769 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.769 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:36.769 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.769 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.769 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.769 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:57184 5.e 5:72532d93:::benchmark_data_smithi043_45180_object57183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:36.769 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.743447+0000", 2024-04-26T10:33:36.769 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0026591800000000001, 2024-04-26T10:33:36.770 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0029858979999999999, 2024-04-26T10:33:36.770 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:36.770 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:36.770 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:36.770 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:36.770 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.770 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 57184 2024-04-26T10:33:36.770 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.770 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:36.770 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.770 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:36.770 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743447+0000", 2024-04-26T10:33:36.770 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.771 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.771 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.771 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:36.771 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743447+0000", 2024-04-26T10:33:36.771 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.771 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.771 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.771 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:36.771 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743446+0000", 2024-04-26T10:33:36.771 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:36.771 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.771 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.771 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:36.772 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743532+0000", 2024-04-26T10:33:36.772 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5846000000000004e-05 2024-04-26T10:33:36.772 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.772 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.772 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:36.772 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743540+0000", 2024-04-26T10:33:36.772 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:33:36.772 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.772 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.772 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.772 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743544+0000", 2024-04-26T10:33:36.772 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7190000000000001e-06 2024-04-26T10:33:36.772 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743582+0000", 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7758e-05 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743713+0000", 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013095000000000001 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743839+0000", 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012590600000000001 2024-04-26T10:33:36.773 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:57186 5.e 5:7f0856df:::benchmark_data_smithi043_45180_object57185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.743552+0000", 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0025538420000000002, 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0029395609999999998, 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.774 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 57186 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743552+0000", 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743552+0000", 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.775 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:36.776 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743551+0000", 2024-04-26T10:33:36.776 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.776 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.776 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.776 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:36.776 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743624+0000", 2024-04-26T10:33:36.776 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2599000000000001e-05 2024-04-26T10:33:36.776 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.776 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.776 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:36.776 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743632+0000", 2024-04-26T10:33:36.776 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5229999999999998e-06 2024-04-26T10:33:36.776 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.777 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.777 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.777 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743637+0000", 2024-04-26T10:33:36.777 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:33:36.777 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.777 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.777 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:36.777 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745389+0000", 2024-04-26T10:33:36.777 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001752137 2024-04-26T10:33:36.777 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.777 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.777 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:36.777 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745473+0000", 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3619e-05 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745566+0000", 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2498999999999996e-05 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:57180 5.9 e25/16 5:9dcd93d0:::benchmark_data_smithi043_45180_object57179:head v 25'3586, mlcod=25'3581)", 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.743652+0000", 2024-04-26T10:33:36.778 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0024536829999999999, 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0029197889999999999, 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743652+0000", 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743652+0000", 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.779 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743652+0000", 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743781+0000", 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012913200000000001 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743795+0000", 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4102e-05 2024-04-26T10:33:36.780 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743801+0000", 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9390000000000002e-06 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743841+0000", 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0602999999999997e-05 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743873+0000", 2024-04-26T10:33:36.781 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1940999999999998e-05 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:57181 5.a e25/16 5:592bf473:::benchmark_data_smithi043_45180_object57180:head v 25'3631, mlcod=25'3627)", 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.743664+0000", 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0024418830000000002, 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0029768910000000002, 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.782 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743664+0000", 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743664+0000", 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743663+0000", 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.783 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743822+0000", 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015847600000000001 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743828+0000", 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8629999999999996e-06 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743832+0000", 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1869999999999999e-06 2024-04-26T10:33:36.784 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743894+0000", 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2123000000000001e-05 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743910+0000", 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6181e-05 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.785 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.786 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:57187 5.d 5:b976353a:::benchmark_data_smithi043_45180_object57186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:36.786 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.743672+0000", 2024-04-26T10:33:36.786 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.002434187, 2024-04-26T10:33:36.786 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0030422880000000002, 2024-04-26T10:33:36.786 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:36.786 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:36.786 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:36.786 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:36.786 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.786 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 57187 2024-04-26T10:33:36.786 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743672+0000", 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743672+0000", 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:36.787 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743671+0000", 2024-04-26T10:33:36.788 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.788 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.788 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.788 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:36.788 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743841+0000", 2024-04-26T10:33:36.788 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000170087 2024-04-26T10:33:36.788 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.788 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.788 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:36.788 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743866+0000", 2024-04-26T10:33:36.788 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4828999999999999e-05 2024-04-26T10:33:36.788 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.788 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743873+0000", 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9700000000000002e-06 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743906+0000", 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2909e-05 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.744051+0000", 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014510900000000001 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.789 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.744181+0000", 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012967400000000001 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.746378+0000", 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0021970039999999998 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.790 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:57188 5.8 5:177b5465:::benchmark_data_smithi043_45180_object57187:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.743885+0000", 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0022211840000000002, 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0029549559999999999, 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 57188 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:36.791 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743885+0000", 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743885+0000", 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743884+0000", 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.792 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743914+0000", 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0039000000000002e-05 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743922+0000", 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1359999999999997e-06 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743928+0000", 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3589999999999996e-06 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.793 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:36.794 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.743962+0000", 2024-04-26T10:33:36.794 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3522999999999997e-05 2024-04-26T10:33:36.794 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.794 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.794 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:36.794 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.744105+0000", 2024-04-26T10:33:36.794 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014325500000000001 2024-04-26T10:33:36.794 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.794 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.794 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:36.794 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.744224+0000", 2024-04-26T10:33:36.794 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011851 2024-04-26T10:33:36.794 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:57191 5.9 e25/16 5:987f5f98:::benchmark_data_smithi043_45180_object57190:head v 25'3587, mlcod=25'3582)", 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.745249+0000", 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00085678900000000005, 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016932500000000001, 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:36.795 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745249+0000", 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745249+0000", 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745248+0000", 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:36.796 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745357+0000", 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010828999999999999 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745366+0000", 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0080000000000008e-06 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745373+0000", 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5390000000000002e-06 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.797 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745497+0000", 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012383500000000001 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745514+0000", 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7214000000000002e-05 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:57183 5.a e25/16 5:5d77f58a:::benchmark_data_smithi043_45180_object57182:head v 25'3632, mlcod=25'3627)", 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.745879+0000", 2024-04-26T10:33:36.798 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00022660599999999999, 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001162036, 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745879+0000", 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745879+0000", 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:36.799 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745879+0000", 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745913+0000", 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4465999999999998e-05 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745921+0000", 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3080000000000008e-06 2024-04-26T10:33:36.800 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.745928+0000", 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4919999999999998e-06 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.746029+0000", 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010117599999999999 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.746046+0000", 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7435000000000002e-05 2024-04-26T10:33:36.801 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.802 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:36.802 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.802 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:36.802 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:33:36.802 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 13 2024-04-26T10:33:36.802 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:36.803 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:36.802+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:36.804 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:36.904 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:36.903+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:36.973 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:36.973 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:33:36.973 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:33:36.974 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:33:36.974 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:36.987 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:37.005 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:37.005+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:37.106 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:37.105+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:37.165 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:33:37.201 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:37.201 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:33:37.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:33:37.201 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3985601469999995, 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:37.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:33:37.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:37.207 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3977320669999997, 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:33:37.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:33:37.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:33:37.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:33:37.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3968030040000006, 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.213 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:33:37.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:33:37.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3961175630000007, 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:33:37.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:33:37.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:33:37.224 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.224 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.224 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.224 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46220 5.0 5:0832587b:::benchmark_data_smithi043_45180_object46219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:37.224 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:37.224 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.1413420639999998, 2024-04-26T10:33:37.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020289430000000001, 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46220 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057256+0000", 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3852999999999999e-05 2024-04-26T10:33:37.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057265+0000", 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8820000000000007e-06 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057271+0000", 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4049999999999999e-06 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064370+0000", 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0070992870000000001 2024-04-26T10:33:37.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064469+0000", 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8818000000000002e-05 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064555+0000", 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6614999999999997e-05 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070612+0000", 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0060566459999999997 2024-04-26T10:33:37.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077392+0000", 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0067803630000000002 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077438+0000", 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5265000000000001e-05 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077473+0000", 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4978999999999998e-05 2024-04-26T10:33:37.229 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.230 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.230 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.230 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46224 5.0 5:055041a5:::benchmark_data_smithi043_45180_object46223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:37.230 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:37.230 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.1408023930000004, 2024-04-26T10:33:37.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019911091999999998, 2024-04-26T10:33:37.230 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.230 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.230 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.230 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.230 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46224 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057722+0000", 2024-04-26T10:33:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057751+0000", 2024-04-26T10:33:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9025000000000001e-05 2024-04-26T10:33:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057758+0000", 2024-04-26T10:33:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8360000000000003e-06 2024-04-26T10:33:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057764+0000", 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3650000000000003e-06 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065640+0000", 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0078760259999999995 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065735+0000", 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5358000000000004e-05 2024-04-26T10:33:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065881+0000", 2024-04-26T10:33:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000146155 2024-04-26T10:33:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070622+0000", 2024-04-26T10:33:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.004740874 2024-04-26T10:33:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077527+0000", 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0069053710000000004 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077589+0000", 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1779999999999995e-05 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077634+0000", 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4861000000000003e-05 2024-04-26T10:33:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46225 5.0 5:0c2c7e61:::benchmark_data_smithi043_45180_object46224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.1407570910000002, 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019997917, 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46225 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057833+0000", 2024-04-26T10:33:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5315999999999996e-05 2024-04-26T10:33:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057840+0000", 2024-04-26T10:33:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7220000000000002e-06 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057845+0000", 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1159999999999998e-06 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067208+0000", 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0093631259999999994 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067339+0000", 2024-04-26T10:33:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013118900000000001 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067479+0000", 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013958800000000001 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070873+0000", 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0033947980000000001 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077696+0000", 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006822168 2024-04-26T10:33:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077735+0000", 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9582999999999997e-05 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077766+0000", 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0882e-05 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.242 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46226 5.8 5:1735f934:::benchmark_data_smithi043_45180_object46225:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:37.242 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:37.242 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.1406758139999997, 2024-04-26T10:33:37.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019932222999999999, 2024-04-26T10:33:37.242 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.242 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.242 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.242 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.242 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.242 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46226 2024-04-26T10:33:37.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.242 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:37.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057904+0000", 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5458999999999999e-05 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057911+0000", 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057917+0000", 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3899999999999998e-06 2024-04-26T10:33:37.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067195+0000", 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0092779960000000002 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067292+0000", 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6556000000000002e-05 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067399+0000", 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000107118 2024-04-26T10:33:37.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.071325+0000", 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0039254729999999996 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077687+0000", 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006362337 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077749+0000", 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2365000000000003e-05 2024-04-26T10:33:37.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077782+0000", 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2398999999999999e-05 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:47346 5.e 5:7f927659:::benchmark_data_smithi043_45180_object47345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.517279+0000", 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.681246131, 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.017212141, 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.247 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 47346 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.517279+0000", 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.517279+0000", 2024-04-26T10:33:37.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.517278+0000", 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.517333+0000", 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4449e-05 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.517342+0000", 2024-04-26T10:33:37.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.1789999999999997e-06 2024-04-26T10:33:37.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.517347+0000", 2024-04-26T10:33:37.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4580000000000001e-06 2024-04-26T10:33:37.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.523720+0000", 2024-04-26T10:33:37.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0063726700000000004 2024-04-26T10:33:37.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.523812+0000", 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2027999999999994e-05 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.523926+0000", 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000113547 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.531699+0000", 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0077734079999999999 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.534425+0000", 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027256049999999999 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.534468+0000", 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2831999999999999e-05 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.534491+0000", 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3740999999999999e-05 2024-04-26T10:33:37.252 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:48101 5.8 5:1cf22750:::benchmark_data_smithi043_45180_object48100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.817983+0000", 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.3805425820000004, 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018899736, 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.253 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 48101 2024-04-26T10:33:37.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.254 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.817983+0000", 2024-04-26T10:33:37.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.817983+0000", 2024-04-26T10:33:37.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.817982+0000", 2024-04-26T10:33:37.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:37.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.818054+0000", 2024-04-26T10:33:37.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2282999999999999e-05 2024-04-26T10:33:37.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.818069+0000", 2024-04-26T10:33:37.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4575e-05 2024-04-26T10:33:37.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.818074+0000", 2024-04-26T10:33:37.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5759999999999996e-06 2024-04-26T10:33:37.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.824167+0000", 2024-04-26T10:33:37.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0060931420000000002 2024-04-26T10:33:37.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.824276+0000", 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000108838 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.824417+0000", 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141173 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.826150+0000", 2024-04-26T10:33:37.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00173237 2024-04-26T10:33:37.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.836801+0000", 2024-04-26T10:33:37.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010651331 2024-04-26T10:33:37.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.836843+0000", 2024-04-26T10:33:37.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2259000000000003e-05 2024-04-26T10:33:37.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.836882+0000", 2024-04-26T10:33:37.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8979000000000001e-05 2024-04-26T10:33:37.259 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.259 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.259 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.259 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:48295 5.a e23/16 5:5d08b1be:::benchmark_data_smithi043_45180_object48294:head v 23'3088, mlcod=23'3083)", 2024-04-26T10:33:37.259 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:37.259 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.3040453159999998, 2024-04-26T10:33:37.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020188498999999999, 2024-04-26T10:33:37.259 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.259 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894479+0000", 2024-04-26T10:33:37.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:37.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.261 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894584+0000", 2024-04-26T10:33:37.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000104863 2024-04-26T10:33:37.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.261 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894594+0000", 2024-04-26T10:33:37.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6760000000000002e-06 2024-04-26T10:33:37.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894608+0000", 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4263e-05 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894687+0000", 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8311000000000003e-05 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894706+0000", 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9531999999999999e-05 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914628+0000", 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019922314 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914668+0000", 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0080999999999998e-05 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.263 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:48299 5.a e23/16 5:5776ea42:::benchmark_data_smithi043_45180_object48298:head v 23'3089, mlcod=23'3084)", 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.896165+0000", 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.302360738, 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.01852943, 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896165+0000", 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.264 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896165+0000", 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896164+0000", 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896227+0000", 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3638000000000003e-05 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896239+0000", 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2041e-05 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896248+0000", 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4740000000000005e-06 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896297+0000", 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9376999999999998e-05 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896317+0000", 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9681e-05 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914672+0000", 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018355346000000002 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914694+0000", 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1804999999999999e-05 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.267 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.268 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.268 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54078 5.0 5:0c5c0f29:::benchmark_data_smithi043_45180_object54077:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:37.268 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.380197+0000", 2024-04-26T10:33:37.268 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.818328266, 2024-04-26T10:33:37.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.017518004, 2024-04-26T10:33:37.268 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.268 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.268 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.268 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.268 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.268 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54078 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380197+0000", 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380197+0000", 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380196+0000", 2024-04-26T10:33:37.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:37.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380274+0000", 2024-04-26T10:33:37.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7415000000000003e-05 2024-04-26T10:33:37.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380283+0000", 2024-04-26T10:33:37.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.653e-06 2024-04-26T10:33:37.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380293+0000", 2024-04-26T10:33:37.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.9879999999999999e-06 2024-04-26T10:33:37.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.384350+0000", 2024-04-26T10:33:37.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0040574169999999998 2024-04-26T10:33:37.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.384482+0000", 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000132156 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.384624+0000", 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141617 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.391596+0000", 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006972397 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.397635+0000", 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0060390069999999999 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.397680+0000", 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4805999999999998e-05 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.397715+0000", 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5061000000000002e-05 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.273 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54079 5.0 5:0a7f1861:::benchmark_data_smithi043_45180_object54078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.8182253720000001, 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020388585000000001, 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54079 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.274 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380299+0000", 2024-04-26T10:33:37.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380329+0000", 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190000000000001e-05 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380341+0000", 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1715999999999999e-05 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380349+0000", 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7209999999999994e-06 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387457+0000", 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0071078779999999998 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387586+0000", 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012915999999999999 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387724+0000", 2024-04-26T10:33:37.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000138011 2024-04-26T10:33:37.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.278 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.278 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.393120+0000", 2024-04-26T10:33:37.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0053964089999999996 2024-04-26T10:33:37.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.278 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.278 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400595+0000", 2024-04-26T10:33:37.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0074747279999999999 2024-04-26T10:33:37.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400651+0000", 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6026000000000002e-05 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400688+0000", 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7336000000000003e-05 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54084 5.8 5:1e0e5340:::benchmark_data_smithi043_45180_object54083:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:37.279 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.383265+0000", 2024-04-26T10:33:37.280 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.8152601339999999, 2024-04-26T10:33:37.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.017509859999999999, 2024-04-26T10:33:37.280 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.280 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.280 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.280 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.280 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.280 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54084 2024-04-26T10:33:37.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.280 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.280 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.383265+0000", 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.383265+0000", 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.383264+0000", 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.383333+0000", 2024-04-26T10:33:37.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8479999999999995e-05 2024-04-26T10:33:37.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.282 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.282 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.383343+0000", 2024-04-26T10:33:37.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6199999999999994e-06 2024-04-26T10:33:37.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.282 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.282 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.383348+0000", 2024-04-26T10:33:37.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1880000000000001e-06 2024-04-26T10:33:37.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.283 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.283 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.391659+0000", 2024-04-26T10:33:37.283 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0083115459999999995 2024-04-26T10:33:37.283 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.283 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.283 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.391759+0000", 2024-04-26T10:33:37.283 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.9345999999999994e-05 2024-04-26T10:33:37.283 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.283 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.283 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.391836+0000", 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7298000000000004e-05 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.394821+0000", 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0029849690000000001 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400699+0000", 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058783560000000004 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400739+0000", 2024-04-26T10:33:37.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0040999999999998e-05 2024-04-26T10:33:37.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400775+0000", 2024-04-26T10:33:37.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5648000000000002e-05 2024-04-26T10:33:37.285 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.285 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.285 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.285 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54631 5.e 5:7b521224:::benchmark_data_smithi043_45180_object54630:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.631528+0000", 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.5669969539999999, 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.017235124000000001, 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54631 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.631528+0000", 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.631528+0000", 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.631527+0000", 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.631547+0000", 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9480999999999999e-05 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.631555+0000", 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9619999999999993e-06 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.631560+0000", 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2669999999999997e-06 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.634727+0000", 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0031666929999999999 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.634813+0000", 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5922999999999997e-05 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.634892+0000", 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9049999999999997e-05 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.289 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.639613+0000", 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0047215729999999997 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.648683+0000", 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0090694950000000003 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.648727+0000", 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4499000000000002e-05 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.648763+0000", 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5994999999999997e-05 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54642 5.e 5:7e60972f:::benchmark_data_smithi043_45180_object54641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.560643945, 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019369872999999999, 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.291 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54642 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:37.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637907+0000", 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6261000000000001e-05 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637915+0000", 2024-04-26T10:33:37.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1780000000000003e-06 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637920+0000", 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.169e-06 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.639652+0000", 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017314990000000001 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.639745+0000", 2024-04-26T10:33:37.295 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3259999999999998e-05 2024-04-26T10:33:37.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.295 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.295 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.639824+0000", 2024-04-26T10:33:37.295 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8869999999999995e-05 2024-04-26T10:33:37.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.295 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.295 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.641052+0000", 2024-04-26T10:33:37.295 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001227627 2024-04-26T10:33:37.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.657185+0000", 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.016133406999999999 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.657222+0000", 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7119000000000002e-05 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.657251+0000", 2024-04-26T10:33:37.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9084000000000001e-05 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:56243 5.b 5:da4ab90e:::benchmark_data_smithi043_45180_object56242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.335494+0000", 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.86303167800000002, 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019609926999999999, 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.297 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 56243 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335494+0000", 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335494+0000", 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335485+0000", 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999919 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335565+0000", 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9476999999999998e-05 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335571+0000", 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3319999999999997e-06 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335584+0000", 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2608e-05 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337185+0000", 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001601597 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337300+0000", 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011501399999999999 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337429+0000", 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000128169 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.340189+0000", 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027599679999999998 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355018+0000", 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014829241 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355063+0000", 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5472000000000001e-05 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355104+0000", 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0170000000000003e-05 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:56252 5.b 5:d96e4aa9:::benchmark_data_smithi043_45180_object56251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:37.302 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.337366+0000", 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.86115918499999999, 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.017876882, 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 56252 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337366+0000", 2024-04-26T10:33:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337366+0000", 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337365+0000", 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337425+0000", 2024-04-26T10:33:37.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0074000000000001e-05 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337432+0000", 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.075e-06 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337437+0000", 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1780000000000002e-06 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.339049+0000", 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016119769999999999 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.339132+0000", 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3003999999999993e-05 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.339212+0000", 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9518000000000007e-05 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.340604+0000", 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001391916 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355154+0000", 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014550034999999999 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355204+0000", 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9801e-05 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355243+0000", 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9341999999999997e-05 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:56600 5.4 5:27249c2e:::benchmark_data_smithi043_45180_object56599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.494766+0000", 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.70375916599999999, 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018862449, 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:37.308 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 56600 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494766+0000", 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494766+0000", 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:37.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494765+0000", 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494862+0000", 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6921000000000003e-05 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494870+0000", 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1289999999999996e-06 2024-04-26T10:33:37.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494877+0000", 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9979999999999997e-06 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.496879+0000", 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020011669999999999 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.497019+0000", 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014009600000000001 2024-04-26T10:33:37.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.497165+0000", 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014645700000000001 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.498902+0000", 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017363750000000001 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.513548+0000", 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014646484 2024-04-26T10:33:37.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.513598+0000", 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0064e-05 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.513629+0000", 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0399000000000002e-05 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:37.313 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:37.314 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:37.315 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:37.314+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:37.315 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:37.318 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:37.338 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:37.360 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:37.361 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:37.361 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:37.361 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:37.415 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:37.414+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:37.418 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:2024-04-26T10:33:37.418556+0000 min lat: 0.00116398 max lat: 0.108637 avg lat: 0.00545359 2024-04-26T10:33:37.419 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T10:33:37.419 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 20 16 58666 58650 183.267 140.625 0.0101647 0.00545359 2024-04-26T10:33:37.502 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:37.502 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:37.516 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:37.515+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:37.518 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:37.615 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:33:37.615 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:33:37.616 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T10:33:37.616 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T10:33:37.617 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:37.616+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:37.698 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:37.698 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:37.714 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:37.718 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:37.717+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:37.820 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:37.819+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:37.898 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:37.899 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:37.912 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:37.956 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:37.955+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:37.969 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:37.970 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-26T10:33:37.970 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 25, 2024-04-26T10:33:37.970 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "6d35b773-83ef-4e54-be62-89cec0b09327", 2024-04-26T10:33:37.970 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-04-26T10:32:36.651799+0000", 2024-04-26T10:33:37.970 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-04-26T10:33:36.386314+0000", 2024-04-26T10:33:37.970 INFO:teuthology.orchestra.run.smithi043.stdout: "last_up_change": "2024-04-26T10:32:44.545583+0000", 2024-04-26T10:33:37.970 INFO:teuthology.orchestra.run.smithi043.stdout: "last_in_change": "2024-04-26T10:32:37.588200+0000", 2024-04-26T10:33:37.970 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T10:33:37.970 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_num": 5799936, 2024-04-26T10:33:37.970 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_set": [ 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: "pglog_hardlimit", 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: "purged_snapdirs", 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_deletes", 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: "sortbitwise" 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_version": 4, 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_snapshot": "", 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_max": 5, 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd": 3, 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: "require_min_compat_client": "luminous", 2024-04-26T10:33:37.971 INFO:teuthology.orchestra.run.smithi043.stdout: "min_compat_client": "jewel", 2024-04-26T10:33:37.972 INFO:teuthology.orchestra.run.smithi043.stdout: "require_osd_release": "reef", 2024-04-26T10:33:37.973 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_crimson": false, 2024-04-26T10:33:37.974 INFO:teuthology.orchestra.run.smithi043.stdout: "pools": [ 2024-04-26T10:33:37.974 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:37.974 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 1, 2024-04-26T10:33:37.974 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": ".mgr", 2024-04-26T10:33:37.974 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.037545+0000", 2024-04-26T10:33:37.974 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:37.974 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:37.974 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:37.975 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:37.975 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:37.975 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:37.975 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:37.975 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:37.975 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:37.975 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:37.975 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:37.975 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:37.975 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 1, 2024-04-26T10:33:37.976 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 1, 2024-04-26T10:33:37.976 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 1, 2024-04-26T10:33:37.976 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 1, 2024-04-26T10:33:37.976 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 1, 2024-04-26T10:33:37.976 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:37.976 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:37.976 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:37.976 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:37.976 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:37.976 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:37.976 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:37.976 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:37.977 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:37.978 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:37.978 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:37.978 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:37.978 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:37.978 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:37.978 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:37.978 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:37.978 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:37.978 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:37.978 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:37.978 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:37.978 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:33:37.979 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_max": 32, 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 1 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": {} 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 2.9900000095367432, 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 2.9900000095367432, 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 2, 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 2, 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:37.980 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 2, 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "rbd", 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.393201+0000", 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:37.981 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:37.982 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:37.982 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:37.982 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:37.982 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 8, 2024-04-26T10:33:37.982 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 8, 2024-04-26T10:33:37.982 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 8, 2024-04-26T10:33:37.982 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 8, 2024-04-26T10:33:37.982 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 8, 2024-04-26T10:33:37.982 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:37.982 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:37.982 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:37.982 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:37.982 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:37.983 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:37.984 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:37.985 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd": {} 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.5, 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.5, 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.5, 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.5, 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 3, 2024-04-26T10:33:37.986 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_metadata", 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:49.859710+0000", 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 32, 2024-04-26T10:33:37.987 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 32, 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 32, 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 32, 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 32, 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "14", 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:37.988 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:37.989 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:37.990 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:33:37.991 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_bias": 4, 2024-04-26T10:33:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 16, 2024-04-26T10:33:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_priority": 5 2024-04-26T10:33:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:33:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": "cephfs" 2024-04-26T10:33:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:33:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:33:37.992 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:33:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:33:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:33:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 4, 2024-04-26T10:33:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_data", 2024-04-26T10:33:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:50.968196+0000", 2024-04-26T10:33:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:37.993 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 64, 2024-04-26T10:33:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 64, 2024-04-26T10:33:37.994 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 64, 2024-04-26T10:33:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 64, 2024-04-26T10:33:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 64, 2024-04-26T10:33:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:37.995 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "15", 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:37.996 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:37.997 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:37.998 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 64, 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: "data": "cephfs" 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:37.999 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 5, 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "unique_pool_0", 2024-04-26T10:33:38.000 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:33:15.284422+0000", 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 16, 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 16, 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 16, 2024-04-26T10:33:38.001 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 16, 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 16, 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "18", 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:38.002 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:38.003 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:38.004 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "rados": {} 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:33:38.005 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "32399f03-8160-43f7-a69f-1db73f105676", 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:33:38.006 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 16, 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6800", 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:38.007 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6801", 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6802", 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:38.008 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6803", 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6806", 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:38.009 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6807", 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6804", 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:38.010 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6805", 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.112:6801/41771", 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.112:6803/41771", 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.112:6807/41771", 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.112:6805/41771", 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:33:38.011 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "89e46a83-bfff-458f-bbac-258edb6ddad2", 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 16, 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:33:38.012 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6800", 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6801", 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.013 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6802", 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6803", 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:33:38.014 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6806", 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6807", 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:38.015 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6804", 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6805", 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.186:6801/41804", 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.186:6803/41804", 2024-04-26T10:33:38.016 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.186:6807/41804", 2024-04-26T10:33:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.186:6805/41804", 2024-04-26T10:33:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:33:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:33:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:33:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:33:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "24c9e06d-1386-4075-b64e-d6c1d57c57bb", 2024-04-26T10:33:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:33:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:33:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:33:38.017 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 16, 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6800", 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.018 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6801", 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6802", 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:38.019 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6803", 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6806", 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6807", 2024-04-26T10:33:38.020 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:33:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6804", 2024-04-26T10:33:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.021 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6805", 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.187:6801/41919", 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.187:6803/41919", 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.187:6807/41919", 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.187:6805/41919", 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:33:38.022 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_xinfo": [ 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.579572+0000", 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.023 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.596783+0000", 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:33:38.024 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.632883+0000", 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap": [], 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_items": [], 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_primaries": [], 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_temp": [], 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_temp": [], 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklist": {}, 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "range_blocklist": {}, 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profiles": { 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "default": { 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-failure-domain": "osd", 2024-04-26T10:33:38.025 INFO:teuthology.orchestra.run.smithi043.stdout: "k": "2", 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "m": "1", 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin": "jerasure", 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "technique": "reed_sol_van" 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps_queue": [], 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "new_removed_snaps": [], 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "new_purged_snaps": [], 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_node_flags": {}, 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "device_class_flags": {}, 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": { 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_enabled": false, 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_bucket_count": 0, 2024-04-26T10:33:38.026 INFO:teuthology.orchestra.run.smithi043.stdout: "degraded_stretch_mode": 0, 2024-04-26T10:33:38.027 INFO:teuthology.orchestra.run.smithi043.stdout: "recovering_stretch_mode": 0, 2024-04-26T10:33:38.027 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_bucket": 0 2024-04-26T10:33:38.027 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:38.027 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-26T10:33:38.029 INFO:tasks.thrashosds.thrasher:j is {'epoch': 25, 'fsid': '6d35b773-83ef-4e54-be62-89cec0b09327', 'created': '2024-04-26T10:32:36.651799+0000', 'modified': '2024-04-26T10:33:36.386314+0000', 'last_up_change': '2024-04-26T10:32:44.545583+0000', 'last_in_change': '2024-04-26T10:32:37.588200+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:32:45.037545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:32:45.393201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:32:49.859710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:32:50.968196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-26T10:33:15.284422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '32399f03-8160-43f7-a69f-1db73f105676', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 41771}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 41771}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 41771}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 41771}]}, 'public_addr': '172.21.15.112:6801/41771', 'cluster_addr': '172.21.15.112:6803/41771', 'heartbeat_back_addr': '172.21.15.112:6807/41771', 'heartbeat_front_addr': '172.21.15.112:6805/41771', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '89e46a83-bfff-458f-bbac-258edb6ddad2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6800', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6801', 'nonce': 41804}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6802', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6803', 'nonce': 41804}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6806', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6807', 'nonce': 41804}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6804', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6805', 'nonce': 41804}]}, 'public_addr': '172.21.15.186:6801/41804', 'cluster_addr': '172.21.15.186:6803/41804', 'heartbeat_back_addr': '172.21.15.186:6807/41804', 'heartbeat_front_addr': '172.21.15.186:6805/41804', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '24c9e06d-1386-4075-b64e-d6c1d57c57bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 41919}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 41919}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 41919}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 41919}]}, 'public_addr': '172.21.15.187:6801/41919', 'cluster_addr': '172.21.15.187:6803/41919', 'heartbeat_back_addr': '172.21.15.187:6807/41919', 'heartbeat_front_addr': '172.21.15.187:6805/41919', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.579572+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.596783+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.632883+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T10:33:38.029 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:33:38.030 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:38.027+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:38.078 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:38.078 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:38.094 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:38.129 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:38.128+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:38.230 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:38.229+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:38.302 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:38.302 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:38.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:38.358 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:38.357+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:38.388 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:38.390 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:33:38.398 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-04-26T10:33:36.993403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3488942938,"num_objects":53252,"num_object_clones":0,"num_object_copies":106504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53252,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":53476,"num_write_kb":3410066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53424,"ondisk_log_size":53424,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":6875436,"kb_used_data":6691852,"kb_used_omap":4,"kb_used_meta":183547,"kb_avail":276240084,"statfs":{"total":289910292480,"available":282869846016,"internally_reserved":0,"allocated":6852456448,"data_stored":6851928449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":187952466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":799277056,"num_objects":12196,"num_object_clones":0,"num_object_copies":24392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12196,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12196,"num_write_kb":780544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.622173"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377441+0000","last_change":"2024-04-26T10:32:51.998840+0000","last_active":"2024-04-26T10:33:30.377441+0000","last_peered":"2024-04-26T10:33:30.377441+0000","last_clean":"2024-04-26T10:33:30.377441+0000","last_became_active":"2024-04-26T10:32:51.998236+0000","last_became_peered":"2024-04-26T10:32:51.998236+0000","last_unstale":"2024-04-26T10:33:30.377441+0000","last_undegraded":"2024-04-26T10:33:30.377441+0000","last_fullsized":"2024-04-26T10:33:30.377441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377288+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:33:30.377288+0000","last_peered":"2024-04-26T10:33:30.377288+0000","last_clean":"2024-04-26T10:33:30.377288+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:33:30.377288+0000","last_undegraded":"2024-04-26T10:33:30.377288+0000","last_fullsized":"2024-04-26T10:33:30.377288+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374642+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:33:30.374642+0000","last_peered":"2024-04-26T10:33:30.374642+0000","last_clean":"2024-04-26T10:33:30.374642+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:33:30.374642+0000","last_undegraded":"2024-04-26T10:33:30.374642+0000","last_fullsized":"2024-04-26T10:33:30.374642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374791+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:33:30.374791+0000","last_peered":"2024-04-26T10:33:30.374791+0000","last_clean":"2024-04-26T10:33:30.374791+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:33:30.374791+0000","last_undegraded":"2024-04-26T10:33:30.374791+0000","last_fullsized":"2024-04-26T10:33:30.374791+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376603+0000","last_change":"2024-04-26T10:32:51.999420+0000","last_active":"2024-04-26T10:33:30.376603+0000","last_peered":"2024-04-26T10:33:30.376603+0000","last_clean":"2024-04-26T10:33:30.376603+0000","last_became_active":"2024-04-26T10:32:51.999046+0000","last_became_peered":"2024-04-26T10:32:51.999046+0000","last_unstale":"2024-04-26T10:33:30.376603+0000","last_undegraded":"2024-04-26T10:33:30.376603+0000","last_fullsized":"2024-04-26T10:33:30.376603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:10.442986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.373875+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:33:30.373875+0000","last_peered":"2024-04-26T10:33:30.373875+0000","last_clean":"2024-04-26T10:33:30.373875+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:33:30.373875+0000","last_undegraded":"2024-04-26T10:33:30.373875+0000","last_fullsized":"2024-04-26T10:33:30.373875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374867+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:33:30.374867+0000","last_peered":"2024-04-26T10:33:30.374867+0000","last_clean":"2024-04-26T10:33:30.374867+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:33:30.374867+0000","last_undegraded":"2024-04-26T10:33:30.374867+0000","last_fullsized":"2024-04-26T10:33:30.374867+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.373308+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:33:30.373308+0000","last_peered":"2024-04-26T10:33:30.373308+0000","last_clean":"2024-04-26T10:33:30.373308+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:33:30.373308+0000","last_undegraded":"2024-04-26T10:33:30.373308+0000","last_fullsized":"2024-04-26T10:33:30.373308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380152+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:33:30.380152+0000","last_peered":"2024-04-26T10:33:30.380152+0000","last_clean":"2024-04-26T10:33:30.380152+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:33:30.380152+0000","last_undegraded":"2024-04-26T10:33:30.380152+0000","last_fullsized":"2024-04-26T10:33:30.380152+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377254+0000","last_change":"2024-04-26T10:32:52.000612+0000","last_active":"2024-04-26T10:33:30.377254+0000","last_peered":"2024-04-26T10:33:30.377254+0000","last_clean":"2024-04-26T10:33:30.377254+0000","last_became_active":"2024-04-26T10:32:51.998958+0000","last_became_peered":"2024-04-26T10:32:51.998958+0000","last_unstale":"2024-04-26T10:33:30.377254+0000","last_undegraded":"2024-04-26T10:33:30.377254+0000","last_fullsized":"2024-04-26T10:33:30.377254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374562+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:33:30.374562+0000","last_peered":"2024-04-26T10:33:30.374562+0000","last_clean":"2024-04-26T10:33:30.374562+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:33:30.374562+0000","last_undegraded":"2024-04-26T10:33:30.374562+0000","last_fullsized":"2024-04-26T10:33:30.374562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376861+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:33:30.376861+0000","last_peered":"2024-04-26T10:33:30.376861+0000","last_clean":"2024-04-26T10:33:30.376861+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:33:30.376861+0000","last_undegraded":"2024-04-26T10:33:30.376861+0000","last_fullsized":"2024-04-26T10:33:30.376861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376712+0000","last_change":"2024-04-26T10:32:52.000261+0000","last_active":"2024-04-26T10:33:30.376712+0000","last_peered":"2024-04-26T10:33:30.376712+0000","last_clean":"2024-04-26T10:33:30.376712+0000","last_became_active":"2024-04-26T10:32:51.999284+0000","last_became_peered":"2024-04-26T10:32:51.999284+0000","last_unstale":"2024-04-26T10:33:30.376712+0000","last_undegraded":"2024-04-26T10:33:30.376712+0000","last_fullsized":"2024-04-26T10:33:30.376712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374243+0000","last_change":"2024-04-26T10:32:52.003123+0000","last_active":"2024-04-26T10:33:30.374243+0000","last_peered":"2024-04-26T10:33:30.374243+0000","last_clean":"2024-04-26T10:33:30.374243+0000","last_became_active":"2024-04-26T10:32:52.001353+0000","last_became_peered":"2024-04-26T10:32:52.001353+0000","last_unstale":"2024-04-26T10:33:30.374243+0000","last_undegraded":"2024-04-26T10:33:30.374243+0000","last_fullsized":"2024-04-26T10:33:30.374243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:59:49.869670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374799+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:33:30.374799+0000","last_peered":"2024-04-26T10:33:30.374799+0000","last_clean":"2024-04-26T10:33:30.374799+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:33:30.374799+0000","last_undegraded":"2024-04-26T10:33:30.374799+0000","last_fullsized":"2024-04-26T10:33:30.374799+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.373323+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:33:30.373323+0000","last_peered":"2024-04-26T10:33:30.373323+0000","last_clean":"2024-04-26T10:33:30.373323+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:33:30.373323+0000","last_undegraded":"2024-04-26T10:33:30.373323+0000","last_fullsized":"2024-04-26T10:33:30.373323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380221+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:33:30.380221+0000","last_peered":"2024-04-26T10:33:30.380221+0000","last_clean":"2024-04-26T10:33:30.380221+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:33:30.380221+0000","last_undegraded":"2024-04-26T10:33:30.380221+0000","last_fullsized":"2024-04-26T10:33:30.380221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377361+0000","last_change":"2024-04-26T10:32:52.000693+0000","last_active":"2024-04-26T10:33:30.377361+0000","last_peered":"2024-04-26T10:33:30.377361+0000","last_clean":"2024-04-26T10:33:30.377361+0000","last_became_active":"2024-04-26T10:32:51.999406+0000","last_became_peered":"2024-04-26T10:32:51.999406+0000","last_unstale":"2024-04-26T10:33:30.377361+0000","last_undegraded":"2024-04-26T10:33:30.377361+0000","last_fullsized":"2024-04-26T10:33:30.377361+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380174+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:33:30.380174+0000","last_peered":"2024-04-26T10:33:30.380174+0000","last_clean":"2024-04-26T10:33:30.380174+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:33:30.380174+0000","last_undegraded":"2024-04-26T10:33:30.380174+0000","last_fullsized":"2024-04-26T10:33:30.380174+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374718+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:33:30.374718+0000","last_peered":"2024-04-26T10:33:30.374718+0000","last_clean":"2024-04-26T10:33:30.374718+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:33:30.374718+0000","last_undegraded":"2024-04-26T10:33:30.374718+0000","last_fullsized":"2024-04-26T10:33:30.374718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.373995+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:33:30.373995+0000","last_peered":"2024-04-26T10:33:30.373995+0000","last_clean":"2024-04-26T10:33:30.373995+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:33:30.373995+0000","last_undegraded":"2024-04-26T10:33:30.373995+0000","last_fullsized":"2024-04-26T10:33:30.373995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377694+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:33:30.377694+0000","last_peered":"2024-04-26T10:33:30.377694+0000","last_clean":"2024-04-26T10:33:30.377694+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:33:30.377694+0000","last_undegraded":"2024-04-26T10:33:30.377694+0000","last_fullsized":"2024-04-26T10:33:30.377694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378198+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:33:30.378198+0000","last_peered":"2024-04-26T10:33:30.378198+0000","last_clean":"2024-04-26T10:33:30.378198+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:33:30.378198+0000","last_undegraded":"2024-04-26T10:33:30.378198+0000","last_fullsized":"2024-04-26T10:33:30.378198+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376509+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:33:30.376509+0000","last_peered":"2024-04-26T10:33:30.376509+0000","last_clean":"2024-04-26T10:33:30.376509+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:33:30.376509+0000","last_undegraded":"2024-04-26T10:33:30.376509+0000","last_fullsized":"2024-04-26T10:33:30.376509+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377381+0000","last_change":"2024-04-26T10:32:52.004089+0000","last_active":"2024-04-26T10:33:30.377381+0000","last_peered":"2024-04-26T10:33:30.377381+0000","last_clean":"2024-04-26T10:33:30.377381+0000","last_became_active":"2024-04-26T10:32:52.003802+0000","last_became_peered":"2024-04-26T10:32:52.003802+0000","last_unstale":"2024-04-26T10:33:30.377381+0000","last_undegraded":"2024-04-26T10:33:30.377381+0000","last_fullsized":"2024-04-26T10:33:30.377381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380431+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:33:30.380431+0000","last_peered":"2024-04-26T10:33:30.380431+0000","last_clean":"2024-04-26T10:33:30.380431+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:33:30.380431+0000","last_undegraded":"2024-04-26T10:33:30.380431+0000","last_fullsized":"2024-04-26T10:33:30.380431+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374642+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:33:30.374642+0000","last_peered":"2024-04-26T10:33:30.374642+0000","last_clean":"2024-04-26T10:33:30.374642+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:33:30.374642+0000","last_undegraded":"2024-04-26T10:33:30.374642+0000","last_fullsized":"2024-04-26T10:33:30.374642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377695+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:33:30.377695+0000","last_peered":"2024-04-26T10:33:30.377695+0000","last_clean":"2024-04-26T10:33:30.377695+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:33:30.377695+0000","last_undegraded":"2024-04-26T10:33:30.377695+0000","last_fullsized":"2024-04-26T10:33:30.377695+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377249+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:33:30.377249+0000","last_peered":"2024-04-26T10:33:30.377249+0000","last_clean":"2024-04-26T10:33:30.377249+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:33:30.377249+0000","last_undegraded":"2024-04-26T10:33:30.377249+0000","last_fullsized":"2024-04-26T10:33:30.377249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378336+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:33:30.378336+0000","last_peered":"2024-04-26T10:33:30.378336+0000","last_clean":"2024-04-26T10:33:30.378336+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:33:30.378336+0000","last_undegraded":"2024-04-26T10:33:30.378336+0000","last_fullsized":"2024-04-26T10:33:30.378336+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380553+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:33:30.380553+0000","last_peered":"2024-04-26T10:33:30.380553+0000","last_clean":"2024-04-26T10:33:30.380553+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:33:30.380553+0000","last_undegraded":"2024-04-26T10:33:30.380553+0000","last_fullsized":"2024-04-26T10:33:30.380553+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378237+0000","last_change":"2024-04-26T10:32:51.588353+0000","last_active":"2024-04-26T10:33:30.378237+0000","last_peered":"2024-04-26T10:33:30.378237+0000","last_clean":"2024-04-26T10:33:30.378237+0000","last_became_active":"2024-04-26T10:32:51.587981+0000","last_became_peered":"2024-04-26T10:32:51.587981+0000","last_unstale":"2024-04-26T10:33:30.378237+0000","last_undegraded":"2024-04-26T10:33:30.378237+0000","last_fullsized":"2024-04-26T10:33:30.378237+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:20.810803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377334+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:33:30.377334+0000","last_peered":"2024-04-26T10:33:30.377334+0000","last_clean":"2024-04-26T10:33:30.377334+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:33:30.377334+0000","last_undegraded":"2024-04-26T10:33:30.377334+0000","last_fullsized":"2024-04-26T10:33:30.377334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380510+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:33:30.380510+0000","last_peered":"2024-04-26T10:33:30.380510+0000","last_clean":"2024-04-26T10:33:30.380510+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:33:30.380510+0000","last_undegraded":"2024-04-26T10:33:30.380510+0000","last_fullsized":"2024-04-26T10:33:30.380510+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378084+0000","last_change":"2024-04-26T10:32:52.008030+0000","last_active":"2024-04-26T10:33:30.378084+0000","last_peered":"2024-04-26T10:33:30.378084+0000","last_clean":"2024-04-26T10:33:30.378084+0000","last_became_active":"2024-04-26T10:32:52.007158+0000","last_became_peered":"2024-04-26T10:32:52.007158+0000","last_unstale":"2024-04-26T10:33:30.378084+0000","last_undegraded":"2024-04-26T10:33:30.378084+0000","last_fullsized":"2024-04-26T10:33:30.378084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.375907+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:33:30.375907+0000","last_peered":"2024-04-26T10:33:30.375907+0000","last_clean":"2024-04-26T10:33:30.375907+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:33:30.375907+0000","last_undegraded":"2024-04-26T10:33:30.375907+0000","last_fullsized":"2024-04-26T10:33:30.375907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378423+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:33:30.378423+0000","last_peered":"2024-04-26T10:33:30.378423+0000","last_clean":"2024-04-26T10:33:30.378423+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:33:30.378423+0000","last_undegraded":"2024-04-26T10:33:30.378423+0000","last_fullsized":"2024-04-26T10:33:30.378423+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377060+0000","last_change":"2024-04-26T10:32:51.586732+0000","last_active":"2024-04-26T10:33:30.377060+0000","last_peered":"2024-04-26T10:33:30.377060+0000","last_clean":"2024-04-26T10:33:30.377060+0000","last_became_active":"2024-04-26T10:32:51.586533+0000","last_became_peered":"2024-04-26T10:32:51.586533+0000","last_unstale":"2024-04-26T10:33:30.377060+0000","last_undegraded":"2024-04-26T10:33:30.377060+0000","last_fullsized":"2024-04-26T10:33:30.377060+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378391+0000","last_change":"2024-04-26T10:32:52.007650+0000","last_active":"2024-04-26T10:33:30.378391+0000","last_peered":"2024-04-26T10:33:30.378391+0000","last_clean":"2024-04-26T10:33:30.378391+0000","last_became_active":"2024-04-26T10:32:52.007261+0000","last_became_peered":"2024-04-26T10:32:52.007261+0000","last_unstale":"2024-04-26T10:33:30.378391+0000","last_undegraded":"2024-04-26T10:33:30.378391+0000","last_fullsized":"2024-04-26T10:33:30.378391+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374479+0000","last_change":"2024-04-26T10:32:51.584497+0000","last_active":"2024-04-26T10:33:30.374479+0000","last_peered":"2024-04-26T10:33:30.374479+0000","last_clean":"2024-04-26T10:33:30.374479+0000","last_became_active":"2024-04-26T10:32:51.583460+0000","last_became_peered":"2024-04-26T10:32:51.583460+0000","last_unstale":"2024-04-26T10:33:30.374479+0000","last_undegraded":"2024-04-26T10:33:30.374479+0000","last_fullsized":"2024-04-26T10:33:30.374479+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374237+0000","last_change":"2024-04-26T10:32:52.001738+0000","last_active":"2024-04-26T10:33:30.374237+0000","last_peered":"2024-04-26T10:33:30.374237+0000","last_clean":"2024-04-26T10:33:30.374237+0000","last_became_active":"2024-04-26T10:32:51.999263+0000","last_became_peered":"2024-04-26T10:32:51.999263+0000","last_unstale":"2024-04-26T10:33:30.374237+0000","last_undegraded":"2024-04-26T10:33:30.374237+0000","last_fullsized":"2024-04-26T10:33:30.374237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:14.966669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374157+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:33:30.374157+0000","last_peered":"2024-04-26T10:33:30.374157+0000","last_clean":"2024-04-26T10:33:30.374157+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:33:30.374157+0000","last_undegraded":"2024-04-26T10:33:30.374157+0000","last_fullsized":"2024-04-26T10:33:30.374157+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377199+0000","last_change":"2024-04-26T10:32:52.000043+0000","last_active":"2024-04-26T10:33:30.377199+0000","last_peered":"2024-04-26T10:33:30.377199+0000","last_clean":"2024-04-26T10:33:30.377199+0000","last_became_active":"2024-04-26T10:32:51.999069+0000","last_became_peered":"2024-04-26T10:32:51.999069+0000","last_unstale":"2024-04-26T10:33:30.377199+0000","last_undegraded":"2024-04-26T10:33:30.377199+0000","last_fullsized":"2024-04-26T10:33:30.377199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378484+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:33:30.378484+0000","last_peered":"2024-04-26T10:33:30.378484+0000","last_clean":"2024-04-26T10:33:30.378484+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:33:30.378484+0000","last_undegraded":"2024-04-26T10:33:30.378484+0000","last_fullsized":"2024-04-26T10:33:30.378484+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377170+0000","last_change":"2024-04-26T10:32:52.000628+0000","last_active":"2024-04-26T10:33:30.377170+0000","last_peered":"2024-04-26T10:33:30.377170+0000","last_clean":"2024-04-26T10:33:30.377170+0000","last_became_active":"2024-04-26T10:32:51.998121+0000","last_became_peered":"2024-04-26T10:32:51.998121+0000","last_unstale":"2024-04-26T10:33:30.377170+0000","last_undegraded":"2024-04-26T10:33:30.377170+0000","last_fullsized":"2024-04-26T10:33:30.377170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.293526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376432+0000","last_change":"2024-04-26T10:32:51.584210+0000","last_active":"2024-04-26T10:33:30.376432+0000","last_peered":"2024-04-26T10:33:30.376432+0000","last_clean":"2024-04-26T10:33:30.376432+0000","last_became_active":"2024-04-26T10:32:51.583823+0000","last_became_peered":"2024-04-26T10:32:51.583823+0000","last_unstale":"2024-04-26T10:33:30.376432+0000","last_undegraded":"2024-04-26T10:33:30.376432+0000","last_fullsized":"2024-04-26T10:33:30.376432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.121333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380596+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:33:30.380596+0000","last_peered":"2024-04-26T10:33:30.380596+0000","last_clean":"2024-04-26T10:33:30.380596+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:33:30.380596+0000","last_undegraded":"2024-04-26T10:33:30.380596+0000","last_fullsized":"2024-04-26T10:33:30.380596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.373644+0000","last_change":"2024-04-26T10:32:51.584088+0000","last_active":"2024-04-26T10:33:30.373644+0000","last_peered":"2024-04-26T10:33:30.373644+0000","last_clean":"2024-04-26T10:33:30.373644+0000","last_became_active":"2024-04-26T10:32:51.583020+0000","last_became_peered":"2024-04-26T10:32:51.583020+0000","last_unstale":"2024-04-26T10:33:30.373644+0000","last_undegraded":"2024-04-26T10:33:30.373644+0000","last_fullsized":"2024-04-26T10:33:30.373644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380729+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:33:30.380729+0000","last_peered":"2024-04-26T10:33:30.380729+0000","last_clean":"2024-04-26T10:33:30.380729+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:33:30.380729+0000","last_undegraded":"2024-04-26T10:33:30.380729+0000","last_fullsized":"2024-04-26T10:33:30.380729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"24'3347","reported_seq":3363,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:34.991970+0000","last_change":"2024-04-26T10:33:16.342202+0000","last_active":"2024-04-26T10:33:34.991970+0000","last_peered":"2024-04-26T10:33:34.991970+0000","last_clean":"2024-04-26T10:33:34.991970+0000","last_became_active":"2024-04-26T10:33:16.341991+0000","last_became_peered":"2024-04-26T10:33:16.341991+0000","last_unstale":"2024-04-26T10:33:34.991970+0000","last_undegraded":"2024-04-26T10:33:34.991970+0000","last_fullsized":"2024-04-26T10:33:34.991970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3347,"log_dups_size":0,"ondisk_log_size":3347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:05:14.018308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219348992,"num_objects":3347,"num_object_clones":0,"num_object_copies":6694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3347,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3347,"num_write_kb":214208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374392+0000","last_change":"2024-04-26T10:32:51.583791+0000","last_active":"2024-04-26T10:33:30.374392+0000","last_peered":"2024-04-26T10:33:30.374392+0000","last_clean":"2024-04-26T10:33:30.374392+0000","last_became_active":"2024-04-26T10:32:51.583103+0000","last_became_peered":"2024-04-26T10:32:51.583103+0000","last_unstale":"2024-04-26T10:33:30.374392+0000","last_undegraded":"2024-04-26T10:33:30.374392+0000","last_fullsized":"2024-04-26T10:33:30.374392+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376261+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:33:30.376261+0000","last_peered":"2024-04-26T10:33:30.376261+0000","last_clean":"2024-04-26T10:33:30.376261+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:33:30.376261+0000","last_undegraded":"2024-04-26T10:33:30.376261+0000","last_fullsized":"2024-04-26T10:33:30.376261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"24'3325","reported_seq":3340,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:35.003133+0000","last_change":"2024-04-26T10:33:16.346351+0000","last_active":"2024-04-26T10:33:35.003133+0000","last_peered":"2024-04-26T10:33:35.003133+0000","last_clean":"2024-04-26T10:33:35.003133+0000","last_became_active":"2024-04-26T10:33:16.346122+0000","last_became_peered":"2024-04-26T10:33:16.346122+0000","last_unstale":"2024-04-26T10:33:35.003133+0000","last_undegraded":"2024-04-26T10:33:35.003133+0000","last_fullsized":"2024-04-26T10:33:35.003133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3325,"log_dups_size":0,"ondisk_log_size":3325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:13.714464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":217907200,"num_objects":3325,"num_object_clones":0,"num_object_copies":6650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3325,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3325,"num_write_kb":212800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377117+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:33:30.377117+0000","last_peered":"2024-04-26T10:33:30.377117+0000","last_clean":"2024-04-26T10:33:30.377117+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:33:30.377117+0000","last_undegraded":"2024-04-26T10:33:30.377117+0000","last_fullsized":"2024-04-26T10:33:30.377117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376513+0000","last_change":"2024-04-26T10:32:51.997516+0000","last_active":"2024-04-26T10:33:30.376513+0000","last_peered":"2024-04-26T10:33:30.376513+0000","last_clean":"2024-04-26T10:33:30.376513+0000","last_became_active":"2024-04-26T10:32:51.996896+0000","last_became_peered":"2024-04-26T10:32:51.996896+0000","last_unstale":"2024-04-26T10:33:30.376513+0000","last_undegraded":"2024-04-26T10:33:30.376513+0000","last_fullsized":"2024-04-26T10:33:30.376513+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:51.552418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"24'3376","reported_seq":3392,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:35.006753+0000","last_change":"2024-04-26T10:33:16.344883+0000","last_active":"2024-04-26T10:33:35.006753+0000","last_peered":"2024-04-26T10:33:35.006753+0000","last_clean":"2024-04-26T10:33:35.006753+0000","last_became_active":"2024-04-26T10:33:16.344582+0000","last_became_peered":"2024-04-26T10:33:16.344582+0000","last_unstale":"2024-04-26T10:33:35.006753+0000","last_undegraded":"2024-04-26T10:33:35.006753+0000","last_fullsized":"2024-04-26T10:33:35.006753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3376,"log_dups_size":0,"ondisk_log_size":3376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:27.495754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221249536,"num_objects":3376,"num_object_clones":0,"num_object_copies":6752,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3376,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3376,"num_write_kb":216064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374901+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:33:30.374901+0000","last_peered":"2024-04-26T10:33:30.374901+0000","last_clean":"2024-04-26T10:33:30.374901+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:33:30.374901+0000","last_undegraded":"2024-04-26T10:33:30.374901+0000","last_fullsized":"2024-04-26T10:33:30.374901+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374020+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:33:30.374020+0000","last_peered":"2024-04-26T10:33:30.374020+0000","last_clean":"2024-04-26T10:33:30.374020+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:33:30.374020+0000","last_undegraded":"2024-04-26T10:33:30.374020+0000","last_fullsized":"2024-04-26T10:33:30.374020+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"24'3389","reported_seq":3405,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:34.975262+0000","last_change":"2024-04-26T10:33:16.346212+0000","last_active":"2024-04-26T10:33:34.975262+0000","last_peered":"2024-04-26T10:33:34.975262+0000","last_clean":"2024-04-26T10:33:34.975262+0000","last_became_active":"2024-04-26T10:33:16.346004+0000","last_became_peered":"2024-04-26T10:33:16.346004+0000","last_unstale":"2024-04-26T10:33:34.975262+0000","last_undegraded":"2024-04-26T10:33:34.975262+0000","last_fullsized":"2024-04-26T10:33:34.975262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3389,"log_dups_size":0,"ondisk_log_size":3389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:27.495754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222101504,"num_objects":3389,"num_object_clones":0,"num_object_copies":6778,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3389,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3389,"num_write_kb":216896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374239+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:33:30.374239+0000","last_peered":"2024-04-26T10:33:30.374239+0000","last_clean":"2024-04-26T10:33:30.374239+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:33:30.374239+0000","last_undegraded":"2024-04-26T10:33:30.374239+0000","last_fullsized":"2024-04-26T10:33:30.374239+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378439+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:33:30.378439+0000","last_peered":"2024-04-26T10:33:30.378439+0000","last_clean":"2024-04-26T10:33:30.378439+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:33:30.378439+0000","last_undegraded":"2024-04-26T10:33:30.378439+0000","last_fullsized":"2024-04-26T10:33:30.378439+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"24'3381","reported_seq":3397,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:34.997247+0000","last_change":"2024-04-26T10:33:16.342132+0000","last_active":"2024-04-26T10:33:34.997247+0000","last_peered":"2024-04-26T10:33:34.997247+0000","last_clean":"2024-04-26T10:33:34.997247+0000","last_became_active":"2024-04-26T10:33:16.341805+0000","last_became_peered":"2024-04-26T10:33:16.341805+0000","last_unstale":"2024-04-26T10:33:34.997247+0000","last_undegraded":"2024-04-26T10:33:34.997247+0000","last_fullsized":"2024-04-26T10:33:34.997247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3381,"log_dups_size":0,"ondisk_log_size":3381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:41.522561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":221577216,"num_objects":3381,"num_object_clones":0,"num_object_copies":6762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3381,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3381,"num_write_kb":216384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378391+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:33:30.378391+0000","last_peered":"2024-04-26T10:33:30.378391+0000","last_clean":"2024-04-26T10:33:30.378391+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:33:30.378391+0000","last_undegraded":"2024-04-26T10:33:30.378391+0000","last_fullsized":"2024-04-26T10:33:30.378391+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374588+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:33:30.374588+0000","last_peered":"2024-04-26T10:33:30.374588+0000","last_clean":"2024-04-26T10:33:30.374588+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:33:30.374588+0000","last_undegraded":"2024-04-26T10:33:30.374588+0000","last_fullsized":"2024-04-26T10:33:30.374588+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"24'3247","reported_seq":3263,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:35.005570+0000","last_change":"2024-04-26T10:33:16.349242+0000","last_active":"2024-04-26T10:33:35.005570+0000","last_peered":"2024-04-26T10:33:35.005570+0000","last_clean":"2024-04-26T10:33:35.005570+0000","last_became_active":"2024-04-26T10:33:16.349063+0000","last_became_peered":"2024-04-26T10:33:16.349063+0000","last_unstale":"2024-04-26T10:33:35.005570+0000","last_undegraded":"2024-04-26T10:33:35.005570+0000","last_fullsized":"2024-04-26T10:33:35.005570+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3247,"log_dups_size":0,"ondisk_log_size":3247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:09.297624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212795392,"num_objects":3247,"num_object_clones":0,"num_object_copies":6494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3247,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3247,"num_write_kb":207808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.373877+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:33:30.373877+0000","last_peered":"2024-04-26T10:33:30.373877+0000","last_clean":"2024-04-26T10:33:30.373877+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:33:30.373877+0000","last_undegraded":"2024-04-26T10:33:30.373877+0000","last_fullsized":"2024-04-26T10:33:30.373877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374812+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:33:30.374812+0000","last_peered":"2024-04-26T10:33:30.374812+0000","last_clean":"2024-04-26T10:33:30.374812+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:33:30.374812+0000","last_undegraded":"2024-04-26T10:33:30.374812+0000","last_fullsized":"2024-04-26T10:33:30.374812+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"24'3233","reported_seq":3249,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:35.001364+0000","last_change":"2024-04-26T10:33:16.342286+0000","last_active":"2024-04-26T10:33:35.001364+0000","last_peered":"2024-04-26T10:33:35.001364+0000","last_clean":"2024-04-26T10:33:35.001364+0000","last_became_active":"2024-04-26T10:33:16.342045+0000","last_became_peered":"2024-04-26T10:33:16.342045+0000","last_unstale":"2024-04-26T10:33:35.001364+0000","last_undegraded":"2024-04-26T10:33:35.001364+0000","last_fullsized":"2024-04-26T10:33:35.001364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3233,"log_dups_size":0,"ondisk_log_size":3233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:42.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":211877888,"num_objects":3233,"num_object_clones":0,"num_object_copies":6466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3233,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3233,"num_write_kb":206912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376324+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:33:30.376324+0000","last_peered":"2024-04-26T10:33:30.376324+0000","last_clean":"2024-04-26T10:33:30.376324+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:33:30.376324+0000","last_undegraded":"2024-04-26T10:33:30.376324+0000","last_fullsized":"2024-04-26T10:33:30.376324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.375972+0000","last_change":"2024-04-26T10:32:52.004444+0000","last_active":"2024-04-26T10:33:30.375972+0000","last_peered":"2024-04-26T10:33:30.375972+0000","last_clean":"2024-04-26T10:33:30.375972+0000","last_became_active":"2024-04-26T10:32:52.003360+0000","last_became_peered":"2024-04-26T10:32:52.003360+0000","last_unstale":"2024-04-26T10:33:30.375972+0000","last_undegraded":"2024-04-26T10:33:30.375972+0000","last_fullsized":"2024-04-26T10:33:30.375972+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:20.180213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"24'3317","reported_seq":3332,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:35.006887+0000","last_change":"2024-04-26T10:33:16.344866+0000","last_active":"2024-04-26T10:33:35.006887+0000","last_peered":"2024-04-26T10:33:35.006887+0000","last_clean":"2024-04-26T10:33:35.006887+0000","last_became_active":"2024-04-26T10:33:16.344614+0000","last_became_peered":"2024-04-26T10:33:16.344614+0000","last_unstale":"2024-04-26T10:33:35.006887+0000","last_undegraded":"2024-04-26T10:33:35.006887+0000","last_fullsized":"2024-04-26T10:33:35.006887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3317,"log_dups_size":0,"ondisk_log_size":3317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":217382912,"num_objects":3317,"num_object_clones":0,"num_object_copies":6634,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3317,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3317,"num_write_kb":212288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376429+0000","last_change":"2024-04-26T10:32:51.584385+0000","last_active":"2024-04-26T10:33:30.376429+0000","last_peered":"2024-04-26T10:33:30.376429+0000","last_clean":"2024-04-26T10:33:30.376429+0000","last_became_active":"2024-04-26T10:32:51.584025+0000","last_became_peered":"2024-04-26T10:32:51.584025+0000","last_unstale":"2024-04-26T10:33:30.376429+0000","last_undegraded":"2024-04-26T10:33:30.376429+0000","last_fullsized":"2024-04-26T10:33:30.376429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:57.247011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380363+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:33:30.380363+0000","last_peered":"2024-04-26T10:33:30.380363+0000","last_clean":"2024-04-26T10:33:30.380363+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:33:30.380363+0000","last_undegraded":"2024-04-26T10:33:30.380363+0000","last_fullsized":"2024-04-26T10:33:30.380363+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"24'3367","reported_seq":3383,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:34.994781+0000","last_change":"2024-04-26T10:33:16.349280+0000","last_active":"2024-04-26T10:33:34.994781+0000","last_peered":"2024-04-26T10:33:34.994781+0000","last_clean":"2024-04-26T10:33:34.994781+0000","last_became_active":"2024-04-26T10:33:16.349010+0000","last_became_peered":"2024-04-26T10:33:16.349010+0000","last_unstale":"2024-04-26T10:33:34.994781+0000","last_undegraded":"2024-04-26T10:33:34.994781+0000","last_fullsized":"2024-04-26T10:33:34.994781+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3367,"log_dups_size":0,"ondisk_log_size":3367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:08.933996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220659712,"num_objects":3367,"num_object_clones":0,"num_object_copies":6734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3367,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3367,"num_write_kb":215488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378609+0000","last_change":"2024-04-26T10:32:46.555353+0000","last_active":"2024-04-26T10:33:30.378609+0000","last_peered":"2024-04-26T10:33:30.378609+0000","last_clean":"2024-04-26T10:33:30.378609+0000","last_became_active":"2024-04-26T10:32:46.555005+0000","last_became_peered":"2024-04-26T10:32:46.555005+0000","last_unstale":"2024-04-26T10:33:30.378609+0000","last_undegraded":"2024-04-26T10:33:30.378609+0000","last_fullsized":"2024-04-26T10:33:30.378609+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374715+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:33:30.374715+0000","last_peered":"2024-04-26T10:33:30.374715+0000","last_clean":"2024-04-26T10:33:30.374715+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:33:30.374715+0000","last_undegraded":"2024-04-26T10:33:30.374715+0000","last_fullsized":"2024-04-26T10:33:30.374715+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377776+0000","last_change":"2024-04-26T10:32:52.004199+0000","last_active":"2024-04-26T10:33:30.377776+0000","last_peered":"2024-04-26T10:33:30.377776+0000","last_clean":"2024-04-26T10:33:30.377776+0000","last_became_active":"2024-04-26T10:32:52.003894+0000","last_became_peered":"2024-04-26T10:32:52.003894+0000","last_unstale":"2024-04-26T10:33:30.377776+0000","last_undegraded":"2024-04-26T10:33:30.377776+0000","last_fullsized":"2024-04-26T10:33:30.377776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"24'3343","reported_seq":3359,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:34.990936+0000","last_change":"2024-04-26T10:33:16.349302+0000","last_active":"2024-04-26T10:33:34.990936+0000","last_peered":"2024-04-26T10:33:34.990936+0000","last_clean":"2024-04-26T10:33:34.990936+0000","last_became_active":"2024-04-26T10:33:16.348992+0000","last_became_peered":"2024-04-26T10:33:16.348992+0000","last_unstale":"2024-04-26T10:33:34.990936+0000","last_undegraded":"2024-04-26T10:33:34.990936+0000","last_fullsized":"2024-04-26T10:33:34.990936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3343,"log_dups_size":0,"ondisk_log_size":3343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:15.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219086848,"num_objects":3343,"num_object_clones":0,"num_object_copies":6686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3343,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3343,"num_write_kb":213952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374144+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:33:30.374144+0000","last_peered":"2024-04-26T10:33:30.374144+0000","last_clean":"2024-04-26T10:33:30.374144+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:33:30.374144+0000","last_undegraded":"2024-04-26T10:33:30.374144+0000","last_fullsized":"2024-04-26T10:33:30.374144+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374101+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:33:30.374101+0000","last_peered":"2024-04-26T10:33:30.374101+0000","last_clean":"2024-04-26T10:33:30.374101+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:33:30.374101+0000","last_undegraded":"2024-04-26T10:33:30.374101+0000","last_fullsized":"2024-04-26T10:33:30.374101+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378516+0000","last_change":"2024-04-26T10:32:52.007589+0000","last_active":"2024-04-26T10:33:30.378516+0000","last_peered":"2024-04-26T10:33:30.378516+0000","last_clean":"2024-04-26T10:33:30.378516+0000","last_became_active":"2024-04-26T10:32:52.007289+0000","last_became_peered":"2024-04-26T10:32:52.007289+0000","last_unstale":"2024-04-26T10:33:30.378516+0000","last_undegraded":"2024-04-26T10:33:30.378516+0000","last_fullsized":"2024-04-26T10:33:30.378516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"24'3332","reported_seq":3348,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:35.002535+0000","last_change":"2024-04-26T10:33:16.349181+0000","last_active":"2024-04-26T10:33:35.002535+0000","last_peered":"2024-04-26T10:33:35.002535+0000","last_clean":"2024-04-26T10:33:35.002535+0000","last_became_active":"2024-04-26T10:33:16.348981+0000","last_became_peered":"2024-04-26T10:33:16.348981+0000","last_unstale":"2024-04-26T10:33:35.002535+0000","last_undegraded":"2024-04-26T10:33:35.002535+0000","last_fullsized":"2024-04-26T10:33:35.002535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3332,"log_dups_size":0,"ondisk_log_size":3332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218365952,"num_objects":3332,"num_object_clones":0,"num_object_copies":6664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3332,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3332,"num_write_kb":213248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378171+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:33:30.378171+0000","last_peered":"2024-04-26T10:33:30.378171+0000","last_clean":"2024-04-26T10:33:30.378171+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:33:30.378171+0000","last_undegraded":"2024-04-26T10:33:30.378171+0000","last_fullsized":"2024-04-26T10:33:30.378171+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376378+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:33:30.376378+0000","last_peered":"2024-04-26T10:33:30.376378+0000","last_clean":"2024-04-26T10:33:30.376378+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:33:30.376378+0000","last_undegraded":"2024-04-26T10:33:30.376378+0000","last_fullsized":"2024-04-26T10:33:30.376378+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380606+0000","last_change":"2024-04-26T10:32:52.009270+0000","last_active":"2024-04-26T10:33:30.380606+0000","last_peered":"2024-04-26T10:33:30.380606+0000","last_clean":"2024-04-26T10:33:30.380606+0000","last_became_active":"2024-04-26T10:32:52.008599+0000","last_became_peered":"2024-04-26T10:32:52.008599+0000","last_unstale":"2024-04-26T10:33:30.380606+0000","last_undegraded":"2024-04-26T10:33:30.380606+0000","last_fullsized":"2024-04-26T10:33:30.380606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"24'3284","reported_seq":3300,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:35.006793+0000","last_change":"2024-04-26T10:33:16.346300+0000","last_active":"2024-04-26T10:33:35.006793+0000","last_peered":"2024-04-26T10:33:35.006793+0000","last_clean":"2024-04-26T10:33:35.006793+0000","last_became_active":"2024-04-26T10:33:16.346123+0000","last_became_peered":"2024-04-26T10:33:16.346123+0000","last_unstale":"2024-04-26T10:33:35.006793+0000","last_undegraded":"2024-04-26T10:33:35.006793+0000","last_fullsized":"2024-04-26T10:33:35.006793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3284,"log_dups_size":0,"ondisk_log_size":3284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:08.933996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215220224,"num_objects":3284,"num_object_clones":0,"num_object_copies":6568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3284,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3284,"num_write_kb":210176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374067+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:33:30.374067+0000","last_peered":"2024-04-26T10:33:30.374067+0000","last_clean":"2024-04-26T10:33:30.374067+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:33:30.374067+0000","last_undegraded":"2024-04-26T10:33:30.374067+0000","last_fullsized":"2024-04-26T10:33:30.374067+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":219,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.373388+0000","last_change":"2024-04-26T10:32:46.555694+0000","last_active":"2024-04-26T10:33:30.373388+0000","last_peered":"2024-04-26T10:33:30.373388+0000","last_clean":"2024-04-26T10:33:30.373388+0000","last_became_active":"2024-04-26T10:32:46.555391+0000","last_became_peered":"2024-04-26T10:32:46.555391+0000","last_unstale":"2024-04-26T10:33:30.373388+0000","last_undegraded":"2024-04-26T10:33:30.373388+0000","last_fullsized":"2024-04-26T10:33:30.373388+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378393+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:33:30.378393+0000","last_peered":"2024-04-26T10:33:30.378393+0000","last_clean":"2024-04-26T10:33:30.378393+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:33:30.378393+0000","last_undegraded":"2024-04-26T10:33:30.378393+0000","last_fullsized":"2024-04-26T10:33:30.378393+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.375032+0000","last_change":"2024-04-26T10:32:52.006765+0000","last_active":"2024-04-26T10:33:30.375032+0000","last_peered":"2024-04-26T10:33:30.375032+0000","last_clean":"2024-04-26T10:33:30.375032+0000","last_became_active":"2024-04-26T10:32:52.004110+0000","last_became_peered":"2024-04-26T10:32:52.004110+0000","last_unstale":"2024-04-26T10:33:30.375032+0000","last_undegraded":"2024-04-26T10:33:30.375032+0000","last_fullsized":"2024-04-26T10:33:30.375032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:47.156703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"24'3243","reported_seq":3258,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:34.999289+0000","last_change":"2024-04-26T10:33:16.344693+0000","last_active":"2024-04-26T10:33:34.999289+0000","last_peered":"2024-04-26T10:33:34.999289+0000","last_clean":"2024-04-26T10:33:34.999289+0000","last_became_active":"2024-04-26T10:33:16.344478+0000","last_became_peered":"2024-04-26T10:33:16.344478+0000","last_unstale":"2024-04-26T10:33:34.999289+0000","last_undegraded":"2024-04-26T10:33:34.999289+0000","last_fullsized":"2024-04-26T10:33:34.999289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3243,"log_dups_size":0,"ondisk_log_size":3243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:24.298876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212533248,"num_objects":3243,"num_object_clones":0,"num_object_copies":6486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3243,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3243,"num_write_kb":207552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.373456+0000","last_change":"2024-04-26T10:32:46.555501+0000","last_active":"2024-04-26T10:33:30.373456+0000","last_peered":"2024-04-26T10:33:30.373456+0000","last_clean":"2024-04-26T10:33:30.373456+0000","last_became_active":"2024-04-26T10:32:46.555252+0000","last_became_peered":"2024-04-26T10:32:46.555252+0000","last_unstale":"2024-04-26T10:33:30.373456+0000","last_undegraded":"2024-04-26T10:33:30.373456+0000","last_fullsized":"2024-04-26T10:33:30.373456+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378071+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:33:30.378071+0000","last_peered":"2024-04-26T10:33:30.378071+0000","last_clean":"2024-04-26T10:33:30.378071+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:33:30.378071+0000","last_undegraded":"2024-04-26T10:33:30.378071+0000","last_fullsized":"2024-04-26T10:33:30.378071+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377338+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:33:30.377338+0000","last_peered":"2024-04-26T10:33:30.377338+0000","last_clean":"2024-04-26T10:33:30.377338+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:33:30.377338+0000","last_undegraded":"2024-04-26T10:33:30.377338+0000","last_fullsized":"2024-04-26T10:33:30.377338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"24'3353","reported_seq":3368,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:35.001620+0000","last_change":"2024-04-26T10:33:16.344694+0000","last_active":"2024-04-26T10:33:35.001620+0000","last_peered":"2024-04-26T10:33:35.001620+0000","last_clean":"2024-04-26T10:33:35.001620+0000","last_became_active":"2024-04-26T10:33:16.344461+0000","last_became_peered":"2024-04-26T10:33:16.344461+0000","last_unstale":"2024-04-26T10:33:35.001620+0000","last_undegraded":"2024-04-26T10:33:35.001620+0000","last_fullsized":"2024-04-26T10:33:35.001620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3353,"log_dups_size":0,"ondisk_log_size":3353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:29.374096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219742208,"num_objects":3353,"num_object_clones":0,"num_object_copies":6706,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3353,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3353,"num_write_kb":214592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377020+0000","last_change":"2024-04-26T10:32:46.556007+0000","last_active":"2024-04-26T10:33:30.377020+0000","last_peered":"2024-04-26T10:33:30.377020+0000","last_clean":"2024-04-26T10:33:30.377020+0000","last_became_active":"2024-04-26T10:32:46.555738+0000","last_became_peered":"2024-04-26T10:32:46.555738+0000","last_unstale":"2024-04-26T10:33:30.377020+0000","last_undegraded":"2024-04-26T10:33:30.377020+0000","last_fullsized":"2024-04-26T10:33:30.377020+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:04.230186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378680+0000","last_change":"2024-04-26T10:32:51.589352+0000","last_active":"2024-04-26T10:33:30.378680+0000","last_peered":"2024-04-26T10:33:30.378680+0000","last_clean":"2024-04-26T10:33:30.378680+0000","last_became_active":"2024-04-26T10:32:51.589006+0000","last_became_peered":"2024-04-26T10:32:51.589006+0000","last_unstale":"2024-04-26T10:33:30.378680+0000","last_undegraded":"2024-04-26T10:33:30.378680+0000","last_fullsized":"2024-04-26T10:33:30.378680+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376612+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:33:30.376612+0000","last_peered":"2024-04-26T10:33:30.376612+0000","last_clean":"2024-04-26T10:33:30.376612+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:33:30.376612+0000","last_undegraded":"2024-04-26T10:33:30.376612+0000","last_fullsized":"2024-04-26T10:33:30.376612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"24'3327","reported_seq":3343,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:34.990223+0000","last_change":"2024-04-26T10:33:16.344714+0000","last_active":"2024-04-26T10:33:34.990223+0000","last_peered":"2024-04-26T10:33:34.990223+0000","last_clean":"2024-04-26T10:33:34.990223+0000","last_became_active":"2024-04-26T10:33:16.344500+0000","last_became_peered":"2024-04-26T10:33:16.344500+0000","last_unstale":"2024-04-26T10:33:34.990223+0000","last_undegraded":"2024-04-26T10:33:34.990223+0000","last_fullsized":"2024-04-26T10:33:34.990223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3327,"log_dups_size":0,"ondisk_log_size":3327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:19.056484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218038272,"num_objects":3327,"num_object_clones":0,"num_object_copies":6654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3327,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3327,"num_write_kb":212928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380296+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:33:30.380296+0000","last_peered":"2024-04-26T10:33:30.380296+0000","last_clean":"2024-04-26T10:33:30.380296+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:33:30.380296+0000","last_undegraded":"2024-04-26T10:33:30.380296+0000","last_fullsized":"2024-04-26T10:33:30.380296+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380691+0000","last_change":"2024-04-26T10:32:46.555394+0000","last_active":"2024-04-26T10:33:30.380691+0000","last_peered":"2024-04-26T10:33:30.380691+0000","last_clean":"2024-04-26T10:33:30.380691+0000","last_became_active":"2024-04-26T10:32:46.555053+0000","last_became_peered":"2024-04-26T10:32:46.555053+0000","last_unstale":"2024-04-26T10:33:30.380691+0000","last_undegraded":"2024-04-26T10:33:30.380691+0000","last_fullsized":"2024-04-26T10:33:30.380691+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378028+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:33:30.378028+0000","last_peered":"2024-04-26T10:33:30.378028+0000","last_clean":"2024-04-26T10:33:30.378028+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:33:30.378028+0000","last_undegraded":"2024-04-26T10:33:30.378028+0000","last_fullsized":"2024-04-26T10:33:30.378028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"24'3364","reported_seq":3380,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:33:35.005214+0000","last_change":"2024-04-26T10:33:16.344949+0000","last_active":"2024-04-26T10:33:35.005214+0000","last_peered":"2024-04-26T10:33:35.005214+0000","last_clean":"2024-04-26T10:33:35.005214+0000","last_became_active":"2024-04-26T10:33:16.344650+0000","last_became_peered":"2024-04-26T10:33:16.344650+0000","last_unstale":"2024-04-26T10:33:35.005214+0000","last_undegraded":"2024-04-26T10:33:35.005214+0000","last_fullsized":"2024-04-26T10:33:35.005214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3364,"log_dups_size":0,"ondisk_log_size":3364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:15.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220463104,"num_objects":3364,"num_object_clones":0,"num_object_copies":6728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3364,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3364,"num_write_kb":215296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374465+0000","last_change":"2024-04-26T10:32:46.555191+0000","last_active":"2024-04-26T10:33:30.374465+0000","last_peered":"2024-04-26T10:33:30.374465+0000","last_clean":"2024-04-26T10:33:30.374465+0000","last_became_active":"2024-04-26T10:32:46.554892+0000","last_became_peered":"2024-04-26T10:32:46.554892+0000","last_unstale":"2024-04-26T10:33:30.374465+0000","last_undegraded":"2024-04-26T10:33:30.374465+0000","last_fullsized":"2024-04-26T10:33:30.374465+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380489+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:33:30.380489+0000","last_peered":"2024-04-26T10:33:30.380489+0000","last_clean":"2024-04-26T10:33:30.380489+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:33:30.380489+0000","last_undegraded":"2024-04-26T10:33:30.380489+0000","last_fullsized":"2024-04-26T10:33:30.380489+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376473+0000","last_change":"2024-04-26T10:32:52.001408+0000","last_active":"2024-04-26T10:33:30.376473+0000","last_peered":"2024-04-26T10:33:30.376473+0000","last_clean":"2024-04-26T10:33:30.376473+0000","last_became_active":"2024-04-26T10:32:52.000668+0000","last_became_peered":"2024-04-26T10:32:52.000668+0000","last_unstale":"2024-04-26T10:33:30.376473+0000","last_undegraded":"2024-04-26T10:33:30.376473+0000","last_fullsized":"2024-04-26T10:33:30.376473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376951+0000","last_change":"2024-04-26T10:32:51.586234+0000","last_active":"2024-04-26T10:33:30.376951+0000","last_peered":"2024-04-26T10:33:30.376951+0000","last_clean":"2024-04-26T10:33:30.376951+0000","last_became_active":"2024-04-26T10:32:51.586004+0000","last_became_peered":"2024-04-26T10:32:51.586004+0000","last_unstale":"2024-04-26T10:33:30.376951+0000","last_undegraded":"2024-04-26T10:33:30.376951+0000","last_fullsized":"2024-04-26T10:33:30.376951+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:03.977752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377339+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:33:30.377339+0000","last_peered":"2024-04-26T10:33:30.377339+0000","last_clean":"2024-04-26T10:33:30.377339+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:33:30.377339+0000","last_undegraded":"2024-04-26T10:33:30.377339+0000","last_fullsized":"2024-04-26T10:33:30.377339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374392+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:33:30.374392+0000","last_peered":"2024-04-26T10:33:30.374392+0000","last_clean":"2024-04-26T10:33:30.374392+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:33:30.374392+0000","last_undegraded":"2024-04-26T10:33:30.374392+0000","last_fullsized":"2024-04-26T10:33:30.374392+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.374025+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:33:30.374025+0000","last_peered":"2024-04-26T10:33:30.374025+0000","last_clean":"2024-04-26T10:33:30.374025+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:33:30.374025+0000","last_undegraded":"2024-04-26T10:33:30.374025+0000","last_fullsized":"2024-04-26T10:33:30.374025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377152+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:33:30.377152+0000","last_peered":"2024-04-26T10:33:30.377152+0000","last_clean":"2024-04-26T10:33:30.377152+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:33:30.377152+0000","last_undegraded":"2024-04-26T10:33:30.377152+0000","last_fullsized":"2024-04-26T10:33:30.377152+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.373951+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:33:30.373951+0000","last_peered":"2024-04-26T10:33:30.373951+0000","last_clean":"2024-04-26T10:33:30.373951+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:33:30.373951+0000","last_undegraded":"2024-04-26T10:33:30.373951+0000","last_fullsized":"2024-04-26T10:33:30.373951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380650+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:33:30.380650+0000","last_peered":"2024-04-26T10:33:30.380650+0000","last_clean":"2024-04-26T10:33:30.380650+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:33:30.380650+0000","last_undegraded":"2024-04-26T10:33:30.380650+0000","last_fullsized":"2024-04-26T10:33:30.380650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.376954+0000","last_change":"2024-04-26T10:32:51.999341+0000","last_active":"2024-04-26T10:33:30.376954+0000","last_peered":"2024-04-26T10:33:30.376954+0000","last_clean":"2024-04-26T10:33:30.376954+0000","last_became_active":"2024-04-26T10:32:51.998256+0000","last_became_peered":"2024-04-26T10:32:51.998256+0000","last_unstale":"2024-04-26T10:33:30.376954+0000","last_undegraded":"2024-04-26T10:33:30.376954+0000","last_fullsized":"2024-04-26T10:33:30.376954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.380440+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:33:30.380440+0000","last_peered":"2024-04-26T10:33:30.380440+0000","last_clean":"2024-04-26T10:33:30.380440+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:33:30.380440+0000","last_undegraded":"2024-04-26T10:33:30.380440+0000","last_fullsized":"2024-04-26T10:33:30.380440+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.373683+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:33:30.373683+0000","last_peered":"2024-04-26T10:33:30.373683+0000","last_clean":"2024-04-26T10:33:30.373683+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:33:30.373683+0000","last_undegraded":"2024-04-26T10:33:30.373683+0000","last_fullsized":"2024-04-26T10:33:30.373683+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.373615+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:33:30.373615+0000","last_peered":"2024-04-26T10:33:30.373615+0000","last_clean":"2024-04-26T10:33:30.373615+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:33:30.373615+0000","last_undegraded":"2024-04-26T10:33:30.373615+0000","last_fullsized":"2024-04-26T10:33:30.373615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378117+0000","last_change":"2024-04-26T10:32:52.004844+0000","last_active":"2024-04-26T10:33:30.378117+0000","last_peered":"2024-04-26T10:33:30.378117+0000","last_clean":"2024-04-26T10:33:30.378117+0000","last_became_active":"2024-04-26T10:32:52.004484+0000","last_became_peered":"2024-04-26T10:32:52.004484+0000","last_unstale":"2024-04-26T10:33:30.378117+0000","last_undegraded":"2024-04-26T10:33:30.378117+0000","last_fullsized":"2024-04-26T10:33:30.378117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377767+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:33:30.377767+0000","last_peered":"2024-04-26T10:33:30.377767+0000","last_clean":"2024-04-26T10:33:30.377767+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:33:30.377767+0000","last_undegraded":"2024-04-26T10:33:30.377767+0000","last_fullsized":"2024-04-26T10:33:30.377767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.378544+0000","last_change":"2024-04-26T10:32:52.007818+0000","last_active":"2024-04-26T10:33:30.378544+0000","last_peered":"2024-04-26T10:33:30.378544+0000","last_clean":"2024-04-26T10:33:30.378544+0000","last_became_active":"2024-04-26T10:32:52.007552+0000","last_became_peered":"2024-04-26T10:32:52.007552+0000","last_unstale":"2024-04-26T10:33:30.378544+0000","last_undegraded":"2024-04-26T10:33:30.378544+0000","last_fullsized":"2024-04-26T10:33:30.378544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:33:30.377401+0000","last_change":"2024-04-26T10:32:52.010309+0000","last_active":"2024-04-26T10:33:30.377401+0000","last_peered":"2024-04-26T10:33:30.377401+0000","last_clean":"2024-04-26T10:33:30.377401+0000","last_became_active":"2024-04-26T10:32:52.009152+0000","last_became_peered":"2024-04-26T10:32:52.009152+0000","last_unstale":"2024-04-26T10:33:30.377401+0000","last_undegraded":"2024-04-26T10:33:30.377401+0000","last_fullsized":"2024-04-26T10:33:30.377401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":3488350208,"num_objects":53228,"num_object_clones":0,"num_object_copies":106456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53228,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53228,"num_write_kb":3406592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6977355776,"data_stored":6977355776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53228,"ondisk_log_size":53228,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2810812,"kb_used_data":2743604,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":91561028,"statfs":{"total":96636764160,"available":93758492672,"internally_reserved":0,"allocated":2809450496,"data_stored":2809289559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.159}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.189}]}]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2129500,"kb_used_data":2058192,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":92242340,"statfs":{"total":96636764160,"available":94456156160,"internally_reserved":0,"allocated":2107588608,"data_stored":2107401289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73005510},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]}]},{"osd":1,"up_from":8,"seq":34359738380,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1935124,"kb_used_data":1890056,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":92436716,"statfs":{"total":96636764160,"available":94655197184,"internally_reserved":0,"allocated":1935417344,"data_stored":1935237601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2174353408,"data_stored":2174353408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1967587328,"data_stored":1967587328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2835415040,"data_stored":2835415040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:33:38.404 INFO:tasks.thrashosds.thrasher:Setting 4.30 to [1, 2, 0] 2024-04-26T10:33:38.404 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.30', '1', '2', '0'] 2024-04-26T10:33:38.404 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.30 1 2 0 2024-04-26T10:33:38.407 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:33:38.419 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 21 16 60845 60829 181.024 136.188 0.0051797 0.00552124 2024-04-26T10:33:38.432 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:38.430+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:38.533 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:38.531+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:38.533 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:38.534 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:38.549 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:38.635 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:38.633+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:38.719 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:38.719 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:38.734 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:38.735 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:38.733+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:38.809 INFO:teuthology.orchestra.run.smithi043.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-26T10:33:38.812 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T10:33:38.812 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-26T10:33:38.835 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:38.835+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:38.908 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:38.908 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:38.923 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:38.936 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:38.935+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:39.037 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:39.036+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:39.097 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:39.098 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:39.112 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:39.138 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:39.137+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:39.239 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:39.238+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:39.289 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:39.289 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:39.305 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:39.340 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:39.340+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:39.373 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:33:39.406 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-26T10:33:39.419 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 22 16 63086 63070 179.162 140.062 0.00397353 0.00557819 2024-04-26T10:33:39.441 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:39.440+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:39.498 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:39.498 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:39.510 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:39.529 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:39.542 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:39.541+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:39.549 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:39.569 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:39.570 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:39.570 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:39.570 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:39.642 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:39.642+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:39.735 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:39.735 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:33:39.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:33:39.735 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:39.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.735 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:39.735 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:39.735 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.930826655000001, 2024-04-26T10:33:39.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:33:39.735 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.735 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.735 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:33:39.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:33:39.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.740 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.930825670000001, 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:39.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:33:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:33:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.744 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.930757047, 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.745 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:33:39.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:39.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:33:39.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:33:39.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:33:39.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:33:39.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:33:39.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:33:39.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.750 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.930705267, 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:39.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:33:39.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:33:39.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:33:39.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:33:39.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:33:39.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:33:39.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:33:39.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.930645417000001, 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.756 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:33:39.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:33:39.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:33:39.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.761 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.928932713, 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:33:39.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:33:39.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:33:39.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:33:39.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:33:39.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:33:39.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:33:39.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.928817646000001, 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:33:39.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:33:39.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:33:39.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:33:39.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:33:39.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.771 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.771 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:39.771 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:39.771 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.928724506, 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:33:39.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:33:39.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:33:39.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:33:39.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:33:39.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:33:39.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.928530346000001, 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.927322977999999, 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.781 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.92651407, 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:33:39.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:33:39.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:33:39.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:33:39.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:33:39.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:33:39.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:33:39.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:33:39.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:33:39.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:33:39.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:33:39.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:33:39.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.926410532, 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.791 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:33:39.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:33:39.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:33:39.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:33:39.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:33:39.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:33:39.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:33:39.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.796 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.926333659000001, 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:39.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:39.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:33:39.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:33:39.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 11.926218275, 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:33:39.802 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:33:39.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:33:39.805 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:48295 5.a 5:5d08b1be:::benchmark_data_smithi043_45180_object48294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.8373570820000005, 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020783243999999999, 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.806 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 48295 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894137+0000", 2024-04-26T10:33:39.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:39.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894198+0000", 2024-04-26T10:33:39.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0192999999999998e-05 2024-04-26T10:33:39.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894209+0000", 2024-04-26T10:33:39.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1486e-05 2024-04-26T10:33:39.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894217+0000", 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1370000000000002e-06 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894251+0000", 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3636000000000001e-05 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894361+0000", 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010988 2024-04-26T10:33:39.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:39.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894441+0000", 2024-04-26T10:33:39.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0549000000000004e-05 2024-04-26T10:33:39.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.897398+0000", 2024-04-26T10:33:39.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002956232 2024-04-26T10:33:39.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914869+0000", 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017471582999999999 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914901+0000", 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1578999999999997e-05 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914922+0000", 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0965999999999999e-05 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:48299 5.a 5:5776ea42:::benchmark_data_smithi043_45180_object48298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.8366612819999997, 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020205178000000001, 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 48299 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894907+0000", 2024-04-26T10:33:39.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3622999999999996e-05 2024-04-26T10:33:39.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894914+0000", 2024-04-26T10:33:39.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:33:39.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894918+0000", 2024-04-26T10:33:39.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8e-06 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.895863+0000", 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00094444799999999997 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.895976+0000", 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000113736 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.896101+0000", 2024-04-26T10:33:39.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012477699999999999 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.899956+0000", 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038552539999999998 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914959+0000", 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015002991 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.915007+0000", 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7404999999999998e-05 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.915039+0000", 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2750000000000003e-05 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:56249 5.3 5:cd0b6957:::benchmark_data_smithi043_45180_object56248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.395817477, 2024-04-26T10:33:39.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019358055999999998, 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 56249 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335801+0000", 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012364900000000001 2024-04-26T10:33:39.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335808+0000", 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335813+0000", 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3650000000000003e-06 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.343739+0000", 2024-04-26T10:33:39.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079259840000000005 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.343846+0000", 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010697200000000001 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.343977+0000", 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000131283 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349555+0000", 2024-04-26T10:33:39.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055777860000000004 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.354963+0000", 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054082599999999998 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355004+0000", 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0203000000000001e-05 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355036+0000", 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2434999999999997e-05 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:56250 5.3 5:c16df6d5:::benchmark_data_smithi043_45180_object56249:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.395676597, 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019349841, 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.823 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 56250 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335906+0000", 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7474999999999999e-05 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335912+0000", 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2539999999999998e-06 2024-04-26T10:33:39.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335918+0000", 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3430000000000003e-06 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349571+0000", 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013653367 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349677+0000", 2024-04-26T10:33:39.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105791 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349768+0000", 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1037000000000003e-05 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.354950+0000", 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051823199999999998 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355103+0000", 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015317299999999999 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355140+0000", 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7088000000000001e-05 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355169+0000", 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8407000000000001e-05 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:58496 5.a 5:5a7e82ac:::benchmark_data_smithi043_45180_object58495:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:37.329970+0000", 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.4015257800000001, 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019239415999999999, 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 58496 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.329970+0000", 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.329970+0000", 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.329969+0000", 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.330018+0000", 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8959999999999999e-05 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.330025+0000", 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2269999999999996e-06 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.330029+0000", 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8539999999999999e-06 2024-04-26T10:33:39.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.335555+0000", 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055257910000000004 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.335721+0000", 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016615099999999999 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.335860+0000", 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138913 2024-04-26T10:33:39.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.342727+0000", 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068670950000000001 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.349128+0000", 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064010869999999997 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.349172+0000", 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3297999999999998e-05 2024-04-26T10:33:39.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.349209+0000", 2024-04-26T10:33:39.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7540000000000003e-05 2024-04-26T10:33:39.834 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.834 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.834 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.834 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:58511 5.a 5:5da7faca:::benchmark_data_smithi043_45180_object58510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:39.834 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:39.834 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.3926771000000002, 2024-04-26T10:33:39.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019708499000000001, 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 58511 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338844+0000", 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338851+0000", 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2219999999999999e-06 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338855+0000", 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8289999999999998e-06 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.346946+0000", 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080906450000000005 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.837 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.347081+0000", 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013469299999999999 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.347225+0000", 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000144704 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.351702+0000", 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044762930000000001 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.358426+0000", 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067239170000000003 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.358482+0000", 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6889999999999999e-05 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.358527+0000", 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4465999999999997e-05 2024-04-26T10:33:39.839 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.840 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.840 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.840 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:39.840 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:39.840 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:39.841 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:39.840+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:39.842 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:39.942 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:39.941+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:40.015 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:64359 5.7 5:ee67a867:::benchmark_data_smithi043_45180_object64358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:40.011491+0000", 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0030099609999999998, 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003039847, 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 64359 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011491+0000", 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011491+0000", 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011490+0000", 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011560+0000", 2024-04-26T10:33:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9603000000000004e-05 2024-04-26T10:33:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011565+0000", 2024-04-26T10:33:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4890000000000003e-06 2024-04-26T10:33:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011569+0000", 2024-04-26T10:33:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9260000000000002e-06 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011599+0000", 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0117e-05 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011700+0000", 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100475 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011792+0000", 2024-04-26T10:33:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2087000000000001e-05 2024-04-26T10:33:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:64360 5.1 5:8772f3ff:::benchmark_data_smithi043_45180_object64359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:40.011576+0000", 2024-04-26T10:33:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0029243799999999999, 2024-04-26T10:33:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030481390000000001, 2024-04-26T10:33:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 64360 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011576+0000", 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011576+0000", 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011576+0000", 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011621+0000", 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5355999999999997e-05 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011626+0000", 2024-04-26T10:33:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8280000000000002e-06 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011630+0000", 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.481e-06 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011657+0000", 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6397000000000002e-05 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011772+0000", 2024-04-26T10:33:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115548 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011950+0000", 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000178016 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.014052+0000", 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002101599 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:64362 5.7 5:ed9b4334:::benchmark_data_smithi043_45180_object64361:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:40.011733+0000", 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0027681619999999998, 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029836519999999998, 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 64362 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011733+0000", 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011733+0000", 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011732+0000", 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011916+0000", 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018458400000000001 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011924+0000", 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.311e-06 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.011931+0000", 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8000000000000001e-06 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013316+0000", 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001385474 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013402+0000", 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5588999999999997e-05 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013541+0000", 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013971599999999999 2024-04-26T10:33:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:64363 5.9 5:90e0892e:::benchmark_data_smithi043_45180_object64362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:40.013045+0000", 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0014556479999999999, 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017523129999999999, 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 64363 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013045+0000", 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013045+0000", 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013044+0000", 2024-04-26T10:33:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013081+0000", 2024-04-26T10:33:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7085000000000002e-05 2024-04-26T10:33:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013091+0000", 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.696e-06 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013099+0000", 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1489999999999994e-06 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013133+0000", 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.345e-05 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013273+0000", 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014042300000000001 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013417+0000", 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014344499999999999 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:64366 5.2 5:4ad61d3c:::benchmark_data_smithi043_45180_object64365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:40.013418+0000", 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0010826469999999999, 2024-04-26T10:33:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014224719999999999, 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 64366 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013418+0000", 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013418+0000", 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013417+0000", 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013480+0000", 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2971000000000004e-05 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013489+0000", 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4089999999999992e-06 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013497+0000", 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3699999999999997e-06 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013534+0000", 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7194000000000003e-05 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013661+0000", 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012693200000000001 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013826+0000", 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016498000000000001 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:64364 5.d e26/16)", 2024-04-26T10:33:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:40.013799+0000", 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00070187199999999998, 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001079928, 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013799+0000", 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013799+0000", 2024-04-26T10:33:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013798+0000", 2024-04-26T10:33:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013917+0000", 2024-04-26T10:33:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119269 2024-04-26T10:33:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013930+0000", 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.225e-05 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.013941+0000", 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0988999999999999e-05 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 6 2024-04-26T10:33:40.040 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:40.042 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:40.083 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:40.082+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:40.145 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:40.144+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:40.245 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:40.245+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:40.253 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:40.254 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:33:40.254 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:33:40.254 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:33:40.254 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:40.266 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:40.346 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:40.345+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:40.419 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 23 16 65251 65235 177.255 135.312 0.00805175 0.0056388 2024-04-26T10:33:40.437 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:40.437 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:33:40.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:33:40.437 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:40.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.437 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:40.437 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:40.437 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.44045114, 2024-04-26T10:33:40.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017960028999999999, 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993792+0000", 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993800+0000", 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0900000000000005e-06 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993805+0000", 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9919999999999998e-06 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993809+0000", 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.703e-06 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012428800000000001 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993937+0000", 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0010000000000003e-06 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006732+0000", 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012794972 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006890+0000", 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015741999999999999 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007049+0000", 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159872 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011426+0000", 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043764370000000004 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011667+0000", 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024095400000000001 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011712+0000", 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4752000000000001e-05 2024-04-26T10:33:40.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011753+0000", 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0995999999999998e-05 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.440384850999997, 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018053829, 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.443 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:40.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993861+0000", 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4990000000000001e-06 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993868+0000", 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7190000000000004e-06 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993873+0000", 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0200000000000002e-06 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993968+0000", 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5310999999999996e-05 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993974+0000", 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008004+0000", 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014029700000000001 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008126+0000", 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122087 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008229+0000", 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102358 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011613+0000", 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033843279999999998 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011812+0000", 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000198798 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011871+0000", 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9283000000000001e-05 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011913+0000", 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1798000000000002e-05 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.440354804000002, 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018338483999999999, 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993892+0000", 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.546e-06 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993899+0000", 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993906+0000", 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9820000000000002e-06 2024-04-26T10:33:40.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994023+0000", 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116766 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994028+0000", 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7079999999999996e-06 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008784+0000", 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014756833 2024-04-26T10:33:40.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008838+0000", 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3112000000000002e-05 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008957+0000", 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119523 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011618+0000", 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026610330000000001 2024-04-26T10:33:40.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012154+0000", 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053582800000000002 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012193+0000", 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9047000000000001e-05 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012227+0000", 2024-04-26T10:33:40.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4442e-05 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:13 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.440312566000003, 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018412833, 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:40.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6139999999999999e-06 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993939+0000", 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3279999999999996e-06 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993949+0000", 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.047e-05 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994066+0000", 2024-04-26T10:33:40.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116952 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994071+0000", 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869999999999996e-06 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009196+0000", 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015125148 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009272+0000", 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5440999999999998e-05 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009381+0000", 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010946399999999999 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012090+0000", 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027090700000000001 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012271+0000", 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018098699999999999 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012312+0000", 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0286e-05 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2276000000000001e-05 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.460 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:15 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.440251787000001, 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018433715, 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993995+0000", 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.225e-06 2024-04-26T10:33:40.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994001+0000", 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0619999999999997e-06 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994004+0000", 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.422e-06 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994157+0000", 2024-04-26T10:33:40.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015285 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1449999999999999e-06 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009937+0000", 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015774455 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010028+0000", 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0746000000000002e-05 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010174+0000", 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146682 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012358+0000", 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021837900000000001 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012382+0000", 2024-04-26T10:33:40.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3768e-05 2024-04-26T10:33:40.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012406+0000", 2024-04-26T10:33:40.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4006999999999999e-05 2024-04-26T10:33:40.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012426+0000", 2024-04-26T10:33:40.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9896000000000001e-05 2024-04-26T10:33:40.466 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.466 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:16 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.440228392000002, 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020879298000000001, 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994017+0000", 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1459999999999999e-06 2024-04-26T10:33:40.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994021+0000", 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2169999999999996e-06 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994025+0000", 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3450000000000002e-06 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996368+0000", 2024-04-26T10:33:40.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002342841 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996374+0000", 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6590000000000001e-06 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010589+0000", 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014214648999999999 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010670+0000", 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1463000000000003e-05 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010824+0000", 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000154007 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.013067+0000", 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022428629999999999 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014821+0000", 2024-04-26T10:33:40.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017534530000000001 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014860+0000", 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9264000000000002e-05 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014895+0000", 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4619999999999997e-05 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:19 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.440214883000003, 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018265699, 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994031+0000", 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9980000000000002e-06 2024-04-26T10:33:40.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994037+0000", 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0100000000000001e-06 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994043+0000", 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1500000000000004e-06 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994085+0000", 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2354000000000001e-05 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994095+0000", 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8749999999999995e-06 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008664+0000", 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01456942 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008786+0000", 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121735 2024-04-26T10:33:40.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008948+0000", 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016180400000000001 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010761+0000", 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018125120000000001 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012205+0000", 2024-04-26T10:33:40.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014441040000000001 2024-04-26T10:33:40.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012256+0000", 2024-04-26T10:33:40.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1817999999999998e-05 2024-04-26T10:33:40.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012295+0000", 2024-04-26T10:33:40.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8142000000000002e-05 2024-04-26T10:33:40.478 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.478 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.478 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.440165808000003, 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018349608999999999, 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994081+0000", 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0589999999999998e-06 2024-04-26T10:33:40.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994086+0000", 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1900000000000003e-06 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994090+0000", 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.771e-06 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994139+0000", 2024-04-26T10:33:40.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9737999999999997e-05 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994145+0000", 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2460000000000003e-06 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009213+0000", 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015068834 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009263+0000", 2024-04-26T10:33:40.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9991999999999998e-05 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009347+0000", 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3997000000000002e-05 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012307+0000", 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029601229999999998 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:40.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6470000000000001e-05 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012390+0000", 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5893000000000003e-05 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012428+0000", 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7721e-05 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.440116525999997, 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017534645000000001, 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:40.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994127+0000", 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994130+0000", 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5530000000000001e-06 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994155+0000", 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4703999999999999e-05 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8650000000000003e-06 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997690+0000", 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035285249999999998 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:40.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997697+0000", 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1399999999999997e-06 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003133+0000", 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054364549999999998 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003272+0000", 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138839 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.003879+0000", 2024-04-26T10:33:40.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00060699599999999995 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009920+0000", 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060407209999999998 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011512+0000", 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015920940000000001 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011591+0000", 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9054999999999994e-05 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011662+0000", 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1095999999999998e-05 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.440034795999999, 2024-04-26T10:33:40.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017587693000000001, 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994209+0000", 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994219+0000", 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0421000000000001e-05 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994226+0000", 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4000000000000003e-06 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994232+0000", 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.575e-06 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997723+0000", 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003491133 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997727+0000", 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5769999999999998e-06 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.004741+0000", 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070140410000000004 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005283+0000", 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054229500000000004 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.005451+0000", 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016849700000000001 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010173+0000", 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047220259999999998 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011703+0000", 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015294499999999999 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011752+0000", 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9524999999999998e-05 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011797+0000", 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4205000000000001e-05 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.440006263999997, 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01805445, 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.496 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:40.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994240+0000", 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4920000000000002e-06 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994249+0000", 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4810000000000006e-06 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994254+0000", 2024-04-26T10:33:40.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3839999999999996e-06 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996056+0000", 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018018839999999999 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996061+0000", 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8690000000000003e-06 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008974+0000", 2024-04-26T10:33:40.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012913127 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009078+0000", 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010333899999999999 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009193+0000", 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011555100000000001 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011374+0000", 2024-04-26T10:33:40.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002180642 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012202+0000", 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00082862099999999998 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012254+0000", 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1498000000000001e-05 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012292+0000", 2024-04-26T10:33:40.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8071999999999997e-05 2024-04-26T10:33:40.502 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.502 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.502 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.502 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:40.502 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:40.502 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.439943208000003, 2024-04-26T10:33:40.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017896868, 2024-04-26T10:33:40.502 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.502 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:40.502 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994300+0000", 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994303+0000", 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.145e-06 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994310+0000", 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.345e-06 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994317+0000", 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9e-06 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997746+0000", 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034290190000000002 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997753+0000", 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2999999999999998e-06 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007898+0000", 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010145207 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008073+0000", 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017543800000000001 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012197+0000", 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041240950000000004 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17792 5.1 5:8c0814d7:::benchmark_data_smithi043_45180_object17791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:40.506 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.722454110000001, 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017771348999999999, 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17792 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711789+0000", 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711901+0000", 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011175600000000001 2024-04-26T10:33:40.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711907+0000", 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3049999999999998e-06 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711911+0000", 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0069999999999999e-06 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711940+0000", 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9088999999999999e-05 2024-04-26T10:33:40.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712019+0000", 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9134000000000005e-05 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712105+0000", 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5932000000000003e-05 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713135+0000", 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010300610000000001 2024-04-26T10:33:40.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729505+0000", 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016369775999999999 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729539+0000", 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4093e-05 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729561+0000", 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1797000000000002e-05 2024-04-26T10:33:40.511 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17797 5.1 5:89b74c1f:::benchmark_data_smithi043_45180_object17796:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.720574065000001, 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018126438000000002, 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17797 2024-04-26T10:33:40.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713669+0000", 2024-04-26T10:33:40.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713706+0000", 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6415000000000003e-05 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713711+0000", 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2140000000000004e-06 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713715+0000", 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2599999999999999e-06 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714380+0000", 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066529399999999998 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714509+0000", 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012870500000000001 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714643+0000", 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013370600000000001 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.719195+0000", 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045520430000000004 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731718+0000", 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012523276999999999 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731776+0000", 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7701000000000002e-05 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731796+0000", 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0398999999999999e-05 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.634133265999999, 2024-04-26T10:33:40.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.522 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:36694 5.f 5:f1c75ca5:::benchmark_data_smithi043_45180_object36693:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:28.235621+0000", 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.198623186000001, 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017516515, 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 36694 2024-04-26T10:33:40.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235621+0000", 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235621+0000", 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235620+0000", 2024-04-26T10:33:40.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235651+0000", 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1306000000000001e-05 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235659+0000", 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2289999999999997e-06 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.235664+0000", 2024-04-26T10:33:40.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7339999999999996e-06 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.236634+0000", 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00096991099999999995 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.236720+0000", 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000003e-05 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:40.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.236807+0000", 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7523999999999998e-05 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.239948+0000", 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031408540000000002 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.253035+0000", 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013086956 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.253091+0000", 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5745999999999998e-05 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:28.253137+0000", 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6162000000000003e-05 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:54323 5.2 5:4d58cd13:::benchmark_data_smithi043_45180_object54322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:40.528 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9454217439999999, 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020404963000000002, 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54323 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488886+0000", 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4800000000000003e-05 2024-04-26T10:33:40.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488898+0000", 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1567e-05 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488905+0000", 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4529999999999996e-06 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.491748+0000", 2024-04-26T10:33:40.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002842528 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.491858+0000", 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109716 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.492007+0000", 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149529 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.494891+0000", 2024-04-26T10:33:40.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002883301 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509167+0000", 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014276494000000001 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509200+0000", 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3229999999999999e-05 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509227+0000", 2024-04-26T10:33:40.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6709000000000001e-05 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:54326 5.2 5:45ded667:::benchmark_data_smithi043_45180_object54325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:35.488913+0000", 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.945330599, 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020409051000000001, 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:40.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54326 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488913+0000", 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488913+0000", 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488912+0000", 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488939+0000", 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6954999999999999e-05 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488946+0000", 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1709999999999996e-06 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488952+0000", 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.493460+0000", 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045077529999999998 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.493593+0000", 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133681 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.493751+0000", 2024-04-26T10:33:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000157107 2024-04-26T10:33:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.495206+0000", 2024-04-26T10:33:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001455256 2024-04-26T10:33:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509263+0000", 2024-04-26T10:33:40.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014056788000000001 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509292+0000", 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9467000000000001e-05 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509322+0000", 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0176999999999999e-05 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:57693 5.7 5:ea937609:::benchmark_data_smithi043_45180_object57692:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:36.980615+0000", 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.453628777, 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017667894, 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 57693 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.980615+0000", 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.980615+0000", 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.980614+0000", 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.980699+0000", 2024-04-26T10:33:40.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4729999999999997e-05 2024-04-26T10:33:40.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.980705+0000", 2024-04-26T10:33:40.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1650000000000003e-06 2024-04-26T10:33:40.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.980710+0000", 2024-04-26T10:33:40.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2390000000000004e-06 2024-04-26T10:33:40.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.989115+0000", 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0084050700000000006 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.989227+0000", 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011216499999999999 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.989411+0000", 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018404399999999999 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.996382+0000", 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069710400000000004 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.998209+0000", 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018266339999999999 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.998251+0000", 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2697999999999997e-05 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:36.998283+0000", 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1616999999999999e-05 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:64811 5.1 5:8ff98dac:::benchmark_data_smithi043_45180_object64810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:40.215016+0000", 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.21922822, 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018673387, 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:40.545 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 64811 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215016+0000", 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215016+0000", 2024-04-26T10:33:40.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215015+0000", 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215097+0000", 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2636e-05 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:40.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215107+0000", 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6809999999999993e-06 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215113+0000", 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7540000000000003e-06 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215142+0000", 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.923e-05 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:40.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215222+0000", 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0269e-05 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215303+0000", 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1310000000000006e-05 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.219003+0000", 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036998809999999999 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:40.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.233590+0000", 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014587009999999999 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.233651+0000", 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1047e-05 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.233689+0000", 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7489e-05 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:40.551 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:40.551 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:40.552 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:40.553 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:40.551+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:40.653 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:40.652+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:40.724 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:40.725 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:40.725 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.725 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:65918 5.4 5:2b14fb1b:::benchmark_data_smithi043_45180_object65917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:40.725 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.718681+0000", 2024-04-26T10:33:40.725 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0047513670000000003, 2024-04-26T10:33:40.725 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0047725279999999998, 2024-04-26T10:33:40.725 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:40.725 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:40.725 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:40.725 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:40.725 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.726 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 65918 2024-04-26T10:33:40.726 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.726 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:40.726 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.726 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:40.726 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.718681+0000", 2024-04-26T10:33:40.726 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.726 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.726 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.726 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:40.726 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.718681+0000", 2024-04-26T10:33:40.726 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.726 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.718680+0000", 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.718738+0000", 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8236000000000003e-05 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.718745+0000", 2024-04-26T10:33:40.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4590000000000001e-06 2024-04-26T10:33:40.728 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.728 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.728 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.728 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.718750+0000", 2024-04-26T10:33:40.728 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8439999999999997e-06 2024-04-26T10:33:40.728 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.728 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.728 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:40.728 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.718781+0000", 2024-04-26T10:33:40.728 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0633000000000003e-05 2024-04-26T10:33:40.728 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.728 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.728 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.718865+0000", 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3654999999999998e-05 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.718972+0000", 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000107551 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:65920 5.8 5:1ec71884:::benchmark_data_smithi043_45180_object65919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.719485+0000", 2024-04-26T10:33:40.729 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0039470750000000004, 2024-04-26T10:33:40.730 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0040202299999999996, 2024-04-26T10:33:40.730 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:40.730 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:40.730 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:40.730 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:40.730 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.730 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 65920 2024-04-26T10:33:40.730 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.730 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:40.730 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.730 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:40.730 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719485+0000", 2024-04-26T10:33:40.730 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719485+0000", 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719484+0000", 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719567+0000", 2024-04-26T10:33:40.731 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3487999999999998e-05 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719581+0000", 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3720000000000001e-05 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719591+0000", 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7559999999999994e-06 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719632+0000", 2024-04-26T10:33:40.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1587e-05 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719760+0000", 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012783799999999999 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719906+0000", 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014596699999999999 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722689+0000", 2024-04-26T10:33:40.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027826330000000001 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:65919 5.a e26/16 5:54bf1610:::benchmark_data_smithi043_45180_object65918:head v 26'4175, mlcod=26'4172)", 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.719735+0000", 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0036966479999999999, 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0038168020000000002, 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.734 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719735+0000", 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719735+0000", 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719735+0000", 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719817+0000", 2024-04-26T10:33:40.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2534999999999995e-05 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719827+0000", 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7529999999999996e-06 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719834+0000", 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1949999999999997e-06 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719872+0000", 2024-04-26T10:33:40.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7528999999999999e-05 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.719891+0000", 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9372e-05 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:65926 5.b 5:d9bd68be:::benchmark_data_smithi043_45180_object65925:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.720820+0000", 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.002611525, 2024-04-26T10:33:40.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027680090000000001, 2024-04-26T10:33:40.738 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:40.738 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:40.738 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:40.738 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:40.738 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.738 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 65926 2024-04-26T10:33:40.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.738 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:40.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:40.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.720820+0000", 2024-04-26T10:33:40.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.720820+0000", 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.720819+0000", 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:40.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.720880+0000", 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0537e-05 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.720894+0000", 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3621999999999999e-05 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.720902+0000", 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3780000000000001e-06 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:40.740 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.720943+0000", 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0537999999999997e-05 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.721062+0000", 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000119317 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.721207+0000", 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014547200000000001 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:40.741 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.742 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:65928 5.4 5:2e3132ab:::benchmark_data_smithi043_45180_object65927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:40.742 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.721897+0000", 2024-04-26T10:33:40.742 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0015348720000000001, 2024-04-26T10:33:40.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017353379999999999, 2024-04-26T10:33:40.742 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:40.742 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:40.742 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:40.742 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:40.742 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.742 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 65928 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.721897+0000", 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.721897+0000", 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.721896+0000", 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.721995+0000", 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8703999999999996e-05 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722008+0000", 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2904e-05 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.744 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722017+0000", 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.003e-06 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722126+0000", 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000109059 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722252+0000", 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012577000000000001 2024-04-26T10:33:40.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722397+0000", 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000145067 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:65930 5.e 5:7785e514:::benchmark_data_smithi043_45180_object65929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.722101+0000", 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0013310570000000001, 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015736190000000001, 2024-04-26T10:33:40.746 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 65930 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722101+0000", 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.747 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722101+0000", 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722100+0000", 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722156+0000", 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5418999999999999e-05 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.748 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:40.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722172+0000", 2024-04-26T10:33:40.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6733999999999999e-05 2024-04-26T10:33:40.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722187+0000", 2024-04-26T10:33:40.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4927e-05 2024-04-26T10:33:40.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:40.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722231+0000", 2024-04-26T10:33:40.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4190000000000002e-05 2024-04-26T10:33:40.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722313+0000", 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1658999999999999e-05 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722442+0000", 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012920400000000001 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.750 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:65931 5.e 5.8ca0034e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.722203+0000", 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001228727, 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015366780000000001, 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 65931 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:40.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722203+0000", 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722203+0000", 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722203+0000", 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722236+0000", 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3473000000000003e-05 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722245+0000", 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9360000000000005e-06 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722251+0000", 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.127e-06 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.753 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:65925 5.f e26/16 5:fc85b3e9:::benchmark_data_smithi043_45180_object65924:head v 26'4021, mlcod=26'4019)", 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.722269+0000", 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001162625, 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001506737, 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722269+0000", 2024-04-26T10:33:40.754 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722269+0000", 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722269+0000", 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722296+0000", 2024-04-26T10:33:40.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7741000000000001e-05 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722306+0000", 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.1640000000000007e-06 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722312+0000", 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1700000000000002e-06 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722344+0000", 2024-04-26T10:33:40.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2502000000000002e-05 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722363+0000", 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.8549000000000001e-05 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:65918 5.4 e26/16)", 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.722599+0000", 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00083336599999999999, 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001214999, 2024-04-26T10:33:40.757 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722599+0000", 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722599+0000", 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722598+0000", 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722602+0000", 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3919999999999996e-06 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722613+0000", 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0521e-05 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:40.759 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:40.760 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.722619+0000", 2024-04-26T10:33:40.760 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2720000000000003e-06 2024-04-26T10:33:40.760 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.760 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:40.760 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.760 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:40.760 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:33:40.760 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 9 2024-04-26T10:33:40.760 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:40.761 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:40.762 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:40.760+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:40.862 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:40.862+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:40.929 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:40.929 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:33:40.929 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:33:40.929 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:33:40.929 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:40.942 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:40.963 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:40.962+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:41.064 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:41.063+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:41.160 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:41.161 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:33:41.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:33:41.161 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:41.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.161 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:41.161 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:41.161 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 13.358061368, 2024-04-26T10:33:41.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:33:41.161 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.161 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.161 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.161 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:33:41.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.165 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:41.166 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 13.357233288, 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:33:41.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:33:41.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 13.356304225000001, 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.172 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:33:41.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.177 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:41.178 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:41.178 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 13.355618784000001, 2024-04-26T10:33:41.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:33:41.178 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.178 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.178 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.178 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.178 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.178 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:33:41.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.178 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.178 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:33:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:41.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:33:41.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:33:41.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46220 5.0 5:0832587b:::benchmark_data_smithi043_45180_object46219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.1008432849999998, 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020289430000000001, 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.183 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46220 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057256+0000", 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3852999999999999e-05 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057265+0000", 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8820000000000007e-06 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057271+0000", 2024-04-26T10:33:41.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4049999999999999e-06 2024-04-26T10:33:41.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064370+0000", 2024-04-26T10:33:41.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0070992870000000001 2024-04-26T10:33:41.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064469+0000", 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8818000000000002e-05 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064555+0000", 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6614999999999997e-05 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070612+0000", 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0060566459999999997 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077392+0000", 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0067803630000000002 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077438+0000", 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5265000000000001e-05 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077473+0000", 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4978999999999998e-05 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.188 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46224 5.0 5:055041a5:::benchmark_data_smithi043_45180_object46223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.1003036139999995, 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019911091999999998, 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46224 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.189 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057722+0000", 2024-04-26T10:33:41.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057751+0000", 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9025000000000001e-05 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057758+0000", 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8360000000000003e-06 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057764+0000", 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3650000000000003e-06 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065640+0000", 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0078760259999999995 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065735+0000", 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5358000000000004e-05 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065881+0000", 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000146155 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070622+0000", 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.004740874 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077527+0000", 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0069053710000000004 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077589+0000", 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1779999999999995e-05 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077634+0000", 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4861000000000003e-05 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46225 5.0 5:0c2c7e61:::benchmark_data_smithi043_45180_object46224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.1002583119999993, 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019997917, 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.194 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46225 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057833+0000", 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5315999999999996e-05 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057840+0000", 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7220000000000002e-06 2024-04-26T10:33:41.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057845+0000", 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1159999999999998e-06 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067208+0000", 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0093631259999999994 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067339+0000", 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013118900000000001 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067479+0000", 2024-04-26T10:33:41.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013958800000000001 2024-04-26T10:33:41.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070873+0000", 2024-04-26T10:33:41.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0033947980000000001 2024-04-26T10:33:41.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077696+0000", 2024-04-26T10:33:41.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006822168 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077735+0000", 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9582999999999997e-05 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077766+0000", 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0882e-05 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46226 5.8 5:1735f934:::benchmark_data_smithi043_45180_object46225:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.1001770349999997, 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019932222999999999, 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46226 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057904+0000", 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5458999999999999e-05 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057911+0000", 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057917+0000", 2024-04-26T10:33:41.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3899999999999998e-06 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067195+0000", 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0092779960000000002 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067292+0000", 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6556000000000002e-05 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067399+0000", 2024-04-26T10:33:41.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000107118 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.071325+0000", 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0039254729999999996 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077687+0000", 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006362337 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077749+0000", 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2365000000000003e-05 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077782+0000", 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2398999999999999e-05 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:48101 5.8 5:1cf22750:::benchmark_data_smithi043_45180_object48100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.817983+0000", 2024-04-26T10:33:41.205 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.3400438030000004, 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018899736, 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 48101 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.817983+0000", 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.817983+0000", 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.817982+0000", 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.818054+0000", 2024-04-26T10:33:41.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2282999999999999e-05 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.818069+0000", 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4575e-05 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.818074+0000", 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5759999999999996e-06 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.208 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.824167+0000", 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0060931420000000002 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.824276+0000", 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000108838 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.824417+0000", 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141173 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.826150+0000", 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00173237 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.836801+0000", 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010651331 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.836843+0000", 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2259000000000003e-05 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.836882+0000", 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8979000000000001e-05 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:48295 5.a e23/16 5:5d08b1be:::benchmark_data_smithi043_45180_object48294:head v 23'3088, mlcod=23'3083)", 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.2635465369999999, 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020188498999999999, 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.211 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894479+0000", 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.213 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.213 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.213 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894584+0000", 2024-04-26T10:33:41.213 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000104863 2024-04-26T10:33:41.213 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.213 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.213 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.213 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894594+0000", 2024-04-26T10:33:41.213 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6760000000000002e-06 2024-04-26T10:33:41.213 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.213 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.213 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.213 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894608+0000", 2024-04-26T10:33:41.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4263e-05 2024-04-26T10:33:41.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894687+0000", 2024-04-26T10:33:41.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8311000000000003e-05 2024-04-26T10:33:41.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894706+0000", 2024-04-26T10:33:41.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9531999999999999e-05 2024-04-26T10:33:41.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914628+0000", 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019922314 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914668+0000", 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0080999999999998e-05 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.215 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:48299 5.a e23/16 5:5776ea42:::benchmark_data_smithi043_45180_object48298:head v 23'3089, mlcod=23'3084)", 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.896165+0000", 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.2618619590000009, 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.01852943, 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896165+0000", 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896165+0000", 2024-04-26T10:33:41.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896164+0000", 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896227+0000", 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3638000000000003e-05 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896239+0000", 2024-04-26T10:33:41.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2041e-05 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896248+0000", 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4740000000000005e-06 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896297+0000", 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9376999999999998e-05 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896317+0000", 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9681e-05 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914672+0000", 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018355346000000002 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914694+0000", 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1804999999999999e-05 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.219 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54078 5.0 5:0c5c0f29:::benchmark_data_smithi043_45180_object54077:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.380197+0000", 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.777829487, 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.017518004, 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54078 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.220 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380197+0000", 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380197+0000", 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380196+0000", 2024-04-26T10:33:41.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380274+0000", 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7415000000000003e-05 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380283+0000", 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.653e-06 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380293+0000", 2024-04-26T10:33:41.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.9879999999999999e-06 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.384350+0000", 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0040574169999999998 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.384482+0000", 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000132156 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.384624+0000", 2024-04-26T10:33:41.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141617 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.391596+0000", 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006972397 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.397635+0000", 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0060390069999999999 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.397680+0000", 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4805999999999998e-05 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.397715+0000", 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5061000000000002e-05 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54079 5.0 5:0a7f1861:::benchmark_data_smithi043_45180_object54078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:41.225 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.7777265929999997, 2024-04-26T10:33:41.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020388585000000001, 2024-04-26T10:33:41.226 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.226 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.226 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.226 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.226 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.226 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54079 2024-04-26T10:33:41.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.226 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:41.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380299+0000", 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380329+0000", 2024-04-26T10:33:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190000000000001e-05 2024-04-26T10:33:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380341+0000", 2024-04-26T10:33:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1715999999999999e-05 2024-04-26T10:33:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380349+0000", 2024-04-26T10:33:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7209999999999994e-06 2024-04-26T10:33:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387457+0000", 2024-04-26T10:33:41.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0071078779999999998 2024-04-26T10:33:41.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387586+0000", 2024-04-26T10:33:41.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012915999999999999 2024-04-26T10:33:41.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387724+0000", 2024-04-26T10:33:41.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000138011 2024-04-26T10:33:41.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.393120+0000", 2024-04-26T10:33:41.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0053964089999999996 2024-04-26T10:33:41.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400595+0000", 2024-04-26T10:33:41.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0074747279999999999 2024-04-26T10:33:41.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400651+0000", 2024-04-26T10:33:41.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6026000000000002e-05 2024-04-26T10:33:41.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400688+0000", 2024-04-26T10:33:41.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7336000000000003e-05 2024-04-26T10:33:41.231 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.231 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.231 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.231 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54084 5.8 5:1e0e5340:::benchmark_data_smithi043_45180_object54083:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.383265+0000", 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.7747613549999999, 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.017509859999999999, 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54084 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.383265+0000", 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.383265+0000", 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.383264+0000", 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.383333+0000", 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8479999999999995e-05 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.383343+0000", 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6199999999999994e-06 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.383348+0000", 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1880000000000001e-06 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.391659+0000", 2024-04-26T10:33:41.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0083115459999999995 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.391759+0000", 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.9345999999999994e-05 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.391836+0000", 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7298000000000004e-05 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.394821+0000", 2024-04-26T10:33:41.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0029849690000000001 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400699+0000", 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058783560000000004 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400739+0000", 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0040999999999998e-05 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400775+0000", 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5648000000000002e-05 2024-04-26T10:33:41.236 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54642 5.e 5:7e60972f:::benchmark_data_smithi043_45180_object54641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.5201451659999998, 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019369872999999999, 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54642 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.237 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637907+0000", 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6261000000000001e-05 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637915+0000", 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1780000000000003e-06 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637920+0000", 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.169e-06 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.639652+0000", 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017314990000000001 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.639745+0000", 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3259999999999998e-05 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.639824+0000", 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8869999999999995e-05 2024-04-26T10:33:41.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.641052+0000", 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001227627 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.657185+0000", 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.016133406999999999 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.657222+0000", 2024-04-26T10:33:41.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7119000000000002e-05 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.657251+0000", 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9084000000000001e-05 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:56243 5.b 5:da4ab90e:::benchmark_data_smithi043_45180_object56242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.335494+0000", 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.8225328990000005, 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019609926999999999, 2024-04-26T10:33:41.242 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 56243 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335494+0000", 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335494+0000", 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335485+0000", 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999919 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335565+0000", 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9476999999999998e-05 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335571+0000", 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3319999999999997e-06 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335584+0000", 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2608e-05 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337185+0000", 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001601597 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337300+0000", 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011501399999999999 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337429+0000", 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000128169 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.340189+0000", 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027599679999999998 2024-04-26T10:33:41.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355018+0000", 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014829241 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355063+0000", 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5472000000000001e-05 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355104+0000", 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0170000000000003e-05 2024-04-26T10:33:41.247 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.249 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.249 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.249 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:56252 5.b 5:d96e4aa9:::benchmark_data_smithi043_45180_object56251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:41.249 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.337366+0000", 2024-04-26T10:33:41.249 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.820660406, 2024-04-26T10:33:41.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.017876882, 2024-04-26T10:33:41.249 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 56252 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337366+0000", 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337366+0000", 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337365+0000", 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337425+0000", 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0074000000000001e-05 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337432+0000", 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.075e-06 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337437+0000", 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1780000000000002e-06 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.339049+0000", 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016119769999999999 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.339132+0000", 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3003999999999993e-05 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.339212+0000", 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9518000000000007e-05 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.340604+0000", 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001391916 2024-04-26T10:33:41.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355154+0000", 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014550034999999999 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355204+0000", 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9801e-05 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355243+0000", 2024-04-26T10:33:41.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9341999999999997e-05 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:56600 5.4 5:27249c2e:::benchmark_data_smithi043_45180_object56599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.494766+0000", 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.6632603870000002, 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018862449, 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.255 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 56600 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494766+0000", 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494766+0000", 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494765+0000", 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494862+0000", 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6921000000000003e-05 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494870+0000", 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1289999999999996e-06 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494877+0000", 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9979999999999997e-06 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.496879+0000", 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020011669999999999 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.497019+0000", 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014009600000000001 2024-04-26T10:33:41.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.497165+0000", 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014645700000000001 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.498902+0000", 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017363750000000001 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.513548+0000", 2024-04-26T10:33:41.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014646484 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.513598+0000", 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0064e-05 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.513629+0000", 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0399000000000002e-05 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:65179 5.e 5:7b4354b2:::benchmark_data_smithi043_45180_object65178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.383735+0000", 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.774291901, 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018666315999999999, 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 65179 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383735+0000", 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383735+0000", 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383734+0000", 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383822+0000", 2024-04-26T10:33:41.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7758999999999998e-05 2024-04-26T10:33:41.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383829+0000", 2024-04-26T10:33:41.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4240000000000004e-06 2024-04-26T10:33:41.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383834+0000", 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4159999999999997e-06 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383858+0000", 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4817999999999999e-05 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383958+0000", 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.9922999999999999e-05 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.264 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.384041+0000", 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2230000000000004e-05 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.386399+0000", 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002358803 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.402349+0000", 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.015950054000000002 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.402378+0000", 2024-04-26T10:33:41.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8804000000000001e-05 2024-04-26T10:33:41.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.402401+0000", 2024-04-26T10:33:41.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2663e-05 2024-04-26T10:33:41.266 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.266 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.266 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.266 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:65241 5.4 5:27070447:::benchmark_data_smithi043_45180_object65240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:41.266 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.414586+0000", 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.74344038199999996, 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019748102, 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 65241 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414586+0000", 2024-04-26T10:33:41.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414586+0000", 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414585+0000", 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414702+0000", 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000117125 2024-04-26T10:33:41.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414711+0000", 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6929999999999996e-06 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414719+0000", 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.416649+0000", 2024-04-26T10:33:41.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019300960000000001 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.416764+0000", 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000115611 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.416872+0000", 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000107243 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:41.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.418259+0000", 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001387288 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.434278+0000", 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.016018988000000001 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.434309+0000", 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0948000000000003e-05 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:41.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:41.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.434334+0000", 2024-04-26T10:33:41.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.533e-05 2024-04-26T10:33:41.272 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.272 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.272 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.272 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:41.272 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:41.272 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:41.273 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:41.272+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:41.274 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:41.374 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:41.374+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:41.418 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:33:41.419 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 24 16 67485 67469 175.686 139.625 0.00871142 0.005689 2024-04-26T10:33:41.466 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:41.466 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:41.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.466 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:67582 5.3 5:c574e65e:::benchmark_data_smithi043_45180_object67581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:41.462935+0000", 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0025482759999999999, 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025764170000000001, 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 67582 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:41.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.462935+0000", 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.462935+0000", 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.462934+0000", 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.462955+0000", 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0815e-05 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.462960+0000", 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7579999999999998e-06 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.462964+0000", 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9910000000000004e-06 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.462990+0000", 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162000000000001e-05 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463085+0000", 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5036000000000003e-05 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463441+0000", 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035604499999999998 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:41.470 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:67583 5.a 5:5bc49cb2:::benchmark_data_smithi043_45180_object67582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:41.463131+0000", 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0023522500000000002, 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024736089999999999, 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 67583 2024-04-26T10:33:41.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463131+0000", 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463131+0000", 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:41.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463130+0000", 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463239+0000", 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010857900000000001 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463247+0000", 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1259999999999998e-06 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463253+0000", 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.438e-06 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463297+0000", 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463417+0000", 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000120086 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:41.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463579+0000", 2024-04-26T10:33:41.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162497 2024-04-26T10:33:41.475 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:41.475 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:41.475 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:41.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.475 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:67584 5.2 e26/16 5:4b0da501:::benchmark_data_smithi043_45180_object67583:head v 26'4273, mlcod=26'4271)", 2024-04-26T10:33:41.475 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:41.463674+0000", 2024-04-26T10:33:41.475 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001808849, 2024-04-26T10:33:41.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002017544, 2024-04-26T10:33:41.475 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:41.475 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463674+0000", 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463674+0000", 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463674+0000", 2024-04-26T10:33:41.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463751+0000", 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7051999999999993e-05 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463759+0000", 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463768+0000", 2024-04-26T10:33:41.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5610000000000004e-06 2024-04-26T10:33:41.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:41.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463801+0000", 2024-04-26T10:33:41.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2545000000000001e-05 2024-04-26T10:33:41.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:41.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.463818+0000", 2024-04-26T10:33:41.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7796999999999999e-05 2024-04-26T10:33:41.478 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:41.478 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:67589 5.a 5.5b6168fa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:41.464925+0000", 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.000558123, 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000811662, 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 67589 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.479 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.464925+0000", 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.464925+0000", 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.464924+0000", 2024-04-26T10:33:41.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.465023+0000", 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9172999999999994e-05 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.465032+0000", 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.465037+0000", 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0849999999999996e-06 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:67585 5.0 e26/16 5:0a6a29fd:::benchmark_data_smithi043_45180_object67584:head v 26'4247, mlcod=26'4244)", 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:41.465013+0000", 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.000470555, 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00075686899999999997, 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.465013+0000", 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.465013+0000", 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.465012+0000", 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.465077+0000", 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5374000000000001e-05 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.465083+0000", 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7710000000000003e-06 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.465086+0000", 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2339999999999999e-06 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.465113+0000", 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6188999999999999e-05 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:41.465127+0000", 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4783999999999999e-05 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 5 2024-04-26T10:33:41.485 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:41.487 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:41.488 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:41.487+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:41.582 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:33:41.587 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:41.587+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:41.672 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:41.672 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:33:41.672 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:33:41.672 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:33:41.672 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:41.688 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:41.687+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:41.690 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:41.736 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:41.756 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:41.777 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:41.779 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:41.789 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:41.788+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:41.872 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:41.872 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:41.888 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:41.889 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:41.889+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:41.991 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:41.990+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:42.063 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:42.063 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:42.077 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:42.092 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:42.092+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:42.193 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:42.193+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:42.287 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:42.287 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:42.294 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:42.293+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:42.301 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:42.395 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:42.394+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:42.408 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-26T10:33:42.419 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 25 16 69670 69654 174.121 136.562 0.00938733 0.0057406 2024-04-26T10:33:42.496 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:42.495+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:42.516 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:42.516 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:42.530 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:42.597 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:42.596+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:42.698 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:42.698+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:42.698 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:42.699 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:42.713 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:42.799 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:42.799+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:42.900 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:42.899+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:42.924 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:42.924 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:42.938 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:43.000 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:43.000+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:43.101 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:43.101+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:43.154 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:43.154 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:43.168 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:43.202 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:43.202+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:43.303 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:43.303+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:43.354 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:43.354 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:43.368 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:43.412 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:43.411+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:43.419 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 26 16 71892 71876 172.764 138.875 0.00750205 0.00578511 2024-04-26T10:33:43.506 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:43.504+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:43.546 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:43.547 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:43.557 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:43.606 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:43.605+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:43.709 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:43.706+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:43.783 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:43.783 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:43.791 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:33:43.798 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:43.810 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:43.808+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:43.813 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:33:43.813 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:33:43.813 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-26T10:33:43.813 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T10:33:43.813 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T10:33:43.814 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-26T10:33:43.910 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:43.909+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:43.946 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:43.967 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:43.982 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:43.982 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:43.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:73059 5.2 5:41b187fb:::benchmark_data_smithi043_45180_object73058:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:43.971514+0000", 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0095239260000000003, 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0095573670000000006, 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 73059 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.971514+0000", 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.971514+0000", 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.971513+0000", 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.971596+0000", 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3004999999999996e-05 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.971604+0000", 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5039999999999996e-06 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.971610+0000", 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3570000000000003e-06 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:43.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.975548+0000", 2024-04-26T10:33:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039373309999999996 2024-04-26T10:33:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.975676+0000", 2024-04-26T10:33:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012815799999999999 2024-04-26T10:33:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.975836+0000", 2024-04-26T10:33:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016063500000000001 2024-04-26T10:33:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978175+0000", 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023387799999999999 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:73068 5.7 5:ed30986d:::benchmark_data_smithi043_45180_object73067:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:43.976255+0000", 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0047826489999999999, 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049229290000000004, 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:43.987 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 73068 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976255+0000", 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976255+0000", 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976254+0000", 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976353+0000", 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8529000000000005e-05 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976367+0000", 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4324e-05 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976377+0000", 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0412e-05 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976428+0000", 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1109999999999997e-05 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976574+0000", 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014556700000000001 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976727+0000", 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152681 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:73071 5.1 5:86bf13d3:::benchmark_data_smithi043_45180_object73070:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:43.976907+0000", 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0041309240000000002, 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043596889999999999, 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:43.991 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 73071 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976907+0000", 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976907+0000", 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:43.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976906+0000", 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976969+0000", 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2912999999999999e-05 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976982+0000", 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2979999999999999e-05 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.976991+0000", 2024-04-26T10:33:43.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3840000000000003e-06 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978505+0000", 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001513089 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978600+0000", 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5883000000000003e-05 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978690+0000", 2024-04-26T10:33:43.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9503e-05 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:73070 5.6 e27/16 5:6919704d:::benchmark_data_smithi043_45180_object73069:head v 27'4545, mlcod=27'4543)", 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:43.978506+0000", 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.002531452, 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028450250000000002, 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:43.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978506+0000", 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978506+0000", 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978506+0000", 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978536+0000", 2024-04-26T10:33:43.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0374000000000001e-05 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978548+0000", 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1199999999999999e-05 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978557+0000", 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0580000000000004e-06 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978596+0000", 2024-04-26T10:33:43.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9787999999999999e-05 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978618+0000", 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1319e-05 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:73072 5.c e27/16 5:30c84b15:::benchmark_data_smithi043_45180_object73071:head v 27'4539, mlcod=27'4537)", 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:43.978567+0000", 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0024708550000000001, 2024-04-26T10:33:43.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028526979999999999, 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978567+0000", 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978567+0000", 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:43.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978567+0000", 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978591+0000", 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3966999999999999e-05 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978598+0000", 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2910000000000002e-06 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978603+0000", 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0590000000000002e-06 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978663+0000", 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9586999999999997e-05 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978680+0000", 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6974e-05 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:73075 5.7 5:e48991f6:::benchmark_data_smithi043_45180_object73074:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:43.978908+0000", 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0021296169999999999, 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025924329999999999, 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 73075 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978908+0000", 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978908+0000", 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978908+0000", 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978976+0000", 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8436999999999995e-05 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978987+0000", 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1112e-05 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.978995+0000", 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7540000000000006e-06 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.979036+0000", 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0923000000000001e-05 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.979159+0000", 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012294399999999999 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.979311+0000", 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015271699999999999 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:73076 5.d e27/16 5:bf4efc8b:::benchmark_data_smithi043_45180_object73075:head v 27'4572, mlcod=27'4570)", 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:43.979950+0000", 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0010880309999999999, 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016336619999999999, 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.979950+0000", 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.979950+0000", 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.979949+0000", 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.980019+0000", 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0000999999999996e-05 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.980029+0000", 2024-04-26T10:33:44.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6889999999999999e-06 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.980036+0000", 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8290000000000002e-06 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.980085+0000", 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9412000000000001e-05 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.980104+0000", 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9428000000000001e-05 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.008 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:73079 5.5 e27/16 5:ac8addc8:::benchmark_data_smithi043_45180_object73078:head v 27'4522, mlcod=27'4520)", 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:43.981170+0000", 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9998679, 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00048531799999999999, 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.981170+0000", 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.981170+0000", 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.981170+0000", 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.981252+0000", 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2731000000000005e-05 2024-04-26T10:33:44.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.981260+0000", 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1440000000000003e-06 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.981266+0000", 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6540000000000004e-06 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.981312+0000", 2024-04-26T10:33:44.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5929e-05 2024-04-26T10:33:44.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:43.981331+0000", 2024-04-26T10:33:44.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8831e-05 2024-04-26T10:33:44.012 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.012 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.012 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.012 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.012 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:33:44.012 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 8 2024-04-26T10:33:44.012 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:44.013 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:44.014 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:44.012+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:44.015 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:44.015 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:44.015 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:44.016 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:44.030 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:44.030 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T10:33:44.030 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:44.115 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:44.114+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:44.191 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:44.191 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:33:44.191 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:33:44.191 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:33:44.191 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:44.205 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:44.248 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:44.248+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:44.317 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:44.315+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:44.377 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:33:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:33:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:44.377 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.379768906999999, 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017960028999999999, 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:44.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993792+0000", 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993800+0000", 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0900000000000005e-06 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993805+0000", 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9919999999999998e-06 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993809+0000", 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.703e-06 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012428800000000001 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:44.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993937+0000", 2024-04-26T10:33:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0010000000000003e-06 2024-04-26T10:33:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006732+0000", 2024-04-26T10:33:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012794972 2024-04-26T10:33:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006890+0000", 2024-04-26T10:33:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015741999999999999 2024-04-26T10:33:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007049+0000", 2024-04-26T10:33:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159872 2024-04-26T10:33:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011426+0000", 2024-04-26T10:33:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043764370000000004 2024-04-26T10:33:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011667+0000", 2024-04-26T10:33:44.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024095400000000001 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011712+0000", 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4752000000000001e-05 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011753+0000", 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0995999999999998e-05 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.379702618000003, 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018053829, 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993861+0000", 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4990000000000001e-06 2024-04-26T10:33:44.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993868+0000", 2024-04-26T10:33:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7190000000000004e-06 2024-04-26T10:33:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993873+0000", 2024-04-26T10:33:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0200000000000002e-06 2024-04-26T10:33:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993968+0000", 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5310999999999996e-05 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993974+0000", 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008004+0000", 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014029700000000001 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008126+0000", 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122087 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008229+0000", 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102358 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011613+0000", 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033843279999999998 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011812+0000", 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000198798 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011871+0000", 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9283000000000001e-05 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011913+0000", 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1798000000000002e-05 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.379672571, 2024-04-26T10:33:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018338483999999999, 2024-04-26T10:33:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:44.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993892+0000", 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.546e-06 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993899+0000", 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993906+0000", 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9820000000000002e-06 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994023+0000", 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116766 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994028+0000", 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7079999999999996e-06 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008784+0000", 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014756833 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008838+0000", 2024-04-26T10:33:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3112000000000002e-05 2024-04-26T10:33:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008957+0000", 2024-04-26T10:33:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119523 2024-04-26T10:33:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011618+0000", 2024-04-26T10:33:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026610330000000001 2024-04-26T10:33:44.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012154+0000", 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053582800000000002 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012193+0000", 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9047000000000001e-05 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012227+0000", 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4442e-05 2024-04-26T10:33:44.395 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:13 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.379630333000001, 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018412833, 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6139999999999999e-06 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993939+0000", 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3279999999999996e-06 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993949+0000", 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.047e-05 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994066+0000", 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116952 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994071+0000", 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869999999999996e-06 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009196+0000", 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015125148 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009272+0000", 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5440999999999998e-05 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009381+0000", 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010946399999999999 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012090+0000", 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027090700000000001 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012271+0000", 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018098699999999999 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012312+0000", 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0286e-05 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2276000000000001e-05 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.401 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:15 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.379569554, 2024-04-26T10:33:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018433715, 2024-04-26T10:33:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993995+0000", 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.225e-06 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994001+0000", 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0619999999999997e-06 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994004+0000", 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.422e-06 2024-04-26T10:33:44.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994157+0000", 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015285 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1449999999999999e-06 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009937+0000", 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015774455 2024-04-26T10:33:44.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010028+0000", 2024-04-26T10:33:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0746000000000002e-05 2024-04-26T10:33:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010174+0000", 2024-04-26T10:33:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146682 2024-04-26T10:33:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012358+0000", 2024-04-26T10:33:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021837900000000001 2024-04-26T10:33:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012382+0000", 2024-04-26T10:33:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3768e-05 2024-04-26T10:33:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012406+0000", 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4006999999999999e-05 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012426+0000", 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9896000000000001e-05 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:16 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:44.408 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.379546159, 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020879298000000001, 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994017+0000", 2024-04-26T10:33:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1459999999999999e-06 2024-04-26T10:33:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994021+0000", 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2169999999999996e-06 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994025+0000", 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3450000000000002e-06 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996368+0000", 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002342841 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:44.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996374+0000", 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6590000000000001e-06 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010589+0000", 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014214648999999999 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010670+0000", 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1463000000000003e-05 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010824+0000", 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000154007 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.013067+0000", 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022428629999999999 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014821+0000", 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017534530000000001 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014860+0000", 2024-04-26T10:33:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9264000000000002e-05 2024-04-26T10:33:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014895+0000", 2024-04-26T10:33:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4619999999999997e-05 2024-04-26T10:33:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:19 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.379532650000002, 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018265699, 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994031+0000", 2024-04-26T10:33:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9980000000000002e-06 2024-04-26T10:33:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994037+0000", 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0100000000000001e-06 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994043+0000", 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1500000000000004e-06 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994085+0000", 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2354000000000001e-05 2024-04-26T10:33:44.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994095+0000", 2024-04-26T10:33:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8749999999999995e-06 2024-04-26T10:33:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008664+0000", 2024-04-26T10:33:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01456942 2024-04-26T10:33:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008786+0000", 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121735 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008948+0000", 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016180400000000001 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010761+0000", 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018125120000000001 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012205+0000", 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014441040000000001 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012256+0000", 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1817999999999998e-05 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012295+0000", 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8142000000000002e-05 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.420 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.379483575000002, 2024-04-26T10:33:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018349608999999999, 2024-04-26T10:33:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994081+0000", 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0589999999999998e-06 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994086+0000", 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1900000000000003e-06 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994090+0000", 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.771e-06 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994139+0000", 2024-04-26T10:33:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9737999999999997e-05 2024-04-26T10:33:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994145+0000", 2024-04-26T10:33:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2460000000000003e-06 2024-04-26T10:33:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009213+0000", 2024-04-26T10:33:44.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015068834 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009263+0000", 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9991999999999998e-05 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009347+0000", 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3997000000000002e-05 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012307+0000", 2024-04-26T10:33:44.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029601229999999998 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6470000000000001e-05 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012390+0000", 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5893000000000003e-05 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012428+0000", 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7721e-05 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.379324031000003, 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01805445, 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994240+0000", 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4920000000000002e-06 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994249+0000", 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4810000000000006e-06 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994254+0000", 2024-04-26T10:33:44.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3839999999999996e-06 2024-04-26T10:33:44.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996056+0000", 2024-04-26T10:33:44.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018018839999999999 2024-04-26T10:33:44.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:44.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996061+0000", 2024-04-26T10:33:44.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8690000000000003e-06 2024-04-26T10:33:44.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008974+0000", 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012913127 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009078+0000", 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010333899999999999 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009193+0000", 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011555100000000001 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011374+0000", 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002180642 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012202+0000", 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00082862099999999998 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012254+0000", 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1498000000000001e-05 2024-04-26T10:33:44.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012292+0000", 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8071999999999997e-05 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.379260975000001, 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017896868, 2024-04-26T10:33:44.433 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.434 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:44.434 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:44.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:44.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994300+0000", 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994303+0000", 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.145e-06 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994310+0000", 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.345e-06 2024-04-26T10:33:44.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994317+0000", 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9e-06 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997746+0000", 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034290190000000002 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997753+0000", 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2999999999999998e-06 2024-04-26T10:33:44.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007898+0000", 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010145207 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008073+0000", 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017543800000000001 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012197+0000", 2024-04-26T10:33:44.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041240950000000004 2024-04-26T10:33:44.438 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.438 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.438 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.438 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17792 5.1 5:8c0814d7:::benchmark_data_smithi043_45180_object17791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:44.438 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:44.438 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.661771877, 2024-04-26T10:33:44.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017771348999999999, 2024-04-26T10:33:44.438 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.438 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:44.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17792 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711789+0000", 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711901+0000", 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011175600000000001 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711907+0000", 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3049999999999998e-06 2024-04-26T10:33:44.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711911+0000", 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0069999999999999e-06 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711940+0000", 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9088999999999999e-05 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712019+0000", 2024-04-26T10:33:44.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9134000000000005e-05 2024-04-26T10:33:44.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712105+0000", 2024-04-26T10:33:44.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5932000000000003e-05 2024-04-26T10:33:44.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713135+0000", 2024-04-26T10:33:44.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010300610000000001 2024-04-26T10:33:44.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729505+0000", 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016369775999999999 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729539+0000", 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4093e-05 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729561+0000", 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1797000000000002e-05 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17797 5.1 5:89b74c1f:::benchmark_data_smithi043_45180_object17796:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.659891832, 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018126438000000002, 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17797 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713669+0000", 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713706+0000", 2024-04-26T10:33:44.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6415000000000003e-05 2024-04-26T10:33:44.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713711+0000", 2024-04-26T10:33:44.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2140000000000004e-06 2024-04-26T10:33:44.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713715+0000", 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2599999999999999e-06 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714380+0000", 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066529399999999998 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714509+0000", 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012870500000000001 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714643+0000", 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013370600000000001 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.719195+0000", 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045520430000000004 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731718+0000", 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012523276999999999 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731776+0000", 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7701000000000002e-05 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731796+0000", 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0398999999999999e-05 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.449 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:44.450 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:44.450 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.573451033000001, 2024-04-26T10:33:44.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:33:44.450 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.450 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.450 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:44.450 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:44.450 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.450 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:33:44.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.450 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:44.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:44.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:44.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:44.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:33:44.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:33:44.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:33:44.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:33:44.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:33:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:33:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:33:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:33:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:33:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:33:44.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:54323 5.2 5:4d58cd13:::benchmark_data_smithi043_45180_object54322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8847395109999994, 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020404963000000002, 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54323 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488886+0000", 2024-04-26T10:33:44.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4800000000000003e-05 2024-04-26T10:33:44.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488898+0000", 2024-04-26T10:33:44.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1567e-05 2024-04-26T10:33:44.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488905+0000", 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4529999999999996e-06 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.491748+0000", 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002842528 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.491858+0000", 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109716 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.492007+0000", 2024-04-26T10:33:44.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149529 2024-04-26T10:33:44.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.494891+0000", 2024-04-26T10:33:44.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002883301 2024-04-26T10:33:44.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509167+0000", 2024-04-26T10:33:44.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014276494000000001 2024-04-26T10:33:44.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509200+0000", 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3229999999999999e-05 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509227+0000", 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6709000000000001e-05 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:54326 5.2 5:45ded667:::benchmark_data_smithi043_45180_object54325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:35.488913+0000", 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.8846483660000004, 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020409051000000001, 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54326 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488913+0000", 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488913+0000", 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488912+0000", 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488939+0000", 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6954999999999999e-05 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488946+0000", 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1709999999999996e-06 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488952+0000", 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.493460+0000", 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045077529999999998 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.493593+0000", 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133681 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.493751+0000", 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000157107 2024-04-26T10:33:44.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.495206+0000", 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001455256 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509263+0000", 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014056788000000001 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509292+0000", 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9467000000000001e-05 2024-04-26T10:33:44.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509322+0000", 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0176999999999999e-05 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:64811 5.1 5:8ff98dac:::benchmark_data_smithi043_45180_object64810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:40.215016+0000", 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.1585459870000001, 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018673387, 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.467 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 64811 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215016+0000", 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215016+0000", 2024-04-26T10:33:44.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215015+0000", 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215097+0000", 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2636e-05 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215107+0000", 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6809999999999993e-06 2024-04-26T10:33:44.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215113+0000", 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7540000000000003e-06 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215142+0000", 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.923e-05 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215222+0000", 2024-04-26T10:33:44.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0269e-05 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215303+0000", 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1310000000000006e-05 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.219003+0000", 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036998809999999999 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.233590+0000", 2024-04-26T10:33:44.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014587009999999999 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.233651+0000", 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1047e-05 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.233689+0000", 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7489e-05 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:73477 5.7 5:ea73eb55:::benchmark_data_smithi043_45180_object73476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:44.160203+0000", 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.21335899999999999, 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018745083999999999, 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 73477 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160203+0000", 2024-04-26T10:33:44.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160203+0000", 2024-04-26T10:33:44.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160202+0000", 2024-04-26T10:33:44.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160257+0000", 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4514e-05 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160261+0000", 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9609999999999996e-06 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160265+0000", 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6500000000000002e-06 2024-04-26T10:33:44.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.164471+0000", 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042059130000000004 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.164604+0000", 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013298499999999999 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.164988+0000", 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000383886 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.167738+0000", 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027496959999999998 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.178858+0000", 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011120365 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.178910+0000", 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2157000000000002e-05 2024-04-26T10:33:44.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.178948+0000", 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7469000000000003e-05 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:73479 5.7 5:ef2d76e7:::benchmark_data_smithi043_45180_object73478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:44.160420+0000", 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.213141578, 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020414346, 2024-04-26T10:33:44.478 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 73479 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160420+0000", 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160420+0000", 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160419+0000", 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160475+0000", 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5720000000000002e-05 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160482+0000", 2024-04-26T10:33:44.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5080000000000002e-06 2024-04-26T10:33:44.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160485+0000", 2024-04-26T10:33:44.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8539999999999999e-06 2024-04-26T10:33:44.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.167768+0000", 2024-04-26T10:33:44.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072829410000000002 2024-04-26T10:33:44.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.167889+0000", 2024-04-26T10:33:44.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120942 2024-04-26T10:33:44.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.168045+0000", 2024-04-26T10:33:44.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015601100000000001 2024-04-26T10:33:44.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.176045+0000", 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0079993059999999994 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180764+0000", 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047188710000000003 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180800+0000", 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6335999999999999e-05 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180834+0000", 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4418999999999997e-05 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:73481 5.f 5:f72f726e:::benchmark_data_smithi043_45180_object73480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:44.161462+0000", 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.21209961899999999, 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019291239000000002, 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.484 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 73481 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161462+0000", 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161462+0000", 2024-04-26T10:33:44.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161461+0000", 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161597+0000", 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013634000000000001 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161606+0000", 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6379999999999993e-06 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161613+0000", 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9759999999999998e-06 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.167761+0000", 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.006147881 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.167889+0000", 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012838899999999999 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.168045+0000", 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015611499999999999 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.176027+0000", 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0079817120000000002 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180670+0000", 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046424639999999998 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180703+0000", 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3432000000000001e-05 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180753+0000", 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0178e-05 2024-04-26T10:33:44.489 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:73483 5.7 5:e357b8e4:::benchmark_data_smithi043_45180_object73482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:44.161952+0000", 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.211609406, 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018943887999999999, 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.490 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 73483 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161952+0000", 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161952+0000", 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:44.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161952+0000", 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.162113+0000", 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000161154 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.162128+0000", 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4799e-05 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.162136+0000", 2024-04-26T10:33:44.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6710000000000005e-06 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.169755+0000", 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076185030000000004 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.169854+0000", 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8963999999999996e-05 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.169946+0000", 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2731000000000004e-05 2024-04-26T10:33:44.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.176074+0000", 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061272599999999998 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180840+0000", 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047667250000000003 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180865+0000", 2024-04-26T10:33:44.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4905999999999998e-05 2024-04-26T10:33:44.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:44.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:44.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:44.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180896+0000", 2024-04-26T10:33:44.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0734000000000001e-05 2024-04-26T10:33:44.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.495 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:44.495 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:44.495 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:44.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:33:44.497 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 27 16 74044 74028 171.347 134.5 0.00725561 0.00583323 2024-04-26T10:33:44.497 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:44.495+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:44.498 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:44.598 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:44.597+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:44.666 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:44.666 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:44.667 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.667 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:74564 5.8 5:12f2af65:::benchmark_data_smithi043_45180_object74563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:44.667 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:44.655513+0000", 2024-04-26T10:33:44.667 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.010032220999999999, 2024-04-26T10:33:44.667 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010051724999999999, 2024-04-26T10:33:44.667 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:44.667 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:44.667 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:44.667 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:44.667 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.667 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 74564 2024-04-26T10:33:44.667 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.668 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:44.668 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.668 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:44.668 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655513+0000", 2024-04-26T10:33:44.668 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.668 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.668 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.668 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:44.668 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655513+0000", 2024-04-26T10:33:44.668 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.668 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.668 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655512+0000", 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655557+0000", 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5015999999999997e-05 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655565+0000", 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1869999999999997e-06 2024-04-26T10:33:44.669 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.670 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.670 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.670 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655571+0000", 2024-04-26T10:33:44.670 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4960000000000004e-06 2024-04-26T10:33:44.670 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.670 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.670 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:44.670 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655603+0000", 2024-04-26T10:33:44.670 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2614999999999999e-05 2024-04-26T10:33:44.670 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.670 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.670 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:44.671 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655714+0000", 2024-04-26T10:33:44.671 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000110915 2024-04-26T10:33:44.671 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.671 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.671 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.671 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655820+0000", 2024-04-26T10:33:44.671 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010563799999999999 2024-04-26T10:33:44.671 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.671 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.671 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:44.671 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.658029+0000", 2024-04-26T10:33:44.671 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0022090539999999998 2024-04-26T10:33:44.672 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.672 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:44.672 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.672 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.672 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.672 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:74565 5.0 5:0c956c2b:::benchmark_data_smithi043_45180_object74564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:44.672 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:44.655596+0000", 2024-04-26T10:33:44.672 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.009948564, 2024-04-26T10:33:44.672 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010023438000000001, 2024-04-26T10:33:44.672 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:44.672 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:44.672 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:44.672 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:44.673 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.673 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 74565 2024-04-26T10:33:44.673 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.673 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:44.673 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.673 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:44.673 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655596+0000", 2024-04-26T10:33:44.673 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.673 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.673 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.673 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:44.673 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655596+0000", 2024-04-26T10:33:44.673 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.674 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.674 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.674 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:44.674 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655596+0000", 2024-04-26T10:33:44.674 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.674 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.674 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.674 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:44.674 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655658+0000", 2024-04-26T10:33:44.674 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2303000000000003e-05 2024-04-26T10:33:44.674 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.674 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.674 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655664+0000", 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2219999999999999e-06 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655668+0000", 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8480000000000003e-06 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655715+0000", 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6981999999999998e-05 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.675 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.676 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:44.676 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655847+0000", 2024-04-26T10:33:44.676 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013179500000000001 2024-04-26T10:33:44.676 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.676 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.676 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.676 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.655990+0000", 2024-04-26T10:33:44.676 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000142547 2024-04-26T10:33:44.676 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.676 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.676 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:44.676 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.658314+0000", 2024-04-26T10:33:44.676 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0023245789999999998 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:74571 5.8 5:1a242e22:::benchmark_data_smithi043_45180_object74570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:44.659762+0000", 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0057824520000000004, 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059062430000000003, 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:44.677 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 74571 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.659762+0000", 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.659762+0000", 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.678 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.659761+0000", 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.659822+0000", 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0806e-05 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.659833+0000", 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0831e-05 2024-04-26T10:33:44.679 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.659842+0000", 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.1330000000000005e-06 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.659871+0000", 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9428999999999999e-05 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.659970+0000", 2024-04-26T10:33:44.680 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8709000000000006e-05 2024-04-26T10:33:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660062+0000", 2024-04-26T10:33:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.1939000000000002e-05 2024-04-26T10:33:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.663671+0000", 2024-04-26T10:33:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0036085510000000002 2024-04-26T10:33:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:44.681 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.682 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.682 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.682 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:74575 5.e 5:744ac80b:::benchmark_data_smithi043_45180_object74574:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:44.682 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:44.660009+0000", 2024-04-26T10:33:44.682 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0055355990000000004, 2024-04-26T10:33:44.682 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0057060089999999997, 2024-04-26T10:33:44.682 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:44.682 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:44.682 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:44.682 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:44.682 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.682 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 74575 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660009+0000", 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660009+0000", 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.683 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:44.684 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660009+0000", 2024-04-26T10:33:44.684 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.684 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.684 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:44.684 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660094+0000", 2024-04-26T10:33:44.684 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5489999999999996e-05 2024-04-26T10:33:44.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.684 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.684 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:44.684 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660104+0000", 2024-04-26T10:33:44.684 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.4809999999999995e-06 2024-04-26T10:33:44.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660110+0000", 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8490000000000002e-06 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660156+0000", 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6260000000000001e-05 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660305+0000", 2024-04-26T10:33:44.685 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000149176 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660482+0000", 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00017729200000000001 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.664531+0000", 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0040484229999999998 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.686 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:74577 5.b 5:d1c79785:::benchmark_data_smithi043_45180_object74576:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:44.660117+0000", 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0054282439999999996, 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0056461690000000004, 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 74577 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:44.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660117+0000", 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660117+0000", 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660116+0000", 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.688 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660182+0000", 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.601e-05 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660192+0000", 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0047999999999999e-05 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660198+0000", 2024-04-26T10:33:44.689 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5729999999999998e-06 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660243+0000", 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5682000000000001e-05 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660373+0000", 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000129698 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660515+0000", 2024-04-26T10:33:44.690 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000142318 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.664146+0000", 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0036307599999999998 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:74580 5.e 5:7ee6d676:::benchmark_data_smithi043_45180_object74579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:44.660612+0000", 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0049329329999999996, 2024-04-26T10:33:44.691 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052079470000000001, 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 74580 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660612+0000", 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:44.692 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660612+0000", 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660611+0000", 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660679+0000", 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8103999999999997e-05 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:44.693 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660690+0000", 2024-04-26T10:33:44.694 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0947999999999999e-05 2024-04-26T10:33:44.694 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.694 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.694 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.694 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660699+0000", 2024-04-26T10:33:44.694 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7749999999999998e-06 2024-04-26T10:33:44.694 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.694 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.694 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:44.694 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.662689+0000", 2024-04-26T10:33:44.694 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019903709999999999 2024-04-26T10:33:44.694 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.694 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.695 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:44.695 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.662770+0000", 2024-04-26T10:33:44.695 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0469999999999994e-05 2024-04-26T10:33:44.695 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.695 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.695 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.695 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.662908+0000", 2024-04-26T10:33:44.695 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013794999999999999 2024-04-26T10:33:44.695 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.695 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.695 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:44.695 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.664835+0000", 2024-04-26T10:33:44.695 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019277509999999999 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:74581 5.b 5:d2ffc38f:::benchmark_data_smithi043_45180_object74580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:44.660738+0000", 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00480737, 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0051269619999999997, 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:44.696 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 74581 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660738+0000", 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660738+0000", 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.697 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:44.698 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660737+0000", 2024-04-26T10:33:44.698 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.698 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.698 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.698 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:44.698 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660794+0000", 2024-04-26T10:33:44.698 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6749000000000002e-05 2024-04-26T10:33:44.698 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.698 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.698 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:44.698 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660809+0000", 2024-04-26T10:33:44.698 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5474000000000001e-05 2024-04-26T10:33:44.698 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660815+0000", 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.015e-06 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.662378+0000", 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015630869999999999 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.662501+0000", 2024-04-26T10:33:44.699 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012318799999999999 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.662651+0000", 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014923200000000001 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.664435+0000", 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017847239999999999 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.700 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:74582 5.8 5:1fae3d93:::benchmark_data_smithi043_45180_object74581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:44.660830+0000", 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0047148839999999999, 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0050774219999999998, 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 74582 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.701 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660830+0000", 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660830+0000", 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660829+0000", 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.702 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660914+0000", 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4361000000000001e-05 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660921+0000", 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5290000000000003e-06 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.660927+0000", 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6389999999999997e-06 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.703 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.661758+0000", 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00083105699999999995 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.661887+0000", 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012856799999999999 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.662019+0000", 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013274399999999999 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:44.704 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:44.705 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:44.705 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.663988+0000", 2024-04-26T10:33:44.705 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019684530000000002 2024-04-26T10:33:44.705 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.705 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:44.705 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.705 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:44.705 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:33:44.705 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 8 2024-04-26T10:33:44.705 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:44.706 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:44.705+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:44.707 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:44.807 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:44.806+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:44.907 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:44.906+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:44.918 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:44.918 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:33:44.918 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:33:44.918 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:33:44.918 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:44.932 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:45.009 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:45.008+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:45.109 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:45.108+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:45.142 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:45.142 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.338835935999999, 2024-04-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.143 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:33:45.144 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.144 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.144 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.144 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.144 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:45.144 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.144 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.144 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.144 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.144 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:45.144 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.144 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.144 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:33:45.145 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:33:45.146 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:33:45.147 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.148 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.338007856000001, 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.149 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.150 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.151 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:33:45.152 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:33:45.153 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.337078793, 2024-04-26T10:33:45.154 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.155 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.157 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.159 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.336393352000002, 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:33:45.160 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:33:45.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:33:45.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:33:45.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46220 5.0 5:0832587b:::benchmark_data_smithi043_45180_object46219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:45.165 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 13.081617852999999, 2024-04-26T10:33:45.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020289430000000001, 2024-04-26T10:33:45.166 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.166 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.166 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.166 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.166 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.166 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46220 2024-04-26T10:33:45.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.166 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:45.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057256+0000", 2024-04-26T10:33:45.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3852999999999999e-05 2024-04-26T10:33:45.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057265+0000", 2024-04-26T10:33:45.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8820000000000007e-06 2024-04-26T10:33:45.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057271+0000", 2024-04-26T10:33:45.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4049999999999999e-06 2024-04-26T10:33:45.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064370+0000", 2024-04-26T10:33:45.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0070992870000000001 2024-04-26T10:33:45.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064469+0000", 2024-04-26T10:33:45.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8818000000000002e-05 2024-04-26T10:33:45.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064555+0000", 2024-04-26T10:33:45.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6614999999999997e-05 2024-04-26T10:33:45.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070612+0000", 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0060566459999999997 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077392+0000", 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0067803630000000002 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077438+0000", 2024-04-26T10:33:45.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5265000000000001e-05 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077473+0000", 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4978999999999998e-05 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46224 5.0 5:055041a5:::benchmark_data_smithi043_45180_object46223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 13.081078182000001, 2024-04-26T10:33:45.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019911091999999998, 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46224 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057722+0000", 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057751+0000", 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9025000000000001e-05 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057758+0000", 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8360000000000003e-06 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057764+0000", 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3650000000000003e-06 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065640+0000", 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0078760259999999995 2024-04-26T10:33:45.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065735+0000", 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5358000000000004e-05 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065881+0000", 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000146155 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070622+0000", 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.004740874 2024-04-26T10:33:45.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077527+0000", 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0069053710000000004 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077589+0000", 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1779999999999995e-05 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077634+0000", 2024-04-26T10:33:45.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4861000000000003e-05 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46225 5.0 5:0c2c7e61:::benchmark_data_smithi043_45180_object46224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 13.08103288, 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019997917, 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.177 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46225 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057833+0000", 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5315999999999996e-05 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057840+0000", 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7220000000000002e-06 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057845+0000", 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1159999999999998e-06 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067208+0000", 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0093631259999999994 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067339+0000", 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013118900000000001 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067479+0000", 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013958800000000001 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070873+0000", 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0033947980000000001 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077696+0000", 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006822168 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077735+0000", 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9582999999999997e-05 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077766+0000", 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0882e-05 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.182 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46226 5.8 5:1735f934:::benchmark_data_smithi043_45180_object46225:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 13.080951603000001, 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019932222999999999, 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46226 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:45.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057904+0000", 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5458999999999999e-05 2024-04-26T10:33:45.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057911+0000", 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057917+0000", 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3899999999999998e-06 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067195+0000", 2024-04-26T10:33:45.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0092779960000000002 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067292+0000", 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6556000000000002e-05 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067399+0000", 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000107118 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.071325+0000", 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0039254729999999996 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077687+0000", 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006362337 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077749+0000", 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2365000000000003e-05 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077782+0000", 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2398999999999999e-05 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:48101 5.8 5:1cf22750:::benchmark_data_smithi043_45180_object48100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.817983+0000", 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.320818371, 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018899736, 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.188 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 48101 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.817983+0000", 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.817983+0000", 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.817982+0000", 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.818054+0000", 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2282999999999999e-05 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.818069+0000", 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4575e-05 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.818074+0000", 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5759999999999996e-06 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.824167+0000", 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0060931420000000002 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.824276+0000", 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000108838 2024-04-26T10:33:45.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.824417+0000", 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141173 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.826150+0000", 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00173237 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.836801+0000", 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010651331 2024-04-26T10:33:45.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.836843+0000", 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2259000000000003e-05 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.836882+0000", 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8979000000000001e-05 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.193 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:48295 5.a e23/16 5:5d08b1be:::benchmark_data_smithi043_45180_object48294:head v 23'3088, mlcod=23'3083)", 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.244321104999999, 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020188498999999999, 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894479+0000", 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894584+0000", 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000104863 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894594+0000", 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6760000000000002e-06 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894608+0000", 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4263e-05 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894687+0000", 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8311000000000003e-05 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894706+0000", 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9531999999999999e-05 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914628+0000", 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019922314 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914668+0000", 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0080999999999998e-05 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.197 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.198 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.198 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:48299 5.a e23/16 5:5776ea42:::benchmark_data_smithi043_45180_object48298:head v 23'3089, mlcod=23'3084)", 2024-04-26T10:33:45.198 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.896165+0000", 2024-04-26T10:33:45.198 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.242636527, 2024-04-26T10:33:45.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.01852943, 2024-04-26T10:33:45.198 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.198 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.198 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896165+0000", 2024-04-26T10:33:45.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896165+0000", 2024-04-26T10:33:45.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896164+0000", 2024-04-26T10:33:45.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:45.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896227+0000", 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3638000000000003e-05 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896239+0000", 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2041e-05 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896248+0000", 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4740000000000005e-06 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896297+0000", 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9376999999999998e-05 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.896317+0000", 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9681e-05 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914672+0000", 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018355346000000002 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914694+0000", 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1804999999999999e-05 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54079 5.0 5:0a7f1861:::benchmark_data_smithi043_45180_object54078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.7585011609999999, 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020388585000000001, 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.202 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54079 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:45.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380299+0000", 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380329+0000", 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190000000000001e-05 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380341+0000", 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1715999999999999e-05 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380349+0000", 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7209999999999994e-06 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387457+0000", 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0071078779999999998 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387586+0000", 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012915999999999999 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387724+0000", 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000138011 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.393120+0000", 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0053964089999999996 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400595+0000", 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0074747279999999999 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400651+0000", 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6026000000000002e-05 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400688+0000", 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7336000000000003e-05 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.207 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.208 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54642 5.e 5:7e60972f:::benchmark_data_smithi043_45180_object54641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:45.208 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:45.208 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.500919734, 2024-04-26T10:33:45.208 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019369872999999999, 2024-04-26T10:33:45.208 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.208 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.208 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.208 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.208 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.208 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54642 2024-04-26T10:33:45.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:45.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637907+0000", 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6261000000000001e-05 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637915+0000", 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1780000000000003e-06 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637920+0000", 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.169e-06 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.639652+0000", 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017314990000000001 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.639745+0000", 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3259999999999998e-05 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.639824+0000", 2024-04-26T10:33:45.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8869999999999995e-05 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.641052+0000", 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001227627 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.657185+0000", 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.016133406999999999 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.657222+0000", 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7119000000000002e-05 2024-04-26T10:33:45.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.657251+0000", 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9084000000000001e-05 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:56243 5.b 5:da4ab90e:::benchmark_data_smithi043_45180_object56242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.335494+0000", 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.8033074669999998, 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019609926999999999, 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.213 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 56243 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335494+0000", 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335494+0000", 2024-04-26T10:33:45.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335485+0000", 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999919 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335565+0000", 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9476999999999998e-05 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335571+0000", 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3319999999999997e-06 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335584+0000", 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2608e-05 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337185+0000", 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001601597 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337300+0000", 2024-04-26T10:33:45.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011501399999999999 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337429+0000", 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000128169 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.340189+0000", 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027599679999999998 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355018+0000", 2024-04-26T10:33:45.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014829241 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355063+0000", 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5472000000000001e-05 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355104+0000", 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0170000000000003e-05 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:56252 5.b 5:d96e4aa9:::benchmark_data_smithi043_45180_object56251:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.337366+0000", 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.8014349739999993, 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.017876882, 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 56252 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337366+0000", 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337366+0000", 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337365+0000", 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337425+0000", 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0074000000000001e-05 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337432+0000", 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.075e-06 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337437+0000", 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1780000000000002e-06 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.339049+0000", 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016119769999999999 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.339132+0000", 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3003999999999993e-05 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.339212+0000", 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9518000000000007e-05 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.340604+0000", 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001391916 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355154+0000", 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014550034999999999 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355204+0000", 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9801e-05 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355243+0000", 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9341999999999997e-05 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:56600 5.4 5:27249c2e:::benchmark_data_smithi043_45180_object56599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.494766+0000", 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.6440349550000004, 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018862449, 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.224 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 56600 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494766+0000", 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494766+0000", 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494765+0000", 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494862+0000", 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6921000000000003e-05 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494870+0000", 2024-04-26T10:33:45.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1289999999999996e-06 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494877+0000", 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9979999999999997e-06 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.496879+0000", 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020011669999999999 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.497019+0000", 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014009600000000001 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.497165+0000", 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014645700000000001 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.498902+0000", 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017363750000000001 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.513548+0000", 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014646484 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.513598+0000", 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0064e-05 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.513629+0000", 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0399000000000002e-05 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.229 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:65179 5.e 5:7b4354b2:::benchmark_data_smithi043_45180_object65178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.383735+0000", 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.755066469, 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018666315999999999, 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 65179 2024-04-26T10:33:45.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383735+0000", 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383735+0000", 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383734+0000", 2024-04-26T10:33:45.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383822+0000", 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7758999999999998e-05 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383829+0000", 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4240000000000004e-06 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383834+0000", 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4159999999999997e-06 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383858+0000", 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4817999999999999e-05 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383958+0000", 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.9922999999999999e-05 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.384041+0000", 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2230000000000004e-05 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.386399+0000", 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002358803 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.402349+0000", 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.015950054000000002 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.402378+0000", 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8804000000000001e-05 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.402401+0000", 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2663e-05 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.235 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:65241 5.4 5:27070447:::benchmark_data_smithi043_45180_object65240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.414586+0000", 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.7242149500000004, 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019748102, 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 65241 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414586+0000", 2024-04-26T10:33:45.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414586+0000", 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414585+0000", 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414702+0000", 2024-04-26T10:33:45.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000117125 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414711+0000", 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6929999999999996e-06 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414719+0000", 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.416649+0000", 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019300960000000001 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.416764+0000", 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000115611 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.416872+0000", 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000107243 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.418259+0000", 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001387288 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.434278+0000", 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.016018988000000001 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.434309+0000", 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0948000000000003e-05 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.434334+0000", 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.533e-05 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:74844 5.8 5:10a10c47:::benchmark_data_smithi043_45180_object74843:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:44.784687+0000", 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.35411356500000002, 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018016557999999998, 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.241 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 74844 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.784687+0000", 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.784687+0000", 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.784687+0000", 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.784814+0000", 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012725400000000001 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.784820+0000", 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9519999999999999e-06 2024-04-26T10:33:45.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.784824+0000", 2024-04-26T10:33:45.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.738e-06 2024-04-26T10:33:45.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.788694+0000", 2024-04-26T10:33:45.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0038701450000000002 2024-04-26T10:33:45.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.788833+0000", 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013902700000000001 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.788987+0000", 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015414899999999999 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.793925+0000", 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0049376480000000002 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.802599+0000", 2024-04-26T10:33:45.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0086737829999999991 2024-04-26T10:33:45.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.802644+0000", 2024-04-26T10:33:45.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4903e-05 2024-04-26T10:33:45.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.802704+0000", 2024-04-26T10:33:45.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0525000000000001e-05 2024-04-26T10:33:45.246 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.246 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:74848 5.8 5:1133781a:::benchmark_data_smithi043_45180_object74847:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:44.786246+0000", 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.35255513999999999, 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018613352999999999, 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 74848 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.247 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.786246+0000", 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.786246+0000", 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.786245+0000", 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.786339+0000", 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3969999999999996e-05 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.786349+0000", 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5310000000000007e-06 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.786355+0000", 2024-04-26T10:33:45.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3579999999999999e-06 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.791991+0000", 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0056360710000000003 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.792123+0000", 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013221500000000001 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:45.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.792273+0000", 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000149942 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.798002+0000", 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0057287900000000001 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.804740+0000", 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0067381189999999999 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:45.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.804803+0000", 2024-04-26T10:33:45.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3118000000000001e-05 2024-04-26T10:33:45.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:45.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:45.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:45.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:44.804859+0000", 2024-04-26T10:33:45.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5899999999999997e-05 2024-04-26T10:33:45.252 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.252 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.252 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.252 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:45.252 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:45.252 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:45.254 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:45.253+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:45.254 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:45.355 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:45.354+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:45.419 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-26T10:33:45.419 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 28 16 76212 76196 170.066 135.5 0.00554677 0.00587719 2024-04-26T10:33:45.441 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:45.441 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:45.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.441 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:76242 5.c 5:32c88ce2:::benchmark_data_smithi043_45180_object76241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:33:45.441 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:45.433673+0000", 2024-04-26T10:33:45.441 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.006115087, 2024-04-26T10:33:45.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0061345990000000001, 2024-04-26T10:33:45.441 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.441 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:45.441 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.441 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.442 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.442 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 76242 2024-04-26T10:33:45.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.442 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433673+0000", 2024-04-26T10:33:45.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433673+0000", 2024-04-26T10:33:45.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433672+0000", 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433747+0000", 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4844000000000004e-05 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433758+0000", 2024-04-26T10:33:45.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1096e-05 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433766+0000", 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6739999999999997e-06 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433811+0000", 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5414000000000003e-05 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433957+0000", 2024-04-26T10:33:45.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000146343 2024-04-26T10:33:45.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.434103+0000", 2024-04-26T10:33:45.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014540199999999999 2024-04-26T10:33:45.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.438094+0000", 2024-04-26T10:33:45.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039909710000000003 2024-04-26T10:33:45.445 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.445 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:76238 5.e e28/16 5:72ac0b86:::benchmark_data_smithi043_45180_object76237:head v 28'4744, mlcod=27'4739)", 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:45.435506+0000", 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0042820940000000002, 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043544109999999999, 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.435506+0000", 2024-04-26T10:33:45.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.435506+0000", 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.435505+0000", 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.435537+0000", 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1401e-05 2024-04-26T10:33:45.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.435551+0000", 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4003e-05 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.435557+0000", 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6259999999999997e-06 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437370+0000", 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018125750000000001 2024-04-26T10:33:45.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437387+0000", 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7567e-05 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:76244 5.c 5:3bcc3f84:::benchmark_data_smithi043_45180_object76243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:45.436151+0000", 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0036363720000000001, 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003746461, 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.449 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 76244 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.436151+0000", 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.436151+0000", 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.436150+0000", 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.436208+0000", 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7549000000000001e-05 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.436217+0000", 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0149999999999992e-06 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.436222+0000", 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3349999999999997e-06 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.436259+0000", 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7150999999999997e-05 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.436409+0000", 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014973100000000001 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.436566+0000", 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015664499999999999 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:76245 5.5 5:ad3e11b1:::benchmark_data_smithi043_45180_object76244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:45.437384+0000", 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0024034299999999998, 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025566199999999999, 2024-04-26T10:33:45.453 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.454 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:45.454 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.454 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.454 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.454 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 76245 2024-04-26T10:33:45.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.454 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437384+0000", 2024-04-26T10:33:45.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437384+0000", 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437383+0000", 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437409+0000", 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5788000000000001e-05 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437417+0000", 2024-04-26T10:33:45.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3429999999999996e-06 2024-04-26T10:33:45.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437425+0000", 2024-04-26T10:33:45.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9899999999999997e-06 2024-04-26T10:33:45.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437462+0000", 2024-04-26T10:33:45.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6996000000000003e-05 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437552+0000", 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9738e-05 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437642+0000", 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9381000000000004e-05 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:76243 5.e e28/16 5:729fe0fe:::benchmark_data_smithi043_45180_object76242:head v 28'4745, mlcod=27'4739)", 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:45.437443+0000", 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0023446510000000001, 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025392710000000001, 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437443+0000", 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437443+0000", 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437443+0000", 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437469+0000", 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6367999999999999e-05 2024-04-26T10:33:45.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437477+0000", 2024-04-26T10:33:45.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6369999999999999e-06 2024-04-26T10:33:45.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.437483+0000", 2024-04-26T10:33:45.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0050000000000001e-06 2024-04-26T10:33:45.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.439128+0000", 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016456039999999999 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.439142+0000", 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3838e-05 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:76246 5.2 e28/16 5:4c104af0:::benchmark_data_smithi043_45180_object76245:head v 28'4821, mlcod=27'4819)", 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:45.438178+0000", 2024-04-26T10:33:45.461 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0016097679999999999, 2024-04-26T10:33:45.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018459629999999999, 2024-04-26T10:33:45.462 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.462 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:45.462 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.438178+0000", 2024-04-26T10:33:45.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.438178+0000", 2024-04-26T10:33:45.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.438177+0000", 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.438241+0000", 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3375999999999998e-05 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.438249+0000", 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2320000000000001e-06 2024-04-26T10:33:45.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.438253+0000", 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3919999999999996e-06 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.438289+0000", 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5955999999999999e-05 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.438309+0000", 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9434999999999999e-05 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.464 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:76234 5.5 5:abeba3d7:::benchmark_data_smithi043_45180_object76233:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:45.430820+0000", 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0089680620000000006, 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0092406550000000004, 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 76234 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.465 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.430820+0000", 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.430820+0000", 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.430819+0000", 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.430851+0000", 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2197999999999999e-05 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.430861+0000", 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6229999999999992e-06 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.430867+0000", 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4119999999999998e-06 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.430911+0000", 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4135999999999999e-05 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.431033+0000", 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121947 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.431368+0000", 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033494999999999998 2024-04-26T10:33:45.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.436173+0000", 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0048050999999999996 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:76229 5.e e28/16 5:7f6df3e7:::benchmark_data_smithi043_45180_object76228:head v 28'4742, mlcod=27'4739)", 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:45.430950+0000", 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0088375740000000008, 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0091554459999999994, 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.469 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:45.470 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.430950+0000", 2024-04-26T10:33:45.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.430950+0000", 2024-04-26T10:33:45.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.430950+0000", 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.430971+0000", 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1348e-05 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.430988+0000", 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6441000000000001e-05 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.430992+0000", 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5959999999999997e-06 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433021+0000", 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002028803 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433042+0000", 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1141e-05 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:76237 5.3 5:caa40bc0:::benchmark_data_smithi043_45180_object76236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:45.432756+0000", 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.007032221, 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007385155, 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 76237 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432756+0000", 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432756+0000", 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432754+0000", 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:45.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432875+0000", 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000120415 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432890+0000", 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.501e-05 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432906+0000", 2024-04-26T10:33:45.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6285000000000001e-05 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432947+0000", 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0425e-05 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433101+0000", 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000154883 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433241+0000", 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013978499999999999 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.436454+0000", 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032128539999999998 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:76236 5.e e28/16 5:7d1e8bce:::benchmark_data_smithi043_45180_object76235:head v 28'4743, mlcod=27'4739)", 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:45.432850+0000", 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0069378549999999997, 2024-04-26T10:33:45.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073338500000000003, 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432850+0000", 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432850+0000", 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432849+0000", 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432946+0000", 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6862999999999997e-05 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432957+0000", 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0669000000000001e-05 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432964+0000", 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7220000000000002e-06 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.435593+0000", 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026292120000000001 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.435615+0000", 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2075000000000001e-05 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.480 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:76239 5.5 5:a724313b:::benchmark_data_smithi043_45180_object76238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:45.432994+0000", 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0067940869999999999, 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0072254490000000001, 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 76239 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432994+0000", 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432994+0000", 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.432993+0000", 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:45.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433064+0000", 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0789000000000003e-05 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433074+0000", 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7070000000000004e-06 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433080+0000", 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9260000000000003e-06 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433832+0000", 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00075172900000000003 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.433995+0000", 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000162802 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.434143+0000", 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000148276 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:45.436181+0000", 2024-04-26T10:33:45.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020375219999999999 2024-04-26T10:33:45.485 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.485 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.485 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.485 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.485 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:33:45.485 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 11 2024-04-26T10:33:45.485 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:45.486 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:45.485+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:45.487 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:45.587 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:45.587+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:45.673 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:45.673 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:33:45.673 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:33:45.673 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:33:45.673 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:45.689 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:45.689 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:45.688+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:45.790 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:45.789+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:45.885 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:33:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:33:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.081415497999998, 2024-04-26T10:33:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:33:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:33:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:45.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:33:45.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:45.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:33:45.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:33:45.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.081414512999999, 2024-04-26T10:33:45.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.892 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:45.895 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.081345890000001, 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:33:45.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:33:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:33:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:33:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:33:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.081294110000002, 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:33:45.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.902 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:45.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:45.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:33:45.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:33:45.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:33:45.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:33:45.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:33:45.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.906 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.081234259999999, 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:33:45.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.079521556, 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:33:45.912 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:33:45.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:33:45.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.079406489, 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:33:45.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:33:45.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:33:45.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:33:45.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:33:45.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.079313349, 2024-04-26T10:33:45.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:33:45.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:33:45.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:33:45.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:33:45.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:33:45.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.079119189, 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:33:45.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:33:45.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:33:45.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:33:45.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:33:45.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.077911821000001, 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:33:45.932 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.933 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:45.933 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:45.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:45.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:33:45.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:33:45.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:33:45.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:45.936 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.077102913000001, 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:45.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:33:45.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:33:45.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:33:45.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:33:45.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:33:45.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:33:45.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:33:45.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:33:45.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:33:45.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:33:45.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.076999375, 2024-04-26T10:33:45.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:45.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:33:45.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:33:45.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:33:45.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:33:45.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:33:45.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:33:45.948 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.948 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.948 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.948 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:45.948 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:45.948 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.076922501999999, 2024-04-26T10:33:45.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:33:45.948 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.948 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.948 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.949 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.949 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.949 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:33:45.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.949 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:45.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:33:45.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:33:45.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.076807118000001, 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:33:45.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:33:45.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:33:45.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:33:45.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:48295 5.a 5:5d08b1be:::benchmark_data_smithi043_45180_object48294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.987945925, 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020783243999999999, 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.958 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.959 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.959 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 48295 2024-04-26T10:33:45.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.959 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:45.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:45.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894137+0000", 2024-04-26T10:33:45.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:45.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894198+0000", 2024-04-26T10:33:45.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0192999999999998e-05 2024-04-26T10:33:45.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894209+0000", 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1486e-05 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894217+0000", 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1370000000000002e-06 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894251+0000", 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3636000000000001e-05 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894361+0000", 2024-04-26T10:33:45.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010988 2024-04-26T10:33:45.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:45.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894441+0000", 2024-04-26T10:33:45.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0549000000000004e-05 2024-04-26T10:33:45.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.897398+0000", 2024-04-26T10:33:45.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002956232 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914869+0000", 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017471582999999999 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914901+0000", 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1578999999999997e-05 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914922+0000", 2024-04-26T10:33:45.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0965999999999999e-05 2024-04-26T10:33:45.966 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.966 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.966 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.966 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:48299 5.a 5:5776ea42:::benchmark_data_smithi043_45180_object48298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:45.966 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:45.966 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.987250124999999, 2024-04-26T10:33:45.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020205178000000001, 2024-04-26T10:33:45.966 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.966 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.966 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.967 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.967 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.967 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 48299 2024-04-26T10:33:45.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.967 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:45.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894907+0000", 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3622999999999996e-05 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894914+0000", 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894918+0000", 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8e-06 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.895863+0000", 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00094444799999999997 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.895976+0000", 2024-04-26T10:33:45.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000113736 2024-04-26T10:33:45.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:45.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.896101+0000", 2024-04-26T10:33:45.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012477699999999999 2024-04-26T10:33:45.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.899956+0000", 2024-04-26T10:33:45.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038552539999999998 2024-04-26T10:33:45.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914959+0000", 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015002991 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.915007+0000", 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7404999999999998e-05 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.915039+0000", 2024-04-26T10:33:45.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2750000000000003e-05 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:56249 5.3 5:cd0b6957:::benchmark_data_smithi043_45180_object56248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.5464063199999991, 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019358055999999998, 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.972 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 56249 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:45.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335801+0000", 2024-04-26T10:33:45.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012364900000000001 2024-04-26T10:33:45.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335808+0000", 2024-04-26T10:33:45.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:33:45.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335813+0000", 2024-04-26T10:33:45.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3650000000000003e-06 2024-04-26T10:33:45.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.343739+0000", 2024-04-26T10:33:45.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079259840000000005 2024-04-26T10:33:45.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.343846+0000", 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010697200000000001 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.343977+0000", 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000131283 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349555+0000", 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055777860000000004 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.354963+0000", 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054082599999999998 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355004+0000", 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0203000000000001e-05 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355036+0000", 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2434999999999997e-05 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.978 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:56250 5.3 5:c16df6d5:::benchmark_data_smithi043_45180_object56249:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:45.978 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:45.978 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.5462654399999991, 2024-04-26T10:33:45.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019349841, 2024-04-26T10:33:45.978 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.978 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.978 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.978 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.978 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.978 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 56250 2024-04-26T10:33:45.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.978 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335906+0000", 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7474999999999999e-05 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335912+0000", 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2539999999999998e-06 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335918+0000", 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3430000000000003e-06 2024-04-26T10:33:45.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349571+0000", 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013653367 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349677+0000", 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105791 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349768+0000", 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1037000000000003e-05 2024-04-26T10:33:45.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.354950+0000", 2024-04-26T10:33:45.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051823199999999998 2024-04-26T10:33:45.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355103+0000", 2024-04-26T10:33:45.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015317299999999999 2024-04-26T10:33:45.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355140+0000", 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7088000000000001e-05 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355169+0000", 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8407000000000001e-05 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:58496 5.a 5:5a7e82ac:::benchmark_data_smithi043_45180_object58495:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:37.329970+0000", 2024-04-26T10:33:45.983 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.5521146229999996, 2024-04-26T10:33:45.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019239415999999999, 2024-04-26T10:33:45.984 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.984 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.984 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.984 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.984 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.984 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 58496 2024-04-26T10:33:45.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.984 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.329970+0000", 2024-04-26T10:33:45.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.329970+0000", 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.329969+0000", 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.330018+0000", 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8959999999999999e-05 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.330025+0000", 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2269999999999996e-06 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.330029+0000", 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8539999999999999e-06 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.335555+0000", 2024-04-26T10:33:45.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055257910000000004 2024-04-26T10:33:45.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.335721+0000", 2024-04-26T10:33:45.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016615099999999999 2024-04-26T10:33:45.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:45.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.335860+0000", 2024-04-26T10:33:45.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138913 2024-04-26T10:33:45.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.342727+0000", 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068670950000000001 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.349128+0000", 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064010869999999997 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.349172+0000", 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3297999999999998e-05 2024-04-26T10:33:45.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.349209+0000", 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7540000000000003e-05 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:58511 5.a 5:5da7faca:::benchmark_data_smithi043_45180_object58510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.5432659429999998, 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019708499000000001, 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:45.989 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 58511 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:45.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338844+0000", 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:45.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338851+0000", 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2219999999999999e-06 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338855+0000", 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8289999999999998e-06 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.346946+0000", 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080906450000000005 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:45.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.347081+0000", 2024-04-26T10:33:45.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013469299999999999 2024-04-26T10:33:45.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:45.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.347225+0000", 2024-04-26T10:33:45.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000144704 2024-04-26T10:33:45.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:45.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.351702+0000", 2024-04-26T10:33:45.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044762930000000001 2024-04-26T10:33:45.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.358426+0000", 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067239170000000003 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.358482+0000", 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6889999999999999e-05 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.358527+0000", 2024-04-26T10:33:45.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4465999999999997e-05 2024-04-26T10:33:45.995 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.995 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.995 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.995 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:45.995 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:45.995 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:45.996 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:45.995+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:45.997 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:46.016 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:33:46.097 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:46.095+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:46.168 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:46.169 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:46.169 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:46.183 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:46.188 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:46.197 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:46.197+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:46.208 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:46.209 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:46.210 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:46.210 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:46.298 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:46.297+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:46.356 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:46.356 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:46.371 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:46.400 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:46.398+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:46.419 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 29 16 78376 78360 168.865 135.25 0.0121681 0.00591876 2024-04-26T10:33:46.501 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:46.500+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:46.584 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:46.585 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:46.597 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:46.604 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:46.601+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:46.702 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:46.701+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:46.766 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:46.766 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:46.782 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:46.803 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:46.802+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:46.904 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:46.903+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:46.956 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:46.957 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:46.972 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:47.005 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:47.004+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:47.108 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:47.107+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:47.182 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:47.182 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:47.195 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:47.239 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:47.238+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:47.307 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:47.306+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:47.378 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:47.378 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:47.395 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:47.420 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 30 16 80553 80537 167.771 136.062 0.00956594 0.00595754 2024-04-26T10:33:47.431 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:33:47.436 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:47.435+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:47.510 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:47.509+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:47.610 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:47.609+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:47.622 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:47.622 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:47.638 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:47.724 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:47.723+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:47.812 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:47.811+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:47.862 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:47.863 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:47.878 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:47.922 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:47.921+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:48.013 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:48.012+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:48.050 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:48.050 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:48.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:48.147 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:48.147+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:48.215 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:48.214+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:48.222 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:33:48.274 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:48.274 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:48.287 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:48.316 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:48.315+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:48.374 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:48.394 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:48.415 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:48.416 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:48.417 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:48.417 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:48.418 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:48.416+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:48.419 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 31 16 82695 82679 166.678 133.875 0.00833688 0.00599667 2024-04-26T10:33:48.422 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-26T10:33:48.496 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:33:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:33:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.496 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 56.499435898999998, 2024-04-26T10:33:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017960028999999999, 2024-04-26T10:33:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993793+0000", 2024-04-26T10:33:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993792+0000", 2024-04-26T10:33:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993800+0000", 2024-04-26T10:33:48.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0900000000000005e-06 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993805+0000", 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9919999999999998e-06 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993809+0000", 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.703e-06 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012428800000000001 2024-04-26T10:33:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993937+0000", 2024-04-26T10:33:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0010000000000003e-06 2024-04-26T10:33:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006732+0000", 2024-04-26T10:33:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012794972 2024-04-26T10:33:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.006890+0000", 2024-04-26T10:33:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015741999999999999 2024-04-26T10:33:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007049+0000", 2024-04-26T10:33:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159872 2024-04-26T10:33:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011426+0000", 2024-04-26T10:33:48.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043764370000000004 2024-04-26T10:33:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011667+0000", 2024-04-26T10:33:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024095400000000001 2024-04-26T10:33:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011712+0000", 2024-04-26T10:33:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4752000000000001e-05 2024-04-26T10:33:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011753+0000", 2024-04-26T10:33:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0995999999999998e-05 2024-04-26T10:33:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 56.499369610000002, 2024-04-26T10:33:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018053829, 2024-04-26T10:33:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.503 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993859+0000", 2024-04-26T10:33:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993861+0000", 2024-04-26T10:33:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4990000000000001e-06 2024-04-26T10:33:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993868+0000", 2024-04-26T10:33:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7190000000000004e-06 2024-04-26T10:33:48.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993873+0000", 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0200000000000002e-06 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993968+0000", 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5310999999999996e-05 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993974+0000", 2024-04-26T10:33:48.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008004+0000", 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014029700000000001 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008126+0000", 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122087 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:48.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008229+0000", 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102358 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011613+0000", 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033843279999999998 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011812+0000", 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000198798 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011871+0000", 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9283000000000001e-05 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011913+0000", 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1798000000000002e-05 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:48.509 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 56.499339562999999, 2024-04-26T10:33:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018338483999999999, 2024-04-26T10:33:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:48.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993889+0000", 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993892+0000", 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.546e-06 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993899+0000", 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993906+0000", 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9820000000000002e-06 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994023+0000", 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116766 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:48.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994028+0000", 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7079999999999996e-06 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008784+0000", 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014756833 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008838+0000", 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3112000000000002e-05 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008957+0000", 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119523 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011618+0000", 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026610330000000001 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012154+0000", 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00053582800000000002 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012193+0000", 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9047000000000001e-05 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012227+0000", 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4442e-05 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:13 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:48.515 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 56.499297325000001, 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018412833, 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993931+0000", 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993933+0000", 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6139999999999999e-06 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993939+0000", 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3279999999999996e-06 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993949+0000", 2024-04-26T10:33:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.047e-05 2024-04-26T10:33:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994066+0000", 2024-04-26T10:33:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116952 2024-04-26T10:33:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994071+0000", 2024-04-26T10:33:48.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869999999999996e-06 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009196+0000", 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015125148 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009272+0000", 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5440999999999998e-05 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009381+0000", 2024-04-26T10:33:48.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010946399999999999 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012090+0000", 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027090700000000001 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012271+0000", 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018098699999999999 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012312+0000", 2024-04-26T10:33:48.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0286e-05 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2276000000000001e-05 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:15 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 56.499236545999999, 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018433715, 2024-04-26T10:33:48.521 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993992+0000", 2024-04-26T10:33:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.993995+0000", 2024-04-26T10:33:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.225e-06 2024-04-26T10:33:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994001+0000", 2024-04-26T10:33:48.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0619999999999997e-06 2024-04-26T10:33:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994004+0000", 2024-04-26T10:33:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.422e-06 2024-04-26T10:33:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994157+0000", 2024-04-26T10:33:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015285 2024-04-26T10:33:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994162+0000", 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1449999999999999e-06 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009937+0000", 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015774455 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010028+0000", 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0746000000000002e-05 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010174+0000", 2024-04-26T10:33:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146682 2024-04-26T10:33:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012358+0000", 2024-04-26T10:33:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021837900000000001 2024-04-26T10:33:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012382+0000", 2024-04-26T10:33:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3768e-05 2024-04-26T10:33:48.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012406+0000", 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4006999999999999e-05 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012426+0000", 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9896000000000001e-05 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.527 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:16 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 56.499213150999999, 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020879298000000001, 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994017+0000", 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1459999999999999e-06 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994021+0000", 2024-04-26T10:33:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2169999999999996e-06 2024-04-26T10:33:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994025+0000", 2024-04-26T10:33:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3450000000000002e-06 2024-04-26T10:33:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996368+0000", 2024-04-26T10:33:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002342841 2024-04-26T10:33:48.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996374+0000", 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6590000000000001e-06 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010589+0000", 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014214648999999999 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010670+0000", 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1463000000000003e-05 2024-04-26T10:33:48.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010824+0000", 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000154007 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.013067+0000", 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022428629999999999 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014821+0000", 2024-04-26T10:33:48.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017534530000000001 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014860+0000", 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9264000000000002e-05 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014895+0000", 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4619999999999997e-05 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:19 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 56.499199642000001, 2024-04-26T10:33:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018265699, 2024-04-26T10:33:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994029+0000", 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994031+0000", 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9980000000000002e-06 2024-04-26T10:33:48.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994037+0000", 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0100000000000001e-06 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994043+0000", 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1500000000000004e-06 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994085+0000", 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2354000000000001e-05 2024-04-26T10:33:48.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-04-26T10:33:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994095+0000", 2024-04-26T10:33:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8749999999999995e-06 2024-04-26T10:33:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008664+0000", 2024-04-26T10:33:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01456942 2024-04-26T10:33:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008786+0000", 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121735 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008948+0000", 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016180400000000001 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010761+0000", 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018125120000000001 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012205+0000", 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014441040000000001 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012256+0000", 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1817999999999998e-05 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012295+0000", 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8142000000000002e-05 2024-04-26T10:33:48.539 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 56.499150567000001, 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018349608999999999, 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994078+0000", 2024-04-26T10:33:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994081+0000", 2024-04-26T10:33:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0589999999999998e-06 2024-04-26T10:33:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994086+0000", 2024-04-26T10:33:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1900000000000003e-06 2024-04-26T10:33:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994090+0000", 2024-04-26T10:33:48.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.771e-06 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994139+0000", 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9737999999999997e-05 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994145+0000", 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2460000000000003e-06 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009213+0000", 2024-04-26T10:33:48.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015068834 2024-04-26T10:33:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009263+0000", 2024-04-26T10:33:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9991999999999998e-05 2024-04-26T10:33:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009347+0000", 2024-04-26T10:33:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3997000000000002e-05 2024-04-26T10:33:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012307+0000", 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029601229999999998 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012344+0000", 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6470000000000001e-05 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012390+0000", 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5893000000000003e-05 2024-04-26T10:33:48.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012428+0000", 2024-04-26T10:33:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7721e-05 2024-04-26T10:33:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 56.498991023000002, 2024-04-26T10:33:48.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01805445, 2024-04-26T10:33:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994237+0000", 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994240+0000", 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4920000000000002e-06 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994249+0000", 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4810000000000006e-06 2024-04-26T10:33:48.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994254+0000", 2024-04-26T10:33:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3839999999999996e-06 2024-04-26T10:33:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996056+0000", 2024-04-26T10:33:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018018839999999999 2024-04-26T10:33:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:48.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996061+0000", 2024-04-26T10:33:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8690000000000003e-06 2024-04-26T10:33:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008974+0000", 2024-04-26T10:33:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012913127 2024-04-26T10:33:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009078+0000", 2024-04-26T10:33:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010333899999999999 2024-04-26T10:33:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.009193+0000", 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011555100000000001 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.011374+0000", 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002180642 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012202+0000", 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00082862099999999998 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012254+0000", 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1498000000000001e-05 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012292+0000", 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8071999999999997e-05 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.552 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 56.498927967, 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017896868, 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994301+0000", 2024-04-26T10:33:48.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994300+0000", 2024-04-26T10:33:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994303+0000", 2024-04-26T10:33:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.145e-06 2024-04-26T10:33:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994310+0000", 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.345e-06 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994317+0000", 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9e-06 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997746+0000", 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034290190000000002 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.997753+0000", 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2999999999999998e-06 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.007898+0000", 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010145207 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.008073+0000", 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017543800000000001 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.012197+0000", 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041240950000000004 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17792 5.1 5:8c0814d7:::benchmark_data_smithi043_45180_object17791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.781438868999999, 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017771348999999999, 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.557 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17792 2024-04-26T10:33:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711790+0000", 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711789+0000", 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711901+0000", 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011175600000000001 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711907+0000", 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3049999999999998e-06 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711911+0000", 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0069999999999999e-06 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.711940+0000", 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9088999999999999e-05 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712019+0000", 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9134000000000005e-05 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.712105+0000", 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5932000000000003e-05 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713135+0000", 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010300610000000001 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729505+0000", 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016369775999999999 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729539+0000", 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4093e-05 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.729561+0000", 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1797000000000002e-05 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.562 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:17797 5.1 5:89b74c1f:::benchmark_data_smithi043_45180_object17796:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.779558823999999, 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018126438000000002, 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 17797 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.563 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713670+0000", 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713669+0000", 2024-04-26T10:33:48.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713706+0000", 2024-04-26T10:33:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6415000000000003e-05 2024-04-26T10:33:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713711+0000", 2024-04-26T10:33:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2140000000000004e-06 2024-04-26T10:33:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.713715+0000", 2024-04-26T10:33:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2599999999999999e-06 2024-04-26T10:33:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714380+0000", 2024-04-26T10:33:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066529399999999998 2024-04-26T10:33:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714509+0000", 2024-04-26T10:33:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012870500000000001 2024-04-26T10:33:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.714643+0000", 2024-04-26T10:33:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013370600000000001 2024-04-26T10:33:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.719195+0000", 2024-04-26T10:33:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045520430000000004 2024-04-26T10:33:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731718+0000", 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012523276999999999 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731776+0000", 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7701000000000002e-05 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:21.731796+0000", 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0398999999999999e-05 2024-04-26T10:33:48.568 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.693118025, 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.569 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:33:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:33:48.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:33:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:33:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:33:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:33:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:33:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:33:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:33:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:33:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:33:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:33:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.574 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:54323 5.2 5:4d58cd13:::benchmark_data_smithi043_45180_object54322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.004406503, 2024-04-26T10:33:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020404963000000002, 2024-04-26T10:33:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.575 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54323 2024-04-26T10:33:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488822+0000", 2024-04-26T10:33:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488886+0000", 2024-04-26T10:33:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4800000000000003e-05 2024-04-26T10:33:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488898+0000", 2024-04-26T10:33:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1567e-05 2024-04-26T10:33:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488905+0000", 2024-04-26T10:33:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4529999999999996e-06 2024-04-26T10:33:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.491748+0000", 2024-04-26T10:33:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002842528 2024-04-26T10:33:48.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.491858+0000", 2024-04-26T10:33:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109716 2024-04-26T10:33:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.492007+0000", 2024-04-26T10:33:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000149529 2024-04-26T10:33:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.494891+0000", 2024-04-26T10:33:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002883301 2024-04-26T10:33:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509167+0000", 2024-04-26T10:33:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014276494000000001 2024-04-26T10:33:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509200+0000", 2024-04-26T10:33:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3229999999999999e-05 2024-04-26T10:33:48.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509227+0000", 2024-04-26T10:33:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6709000000000001e-05 2024-04-26T10:33:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:54326 5.2 5:45ded667:::benchmark_data_smithi043_45180_object54325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:35.488913+0000", 2024-04-26T10:33:48.581 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.004315357999999, 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020409051000000001, 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 54326 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488913+0000", 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488913+0000", 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488912+0000", 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488939+0000", 2024-04-26T10:33:48.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6954999999999999e-05 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488946+0000", 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1709999999999996e-06 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.488952+0000", 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.493460+0000", 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045077529999999998 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.493593+0000", 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133681 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.493751+0000", 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000157107 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.495206+0000", 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001455256 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509263+0000", 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014056788000000001 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509292+0000", 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9467000000000001e-05 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:35.509322+0000", 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0176999999999999e-05 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:64811 5.1 5:8ff98dac:::benchmark_data_smithi043_45180_object64810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:40.215016+0000", 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.2782129789999992, 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018673387, 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 64811 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215016+0000", 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215016+0000", 2024-04-26T10:33:48.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215015+0000", 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215097+0000", 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2636e-05 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215107+0000", 2024-04-26T10:33:48.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6809999999999993e-06 2024-04-26T10:33:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215113+0000", 2024-04-26T10:33:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7540000000000003e-06 2024-04-26T10:33:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215142+0000", 2024-04-26T10:33:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.923e-05 2024-04-26T10:33:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215222+0000", 2024-04-26T10:33:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0269e-05 2024-04-26T10:33:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.215303+0000", 2024-04-26T10:33:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1310000000000006e-05 2024-04-26T10:33:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.219003+0000", 2024-04-26T10:33:48.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036998809999999999 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.233590+0000", 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014587009999999999 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.233651+0000", 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1047e-05 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:40.233689+0000", 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7489e-05 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:73477 5.7 5:ea73eb55:::benchmark_data_smithi043_45180_object73476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:44.160203+0000", 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3330259919999996, 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018745083999999999, 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:48.593 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 73477 2024-04-26T10:33:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160203+0000", 2024-04-26T10:33:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160203+0000", 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160202+0000", 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160257+0000", 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4514e-05 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160261+0000", 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9609999999999996e-06 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160265+0000", 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6500000000000002e-06 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.164471+0000", 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042059130000000004 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.164604+0000", 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013298499999999999 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.164988+0000", 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000383886 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.167738+0000", 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027496959999999998 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.178858+0000", 2024-04-26T10:33:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011120365 2024-04-26T10:33:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.178910+0000", 2024-04-26T10:33:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2157000000000002e-05 2024-04-26T10:33:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.178948+0000", 2024-04-26T10:33:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7469000000000003e-05 2024-04-26T10:33:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:73479 5.7 5:ef2d76e7:::benchmark_data_smithi043_45180_object73478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:44.160420+0000", 2024-04-26T10:33:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3328085700000001, 2024-04-26T10:33:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020414346, 2024-04-26T10:33:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.599 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 73479 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160420+0000", 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160420+0000", 2024-04-26T10:33:48.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160419+0000", 2024-04-26T10:33:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160475+0000", 2024-04-26T10:33:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5720000000000002e-05 2024-04-26T10:33:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160482+0000", 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5080000000000002e-06 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.160485+0000", 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8539999999999999e-06 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.167768+0000", 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072829410000000002 2024-04-26T10:33:48.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.167889+0000", 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120942 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.168045+0000", 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015601100000000001 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.176045+0000", 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0079993059999999994 2024-04-26T10:33:48.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180764+0000", 2024-04-26T10:33:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047188710000000003 2024-04-26T10:33:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180800+0000", 2024-04-26T10:33:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6335999999999999e-05 2024-04-26T10:33:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180834+0000", 2024-04-26T10:33:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4418999999999997e-05 2024-04-26T10:33:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:73481 5.f 5:f72f726e:::benchmark_data_smithi043_45180_object73480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:44.161462+0000", 2024-04-26T10:33:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3317666109999999, 2024-04-26T10:33:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019291239000000002, 2024-04-26T10:33:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.605 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 73481 2024-04-26T10:33:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161462+0000", 2024-04-26T10:33:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161462+0000", 2024-04-26T10:33:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161461+0000", 2024-04-26T10:33:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161597+0000", 2024-04-26T10:33:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013634000000000001 2024-04-26T10:33:48.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161606+0000", 2024-04-26T10:33:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6379999999999993e-06 2024-04-26T10:33:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161613+0000", 2024-04-26T10:33:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9759999999999998e-06 2024-04-26T10:33:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.167761+0000", 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.006147881 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.167889+0000", 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012838899999999999 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.168045+0000", 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015611499999999999 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.176027+0000", 2024-04-26T10:33:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0079817120000000002 2024-04-26T10:33:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180670+0000", 2024-04-26T10:33:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046424639999999998 2024-04-26T10:33:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180703+0000", 2024-04-26T10:33:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3432000000000001e-05 2024-04-26T10:33:48.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180753+0000", 2024-04-26T10:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0178e-05 2024-04-26T10:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:73483 5.7 5:e357b8e4:::benchmark_data_smithi043_45180_object73482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:48.611 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:44.161952+0000", 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.331276398, 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018943887999999999, 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 73483 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161952+0000", 2024-04-26T10:33:48.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161952+0000", 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.161952+0000", 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.162113+0000", 2024-04-26T10:33:48.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000161154 2024-04-26T10:33:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.162128+0000", 2024-04-26T10:33:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4799e-05 2024-04-26T10:33:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.162136+0000", 2024-04-26T10:33:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6710000000000005e-06 2024-04-26T10:33:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.169755+0000", 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076185030000000004 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.169854+0000", 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8963999999999996e-05 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.169946+0000", 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2731000000000004e-05 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.176074+0000", 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061272599999999998 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180840+0000", 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047667250000000003 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180865+0000", 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4905999999999998e-05 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:44.180896+0000", 2024-04-26T10:33:48.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0734000000000001e-05 2024-04-26T10:33:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:48.617 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:48.617 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:48.618 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:48.617+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:48.619 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:48.719 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:48.719+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:48.792 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:48.792 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:48.792 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.792 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:83494 5.0 5:063aa65e:::benchmark_data_smithi043_45180_object83493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:48.792 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.782986+0000", 2024-04-26T10:33:48.792 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.007639463, 2024-04-26T10:33:48.792 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0076597970000000003, 2024-04-26T10:33:48.792 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 83494 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.782986+0000", 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:48.793 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.782986+0000", 2024-04-26T10:33:48.794 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.794 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.794 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.794 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:48.794 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.782985+0000", 2024-04-26T10:33:48.794 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:48.794 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.794 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.794 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:48.794 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.783047+0000", 2024-04-26T10:33:48.794 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2325999999999999e-05 2024-04-26T10:33:48.794 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.794 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.783059+0000", 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1562e-05 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.783066+0000", 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2219999999999996e-06 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785707+0000", 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0026414199999999998 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.795 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785830+0000", 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012275799999999999 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785979+0000", 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000148589 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.790184+0000", 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0042056819999999996 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.796 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:83497 5.4 5:26fda3fc:::benchmark_data_smithi043_45180_object83496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.784271+0000", 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0063548040000000004, 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0064349259999999997, 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 83497 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.797 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:48.798 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.798 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:48.798 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784271+0000", 2024-04-26T10:33:48.798 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.798 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.798 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.798 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:48.798 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784271+0000", 2024-04-26T10:33:48.798 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.798 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.798 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.798 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:48.798 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784270+0000", 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784335+0000", 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4808999999999996e-05 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784343+0000", 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7779999999999996e-06 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784351+0000", 2024-04-26T10:33:48.799 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1709999999999996e-06 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784389+0000", 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7892999999999998e-05 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784490+0000", 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000101594 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784591+0000", 2024-04-26T10:33:48.800 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010111300000000001 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:83498 5.4 5:2a6b8322:::benchmark_data_smithi043_45180_object83497:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.784360+0000", 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0062652239999999998, 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0063931079999999998, 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.801 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 83498 2024-04-26T10:33:48.802 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.802 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:48.802 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.802 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:48.802 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784360+0000", 2024-04-26T10:33:48.802 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.802 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.802 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.802 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:48.802 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784360+0000", 2024-04-26T10:33:48.802 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.802 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.802 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784360+0000", 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784396+0000", 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6421000000000002e-05 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784401+0000", 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.271e-06 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.803 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784405+0000", 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7780000000000001e-06 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786485+0000", 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020796339999999999 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786598+0000", 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000113651 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.804 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786734+0000", 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013544499999999999 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:83496 5.a e29/16 5:5acdd973:::benchmark_data_smithi043_45180_object83495:head v 29'5311, mlcod=29'5308)", 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.784622+0000", 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0060033939999999996, 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0061982340000000004, 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:48.805 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.806 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:48.806 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784622+0000", 2024-04-26T10:33:48.806 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.806 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.806 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.806 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:48.806 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784622+0000", 2024-04-26T10:33:48.806 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.806 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.806 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.806 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:48.806 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784621+0000", 2024-04-26T10:33:48.806 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784673+0000", 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1947999999999998e-05 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784683+0000", 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3759999999999997e-06 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.807 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.784688+0000", 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9840000000000001e-06 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786374+0000", 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016867679999999999 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786393+0000", 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.8114e-05 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.808 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:83500 5.0 5:0ec4ff1f:::benchmark_data_smithi043_45180_object83499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.785626+0000", 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.004999051, 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052336209999999999, 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 83500 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:48.809 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785626+0000", 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785626+0000", 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785626+0000", 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.810 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785736+0000", 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000109944 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785743+0000", 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5580000000000003e-06 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785750+0000", 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1350000000000003e-06 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787945+0000", 2024-04-26T10:33:48.811 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0021950099999999998 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.788056+0000", 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000110178 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.788196+0000", 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014018900000000001 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.812 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:83503 5.4 5:2b1cd511:::benchmark_data_smithi043_45180_object83502:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.785826+0000", 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0047990730000000001, 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0050770679999999997, 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 83503 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:48.813 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785826+0000", 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785826+0000", 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785826+0000", 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.814 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785917+0000", 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.1497999999999997e-05 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785922+0000", 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7639999999999996e-06 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.785926+0000", 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1609999999999996e-06 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.815 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.790003+0000", 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0040767850000000003 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.790224+0000", 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00022081299999999999 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.790379+0000", 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015473799999999999 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.816 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:83502 5.9 e29/16 5:9bde8f90:::benchmark_data_smithi043_45180_object83501:head v 29'5180, mlcod=29'5178)", 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.786206+0000", 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0044197459999999996, 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0047378619999999998, 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786206+0000", 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.817 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786206+0000", 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786205+0000", 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786275+0000", 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9379000000000001e-05 2024-04-26T10:33:48.818 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786281+0000", 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786285+0000", 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520000000000002e-06 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786318+0000", 2024-04-26T10:33:48.819 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3334000000000003e-05 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786342+0000", 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3496e-05 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:83501 5.a e29/16 5:53dda127:::benchmark_data_smithi043_45180_object83500:head v 29'5312, mlcod=29'5308)", 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.786350+0000", 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0042759030000000002, 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0046299699999999997, 2024-04-26T10:33:48.820 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:48.821 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:48.821 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:48.821 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.821 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:48.821 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786350+0000", 2024-04-26T10:33:48.821 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.821 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.821 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.821 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:48.821 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786350+0000", 2024-04-26T10:33:48.821 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.821 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.821 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786349+0000", 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786452+0000", 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010276300000000001 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786460+0000", 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0870000000000007e-06 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.822 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786466+0000", 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.173e-06 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.788117+0000", 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016508709999999999 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.788134+0000", 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7493999999999999e-05 2024-04-26T10:33:48.823 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:83497 5.4 e29/16)", 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.786963+0000", 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0036625189999999999, 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0040573270000000003, 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786963+0000", 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.824 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786963+0000", 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786962+0000", 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786966+0000", 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.534e-06 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.825 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.826 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:48.826 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786975+0000", 2024-04-26T10:33:48.826 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0799999999999995e-06 2024-04-26T10:33:48.826 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.826 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.826 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.826 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.786981+0000", 2024-04-26T10:33:48.826 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.502e-06 2024-04-26T10:33:48.826 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.826 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:48.826 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.826 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.826 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:83504 5.8 5:1c63eea5:::benchmark_data_smithi043_45180_object83503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.787589+0000", 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0030367839999999998, 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003461974, 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 83504 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:48.827 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787589+0000", 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787589+0000", 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787588+0000", 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.828 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787639+0000", 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1056e-05 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787650+0000", 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1459e-05 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787657+0000", 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1659999999999997e-06 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.829 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787932+0000", 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00027473200000000003 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.788054+0000", 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000121876 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.788205+0000", 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015107099999999999 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.830 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:83506 5.d 5:b9076647:::benchmark_data_smithi043_45180_object83505:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.787675+0000", 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.002950645, 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0034275500000000001, 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 83506 2024-04-26T10:33:48.831 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787675+0000", 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787675+0000", 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:48.832 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787674+0000", 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787742+0000", 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8180000000000001e-05 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787750+0000", 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4939999999999997e-06 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.833 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787757+0000", 2024-04-26T10:33:48.834 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8510000000000001e-06 2024-04-26T10:33:48.834 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.834 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.834 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:48.834 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787808+0000", 2024-04-26T10:33:48.834 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0952999999999998e-05 2024-04-26T10:33:48.834 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.834 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.834 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:48.834 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.787941+0000", 2024-04-26T10:33:48.834 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013363900000000001 2024-04-26T10:33:48.834 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.834 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.788094+0000", 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015256800000000001 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:83498 5.4 e29/16)", 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.789765+0000", 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00086079400000000001, 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001376707, 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:48.835 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.789765+0000", 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.789765+0000", 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.789764+0000", 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967296 2024-04-26T10:33:48.836 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.789766+0000", 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.8789999999999999e-06 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.789772+0000", 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5860000000000004e-06 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.789776+0000", 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8739999999999997e-06 2024-04-26T10:33:48.837 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.838 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:48.838 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.838 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.838 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.838 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:83510 5.0 5:07b54347:::benchmark_data_smithi043_45180_object83509:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:48.838 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.790437+0000", 2024-04-26T10:33:48.838 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.000188025, 2024-04-26T10:33:48.838 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00073352900000000002, 2024-04-26T10:33:48.838 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:48.838 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:48.838 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:48.838 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:48.838 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 83510 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.790437+0000", 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.790437+0000", 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.839 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.790437+0000", 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.790516+0000", 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9652000000000002e-05 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.790525+0000", 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6400000000000003e-06 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.840 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.790530+0000", 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3759999999999999e-06 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.790560+0000", 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9924999999999999e-05 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.790639+0000", 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8584999999999994e-05 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:48.841 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:48.842 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.790751+0000", 2024-04-26T10:33:48.842 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000111867 2024-04-26T10:33:48.842 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.842 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:48.842 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.842 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:48.842 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:33:48.842 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 13 2024-04-26T10:33:48.842 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:48.844 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:48.844 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:48.842+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:48.945 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:48.944+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:49.045 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:33:49.046 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:33:49.046 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T10:33:49.046 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T10:33:49.047 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:49.045+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:49.057 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:49.057 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:33:49.057 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:33:49.057 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:33:49.057 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:49.073 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:49.146 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:49.145+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:49.243 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:33:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:33:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.440462239999999, 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:33:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:33:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:33:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:33:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:33:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:33:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:33:49.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:33:49.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.439634160000001, 2024-04-26T10:33:49.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:33:49.250 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.250 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.250 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.250 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.250 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.250 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:33:49.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.250 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:49.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:33:49.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.438705097, 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.255 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:49.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:49.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:33:49.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:33:49.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:33:49.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:33:49.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:33:49.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.438019656000002, 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.261 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.262 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:33:49.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.262 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:49.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:49.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:33:49.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:33:49.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:33:49.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:33:49.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:33:49.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:33:49.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:33:49.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:33:49.266 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.266 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.266 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46220 5.0 5:0832587b:::benchmark_data_smithi043_45180_object46219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.183244157000001, 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020289430000000001, 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46220 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.267 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057256+0000", 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3852999999999999e-05 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057265+0000", 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8820000000000007e-06 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057271+0000", 2024-04-26T10:33:49.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4049999999999999e-06 2024-04-26T10:33:49.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064370+0000", 2024-04-26T10:33:49.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0070992870000000001 2024-04-26T10:33:49.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064469+0000", 2024-04-26T10:33:49.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8818000000000002e-05 2024-04-26T10:33:49.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064555+0000", 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6614999999999997e-05 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070612+0000", 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0060566459999999997 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077392+0000", 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0067803630000000002 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077438+0000", 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5265000000000001e-05 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077473+0000", 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4978999999999998e-05 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46224 5.0 5:055041a5:::benchmark_data_smithi043_45180_object46223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:49.272 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.182704485999999, 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019911091999999998, 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46224 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057722+0000", 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057751+0000", 2024-04-26T10:33:49.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9025000000000001e-05 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057758+0000", 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8360000000000003e-06 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057764+0000", 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3650000000000003e-06 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065640+0000", 2024-04-26T10:33:49.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0078760259999999995 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065735+0000", 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5358000000000004e-05 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065881+0000", 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000146155 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070622+0000", 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.004740874 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077527+0000", 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0069053710000000004 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077589+0000", 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1779999999999995e-05 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077634+0000", 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4861000000000003e-05 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46225 5.0 5:0c2c7e61:::benchmark_data_smithi043_45180_object46224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.182659183999998, 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019997917, 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.278 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46225 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057833+0000", 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5315999999999996e-05 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057840+0000", 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7220000000000002e-06 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057845+0000", 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1159999999999998e-06 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067208+0000", 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0093631259999999994 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067339+0000", 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013118900000000001 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.282 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067479+0000", 2024-04-26T10:33:49.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013958800000000001 2024-04-26T10:33:49.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.282 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.282 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070873+0000", 2024-04-26T10:33:49.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0033947980000000001 2024-04-26T10:33:49.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.282 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.282 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077696+0000", 2024-04-26T10:33:49.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006822168 2024-04-26T10:33:49.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077735+0000", 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9582999999999997e-05 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077766+0000", 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0882e-05 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46226 5.8 5:1735f934:::benchmark_data_smithi043_45180_object46225:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.182577906999999, 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019932222999999999, 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46226 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:49.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057904+0000", 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5458999999999999e-05 2024-04-26T10:33:49.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057911+0000", 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057917+0000", 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3899999999999998e-06 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067195+0000", 2024-04-26T10:33:49.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0092779960000000002 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067292+0000", 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6556000000000002e-05 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067399+0000", 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000107118 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.071325+0000", 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0039254729999999996 2024-04-26T10:33:49.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077687+0000", 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006362337 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077749+0000", 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2365000000000003e-05 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077782+0000", 2024-04-26T10:33:49.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2398999999999999e-05 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:48101 5.8 5:1cf22750:::benchmark_data_smithi043_45180_object48100:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.817983+0000", 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 16.422444675000001, 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018899736, 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.289 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.290 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 48101 2024-04-26T10:33:49.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.290 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.817983+0000", 2024-04-26T10:33:49.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.817983+0000", 2024-04-26T10:33:49.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.817982+0000", 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.818054+0000", 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2282999999999999e-05 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.818069+0000", 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4575e-05 2024-04-26T10:33:49.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.818074+0000", 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5759999999999996e-06 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.824167+0000", 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0060931420000000002 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.824276+0000", 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000108838 2024-04-26T10:33:49.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.824417+0000", 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141173 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.826150+0000", 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00173237 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.836801+0000", 2024-04-26T10:33:49.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010651331 2024-04-26T10:33:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.836843+0000", 2024-04-26T10:33:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2259000000000003e-05 2024-04-26T10:33:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.836882+0000", 2024-04-26T10:33:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8979000000000001e-05 2024-04-26T10:33:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.294 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:48295 5.a e23/16 5:5d08b1be:::benchmark_data_smithi043_45180_object48294:head v 23'3088, mlcod=23'3083)", 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 16.345947409000001, 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020188498999999999, 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894479+0000", 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894584+0000", 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000104863 2024-04-26T10:33:49.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894594+0000", 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6760000000000002e-06 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894608+0000", 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4263e-05 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894687+0000", 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8311000000000003e-05 2024-04-26T10:33:49.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894706+0000", 2024-04-26T10:33:49.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9531999999999999e-05 2024-04-26T10:33:49.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914628+0000", 2024-04-26T10:33:49.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019922314 2024-04-26T10:33:49.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914668+0000", 2024-04-26T10:33:49.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0080999999999998e-05 2024-04-26T10:33:49.299 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.299 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.299 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.299 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54079 5.0 5:0a7f1861:::benchmark_data_smithi043_45180_object54078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 13.860127465, 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020388585000000001, 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54079 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380299+0000", 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380329+0000", 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190000000000001e-05 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380341+0000", 2024-04-26T10:33:49.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1715999999999999e-05 2024-04-26T10:33:49.302 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.302 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380349+0000", 2024-04-26T10:33:49.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7209999999999994e-06 2024-04-26T10:33:49.302 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.302 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387457+0000", 2024-04-26T10:33:49.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0071078779999999998 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387586+0000", 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012915999999999999 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387724+0000", 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000138011 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.393120+0000", 2024-04-26T10:33:49.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0053964089999999996 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400595+0000", 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0074747279999999999 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400651+0000", 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6026000000000002e-05 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400688+0000", 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7336000000000003e-05 2024-04-26T10:33:49.304 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54642 5.e 5:7e60972f:::benchmark_data_smithi043_45180_object54641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 13.602546038, 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019369872999999999, 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54642 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.305 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:49.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:49.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637881+0000", 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637907+0000", 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6261000000000001e-05 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637915+0000", 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1780000000000003e-06 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.637920+0000", 2024-04-26T10:33:49.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.169e-06 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.639652+0000", 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017314990000000001 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.639745+0000", 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3259999999999998e-05 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.639824+0000", 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8869999999999995e-05 2024-04-26T10:33:49.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.641052+0000", 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001227627 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.657185+0000", 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.016133406999999999 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.657222+0000", 2024-04-26T10:33:49.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7119000000000002e-05 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.657251+0000", 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9084000000000001e-05 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:56243 5.b 5:da4ab90e:::benchmark_data_smithi043_45180_object56242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.335494+0000", 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.904933771, 2024-04-26T10:33:49.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019609926999999999, 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 56243 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335494+0000", 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335494+0000", 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335485+0000", 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999919 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335565+0000", 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9476999999999998e-05 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335571+0000", 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3319999999999997e-06 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.335584+0000", 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2608e-05 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337185+0000", 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001601597 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337300+0000", 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011501399999999999 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.337429+0000", 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000128169 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.340189+0000", 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027599679999999998 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.314 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355018+0000", 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014829241 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355063+0000", 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5472000000000001e-05 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.355104+0000", 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0170000000000003e-05 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:56600 5.4 5:27249c2e:::benchmark_data_smithi043_45180_object56599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:36.494766+0000", 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.745661259, 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018862449, 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 56600 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494766+0000", 2024-04-26T10:33:49.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494766+0000", 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494765+0000", 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494862+0000", 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6921000000000003e-05 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494870+0000", 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1289999999999996e-06 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.494877+0000", 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9979999999999997e-06 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.496879+0000", 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020011669999999999 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.497019+0000", 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014009600000000001 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.497165+0000", 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014645700000000001 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.498902+0000", 2024-04-26T10:33:49.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017363750000000001 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.513548+0000", 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.014646484 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.513598+0000", 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0064e-05 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:36.513629+0000", 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0399000000000002e-05 2024-04-26T10:33:49.320 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:65179 5.e 5:7b4354b2:::benchmark_data_smithi043_45180_object65178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.383735+0000", 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.8566927730000007, 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018666315999999999, 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 65179 2024-04-26T10:33:49.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.322 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.322 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.322 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383735+0000", 2024-04-26T10:33:49.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.322 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.322 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383735+0000", 2024-04-26T10:33:49.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383734+0000", 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383822+0000", 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7758999999999998e-05 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383829+0000", 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4240000000000004e-06 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383834+0000", 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4159999999999997e-06 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383858+0000", 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4817999999999999e-05 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.383958+0000", 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.9922999999999999e-05 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.384041+0000", 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2230000000000004e-05 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.386399+0000", 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002358803 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.402349+0000", 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.015950054000000002 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.402378+0000", 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8804000000000001e-05 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.402401+0000", 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2663e-05 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:65241 5.4 5:27070447:::benchmark_data_smithi043_45180_object65240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.414586+0000", 2024-04-26T10:33:49.326 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.8258412540000002, 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019748102, 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 65241 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414586+0000", 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.327 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414586+0000", 2024-04-26T10:33:49.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.328 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414585+0000", 2024-04-26T10:33:49.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:49.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.328 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414702+0000", 2024-04-26T10:33:49.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000117125 2024-04-26T10:33:49.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414711+0000", 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6929999999999996e-06 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414719+0000", 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.416649+0000", 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019300960000000001 2024-04-26T10:33:49.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.416764+0000", 2024-04-26T10:33:49.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000115611 2024-04-26T10:33:49.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.416872+0000", 2024-04-26T10:33:49.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000107243 2024-04-26T10:33:49.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.418259+0000", 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001387288 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.434278+0000", 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.016018988000000001 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.434309+0000", 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0948000000000003e-05 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.434334+0000", 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.533e-05 2024-04-26T10:33:49.331 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:75752 5.0 5:06ccff27:::benchmark_data_smithi043_45180_object75751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:45.207071+0000", 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.0333560049999999, 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.018751988000000001, 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 75752 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.332 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.207071+0000", 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.207071+0000", 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.207070+0000", 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.333 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.207140+0000", 2024-04-26T10:33:49.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9771999999999995e-05 2024-04-26T10:33:49.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.207151+0000", 2024-04-26T10:33:49.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0518e-05 2024-04-26T10:33:49.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.207160+0000", 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8780000000000004e-06 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.209068+0000", 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019086280000000001 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.209189+0000", 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000121266 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.209285+0000", 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5293999999999999e-05 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.216580+0000", 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0072947419999999999 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.225752+0000", 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0091725109999999995 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.225793+0000", 2024-04-26T10:33:49.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1440999999999998e-05 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.225823+0000", 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9839999999999999e-05 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:76476 5.0 5:0877a31b:::benchmark_data_smithi043_45180_object76475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:45.544923+0000", 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 3.6955045650000002, 2024-04-26T10:33:49.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.021067567999999998, 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 76476 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544923+0000", 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544923+0000", 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544922+0000", 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544947+0000", 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4961999999999999e-05 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544957+0000", 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7389999999999994e-06 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544960+0000", 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.349e-06 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.549294+0000", 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0043340109999999996 2024-04-26T10:33:49.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.549421+0000", 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012669800000000001 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.549565+0000", 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000144208 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.553702+0000", 2024-04-26T10:33:49.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041373080000000001 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.565915+0000", 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012212212 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.565966+0000", 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1119000000000003e-05 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.565990+0000", 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4539e-05 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:82981 5.4 5:2d6d9fdd:::benchmark_data_smithi043_45180_object82980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.547307+0000", 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.69312074800000001, 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.022009709999999998, 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.343 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 82981 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547307+0000", 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547307+0000", 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547306+0000", 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547371+0000", 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4937000000000005e-05 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547380+0000", 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7229999999999993e-06 2024-04-26T10:33:49.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547386+0000", 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5119999999999997e-06 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.550471+0000", 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0030849850000000002 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.550554+0000", 2024-04-26T10:33:49.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3246999999999998e-05 2024-04-26T10:33:49.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.347 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.347 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.347 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.550642+0000", 2024-04-26T10:33:49.347 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7309e-05 2024-04-26T10:33:49.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.347 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.347 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.347 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.558827+0000", 2024-04-26T10:33:49.347 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0081850859999999994 2024-04-26T10:33:49.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.347 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.347 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569264+0000", 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010437327 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569292+0000", 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8469000000000001e-05 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569316+0000", 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3816e-05 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.348 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:82983 5.4 5:239b8360:::benchmark_data_smithi043_45180_object82982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.548917+0000", 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.69151009299999999, 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020444285999999999, 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 82983 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:49.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:49.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.548917+0000", 2024-04-26T10:33:49.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:49.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.548917+0000", 2024-04-26T10:33:49.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:49.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:49.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.548917+0000", 2024-04-26T10:33:49.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.549007+0000", 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0612999999999995e-05 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.549015+0000", 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0620000000000001e-06 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.549022+0000", 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2910000000000004e-06 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.554482+0000", 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0054603120000000002 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.554563+0000", 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0858000000000004e-05 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:49.352 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.554650+0000", 2024-04-26T10:33:49.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7478999999999994e-05 2024-04-26T10:33:49.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.353 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.353 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.558862+0000", 2024-04-26T10:33:49.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0042117279999999997 2024-04-26T10:33:49.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.353 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:49.353 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569322+0000", 2024-04-26T10:33:49.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.01046041 2024-04-26T10:33:49.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569344+0000", 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1994999999999999e-05 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569362+0000", 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7217000000000001e-05 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:49.354 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:49.356 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:49.356 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:49.354+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:33:49.393 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-26T10:33:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 29, 2024-04-26T10:33:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "6d35b773-83ef-4e54-be62-89cec0b09327", 2024-04-26T10:33:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-04-26T10:32:36.651799+0000", 2024-04-26T10:33:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-04-26T10:33:48.411051+0000", 2024-04-26T10:33:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: "last_up_change": "2024-04-26T10:32:44.545583+0000", 2024-04-26T10:33:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: "last_in_change": "2024-04-26T10:32:37.588200+0000", 2024-04-26T10:33:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T10:33:49.393 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_num": 5799936, 2024-04-26T10:33:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_set": [ 2024-04-26T10:33:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: "pglog_hardlimit", 2024-04-26T10:33:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: "purged_snapdirs", 2024-04-26T10:33:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_deletes", 2024-04-26T10:33:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: "sortbitwise" 2024-04-26T10:33:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:33:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_version": 4, 2024-04-26T10:33:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T10:33:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T10:33:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T10:33:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_snapshot": "", 2024-04-26T10:33:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_max": 5, 2024-04-26T10:33:49.394 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd": 3, 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: "require_min_compat_client": "luminous", 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: "min_compat_client": "jewel", 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: "require_osd_release": "reef", 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_crimson": false, 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: "pools": [ 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 1, 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": ".mgr", 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.037545+0000", 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:49.395 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 1, 2024-04-26T10:33:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 1, 2024-04-26T10:33:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 1, 2024-04-26T10:33:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 1, 2024-04-26T10:33:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 1, 2024-04-26T10:33:49.396 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:33:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:49.397 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:49.398 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:49.398 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:49.398 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:49.398 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:49.398 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:49.398 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:49.398 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:49.398 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:49.398 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:49.398 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:49.398 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:49.398 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:49.398 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:49.399 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:49.400 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:49.400 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:49.400 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:49.400 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:49.400 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:49.400 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:49.400 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:49.400 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:33:49.400 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_max": 32, 2024-04-26T10:33:49.400 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 1 2024-04-26T10:33:49.400 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.400 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:49.400 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": {} 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 2.9900000095367432, 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 2.9900000095367432, 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 2, 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 2, 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.401 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 2, 2024-04-26T10:33:49.402 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "rbd", 2024-04-26T10:33:49.402 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.393201+0000", 2024-04-26T10:33:49.402 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:49.402 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:49.402 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:49.402 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:49.402 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:49.402 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:49.402 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:49.402 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:49.402 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:49.402 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:49.402 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 8, 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 8, 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 8, 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 8, 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 8, 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:49.403 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:33:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:49.404 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:49.405 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.406 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:49.406 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:49.406 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:49.406 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:49.406 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:49.406 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:49.406 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:49.406 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:49.406 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:49.406 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:49.406 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:49.406 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:33:49.406 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:49.407 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd": {} 2024-04-26T10:33:49.407 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.407 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:49.407 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.5, 2024-04-26T10:33:49.407 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.5, 2024-04-26T10:33:49.407 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:33:49.407 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.5, 2024-04-26T10:33:49.407 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.5, 2024-04-26T10:33:49.407 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:49.407 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:49.407 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:49.407 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.407 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 3, 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_metadata", 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:49.859710+0000", 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:49.408 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 32, 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 32, 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 32, 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 32, 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 32, 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:49.409 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:49.410 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.410 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "14", 2024-04-26T10:33:49.410 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:49.410 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:49.410 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:49.410 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:49.410 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:49.410 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:49.410 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:49.410 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:49.410 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:49.410 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:49.411 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:33:49.412 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_bias": 4, 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 16, 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_priority": 5 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": "cephfs" 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:33:49.413 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:33:49.414 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:49.414 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:49.414 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:49.414 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.414 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.414 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.414 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 4, 2024-04-26T10:33:49.414 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_data", 2024-04-26T10:33:49.414 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:50.968196+0000", 2024-04-26T10:33:49.414 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:49.414 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:49.414 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:49.414 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 64, 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 64, 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 64, 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 64, 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 64, 2024-04-26T10:33:49.415 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "15", 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:49.416 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:49.417 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:49.418 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:49.419 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:49.419 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:49.419 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:49.419 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:49.419 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:33:49.419 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 64, 2024-04-26T10:33:49.419 INFO:teuthology.orchestra.run.smithi043.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T10:33:49.419 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.419 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:49.419 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:33:49.419 INFO:teuthology.orchestra.run.smithi043.stdout: "data": "cephfs" 2024-04-26T10:33:49.419 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.419 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 5, 2024-04-26T10:33:49.420 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "unique_pool_0", 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:33:15.284422+0000", 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:33:49.421 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 16, 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 16, 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 16, 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 16, 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 16, 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "18", 2024-04-26T10:33:49.422 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:33:49.423 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:33:49.424 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:33:49.425 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:33:49.425 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:33:49.425 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:33:49.425 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:33:49.425 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:33:49.425 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:33:49.425 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:33:49.425 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:33:49.425 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:33:49.425 INFO:teuthology.orchestra.run.smithi043.stdout: "rados": {} 2024-04-26T10:33:49.425 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.425 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:33:49.425 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:33:49.426 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "32399f03-8160-43f7-a69f-1db73f105676", 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 16, 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.427 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6800", 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6801", 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.428 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6802", 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6803", 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.429 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6806", 2024-04-26T10:33:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6807", 2024-04-26T10:33:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:33:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:49.430 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6804", 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6805", 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.112:6801/41771", 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.112:6803/41771", 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.112:6807/41771", 2024-04-26T10:33:49.431 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.112:6805/41771", 2024-04-26T10:33:49.433 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:33:49.434 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:33:49.434 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:33:49.434 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.434 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.434 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.434 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:33:49.434 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "89e46a83-bfff-458f-bbac-258edb6ddad2", 2024-04-26T10:33:49.434 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:33:49.434 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:33:49.434 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:33:49.434 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:33:49.434 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 16, 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6800", 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.435 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6801", 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6802", 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6803", 2024-04-26T10:33:49.436 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6806", 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6807", 2024-04-26T10:33:49.437 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6804", 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6805", 2024-04-26T10:33:49.438 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.186:6801/41804", 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.186:6803/41804", 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.186:6807/41804", 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.186:6805/41804", 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.439 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:33:49.440 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "24c9e06d-1386-4075-b64e-d6c1d57c57bb", 2024-04-26T10:33:49.440 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:33:49.440 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:33:49.440 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:33:49.440 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:33:49.440 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:33:49.440 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:33:49.440 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:33:49.440 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 16, 2024-04-26T10:33:49.440 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:33:49.440 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:33:49.440 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6800", 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6801", 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:33:49.441 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:49.442 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.442 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:49.442 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6802", 2024-04-26T10:33:49.442 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:49.442 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.442 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.442 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:49.442 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6803", 2024-04-26T10:33:49.442 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:49.442 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.442 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.442 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.443 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:33:49.443 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:49.443 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.443 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:49.443 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6806", 2024-04-26T10:33:49.443 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:49.443 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.444 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.444 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:49.444 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6807", 2024-04-26T10:33:49.444 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:49.444 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.444 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.444 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.444 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:33:49.444 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:33:49.445 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.445 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:33:49.445 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6804", 2024-04-26T10:33:49.445 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:49.445 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.445 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.445 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:33:49.445 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6805", 2024-04-26T10:33:49.446 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:33:49.446 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.446 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.446 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.446 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.187:6801/41919", 2024-04-26T10:33:49.446 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.187:6803/41919", 2024-04-26T10:33:49.447 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.187:6807/41919", 2024-04-26T10:33:49.447 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.187:6805/41919", 2024-04-26T10:33:49.447 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:33:49.447 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:33:49.447 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:33:49.447 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:33:49.447 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.448 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:33:49.448 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_xinfo": [ 2024-04-26T10:33:49.448 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.448 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:33:49.448 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:33:49.448 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:33:49.448 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:33:49.449 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:33:49.449 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:33:49.449 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.579572+0000", 2024-04-26T10:33:49.449 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:33:49.449 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.449 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.449 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:33:49.450 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:33:49.450 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:33:49.450 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:33:49.450 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:33:49.450 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:33:49.450 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.596783+0000", 2024-04-26T10:33:49.450 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:33:49.450 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.451 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:33:49.451 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:33:49.451 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:33:49.451 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:33:49.451 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:33:49.451 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:33:49.451 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:33:49.452 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.632883+0000", 2024-04-26T10:33:49.452 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:33:49.452 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.452 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:33:49.452 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap": [], 2024-04-26T10:33:49.452 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_items": [], 2024-04-26T10:33:49.452 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_primaries": [], 2024-04-26T10:33:49.453 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_temp": [], 2024-04-26T10:33:49.453 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_temp": [], 2024-04-26T10:33:49.453 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklist": {}, 2024-04-26T10:33:49.453 INFO:teuthology.orchestra.run.smithi043.stdout: "range_blocklist": {}, 2024-04-26T10:33:49.453 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profiles": { 2024-04-26T10:33:49.453 INFO:teuthology.orchestra.run.smithi043.stdout: "default": { 2024-04-26T10:33:49.454 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-failure-domain": "osd", 2024-04-26T10:33:49.454 INFO:teuthology.orchestra.run.smithi043.stdout: "k": "2", 2024-04-26T10:33:49.454 INFO:teuthology.orchestra.run.smithi043.stdout: "m": "1", 2024-04-26T10:33:49.454 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin": "jerasure", 2024-04-26T10:33:49.454 INFO:teuthology.orchestra.run.smithi043.stdout: "technique": "reed_sol_van" 2024-04-26T10:33:49.454 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.454 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:33:49.454 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps_queue": [], 2024-04-26T10:33:49.455 INFO:teuthology.orchestra.run.smithi043.stdout: "new_removed_snaps": [], 2024-04-26T10:33:49.455 INFO:teuthology.orchestra.run.smithi043.stdout: "new_purged_snaps": [], 2024-04-26T10:33:49.455 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_node_flags": {}, 2024-04-26T10:33:49.455 INFO:teuthology.orchestra.run.smithi043.stdout: "device_class_flags": {}, 2024-04-26T10:33:49.455 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": { 2024-04-26T10:33:49.455 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_enabled": false, 2024-04-26T10:33:49.455 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_bucket_count": 0, 2024-04-26T10:33:49.455 INFO:teuthology.orchestra.run.smithi043.stdout: "degraded_stretch_mode": 0, 2024-04-26T10:33:49.455 INFO:teuthology.orchestra.run.smithi043.stdout: "recovering_stretch_mode": 0, 2024-04-26T10:33:49.455 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_bucket": 0 2024-04-26T10:33:49.455 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:33:49.456 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-26T10:33:49.457 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:49.456+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:49.458 INFO:tasks.thrashosds.thrasher:j is {'epoch': 29, 'fsid': '6d35b773-83ef-4e54-be62-89cec0b09327', 'created': '2024-04-26T10:32:36.651799+0000', 'modified': '2024-04-26T10:33:48.411051+0000', 'last_up_change': '2024-04-26T10:32:44.545583+0000', 'last_in_change': '2024-04-26T10:32:37.588200+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:32:45.037545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:32:45.393201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:32:49.859710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:32:50.968196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-26T10:33:15.284422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '32399f03-8160-43f7-a69f-1db73f105676', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 41771}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 41771}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 41771}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 41771}]}, 'public_addr': '172.21.15.112:6801/41771', 'cluster_addr': '172.21.15.112:6803/41771', 'heartbeat_back_addr': '172.21.15.112:6807/41771', 'heartbeat_front_addr': '172.21.15.112:6805/41771', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '89e46a83-bfff-458f-bbac-258edb6ddad2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6800', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6801', 'nonce': 41804}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6802', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6803', 'nonce': 41804}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6806', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6807', 'nonce': 41804}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6804', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6805', 'nonce': 41804}]}, 'public_addr': '172.21.15.186:6801/41804', 'cluster_addr': '172.21.15.186:6803/41804', 'heartbeat_back_addr': '172.21.15.186:6807/41804', 'heartbeat_front_addr': '172.21.15.186:6805/41804', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '24c9e06d-1386-4075-b64e-d6c1d57c57bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 41919}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 41919}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 41919}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 41919}]}, 'public_addr': '172.21.15.187:6801/41919', 'cluster_addr': '172.21.15.187:6803/41919', 'heartbeat_back_addr': '172.21.15.187:6807/41919', 'heartbeat_front_addr': '172.21.15.187:6805/41919', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.579572+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.596783+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.632883+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T10:33:49.458 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-26T10:33:49.458 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 32 16 84848 84832 165.674 134.562 0.00921691 0.00603313 2024-04-26T10:33:49.545 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:49.545 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:49.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.545 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:85100 5.7 e29/16 5:ee9bde79:::benchmark_data_smithi043_45180_object85099:head v 29'5238, mlcod=29'5235)", 2024-04-26T10:33:49.545 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.538016+0000", 2024-04-26T10:33:49.545 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0048311700000000001, 2024-04-26T10:33:49.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0048607720000000002, 2024-04-26T10:33:49.545 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.545 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:49.545 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538016+0000", 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538016+0000", 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538016+0000", 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538070+0000", 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4120999999999999e-05 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538080+0000", 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0087e-05 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538087+0000", 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4869999999999996e-06 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538273+0000", 2024-04-26T10:33:49.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000185367 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538291+0000", 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8284e-05 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:85102 5.5 5:a7a5e4b1:::benchmark_data_smithi043_45180_object85101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.538850+0000", 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0039970810000000004, 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0041181719999999998, 2024-04-26T10:33:49.548 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 85102 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538850+0000", 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538850+0000", 2024-04-26T10:33:49.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538849+0000", 2024-04-26T10:33:49.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:49.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538945+0000", 2024-04-26T10:33:49.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5753000000000003e-05 2024-04-26T10:33:49.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538954+0000", 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8289999999999997e-06 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538965+0000", 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0849000000000001e-05 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539009+0000", 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3918999999999997e-05 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539129+0000", 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0001204 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539255+0000", 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012621400000000001 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.542066+0000", 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028107359999999999 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:85103 5.a 5:57f0fde9:::benchmark_data_smithi043_45180_object85102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.538974+0000", 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0038735890000000002, 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040894629999999998, 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 85103 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538974+0000", 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538974+0000", 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.538973+0000", 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539061+0000", 2024-04-26T10:33:49.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7942000000000006e-05 2024-04-26T10:33:49.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539072+0000", 2024-04-26T10:33:49.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0353000000000001e-05 2024-04-26T10:33:49.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539079+0000", 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4660000000000002e-06 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539120+0000", 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0655999999999998e-05 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539248+0000", 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127775 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:49.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539367+0000", 2024-04-26T10:33:49.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011961800000000001 2024-04-26T10:33:49.557 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.557 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.557 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.557 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:85106 5.a 5:58cd4b2a:::benchmark_data_smithi043_45180_object85105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:49.557 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.539094+0000", 2024-04-26T10:33:49.557 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0037530530000000001, 2024-04-26T10:33:49.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040490760000000004, 2024-04-26T10:33:49.557 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 85106 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539094+0000", 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539094+0000", 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539094+0000", 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539221+0000", 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012692399999999999 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539229+0000", 2024-04-26T10:33:49.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3510000000000002e-06 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539236+0000", 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6810000000000001e-06 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541239+0000", 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020035320000000001 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541344+0000", 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104907 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541432+0000", 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.81e-05 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:85111 5.c 5:371dbf3b:::benchmark_data_smithi043_45180_object85110:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.539480+0000", 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0033669770000000002, 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0037381630000000001, 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:49.561 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 85111 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539480+0000", 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539480+0000", 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539480+0000", 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539584+0000", 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103881 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539594+0000", 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0631999999999999e-05 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539602+0000", 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.43e-06 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539667+0000", 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5339999999999994e-05 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539808+0000", 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014054099999999999 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.540077+0000", 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026919900000000002 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:85105 5.e e29/16 5:74880735:::benchmark_data_smithi043_45180_object85104:head v 29'5293, mlcod=29'5291)", 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.539560+0000", 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0032872000000000001, 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0037378009999999998, 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539560+0000", 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539560+0000", 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539560+0000", 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539649+0000", 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9378999999999999e-05 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539657+0000", 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5660000000000001e-06 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539662+0000", 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3720000000000004e-06 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:49.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539742+0000", 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9776000000000003e-05 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539762+0000", 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0208e-05 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:85104 5.7 e29/16 5:e6ad4990:::benchmark_data_smithi043_45180_object85103:head v 29'5239, mlcod=29'5235)", 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.539919+0000", 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.002928436, 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034491579999999999, 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.568 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539919+0000", 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539919+0000", 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539918+0000", 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539948+0000", 2024-04-26T10:33:49.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9791999999999999e-05 2024-04-26T10:33:49.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539958+0000", 2024-04-26T10:33:49.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4299999999999995e-06 2024-04-26T10:33:49.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539973+0000", 2024-04-26T10:33:49.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5299e-05 2024-04-26T10:33:49.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:49.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.540008+0000", 2024-04-26T10:33:49.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4609e-05 2024-04-26T10:33:49.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:49.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.540027+0000", 2024-04-26T10:33:49.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9375999999999999e-05 2024-04-26T10:33:49.571 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:85107 5.2 e29/16 5:4fd8f78b:::benchmark_data_smithi043_45180_object85106:head v 29'5365, mlcod=29'5362)", 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.539982+0000", 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0028652130000000001, 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034489550000000001, 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539982+0000", 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539982+0000", 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539982+0000", 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.540008+0000", 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6288999999999999e-05 2024-04-26T10:33:49.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.540014+0000", 2024-04-26T10:33:49.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8939999999999998e-06 2024-04-26T10:33:49.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.540018+0000", 2024-04-26T10:33:49.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.408e-06 2024-04-26T10:33:49.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:49.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541219+0000", 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001200921 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541237+0000", 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7621999999999998e-05 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:85110 5.8 e29/16 5:10274804:::benchmark_data_smithi043_45180_object85109:head v 29'5371, mlcod=29'5369)", 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.539949+0000", 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0028980389999999998, 2024-04-26T10:33:49.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035496709999999999, 2024-04-26T10:33:49.576 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.576 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:49.576 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539949+0000", 2024-04-26T10:33:49.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539949+0000", 2024-04-26T10:33:49.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.539949+0000", 2024-04-26T10:33:49.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.540036+0000", 2024-04-26T10:33:49.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7336000000000005e-05 2024-04-26T10:33:49.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.540045+0000", 2024-04-26T10:33:49.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4800000000000001e-06 2024-04-26T10:33:49.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.540051+0000", 2024-04-26T10:33:49.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2589999999999997e-06 2024-04-26T10:33:49.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:49.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.540092+0000", 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1390000000000002e-05 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.540109+0000", 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7030000000000001e-05 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:85113 5.6 5:631e36e8:::benchmark_data_smithi043_45180_object85112:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.541788+0000", 2024-04-26T10:33:49.579 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001059351, 2024-04-26T10:33:49.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001774992, 2024-04-26T10:33:49.580 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.580 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:49.580 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:49.580 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:49.580 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:49.580 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 85113 2024-04-26T10:33:49.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.580 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541788+0000", 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541788+0000", 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541787+0000", 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541864+0000", 2024-04-26T10:33:49.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7112000000000003e-05 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541883+0000", 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9026999999999999e-05 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.542004+0000", 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012050800000000001 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:49.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.542697+0000", 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00069337399999999997 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.542825+0000", 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127844 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.542977+0000", 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015212099999999999 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.583 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:85108 5.7 e29/16 5:e1b1cdfc:::benchmark_data_smithi043_45180_object85107:head v 29'5240, mlcod=29'5235)", 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.541888+0000", 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.000959826, 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017449410000000001, 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541888+0000", 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541888+0000", 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541887+0000", 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541919+0000", 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1980000000000002e-05 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541928+0000", 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1910000000000006e-06 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.541936+0000", 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6359999999999994e-06 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543424+0000", 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014878109999999999 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543442+0000", 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8417e-05 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:85112 5.0 e29/16 5:03f078bb:::benchmark_data_smithi043_45180_object85111:head v 29'5343, mlcod=29'5341)", 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.542678+0000", 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00016968500000000001, 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001023211, 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:49.587 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.542678+0000", 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.542678+0000", 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.542677+0000", 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.542707+0000", 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9396000000000001e-05 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.542719+0000", 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2038999999999999e-05 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.542725+0000", 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-04-26T10:33:49.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.542760+0000", 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5213000000000003e-05 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.542779+0000", 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9301e-05 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:85114 5.1 e29/16 5:8ed735b8:::benchmark_data_smithi043_45180_object85113:head v 29'5353, mlcod=29'5351)", 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.543294+0000", 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9995532, 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00046345300000000001, 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543294+0000", 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543294+0000", 2024-04-26T10:33:49.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543294+0000", 2024-04-26T10:33:49.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543346+0000", 2024-04-26T10:33:49.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2395000000000002e-05 2024-04-26T10:33:49.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543355+0000", 2024-04-26T10:33:49.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4290000000000001e-06 2024-04-26T10:33:49.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.594 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.594 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543361+0000", 2024-04-26T10:33:49.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2249999999999997e-06 2024-04-26T10:33:49.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.594 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:49.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543419+0000", 2024-04-26T10:33:49.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8257000000000001e-05 2024-04-26T10:33:49.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:49.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543436+0000", 2024-04-26T10:33:49.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6436999999999999e-05 2024-04-26T10:33:49.596 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.596 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.596 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.596 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:85115 5.4 e29/16)", 2024-04-26T10:33:49.597 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:49.543714+0000", 2024-04-26T10:33:49.597 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9991336, 2024-04-26T10:33:49.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9067000000000005e-05, 2024-04-26T10:33:49.597 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:49.597 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:49.597 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:49.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:49.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543714+0000", 2024-04-26T10:33:49.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:49.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543714+0000", 2024-04-26T10:33:49.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:49.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:49.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543713+0000", 2024-04-26T10:33:49.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:49.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:49.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543778+0000", 2024-04-26T10:33:49.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4937999999999994e-05 2024-04-26T10:33:49.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:49.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543789+0000", 2024-04-26T10:33:49.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0706e-05 2024-04-26T10:33:49.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:49.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:49.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:49.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:49.543795+0000", 2024-04-26T10:33:49.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3010000000000003e-06 2024-04-26T10:33:49.602 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.602 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:49.602 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.602 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:49.603 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:33:49.603 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 14 2024-04-26T10:33:49.603 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:49.605 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:49.605 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:49.603+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:49.705 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:49.704+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:49.806 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:49.805+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:49.824 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:49.824 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:33:49.824 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:33:49.824 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:33:49.824 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:49.843 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:49.907 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:49.906+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:50.007 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:50.007+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:50.028 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:50.028 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:33:50.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:33:50.028 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:50.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.028 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:50.028 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:50.028 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.224577314000001, 2024-04-26T10:33:50.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:33:50.028 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.028 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.028 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.028 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:33:50.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:33:50.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:33:50.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.033 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.224576329000001, 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.037 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.224507706000001, 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.038 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:33:50.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:33:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:50.043 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.224455926000001, 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:33:50.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:33:50.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:33:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.224396076000001, 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:33:50.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:50.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:50.054 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.222683371999999, 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:33:50.059 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.222568304999999, 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:33:50.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:33:50.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:33:50.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:33:50.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:33:50.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:33:50.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:33:50.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.222475164999999, 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.064 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.069 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.222281004999999, 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:50.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.221073637, 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:50.074 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:33:50.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.077 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.220264729, 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:33:50.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:33:50.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:33:50.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:50.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:50.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:33:50.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:33:50.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:33:50.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:33:50.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:33:50.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.083 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.220161190999999, 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:50.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:33:50.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:33:50.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:33:50.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:33:50.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:33:50.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:33:50.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.220084318000001, 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.089 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:33:50.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.095 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:33:50.095 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:50.095 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.219968934000001, 2024-04-26T10:33:50.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:33:50.095 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.095 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:50.095 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:50.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:33:50.096 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:33:50.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:33:50.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:33:50.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:33:50.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:33:50.098 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.098 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.098 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:48295 5.a 5:5d08b1be:::benchmark_data_smithi043_45180_object48294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.131107741000001, 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020783243999999999, 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 48295 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894137+0000", 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894198+0000", 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0192999999999998e-05 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894209+0000", 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1486e-05 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894217+0000", 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1370000000000002e-06 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894251+0000", 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3636000000000001e-05 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894361+0000", 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010988 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894441+0000", 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0549000000000004e-05 2024-04-26T10:33:50.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.897398+0000", 2024-04-26T10:33:50.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002956232 2024-04-26T10:33:50.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914869+0000", 2024-04-26T10:33:50.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017471582999999999 2024-04-26T10:33:50.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914901+0000", 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1578999999999997e-05 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914922+0000", 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0965999999999999e-05 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:48299 5.a 5:5776ea42:::benchmark_data_smithi043_45180_object48298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.130411940999998, 2024-04-26T10:33:50.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020205178000000001, 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 48299 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894907+0000", 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3622999999999996e-05 2024-04-26T10:33:50.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894914+0000", 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894918+0000", 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8e-06 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.895863+0000", 2024-04-26T10:33:50.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00094444799999999997 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.895976+0000", 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000113736 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.896101+0000", 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012477699999999999 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.899956+0000", 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038552539999999998 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914959+0000", 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015002991 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.915007+0000", 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7404999999999998e-05 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.915039+0000", 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2750000000000003e-05 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:56249 5.3 5:cd0b6957:::benchmark_data_smithi043_45180_object56248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.689568136, 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019358055999999998, 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.110 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 56249 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:50.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335801+0000", 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012364900000000001 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335808+0000", 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335813+0000", 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3650000000000003e-06 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.343739+0000", 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079259840000000005 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.343846+0000", 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010697200000000001 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.343977+0000", 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000131283 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349555+0000", 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055777860000000004 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.354963+0000", 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054082599999999998 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355004+0000", 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0203000000000001e-05 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355036+0000", 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2434999999999997e-05 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:56250 5.3 5:c16df6d5:::benchmark_data_smithi043_45180_object56249:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.689427256, 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019349841, 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 56250 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335906+0000", 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7474999999999999e-05 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335912+0000", 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2539999999999998e-06 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335918+0000", 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3430000000000003e-06 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349571+0000", 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013653367 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349677+0000", 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105791 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349768+0000", 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1037000000000003e-05 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.354950+0000", 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051823199999999998 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355103+0000", 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015317299999999999 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355140+0000", 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7088000000000001e-05 2024-04-26T10:33:50.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355169+0000", 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8407000000000001e-05 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:58496 5.a 5:5a7e82ac:::benchmark_data_smithi043_45180_object58495:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:37.329970+0000", 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.695276439000001, 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019239415999999999, 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.121 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 58496 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.329970+0000", 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.329970+0000", 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.329969+0000", 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.330018+0000", 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8959999999999999e-05 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.330025+0000", 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2269999999999996e-06 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.330029+0000", 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8539999999999999e-06 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.335555+0000", 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055257910000000004 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.335721+0000", 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016615099999999999 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.335860+0000", 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138913 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.342727+0000", 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068670950000000001 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.349128+0000", 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064010869999999997 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.349172+0000", 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3297999999999998e-05 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.349209+0000", 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7540000000000003e-05 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.126 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:58511 5.a 5:5da7faca:::benchmark_data_smithi043_45180_object58510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.686427759000001, 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019708499000000001, 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 58511 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:50.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338844+0000", 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338851+0000", 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2219999999999999e-06 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338855+0000", 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8289999999999998e-06 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.346946+0000", 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080906450000000005 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.347081+0000", 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013469299999999999 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.347225+0000", 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000144704 2024-04-26T10:33:50.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.351702+0000", 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044762930000000001 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.358426+0000", 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067239170000000003 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.358482+0000", 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6889999999999999e-05 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:50.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:50.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:50.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.358527+0000", 2024-04-26T10:33:50.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4465999999999997e-05 2024-04-26T10:33:50.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.132 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:50.132 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:50.132 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:50.133 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:50.132+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:50.134 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:50.234 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:50.233+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:50.303 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:50.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:50.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.303 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:86704 5.1 5:825d16fb:::benchmark_data_smithi043_45180_object86703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:50.303 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:50.299082+0000", 2024-04-26T10:33:50.303 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0028819029999999999, 2024-04-26T10:33:50.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029087050000000001, 2024-04-26T10:33:50.303 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:50.303 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 86704 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299082+0000", 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299082+0000", 2024-04-26T10:33:50.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:50.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:50.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299081+0000", 2024-04-26T10:33:50.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:50.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:50.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299142+0000", 2024-04-26T10:33:50.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0785999999999997e-05 2024-04-26T10:33:50.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:50.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299150+0000", 2024-04-26T10:33:50.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8120000000000008e-06 2024-04-26T10:33:50.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299157+0000", 2024-04-26T10:33:50.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6939999999999998e-06 2024-04-26T10:33:50.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:50.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299185+0000", 2024-04-26T10:33:50.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8847e-05 2024-04-26T10:33:50.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:50.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299307+0000", 2024-04-26T10:33:50.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121426 2024-04-26T10:33:50.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299453+0000", 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014628500000000001 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:86705 5.2 5:4ca9c26f:::benchmark_data_smithi043_45180_object86704:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:50.299166+0000", 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0027985430000000001, 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029152240000000001, 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:50.308 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 86705 2024-04-26T10:33:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299166+0000", 2024-04-26T10:33:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299166+0000", 2024-04-26T10:33:50.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299165+0000", 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299203+0000", 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7719999999999998e-05 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:50.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299210+0000", 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4410000000000004e-06 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299216+0000", 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1859999999999997e-06 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299251+0000", 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4489999999999997e-05 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:50.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299361+0000", 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109856 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299488+0000", 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012743800000000001 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:86707 5.2 5:413c864e:::benchmark_data_smithi043_45180_object86706:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:50.299361+0000", 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0026031639999999998, 2024-04-26T10:33:50.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027977850000000001, 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 86707 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299361+0000", 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299361+0000", 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299360+0000", 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299422+0000", 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1833000000000002e-05 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299430+0000", 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0120000000000005e-06 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.299437+0000", 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0060000000000003e-06 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301419+0000", 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019819270000000001 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301533+0000", 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011369100000000001 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301681+0000", 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014841499999999999 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.316 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:86711 5.1 5:85291c45:::benchmark_data_smithi043_45180_object86710:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:50.300558+0000", 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.001406072, 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016775259999999999, 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 86711 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.300558+0000", 2024-04-26T10:33:50.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:50.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:50.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.300558+0000", 2024-04-26T10:33:50.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:50.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:50.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.300557+0000", 2024-04-26T10:33:50.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:50.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.300607+0000", 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9888000000000001e-05 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.300617+0000", 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3719999999999994e-06 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.300624+0000", 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:33:50.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:50.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301400+0000", 2024-04-26T10:33:50.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00077637099999999998 2024-04-26T10:33:50.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:50.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301536+0000", 2024-04-26T10:33:50.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000135847 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301689+0000", 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015307499999999999 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:86712 5.2 5.1f8e9bd2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:50.301000+0000", 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00096405000000000004, 2024-04-26T10:33:50.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001307194, 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 86712 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301000+0000", 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301000+0000", 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301000+0000", 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301053+0000", 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2933000000000003e-05 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301059+0000", 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7680000000000003e-06 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301065+0000", 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.993e-06 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:86710 5.c e29/16 5:36f708d2:::benchmark_data_smithi043_45180_object86709:head v 29'5403, mlcod=29'5400)", 2024-04-26T10:33:50.324 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:50.301482+0000", 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00048186700000000003, 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00088064800000000004, 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301482+0000", 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301482+0000", 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:50.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301481+0000", 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301542+0000", 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0477999999999999e-05 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301553+0000", 2024-04-26T10:33:50.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0613e-05 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301559+0000", 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5889999999999999e-06 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301592+0000", 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3102000000000003e-05 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:50.301609+0000", 2024-04-26T10:33:50.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6908000000000001e-05 2024-04-26T10:33:50.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:50.328 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:50.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:50.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:50.328 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:33:50.328 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 6 2024-04-26T10:33:50.328 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:50.329 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:50.334 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:50.333+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:50.420 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 33 16 86974 86958 164.68 132.875 0.0134943 0.00606899 2024-04-26T10:33:50.433 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:33:50.435 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:50.434+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:50.437 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:33:50.536 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:50.534+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:50.539 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:33:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:33:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:33:50.539 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:50.553 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:50.589 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:50.610 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:50.637 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:50.636+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:50.643 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:50.644 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:50.644 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:50.644 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:50.738 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:50.737+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:50.768 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:50.768 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:50.781 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:50.839 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:50.838+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:50.939 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:50.938+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:50.949 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:50.949 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:50.963 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:51.041 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:51.039+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:51.134 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:51.134 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:51.141 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:51.139+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:51.147 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:51.242 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:51.241+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:51.343 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:51.343+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:51.357 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:51.357 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:51.370 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:51.420 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 34 16 89138 89122 163.814 135.25 0.00554899 0.00610155 2024-04-26T10:33:51.429 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-26T10:33:51.444 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:51.443+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:51.545 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:51.543+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:51.553 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:51.553 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:51.570 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:51.654 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:51.653+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:51.747 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:51.746+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:51.790 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:51.790 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:51.805 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:51.847 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:51.846+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:51.948 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:51.947+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:52.027 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:52.027 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:52.043 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:52.049 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:52.048+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:52.149 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:52.148+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:52.209 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:52.209 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:52.223 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:52.250 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:52.249+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:52.352 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:52.351+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:52.398 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:52.398 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:52.413 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:52.420 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 35 16 91242 91226 162.89 131.5 0.0148339 0.00613657 2024-04-26T10:33:52.452 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:52.451+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:52.553 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:52.551+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:52.626 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:52.626 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:52.640 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:52.658 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:33:52.684 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:52.683+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:52.755 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:52.754+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:52.810 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:52.810 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:52.812 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:52.823 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:52.833 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:52.854 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:52.855 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:52.855 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:52.855 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:52.856 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:52.855+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:52.957 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:52.956+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:53.036 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:53.036 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:33:53.036 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:33:53.036 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:33:53.036 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:53.049 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:53.091 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:53.089+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:53.158 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:53.157+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:53.259 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:53.257+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:53.268 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:53.268 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 25.465536483000001, 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:53.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:33:53.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:53.274 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 25.464708402999999, 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.278 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:33:53.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:33:53.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.278 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.278 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:33:53.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:33:53.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.278 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.278 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:33:53.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:33:53.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 25.463779339999999, 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.280 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.282 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.283 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:53.286 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 25.463093899, 2024-04-26T10:33:53.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:33:53.286 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.286 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.286 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.286 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.286 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.286 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:33:53.286 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.286 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.286 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:33:53.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:33:53.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:33:53.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:33:53.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:33:53.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:33:53.289 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.289 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.289 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.289 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:33:53.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:33:53.289 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.289 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.289 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.289 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:33:53.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:33:53.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:33:53.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:33:53.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:33:53.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:33:53.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.291 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46220 5.0 5:0832587b:::benchmark_data_smithi043_45180_object46219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.2083184, 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020289430000000001, 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46220 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.292 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:53.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057256+0000", 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3852999999999999e-05 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057265+0000", 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8820000000000007e-06 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057271+0000", 2024-04-26T10:33:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4049999999999999e-06 2024-04-26T10:33:53.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.295 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.295 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064370+0000", 2024-04-26T10:33:53.295 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0070992870000000001 2024-04-26T10:33:53.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.295 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.295 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064469+0000", 2024-04-26T10:33:53.295 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8818000000000002e-05 2024-04-26T10:33:53.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.295 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064555+0000", 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6614999999999997e-05 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070612+0000", 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0060566459999999997 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077392+0000", 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0067803630000000002 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077438+0000", 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5265000000000001e-05 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077473+0000", 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4978999999999998e-05 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46224 5.0 5:055041a5:::benchmark_data_smithi043_45180_object46223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:53.297 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.207778729000001, 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019911091999999998, 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46224 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:53.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057723+0000", 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057722+0000", 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057751+0000", 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9025000000000001e-05 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057758+0000", 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8360000000000003e-06 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057764+0000", 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3650000000000003e-06 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065640+0000", 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0078760259999999995 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065735+0000", 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5358000000000004e-05 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.065881+0000", 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000146155 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070622+0000", 2024-04-26T10:33:53.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.004740874 2024-04-26T10:33:53.302 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.302 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077527+0000", 2024-04-26T10:33:53.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0069053710000000004 2024-04-26T10:33:53.302 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.302 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077589+0000", 2024-04-26T10:33:53.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1779999999999995e-05 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077634+0000", 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4861000000000003e-05 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46225 5.0 5:0c2c7e61:::benchmark_data_smithi043_45180_object46224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.207733427000001, 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019997917, 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.303 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46225 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057833+0000", 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5315999999999996e-05 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057840+0000", 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7220000000000002e-06 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057845+0000", 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1159999999999998e-06 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067208+0000", 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0093631259999999994 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067339+0000", 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013118900000000001 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067479+0000", 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013958800000000001 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070873+0000", 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0033947980000000001 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077696+0000", 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006822168 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077735+0000", 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9582999999999997e-05 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077766+0000", 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0882e-05 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.308 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46226 5.8 5:1735f934:::benchmark_data_smithi043_45180_object46225:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.207652150000001, 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019932222999999999, 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46226 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057849+0000", 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057904+0000", 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5458999999999999e-05 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057911+0000", 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5740000000000001e-06 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057917+0000", 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3899999999999998e-06 2024-04-26T10:33:53.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067195+0000", 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0092779960000000002 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067292+0000", 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6556000000000002e-05 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067399+0000", 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000107118 2024-04-26T10:33:53.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.071325+0000", 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0039254729999999996 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077687+0000", 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006362337 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077749+0000", 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2365000000000003e-05 2024-04-26T10:33:53.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077782+0000", 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2398999999999999e-05 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:48295 5.a e23/16 5:5d08b1be:::benchmark_data_smithi043_45180_object48294:head v 23'3088, mlcod=23'3083)", 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 20.371021652, 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020188498999999999, 2024-04-26T10:33:53.314 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.315 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894479+0000", 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894584+0000", 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000104863 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894594+0000", 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6760000000000002e-06 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894608+0000", 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4263e-05 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894687+0000", 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8311000000000003e-05 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894706+0000", 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9531999999999999e-05 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914628+0000", 2024-04-26T10:33:53.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019922314 2024-04-26T10:33:53.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914668+0000", 2024-04-26T10:33:53.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0080999999999998e-05 2024-04-26T10:33:53.318 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.318 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.318 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54079 5.0 5:0a7f1861:::benchmark_data_smithi043_45180_object54078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.885201708, 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020388585000000001, 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54079 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380299+0000", 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380329+0000", 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190000000000001e-05 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380341+0000", 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1715999999999999e-05 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380349+0000", 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7209999999999994e-06 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.321 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387457+0000", 2024-04-26T10:33:53.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0071078779999999998 2024-04-26T10:33:53.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.322 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.322 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387586+0000", 2024-04-26T10:33:53.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012915999999999999 2024-04-26T10:33:53.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.322 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.322 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387724+0000", 2024-04-26T10:33:53.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000138011 2024-04-26T10:33:53.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.393120+0000", 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0053964089999999996 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400595+0000", 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0074747279999999999 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400651+0000", 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6026000000000002e-05 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400688+0000", 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7336000000000003e-05 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:65241 5.4 5:27070447:::benchmark_data_smithi043_45180_object65240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:40.414586+0000", 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.850915497000001, 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019748102, 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.324 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 65241 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414586+0000", 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414586+0000", 2024-04-26T10:33:53.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414585+0000", 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414702+0000", 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000117125 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.326 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414711+0000", 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6929999999999996e-06 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.414719+0000", 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.416649+0000", 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019300960000000001 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.416764+0000", 2024-04-26T10:33:53.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000115611 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.416872+0000", 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000107243 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.418259+0000", 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001387288 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.434278+0000", 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.016018988000000001 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.434309+0000", 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0948000000000003e-05 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:40.434334+0000", 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.533e-05 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:76476 5.0 5:0877a31b:::benchmark_data_smithi043_45180_object76475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:45.544923+0000", 2024-04-26T10:33:53.329 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 7.720578808, 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.021067567999999998, 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 76476 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544923+0000", 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544923+0000", 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544922+0000", 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544947+0000", 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4961999999999999e-05 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544957+0000", 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7389999999999994e-06 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544960+0000", 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.349e-06 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.549294+0000", 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0043340109999999996 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.549421+0000", 2024-04-26T10:33:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012669800000000001 2024-04-26T10:33:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.549565+0000", 2024-04-26T10:33:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000144208 2024-04-26T10:33:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.553702+0000", 2024-04-26T10:33:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041373080000000001 2024-04-26T10:33:53.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.565915+0000", 2024-04-26T10:33:53.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012212212 2024-04-26T10:33:53.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.565966+0000", 2024-04-26T10:33:53.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1119000000000003e-05 2024-04-26T10:33:53.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.565990+0000", 2024-04-26T10:33:53.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4539e-05 2024-04-26T10:33:53.335 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.335 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.335 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.335 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:82981 5.4 5:2d6d9fdd:::benchmark_data_smithi043_45180_object82980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:53.335 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.547307+0000", 2024-04-26T10:33:53.335 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.7181949909999998, 2024-04-26T10:33:53.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.022009709999999998, 2024-04-26T10:33:53.335 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.335 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 82981 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547307+0000", 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547307+0000", 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547306+0000", 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547371+0000", 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4937000000000005e-05 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547380+0000", 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7229999999999993e-06 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547386+0000", 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5119999999999997e-06 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.550471+0000", 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0030849850000000002 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.550554+0000", 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3246999999999998e-05 2024-04-26T10:33:53.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.550642+0000", 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7309e-05 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.558827+0000", 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0081850859999999994 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569264+0000", 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010437327 2024-04-26T10:33:53.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569292+0000", 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8469000000000001e-05 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569316+0000", 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3816e-05 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.340 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.341 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:82983 5.4 5:239b8360:::benchmark_data_smithi043_45180_object82982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:53.341 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.548917+0000", 2024-04-26T10:33:53.341 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.7165843360000004, 2024-04-26T10:33:53.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020444285999999999, 2024-04-26T10:33:53.341 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.341 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.341 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.341 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.341 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.341 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 82983 2024-04-26T10:33:53.341 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.341 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.548917+0000", 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.548917+0000", 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.548917+0000", 2024-04-26T10:33:53.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.549007+0000", 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0612999999999995e-05 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.549015+0000", 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0620000000000001e-06 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.549022+0000", 2024-04-26T10:33:53.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2910000000000004e-06 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.554482+0000", 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0054603120000000002 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.554563+0000", 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0858000000000004e-05 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.554650+0000", 2024-04-26T10:33:53.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7478999999999994e-05 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.558862+0000", 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0042117279999999997 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569322+0000", 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.01046041 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569344+0000", 2024-04-26T10:33:53.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1994999999999999e-05 2024-04-26T10:33:53.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.346 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569362+0000", 2024-04-26T10:33:53.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7217000000000001e-05 2024-04-26T10:33:53.346 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.346 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.346 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.346 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:84530 5.d 5:b15f0501:::benchmark_data_smithi043_45180_object84529:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:53.346 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:49.255578+0000", 2024-04-26T10:33:53.347 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.0099235169999998, 2024-04-26T10:33:53.347 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.025106407000000001, 2024-04-26T10:33:53.347 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.347 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.347 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.347 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.347 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.347 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 84530 2024-04-26T10:33:53.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.347 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.347 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.347 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.347 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.255578+0000", 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.255578+0000", 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.255577+0000", 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.348 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.349 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.255645+0000", 2024-04-26T10:33:53.349 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7830000000000006e-05 2024-04-26T10:33:53.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.349 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.349 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.255654+0000", 2024-04-26T10:33:53.349 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.1549999999999996e-06 2024-04-26T10:33:53.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.349 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.349 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.255662+0000", 2024-04-26T10:33:53.349 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7069999999999992e-06 2024-04-26T10:33:53.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.264969+0000", 2024-04-26T10:33:53.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0093066899999999994 2024-04-26T10:33:53.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265101+0000", 2024-04-26T10:33:53.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000131827 2024-04-26T10:33:53.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:53.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265244+0000", 2024-04-26T10:33:53.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000143258 2024-04-26T10:33:53.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.273040+0000", 2024-04-26T10:33:53.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0077958460000000004 2024-04-26T10:33:53.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.280604+0000", 2024-04-26T10:33:53.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0075638770000000001 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.280645+0000", 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1498000000000001e-05 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.280684+0000", 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9471999999999997e-05 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:84537 5.d 5:b0a45e0d:::benchmark_data_smithi043_45180_object84536:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:49.261030+0000", 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.0044714270000004, 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019871521, 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 84537 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.353 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.261030+0000", 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.261030+0000", 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.261029+0000", 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.261102+0000", 2024-04-26T10:33:53.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2467999999999998e-05 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.261112+0000", 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0444e-05 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.261120+0000", 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0290000000000005e-06 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.355 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268748+0000", 2024-04-26T10:33:53.356 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0076277560000000003 2024-04-26T10:33:53.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.356 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.356 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.356 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268872+0000", 2024-04-26T10:33:53.356 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000123595 2024-04-26T10:33:53.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.356 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.356 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:53.356 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268999+0000", 2024-04-26T10:33:53.356 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012758999999999999 2024-04-26T10:33:53.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.356 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.273067+0000", 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0040677059999999999 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.280810+0000", 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0077432610000000004 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.280863+0000", 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2638e-05 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.357 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.280902+0000", 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8893999999999997e-05 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:84544 5.0 5:07b615ab:::benchmark_data_smithi043_45180_object84543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:49.263518+0000", 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.0019837230000004, 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.025660117999999999, 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.358 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 84544 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.263518+0000", 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.263518+0000", 2024-04-26T10:33:53.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.263517+0000", 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.263591+0000", 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4406999999999994e-05 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.263602+0000", 2024-04-26T10:33:53.360 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0764000000000001e-05 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.263610+0000", 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.79e-06 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268687+0000", 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0050767679999999997 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268796+0000", 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010949499999999999 2024-04-26T10:33:53.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268883+0000", 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7025000000000001e-05 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.272927+0000", 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.004044003 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289047+0000", 2024-04-26T10:33:53.362 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.016119379 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289151+0000", 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000104418 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289178+0000", 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6906999999999998e-05 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.363 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:84547 5.8 5:192782b7:::benchmark_data_smithi043_45180_object84546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:49.265035+0000", 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.0004669179999999, 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.024211801000000002, 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 84547 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.364 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265035+0000", 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265035+0000", 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265034+0000", 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.365 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.366 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265117+0000", 2024-04-26T10:33:53.366 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2992999999999996e-05 2024-04-26T10:33:53.366 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.366 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.366 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.366 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265126+0000", 2024-04-26T10:33:53.366 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3840000000000003e-06 2024-04-26T10:33:53.366 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.366 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.366 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.366 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265133+0000", 2024-04-26T10:33:53.366 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0040000000000002e-06 2024-04-26T10:33:53.366 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.272913+0000", 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0077799130000000003 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.273038+0000", 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000124645 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.273163+0000", 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012459 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.367 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.277550+0000", 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0043876999999999996 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289201+0000", 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.011651208 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289226+0000", 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4939999999999998e-05 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.368 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289246+0000", 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0075e-05 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:84551 5.8 5:1b72283c:::benchmark_data_smithi043_45180_object84550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:49.268122+0000", 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 3.997379708, 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.021167970000000001, 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.369 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 84551 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268122+0000", 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268122+0000", 2024-04-26T10:33:53.370 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268120+0000", 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268196+0000", 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5978999999999999e-05 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268202+0000", 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1360000000000002e-06 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.371 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268209+0000", 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.274924+0000", 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0067146649999999999 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.275058+0000", 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133638 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.372 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.373 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.373 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.275208+0000", 2024-04-26T10:33:53.373 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000150314 2024-04-26T10:33:53.373 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.373 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.373 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.373 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.277635+0000", 2024-04-26T10:33:53.373 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002426835 2024-04-26T10:33:53.373 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.373 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.373 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.373 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289251+0000", 2024-04-26T10:33:53.373 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.011616133000000001 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289274+0000", 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3346999999999999e-05 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289290+0000", 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5699999999999999e-05 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.374 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:84553 5.0 5:0ef3744a:::benchmark_data_smithi043_45180_object84552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:49.271081+0000", 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 3.994420775, 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.021857636999999999, 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 84553 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:53.375 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.271081+0000", 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.271081+0000", 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.271080+0000", 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.376 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.271136+0000", 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6100000000000002e-05 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.271147+0000", 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0859000000000001e-05 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.271153+0000", 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.913e-06 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:53.377 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.274911+0000", 2024-04-26T10:33:53.378 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003758665 2024-04-26T10:33:53.378 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.378 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.378 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:53.378 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.275034+0000", 2024-04-26T10:33:53.378 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012310199999999999 2024-04-26T10:33:53.378 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.378 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.378 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:53.378 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.275180+0000", 2024-04-26T10:33:53.378 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000146062 2024-04-26T10:33:53.378 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.378 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.280463+0000", 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.005282681 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.292871+0000", 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012407733000000001 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.292908+0000", 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6735e-05 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:53.379 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:53.380 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:53.380 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.292938+0000", 2024-04-26T10:33:53.380 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0827000000000001e-05 2024-04-26T10:33:53.380 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.380 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.380 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.380 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:53.380 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:53.380 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:53.382 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:53.382 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:53.380+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:53.420 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 36 16 93449 93433 162.197 137.938 0.010758 0.0061624 2024-04-26T10:33:53.441 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:33:53.482 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:53.481+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:53.566 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:53.566 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:53.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.566 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:93735 5.0 e30/16 5:044d6089:::benchmark_data_smithi043_45180_object93734:head v 30'5869, mlcod=30'5866)", 2024-04-26T10:33:53.566 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.558047+0000", 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0059675199999999996, 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059940729999999999, 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558047+0000", 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558047+0000", 2024-04-26T10:33:53.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558046+0000", 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558092+0000", 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6106000000000002e-05 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558101+0000", 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2449999999999998e-06 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558105+0000", 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6639999999999997e-06 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558328+0000", 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00022305400000000001 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:53.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558340+0000", 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1936000000000001e-05 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:93738 5.6 5:609e55f1:::benchmark_data_smithi043_45180_object93737:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.558439+0000", 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0055754009999999998, 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0056741930000000001, 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:53.570 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 93738 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558439+0000", 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558439+0000", 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558438+0000", 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558518+0000", 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0187999999999999e-05 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558535+0000", 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7260000000000001e-05 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558543+0000", 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2019999999999998e-06 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558581+0000", 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8185000000000001e-05 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558721+0000", 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013986200000000001 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:53.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558859+0000", 2024-04-26T10:33:53.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013803700000000001 2024-04-26T10:33:53.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:53.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.563751+0000", 2024-04-26T10:33:53.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0048924850000000002 2024-04-26T10:33:53.574 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.574 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.574 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.574 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:93736 5.e e30/16 5:7c9dce4a:::benchmark_data_smithi043_45180_object93735:head v 30'5823, mlcod=30'5821)", 2024-04-26T10:33:53.574 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.558473+0000", 2024-04-26T10:33:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0055410260000000001, 2024-04-26T10:33:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057375519999999999, 2024-04-26T10:33:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558473+0000", 2024-04-26T10:33:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558473+0000", 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558473+0000", 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558576+0000", 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102897 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558583+0000", 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6470000000000001e-06 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558587+0000", 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.78e-06 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558614+0000", 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6704e-05 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.558630+0000", 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5970000000000001e-05 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:93740 5.4 e30/16 5:2f7f2b74:::benchmark_data_smithi043_45180_object93739:head v 30'5840, mlcod=30'5838)", 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.559635+0000", 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0043798190000000001, 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0046428379999999998, 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.559635+0000", 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.559635+0000", 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.559634+0000", 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.559690+0000", 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6391000000000003e-05 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.559702+0000", 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1875999999999999e-05 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.559710+0000", 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5490000000000001e-06 2024-04-26T10:33:53.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:53.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.559747+0000", 2024-04-26T10:33:53.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6808999999999999e-05 2024-04-26T10:33:53.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:53.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.559768+0000", 2024-04-26T10:33:53.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1115e-05 2024-04-26T10:33:53.581 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.581 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.581 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:93743 5.0 e30/16 5:0bec6b1d:::benchmark_data_smithi043_45180_object93742:head v 30'5870, mlcod=30'5866)", 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.560132+0000", 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0038822499999999999, 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042072139999999999, 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560132+0000", 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560132+0000", 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560132+0000", 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560192+0000", 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0529000000000003e-05 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560203+0000", 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0903e-05 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560209+0000", 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3010000000000003e-06 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560244+0000", 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4479e-05 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560262+0000", 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8196999999999999e-05 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:93737 5.7 e30/16 5:e38cb3b1:::benchmark_data_smithi043_45180_object93736:head v 30'5795, mlcod=30'5792)", 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.560591+0000", 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0034235870000000001, 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038061919999999999, 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560591+0000", 2024-04-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560591+0000", 2024-04-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560590+0000", 2024-04-26T10:33:53.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560614+0000", 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3376000000000001e-05 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560630+0000", 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6535999999999999e-05 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560636+0000", 2024-04-26T10:33:53.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3800000000000002e-06 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560667+0000", 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1269999999999997e-05 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560688+0000", 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1432000000000001e-05 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.589 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:93744 5.b e30/16 5:db3671a7:::benchmark_data_smithi043_45180_object93743:head v 30'5951, mlcod=30'5949)", 2024-04-26T10:33:53.589 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.560789+0000", 2024-04-26T10:33:53.589 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0032250579999999998, 2024-04-26T10:33:53.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003665055, 2024-04-26T10:33:53.589 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.589 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:53.589 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560789+0000", 2024-04-26T10:33:53.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560789+0000", 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560789+0000", 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560854+0000", 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5273999999999999e-05 2024-04-26T10:33:53.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560866+0000", 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1428e-05 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560872+0000", 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.754e-06 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560908+0000", 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5713999999999997e-05 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560926+0000", 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7839e-05 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:93745 5.c 5:3c69b38d:::benchmark_data_smithi043_45180_object93744:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.560973+0000", 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0030413129999999999, 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035438319999999998, 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:53.592 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 93745 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560973+0000", 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560973+0000", 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.560972+0000", 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561099+0000", 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012664499999999999 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561112+0000", 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3566e-05 2024-04-26T10:33:53.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561122+0000", 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3540000000000006e-06 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561166+0000", 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4792000000000001e-05 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561309+0000", 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014290700000000001 2024-04-26T10:33:53.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561469+0000", 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015993600000000001 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:93747 5.c 5:3c14a880:::benchmark_data_smithi043_45180_object93746:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.561131+0000", 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.002883334, 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034629130000000002, 2024-04-26T10:33:53.596 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 93747 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561131+0000", 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561131+0000", 2024-04-26T10:33:53.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561131+0000", 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561165+0000", 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.472e-05 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561175+0000", 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0074999999999999e-05 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561182+0000", 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6270000000000002e-06 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.563883+0000", 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027015229999999999 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.564035+0000", 2024-04-26T10:33:53.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015180700000000001 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.564196+0000", 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000160538 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:93746 5.2 e30/16 5:45bbbdfd:::benchmark_data_smithi043_45180_object93745:head v 30'5914, mlcod=30'5912)", 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.561573+0000", 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0024416519999999999, 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030965089999999999, 2024-04-26T10:33:53.600 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561573+0000", 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561573+0000", 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561572+0000", 2024-04-26T10:33:53.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561599+0000", 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6771000000000002e-05 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561621+0000", 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1883e-05 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561628+0000", 2024-04-26T10:33:53.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6069999999999996e-06 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561711+0000", 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3497000000000004e-05 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561735+0000", 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3427000000000001e-05 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:93741 5.4 e30/16 5:247fe2c6:::benchmark_data_smithi043_45180_object93740:head v 30'5841, mlcod=30'5838)", 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.561940+0000", 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0020748799999999999, 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002789148, 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561940+0000", 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561940+0000", 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561939+0000", 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561987+0000", 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7590999999999999e-05 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561995+0000", 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1899999999999995e-06 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.561999+0000", 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.563867+0000", 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018679619999999999 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.563879+0000", 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1306e-05 2024-04-26T10:33:53.606 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:93750 5.0 e30/16 5:0e087509:::benchmark_data_smithi043_45180_object93749:head v 30'5871, mlcod=30'5866)", 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.562309+0000", 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0017051849999999999, 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024761729999999999, 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.562309+0000", 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.562309+0000", 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.562309+0000", 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.562368+0000", 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9283999999999997e-05 2024-04-26T10:33:53.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.562374+0000", 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5210000000000002e-06 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.562377+0000", 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1999999999999999e-06 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.563814+0000", 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014368180000000001 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.563829+0000", 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4972e-05 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:93749 5.b e30/16)", 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.562958+0000", 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00105608, 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018800259999999999, 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.610 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.562958+0000", 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.562958+0000", 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.562958+0000", 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.563010+0000", 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2281000000000003e-05 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.563016+0000", 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6980000000000003e-06 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.563019+0000", 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2909999999999999e-06 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:93745 5.c e30/16)", 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:53.564079+0000", 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9999356, 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00080366699999999999, 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.564079+0000", 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.564079+0000", 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:53.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.564079+0000", 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.564083+0000", 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1869999999999999e-06 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.564090+0000", 2024-04-26T10:33:53.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.097e-06 2024-04-26T10:33:53.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:53.615 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:53.615 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:53.615 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:53.564094+0000", 2024-04-26T10:33:53.615 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4700000000000004e-06 2024-04-26T10:33:53.615 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.615 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:53.615 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.615 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:53.615 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:33:53.615 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 14 2024-04-26T10:33:53.615 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:53.617 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:53.617 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:53.615+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:53.717 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:53.716+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:53.818 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:53.817+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:53.841 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:53.841 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:33:53.841 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:33:53.841 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:33:53.841 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:53.855 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:53.940 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:53.939+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:54.023 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:54.021+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:54.425 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 37 15 95626 95611 161.492 136.125 0.0100546 0.00618946 2024-04-26T10:33:54.426 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:33:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:33:54.426 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.281492475, 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:33:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:33:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:33:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:33:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:33:54.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:33:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:33:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:33:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:33:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:33:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:33:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:33:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:33:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:33:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.281491490000001, 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:33:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:33:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:33:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.281422867, 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.437 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:54.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:33:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:33:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:33:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:33:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:33:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:33:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:33:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:33:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:33:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:33:54.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:33:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:33:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:54.443 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.281371087, 2024-04-26T10:33:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:33:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:33:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:33:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:33:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:33:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:33:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:33:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:33:54.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:33:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:33:54.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:33:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:33:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:33:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:33:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:33:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:33:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:33:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:33:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:33:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:33:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:33:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.281311237000001, 2024-04-26T10:33:54.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:33:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:33:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:33:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:33:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:33:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:33:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:33:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:33:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:33:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:33:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:33:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:33:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:33:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:33:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:33:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:33:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:33:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:33:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:33:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:33:54.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:33:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:33:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:54.460 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.279598533000001, 2024-04-26T10:33:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:33:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:33:54.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:54.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:33:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:33:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:33:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:33:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:33:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:33:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:33:54.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:33:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:33:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:33:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:33:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:33:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:33:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:33:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:33:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:33:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:33:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:33:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:33:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:33:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:33:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:33:54.468 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.279483465999999, 2024-04-26T10:33:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:33:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:33:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:33:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:33:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:33:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:33:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:33:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:33:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:33:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:33:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.472 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:33:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:33:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:33:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:33:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:33:54.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:33:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.279390326000001, 2024-04-26T10:33:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:33:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:33:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:33:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:33:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:33:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:33:54.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:33:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:33:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:33:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:33:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:33:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:33:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:33:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:33:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:33:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:33:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:33:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:33:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:33:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:33:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:33:54.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:33:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:33:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:33:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:54.481 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.279196165999998, 2024-04-26T10:33:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:33:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:33:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:33:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:33:54.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:33:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:33:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:33:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:33:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:33:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:33:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:33:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.277988797999999, 2024-04-26T10:33:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:33:54.486 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:54.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:33:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:33:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:33:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:33:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:33:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:33:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:33:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.490 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.277179889999999, 2024-04-26T10:33:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:33:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.491 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:33:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:33:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:33:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:33:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:33:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:33:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:33:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:33:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:33:54.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:33:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:33:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:33:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:54.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:33:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:33:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:33:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:33:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:33:54.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:33:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:33:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:33:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:33:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.277076352000002, 2024-04-26T10:33:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:33:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:33:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:33:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:33:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:33:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:33:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:33:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:33:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:33:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:33:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:33:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:33:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:33:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:33:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:33:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:33:54.504 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.276999479000001, 2024-04-26T10:33:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:33:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.505 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:33:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:33:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:33:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:33:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:33:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:33:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:33:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:33:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:33:54.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:33:54.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:33:54.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:33:54.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:54.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:33:54.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:33:54.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:33:54.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:33:54.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:33:54.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:33:54.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:33:54.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:33:54.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:33:54.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:33:54.511 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.511 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:33:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.276884095, 2024-04-26T10:33:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:33:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:54.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:54.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:54.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:33:54.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:33:54.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:33:54.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:33:54.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:33:54.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:33:54.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:33:54.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:33:54.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:33:54.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:33:54.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:33:54.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:33:54.516 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.516 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.516 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.517 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:48295 5.a 5:5d08b1be:::benchmark_data_smithi043_45180_object48294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:54.517 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:54.517 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.188022902, 2024-04-26T10:33:54.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020783243999999999, 2024-04-26T10:33:54.517 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.517 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.517 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.517 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.517 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.517 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 48295 2024-04-26T10:33:54.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.518 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:54.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:54.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894137+0000", 2024-04-26T10:33:54.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:54.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894198+0000", 2024-04-26T10:33:54.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0192999999999998e-05 2024-04-26T10:33:54.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894209+0000", 2024-04-26T10:33:54.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1486e-05 2024-04-26T10:33:54.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.520 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894217+0000", 2024-04-26T10:33:54.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1370000000000002e-06 2024-04-26T10:33:54.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894251+0000", 2024-04-26T10:33:54.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3636000000000001e-05 2024-04-26T10:33:54.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894361+0000", 2024-04-26T10:33:54.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010988 2024-04-26T10:33:54.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:54.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894441+0000", 2024-04-26T10:33:54.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0549000000000004e-05 2024-04-26T10:33:54.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.897398+0000", 2024-04-26T10:33:54.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002956232 2024-04-26T10:33:54.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914869+0000", 2024-04-26T10:33:54.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017471582999999999 2024-04-26T10:33:54.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914901+0000", 2024-04-26T10:33:54.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1578999999999997e-05 2024-04-26T10:33:54.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914922+0000", 2024-04-26T10:33:54.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0965999999999999e-05 2024-04-26T10:33:54.523 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.523 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.523 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.524 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:48299 5.a 5:5776ea42:::benchmark_data_smithi043_45180_object48298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:54.524 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:54.524 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 21.187327102000001, 2024-04-26T10:33:54.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020205178000000001, 2024-04-26T10:33:54.524 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.524 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.524 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.525 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.525 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.525 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 48299 2024-04-26T10:33:54.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.525 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:54.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:54.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894834+0000", 2024-04-26T10:33:54.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894907+0000", 2024-04-26T10:33:54.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3622999999999996e-05 2024-04-26T10:33:54.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894914+0000", 2024-04-26T10:33:54.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:33:54.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894918+0000", 2024-04-26T10:33:54.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8e-06 2024-04-26T10:33:54.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.895863+0000", 2024-04-26T10:33:54.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00094444799999999997 2024-04-26T10:33:54.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.895976+0000", 2024-04-26T10:33:54.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000113736 2024-04-26T10:33:54.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:54.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.896101+0000", 2024-04-26T10:33:54.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012477699999999999 2024-04-26T10:33:54.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.899956+0000", 2024-04-26T10:33:54.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038552539999999998 2024-04-26T10:33:54.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914959+0000", 2024-04-26T10:33:54.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015002991 2024-04-26T10:33:54.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.915007+0000", 2024-04-26T10:33:54.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7404999999999998e-05 2024-04-26T10:33:54.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.915039+0000", 2024-04-26T10:33:54.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2750000000000003e-05 2024-04-26T10:33:54.531 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.531 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.531 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.531 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:56249 5.3 5:cd0b6957:::benchmark_data_smithi043_45180_object56248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:54.531 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:54.531 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.746483297000001, 2024-04-26T10:33:54.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019358055999999998, 2024-04-26T10:33:54.532 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.532 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.532 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.532 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.532 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.532 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 56249 2024-04-26T10:33:54.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.532 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:54.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:54.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335678+0000", 2024-04-26T10:33:54.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335801+0000", 2024-04-26T10:33:54.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012364900000000001 2024-04-26T10:33:54.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335808+0000", 2024-04-26T10:33:54.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6900000000000003e-06 2024-04-26T10:33:54.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335813+0000", 2024-04-26T10:33:54.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3650000000000003e-06 2024-04-26T10:33:54.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.343739+0000", 2024-04-26T10:33:54.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0079259840000000005 2024-04-26T10:33:54.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.343846+0000", 2024-04-26T10:33:54.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010697200000000001 2024-04-26T10:33:54.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:54.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.343977+0000", 2024-04-26T10:33:54.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000131283 2024-04-26T10:33:54.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349555+0000", 2024-04-26T10:33:54.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055777860000000004 2024-04-26T10:33:54.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.354963+0000", 2024-04-26T10:33:54.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054082599999999998 2024-04-26T10:33:54.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355004+0000", 2024-04-26T10:33:54.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0203000000000001e-05 2024-04-26T10:33:54.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355036+0000", 2024-04-26T10:33:54.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2434999999999997e-05 2024-04-26T10:33:54.537 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.537 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.538 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.538 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:56250 5.3 5:c16df6d5:::benchmark_data_smithi043_45180_object56249:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:54.538 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:54.538 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 17.746342417000001, 2024-04-26T10:33:54.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019349841, 2024-04-26T10:33:54.538 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.538 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.538 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.538 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.539 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.539 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 56250 2024-04-26T10:33:54.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.539 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:54.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:54.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335819+0000", 2024-04-26T10:33:54.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335906+0000", 2024-04-26T10:33:54.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7474999999999999e-05 2024-04-26T10:33:54.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335912+0000", 2024-04-26T10:33:54.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2539999999999998e-06 2024-04-26T10:33:54.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.335918+0000", 2024-04-26T10:33:54.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3430000000000003e-06 2024-04-26T10:33:54.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349571+0000", 2024-04-26T10:33:54.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013653367 2024-04-26T10:33:54.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349677+0000", 2024-04-26T10:33:54.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105791 2024-04-26T10:33:54.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:54.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.349768+0000", 2024-04-26T10:33:54.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1037000000000003e-05 2024-04-26T10:33:54.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.354950+0000", 2024-04-26T10:33:54.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051823199999999998 2024-04-26T10:33:54.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355103+0000", 2024-04-26T10:33:54.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015317299999999999 2024-04-26T10:33:54.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355140+0000", 2024-04-26T10:33:54.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7088000000000001e-05 2024-04-26T10:33:54.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:36.355169+0000", 2024-04-26T10:33:54.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8407000000000001e-05 2024-04-26T10:33:54.545 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.545 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.545 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.545 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:58496 5.a 5:5a7e82ac:::benchmark_data_smithi043_45180_object58495:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:54.545 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:37.329970+0000", 2024-04-26T10:33:54.546 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.7521916, 2024-04-26T10:33:54.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019239415999999999, 2024-04-26T10:33:54.546 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.546 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.546 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.546 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.546 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.546 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 58496 2024-04-26T10:33:54.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.546 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.329970+0000", 2024-04-26T10:33:54.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.329970+0000", 2024-04-26T10:33:54.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.329969+0000", 2024-04-26T10:33:54.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.330018+0000", 2024-04-26T10:33:54.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8959999999999999e-05 2024-04-26T10:33:54.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.330025+0000", 2024-04-26T10:33:54.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2269999999999996e-06 2024-04-26T10:33:54.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.330029+0000", 2024-04-26T10:33:54.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8539999999999999e-06 2024-04-26T10:33:54.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.335555+0000", 2024-04-26T10:33:54.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055257910000000004 2024-04-26T10:33:54.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.335721+0000", 2024-04-26T10:33:54.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016615099999999999 2024-04-26T10:33:54.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:54.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.335860+0000", 2024-04-26T10:33:54.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138913 2024-04-26T10:33:54.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.342727+0000", 2024-04-26T10:33:54.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0068670950000000001 2024-04-26T10:33:54.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.349128+0000", 2024-04-26T10:33:54.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064010869999999997 2024-04-26T10:33:54.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.349172+0000", 2024-04-26T10:33:54.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3297999999999998e-05 2024-04-26T10:33:54.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.349209+0000", 2024-04-26T10:33:54.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7540000000000003e-05 2024-04-26T10:33:54.552 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.552 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.552 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.552 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:58511 5.a 5:5da7faca:::benchmark_data_smithi043_45180_object58510:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:33:54.552 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:54.552 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.74334292, 2024-04-26T10:33:54.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.019708499000000001, 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 58511 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:54.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:54.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:54.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:54.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338818+0000", 2024-04-26T10:33:54.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:54.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338844+0000", 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338851+0000", 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2219999999999999e-06 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.338855+0000", 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8289999999999998e-06 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:54.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.346946+0000", 2024-04-26T10:33:54.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0080906450000000005 2024-04-26T10:33:54.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:54.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.347081+0000", 2024-04-26T10:33:54.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013469299999999999 2024-04-26T10:33:54.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:54.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.347225+0000", 2024-04-26T10:33:54.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000144704 2024-04-26T10:33:54.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:54.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.351702+0000", 2024-04-26T10:33:54.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044762930000000001 2024-04-26T10:33:54.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:54.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.358426+0000", 2024-04-26T10:33:54.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0067239170000000003 2024-04-26T10:33:54.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:54.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.358482+0000", 2024-04-26T10:33:54.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6889999999999999e-05 2024-04-26T10:33:54.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:54.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:54.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:54.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:37.358527+0000", 2024-04-26T10:33:54.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4465999999999997e-05 2024-04-26T10:33:54.558 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.558 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.559 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.559 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:54.559 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:54.559 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:54.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:54.560 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:33:54.560 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:33:54.560 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-26T10:33:54.560 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T10:33:54.560 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T10:33:54.560 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-26T10:33:54.562 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:54.427+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:54.562 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:54.560+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:54.563 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-26T10:33:54.663 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:54.662+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:54.728 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:96251 5.1 5:89a02487:::benchmark_data_smithi043_45180_object96250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.721488+0000", 2024-04-26T10:33:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0037623119999999999, 2024-04-26T10:33:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037830720000000002, 2024-04-26T10:33:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 96251 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.721488+0000", 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.721488+0000", 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.721487+0000", 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.721548+0000", 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1267999999999997e-05 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.721560+0000", 2024-04-26T10:33:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1459e-05 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.721568+0000", 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0560000000000005e-06 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.721620+0000", 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2284999999999998e-05 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.721749+0000", 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012889999999999999 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.721896+0000", 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014729200000000001 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.724635+0000", 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027390219999999998 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:96256 5.9 5:98b03237:::benchmark_data_smithi043_45180_object96255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.724916+0000", 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00033347699999999999, 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041733900000000002, 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 96256 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.724916+0000", 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.724916+0000", 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.724915+0000", 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.724974+0000", 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8232000000000001e-05 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.724983+0000", 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4099999999999997e-06 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.724989+0000", 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0650000000000004e-06 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725026+0000", 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6522e-05 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725162+0000", 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013620400000000001 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725316+0000", 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000154511 2024-04-26T10:33:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:96257 5.9 5.7eb5c629 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.724996+0000", 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00025350900000000002, 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044486500000000002, 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 96257 2024-04-26T10:33:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.724996+0000", 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.724996+0000", 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.724996+0000", 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725046+0000", 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9870999999999997e-05 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725051+0000", 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0629999999999996e-06 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725055+0000", 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5900000000000001e-06 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:96258 5.1 5.5f10e1e1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.725061+0000", 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00018869700000000001, 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00045462200000000001, 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 96258 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725061+0000", 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725061+0000", 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725061+0000", 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725089+0000", 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8027000000000001e-05 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725095+0000", 2024-04-26T10:33:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4269999999999996e-06 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725099+0000", 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.997e-06 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:96259 5.9 5.65199159 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.725376+0000", 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9998741, 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000175432, 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 96259 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725376+0000", 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725376+0000", 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725375+0000", 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725463+0000", 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7509000000000005e-05 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725476+0000", 2024-04-26T10:33:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3674e-05 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.725484+0000", 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1300000000000003e-06 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:96233 5.2 5:440f7acb:::benchmark_data_smithi043_45180_object96232:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.713329+0000", 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.011921318, 2024-04-26T10:33:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012256749000000001, 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 96233 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.713329+0000", 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.713329+0000", 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.713328+0000", 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.713421+0000", 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3190999999999996e-05 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.713432+0000", 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1012999999999999e-05 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.713439+0000", 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8419999999999999e-06 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.713474+0000", 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5549000000000001e-05 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.713589+0000", 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114924 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.713733+0000", 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014332799999999999 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.718439+0000", 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004706516 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:96237 5.2 5:454a5634:::benchmark_data_smithi043_45180_object96236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.715983+0000", 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0092666229999999999, 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0096808970000000008, 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 96237 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.715983+0000", 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.715983+0000", 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.715982+0000", 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.716082+0000", 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9743999999999999e-05 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.716092+0000", 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0063e-05 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.716100+0000", 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7349999999999996e-06 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.716128+0000", 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8296000000000001e-05 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.716212+0000", 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4098999999999996e-05 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.716300+0000", 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8428000000000001e-05 2024-04-26T10:33:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.721155+0000", 2024-04-26T10:33:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048542409999999996 2024-04-26T10:33:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:33:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 7 2024-04-26T10:33:54.755 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:54.756 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:54.757 INFO:teuthology.orchestra.run.smithi187.stdout: "success": "" 2024-04-26T10:33:54.757 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:54.757 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:54.763 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:54.762+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:54.865 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:54.864+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:54.867 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:33:54.923 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:54.924 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:33:54.924 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:33:54.924 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:33:54.924 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:54.940 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:54.984 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:54.983+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:55.016 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:55.036 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:55.057 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:55.058 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:55.058 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:55.058 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:55.068 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:55.066+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:55.114 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:55.114 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:55.129 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:55.170 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:55.168+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:55.269 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:55.268+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:55.303 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:55.303 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:55.319 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:55.371 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:55.369+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:55.420 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 38 16 97760 97744 160.75 133.312 0.00447834 0.00621806 2024-04-26T10:33:55.471 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:55.470+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:55.532 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:55.532 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:55.548 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:55.591 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:55.590+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:55.673 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:55.671+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:55.719 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:55.719 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:55.733 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:55.776 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:55.776+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:55.874 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:55.873+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:55.929 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:55.930 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:55.944 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:55.975 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:55.974+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:56.133 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:56.133 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:56.143 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:56.177 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:56.176+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:56.180 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:56.076+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:56.278 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:56.277+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:56.315 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:56.315 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:56.330 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:56.378 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:56.377+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:56.420 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 39 16 99618 99602 159.606 116.125 0.0117175 0.0062626 2024-04-26T10:33:56.480 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:56.479+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:56.497 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:56.498 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:56.513 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:56.564 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:33:56.581 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:56.579+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:56.681 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:56.681 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:56.681 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:56.680+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:56.694 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:56.782 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:56.781+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:56.862 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:56.862 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:56.876 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:56.882 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:56.881+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:56.983 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:56.982+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:57.050 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:57.050 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:57.063 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:57.071 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:33:57.107 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:57.106+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:57.185 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:57.185+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:57.222 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:57.228 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:57.228 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:57.242 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:57.242 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:57.263 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:57.264 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:57.264 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:57.264 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:57.285 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:57.284+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:57.386 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:57.384+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:57.420 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:2024-04-26T10:33:57.420225+0000 min lat: 0.00116398 max lat: 0.142932 avg lat: 0.00628815 2024-04-26T10:33:57.420 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T10:33:57.420 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 40 16 101763 101747 158.967 134.062 0.0088695 0.00628815 2024-04-26T10:33:57.443 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-26T10:33:57.454 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:57.454 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:33:57.454 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:33:57.454 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 29.650715845000001, 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.455 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:57.456 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:33:57.457 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.458 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.458 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.458 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:33:57.458 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:33:57.458 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.458 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.458 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.458 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:33:57.458 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:33:57.458 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.458 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.458 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.458 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.459 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:57.460 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 29.649887764999999, 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.461 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.462 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.462 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:33:57.462 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.462 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.462 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.462 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.462 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:33:57.462 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.462 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.462 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.462 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.462 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:33:57.462 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.463 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.464 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.465 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 29.648958702000002, 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.466 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:57.467 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.468 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.469 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.470 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:33:57.470 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:33:57.470 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.470 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.470 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.470 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:33:57.470 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:33:57.470 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.470 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.470 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.470 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:33:57.470 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:33:57.471 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 29.648273261, 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.472 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.473 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.474 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.474 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:33:57.474 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:57.474 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.474 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.474 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.474 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:33:57.474 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:33:57.474 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.474 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.474 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.474 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:33:57.474 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.475 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.476 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.477 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.478 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.478 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.478 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.478 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46220 5.0 5:0832587b:::benchmark_data_smithi043_45180_object46219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:57.478 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:57.478 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 25.393497761999999, 2024-04-26T10:33:57.478 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020289430000000001, 2024-04-26T10:33:57.478 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.478 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.478 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.478 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.478 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.478 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46220 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.479 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057183+0000", 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057256+0000", 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3852999999999999e-05 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057265+0000", 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8820000000000007e-06 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.480 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057271+0000", 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4049999999999999e-06 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064370+0000", 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0070992870000000001 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064469+0000", 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8818000000000002e-05 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.481 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.064555+0000", 2024-04-26T10:33:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6614999999999997e-05 2024-04-26T10:33:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070612+0000", 2024-04-26T10:33:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0060566459999999997 2024-04-26T10:33:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077392+0000", 2024-04-26T10:33:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0067803630000000002 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077438+0000", 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5265000000000001e-05 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077473+0000", 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4978999999999998e-05 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.483 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:46225 5.0 5:0c2c7e61:::benchmark_data_smithi043_45180_object46224:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 25.392912789, 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019997917, 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 46225 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.484 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057768+0000", 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.485 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.486 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.486 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057833+0000", 2024-04-26T10:33:57.486 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5315999999999996e-05 2024-04-26T10:33:57.486 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.486 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.486 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.486 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057840+0000", 2024-04-26T10:33:57.486 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7220000000000002e-06 2024-04-26T10:33:57.486 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.486 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.486 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.486 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.057845+0000", 2024-04-26T10:33:57.486 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1159999999999998e-06 2024-04-26T10:33:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067208+0000", 2024-04-26T10:33:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0093631259999999994 2024-04-26T10:33:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067339+0000", 2024-04-26T10:33:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013118900000000001 2024-04-26T10:33:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.487 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.067479+0000", 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013958800000000001 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.070873+0000", 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0033947980000000001 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077696+0000", 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006822168 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.488 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077735+0000", 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9582999999999997e-05 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.077766+0000", 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0882e-05 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:48295 5.a e23/16 5:5d08b1be:::benchmark_data_smithi043_45180_object48294:head v 23'3088, mlcod=23'3083)", 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:57.489 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 24.556201013999999, 2024-04-26T10:33:57.490 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020188498999999999, 2024-04-26T10:33:57.490 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.490 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.490 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.490 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.490 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.490 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:57.490 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.490 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.490 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.490 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.490 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894480+0000", 2024-04-26T10:33:57.490 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.491 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.491 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.491 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.491 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894479+0000", 2024-04-26T10:33:57.491 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.491 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.491 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.491 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.491 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894584+0000", 2024-04-26T10:33:57.491 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000104863 2024-04-26T10:33:57.491 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.491 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.491 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894594+0000", 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6760000000000002e-06 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894608+0000", 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4263e-05 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894687+0000", 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8311000000000003e-05 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.492 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.894706+0000", 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9531999999999999e-05 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914628+0000", 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019922314 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:32.914668+0000", 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0080999999999998e-05 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.493 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.494 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.494 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.494 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.494 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:54079 5.0 5:0a7f1861:::benchmark_data_smithi043_45180_object54078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:33:57.494 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:57.494 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 22.07038107, 2024-04-26T10:33:57.494 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020388585000000001, 2024-04-26T10:33:57.494 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.494 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.494 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.494 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.494 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.494 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 54079 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380300+0000", 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.495 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380299+0000", 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380329+0000", 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190000000000001e-05 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380341+0000", 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1715999999999999e-05 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.496 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.380349+0000", 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7209999999999994e-06 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387457+0000", 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0071078779999999998 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387586+0000", 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012915999999999999 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.497 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.387724+0000", 2024-04-26T10:33:57.498 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000138011 2024-04-26T10:33:57.498 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.498 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.498 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.498 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.393120+0000", 2024-04-26T10:33:57.498 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0053964089999999996 2024-04-26T10:33:57.498 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.498 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.498 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.498 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400595+0000", 2024-04-26T10:33:57.498 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0074747279999999999 2024-04-26T10:33:57.498 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.498 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.499 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.499 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400651+0000", 2024-04-26T10:33:57.499 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6026000000000002e-05 2024-04-26T10:33:57.499 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.499 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.499 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.499 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:35.400688+0000", 2024-04-26T10:33:57.499 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7336000000000003e-05 2024-04-26T10:33:57.499 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.499 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.499 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.499 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.499 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:76476 5.0 5:0877a31b:::benchmark_data_smithi043_45180_object76475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:45.544923+0000", 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 11.90575817, 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.021067567999999998, 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 76476 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.500 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544923+0000", 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544923+0000", 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544922+0000", 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.501 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544947+0000", 2024-04-26T10:33:57.502 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4961999999999999e-05 2024-04-26T10:33:57.502 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.502 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.502 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.502 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544957+0000", 2024-04-26T10:33:57.502 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7389999999999994e-06 2024-04-26T10:33:57.502 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.502 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.502 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.502 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.544960+0000", 2024-04-26T10:33:57.502 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.349e-06 2024-04-26T10:33:57.502 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.502 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.549294+0000", 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0043340109999999996 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.549421+0000", 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012669800000000001 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.549565+0000", 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000144208 2024-04-26T10:33:57.503 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.553702+0000", 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041373080000000001 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.565915+0000", 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012212212 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.565966+0000", 2024-04-26T10:33:57.504 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1119000000000003e-05 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:45.565990+0000", 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4539e-05 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:82981 5.4 5:2d6d9fdd:::benchmark_data_smithi043_45180_object82980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.547307+0000", 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.9033743530000002, 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.022009709999999998, 2024-04-26T10:33:57.505 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.506 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.506 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.506 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.506 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.506 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 82981 2024-04-26T10:33:57.506 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.506 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.506 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.506 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.506 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547307+0000", 2024-04-26T10:33:57.506 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.506 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.506 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547307+0000", 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547306+0000", 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547371+0000", 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4937000000000005e-05 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.507 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547380+0000", 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7229999999999993e-06 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.547386+0000", 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5119999999999997e-06 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.550471+0000", 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0030849850000000002 2024-04-26T10:33:57.508 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.550554+0000", 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3246999999999998e-05 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.550642+0000", 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7309e-05 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.558827+0000", 2024-04-26T10:33:57.509 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0081850859999999994 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569264+0000", 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010437327 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569292+0000", 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8469000000000001e-05 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.510 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569316+0000", 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3816e-05 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:82983 5.4 5:239b8360:::benchmark_data_smithi043_45180_object82982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:48.548917+0000", 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.9017636979999999, 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020444285999999999, 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.511 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 82983 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.548917+0000", 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.548917+0000", 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.512 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.548917+0000", 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.549007+0000", 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0612999999999995e-05 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.549015+0000", 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0620000000000001e-06 2024-04-26T10:33:57.513 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.514 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.514 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.514 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.549022+0000", 2024-04-26T10:33:57.514 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2910000000000004e-06 2024-04-26T10:33:57.514 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.514 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.514 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.514 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.554482+0000", 2024-04-26T10:33:57.514 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0054603120000000002 2024-04-26T10:33:57.514 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.514 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.514 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.514 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.554563+0000", 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0858000000000004e-05 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.554650+0000", 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7478999999999994e-05 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.558862+0000", 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0042117279999999997 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.515 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569322+0000", 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.01046041 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569344+0000", 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1994999999999999e-05 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:48.569362+0000", 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7217000000000001e-05 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.516 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:84530 5.d 5:b15f0501:::benchmark_data_smithi043_45180_object84529:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:49.255578+0000", 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.1951028790000002, 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.025106407000000001, 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 84530 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.517 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.255578+0000", 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.255578+0000", 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.255577+0000", 2024-04-26T10:33:57.518 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.255645+0000", 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7830000000000006e-05 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.255654+0000", 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.1549999999999996e-06 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.255662+0000", 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7069999999999992e-06 2024-04-26T10:33:57.519 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.264969+0000", 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0093066899999999994 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265101+0000", 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000131827 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265244+0000", 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000143258 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.520 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.273040+0000", 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0077958460000000004 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.280604+0000", 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0075638770000000001 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.280645+0000", 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1498000000000001e-05 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.521 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.522 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.522 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.280684+0000", 2024-04-26T10:33:57.522 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9471999999999997e-05 2024-04-26T10:33:57.522 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.522 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.522 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.522 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.522 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.522 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:84544 5.0 5:07b615ab:::benchmark_data_smithi043_45180_object84543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:57.522 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:49.263518+0000", 2024-04-26T10:33:57.522 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.1871630849999999, 2024-04-26T10:33:57.522 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.025660117999999999, 2024-04-26T10:33:57.522 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 84544 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.263518+0000", 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.523 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.263518+0000", 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.263517+0000", 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.263591+0000", 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4406999999999994e-05 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.524 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.263602+0000", 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0764000000000001e-05 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.263610+0000", 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.79e-06 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268687+0000", 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0050767679999999997 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.525 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.526 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268796+0000", 2024-04-26T10:33:57.526 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010949499999999999 2024-04-26T10:33:57.526 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.526 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.526 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.526 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268883+0000", 2024-04-26T10:33:57.526 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7025000000000001e-05 2024-04-26T10:33:57.526 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.526 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.526 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.526 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.272927+0000", 2024-04-26T10:33:57.526 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.004044003 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289047+0000", 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.016119379 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289151+0000", 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000104418 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289178+0000", 2024-04-26T10:33:57.527 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6906999999999998e-05 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:84547 5.8 5:192782b7:::benchmark_data_smithi043_45180_object84546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:49.265035+0000", 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.1856462800000003, 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.024211801000000002, 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 84547 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265035+0000", 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265035+0000", 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265034+0000", 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265117+0000", 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2992999999999996e-05 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265126+0000", 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3840000000000003e-06 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.265133+0000", 2024-04-26T10:33:57.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0040000000000002e-06 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.272913+0000", 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0077799130000000003 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.273038+0000", 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000124645 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.273163+0000", 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012459 2024-04-26T10:33:57.531 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.277550+0000", 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0043876999999999996 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289201+0000", 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.011651208 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289226+0000", 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4939999999999998e-05 2024-04-26T10:33:57.532 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289246+0000", 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0075e-05 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:84551 5.8 5:1b72283c:::benchmark_data_smithi043_45180_object84550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:49.268122+0000", 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.1825590699999999, 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.021167970000000001, 2024-04-26T10:33:57.533 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.534 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.534 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.534 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.534 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.534 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 84551 2024-04-26T10:33:57.534 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.534 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.534 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.534 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.534 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268122+0000", 2024-04-26T10:33:57.534 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.534 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.534 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268122+0000", 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268120+0000", 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268196+0000", 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5978999999999999e-05 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.535 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268202+0000", 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1360000000000002e-06 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.268209+0000", 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.274924+0000", 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0067146649999999999 2024-04-26T10:33:57.536 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.275058+0000", 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133638 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.275208+0000", 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000150314 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.277635+0000", 2024-04-26T10:33:57.537 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002426835 2024-04-26T10:33:57.538 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.538 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.538 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.538 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289251+0000", 2024-04-26T10:33:57.538 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.011616133000000001 2024-04-26T10:33:57.538 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.538 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.538 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.538 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289274+0000", 2024-04-26T10:33:57.538 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3346999999999999e-05 2024-04-26T10:33:57.538 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.538 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.538 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.539 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.289290+0000", 2024-04-26T10:33:57.539 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5699999999999999e-05 2024-04-26T10:33:57.539 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.539 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.539 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.539 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.539 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.539 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:84553 5.0 5:0ef3744a:::benchmark_data_smithi043_45180_object84552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-26T10:33:57.539 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:49.271081+0000", 2024-04-26T10:33:57.539 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.1796001369999995, 2024-04-26T10:33:57.539 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.021857636999999999, 2024-04-26T10:33:57.539 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.539 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 84553 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.271081+0000", 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.540 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.271081+0000", 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.271080+0000", 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.271136+0000", 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6100000000000002e-05 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.541 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.271147+0000", 2024-04-26T10:33:57.542 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0859000000000001e-05 2024-04-26T10:33:57.542 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.542 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.542 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.542 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.271153+0000", 2024-04-26T10:33:57.542 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.913e-06 2024-04-26T10:33:57.542 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.542 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.542 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.542 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.274911+0000", 2024-04-26T10:33:57.542 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003758665 2024-04-26T10:33:57.542 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.275034+0000", 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012310199999999999 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.275180+0000", 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000146062 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.280463+0000", 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.005282681 2024-04-26T10:33:57.543 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.292871+0000", 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.012407733000000001 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.292908+0000", 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6735e-05 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:49.292938+0000", 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0827000000000001e-05 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.544 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:96001 5.8 5:1d7dd672:::benchmark_data_smithi043_45180_object96000:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:54.591033+0000", 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 2.8596477380000001, 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.024133154, 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 96001 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.545 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.546 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.546 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.546 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591033+0000", 2024-04-26T10:33:57.546 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.546 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.546 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.546 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.546 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591033+0000", 2024-04-26T10:33:57.546 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.546 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.546 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.546 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.546 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591032+0000", 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591101+0000", 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8752999999999997e-05 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591109+0000", 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0150000000000003e-06 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.547 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591114+0000", 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7339999999999999e-06 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591153+0000", 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8974000000000003e-05 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591276+0000", 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000123266 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591425+0000", 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000149087 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.595328+0000", 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0039022359999999999 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.615081+0000", 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019753699999999999 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.549 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.615128+0000", 2024-04-26T10:33:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6721000000000002e-05 2024-04-26T10:33:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.615166+0000", 2024-04-26T10:33:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8396000000000003e-05 2024-04-26T10:33:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:96003 5.0 5:0c791534:::benchmark_data_smithi043_45180_object96002:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:57.550 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:54.591471+0000", 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 2.8592100189999998, 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.023579477000000001, 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 96003 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591471+0000", 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.551 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591471+0000", 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591471+0000", 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591567+0000", 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5958000000000005e-05 2024-04-26T10:33:57.552 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591572+0000", 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5790000000000003e-06 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591576+0000", 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.613e-06 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591608+0000", 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2094999999999997e-05 2024-04-26T10:33:57.553 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591705+0000", 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7417999999999995e-05 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591802+0000", 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6453999999999995e-05 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.593903+0000", 2024-04-26T10:33:57.554 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0021016189999999999 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.614997+0000", 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.021093311 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.615028+0000", 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1279000000000003e-05 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.615050+0000", 2024-04-26T10:33:57.555 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2529000000000001e-05 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:96004 5.8 5:1b189395:::benchmark_data_smithi043_45180_object96003:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:54.591581+0000", 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 2.8591001949999999, 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.023666471000000001, 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.556 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 96004 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591581+0000", 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591581+0000", 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.558 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591580+0000", 2024-04-26T10:33:57.558 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.558 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.558 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.558 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.558 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591649+0000", 2024-04-26T10:33:57.558 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8695000000000006e-05 2024-04-26T10:33:57.558 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.558 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.558 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.558 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591653+0000", 2024-04-26T10:33:57.558 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2939999999999999e-06 2024-04-26T10:33:57.558 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.591657+0000", 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4419999999999998e-06 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.593327+0000", 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016700599999999999 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.593442+0000", 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000115442 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.559 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.593573+0000", 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000130674 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.595624+0000", 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020506029999999998 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.615202+0000", 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.019578403000000001 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.560 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.615228+0000", 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5553000000000001e-05 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.615247+0000", 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9630999999999999e-05 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:96634 5.e 5:7fa85aaf:::benchmark_data_smithi043_45180_object96633:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:54.904055+0000", 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 2.5466264199999999, 2024-04-26T10:33:57.561 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.020848094000000001, 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 96634 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.904055+0000", 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.562 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.904055+0000", 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.904054+0000", 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.904121+0000", 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7210000000000002e-05 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.563 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.904130+0000", 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5690000000000005e-06 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.904138+0000", 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0770000000000008e-06 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.910771+0000", 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066335910000000003 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.564 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.910896+0000", 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000124931 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.911032+0000", 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013542 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.913113+0000", 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020811079999999999 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.565 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.924845+0000", 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.011732298 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.924880+0000", 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:54.924903+0000", 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2931000000000001e-05 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.566 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:57.567 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:57.567 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:57.568 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:57.566+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:57.569 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:57.669 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:57.668+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:57.752 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:57.752 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:57.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.752 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:102426 5.b e32/16 5:d099348c:::benchmark_data_smithi043_45180_object102425:head v 32'6480, mlcod=32'6478)", 2024-04-26T10:33:57.752 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.741467+0000", 2024-04-26T10:33:57.752 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0080886320000000001, 2024-04-26T10:33:57.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0081079710000000003, 2024-04-26T10:33:57.752 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741467+0000", 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741467+0000", 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741466+0000", 2024-04-26T10:33:57.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:57.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741534+0000", 2024-04-26T10:33:57.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7179000000000002e-05 2024-04-26T10:33:57.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:57.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741539+0000", 2024-04-26T10:33:57.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3959999999999997e-06 2024-04-26T10:33:57.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741543+0000", 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7670000000000001e-06 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741576+0000", 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3247000000000002e-05 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741594+0000", 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8173999999999999e-05 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:102429 5.6 5:655d9a63:::benchmark_data_smithi043_45180_object102428:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.741855+0000", 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0077006469999999997, 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007766434, 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 102429 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:57.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741855+0000", 2024-04-26T10:33:57.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:57.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741855+0000", 2024-04-26T10:33:57.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:57.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741854+0000", 2024-04-26T10:33:57.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:57.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741922+0000", 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8279000000000001e-05 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741944+0000", 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1668e-05 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741952+0000", 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:33:57.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743993+0000", 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020416290000000001 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.744129+0000", 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000135456 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.744254+0000", 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012521900000000001 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.747365+0000", 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031110450000000002 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:102430 5.5 5:a563236d:::benchmark_data_smithi043_45180_object102429:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.741961+0000", 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0075942479999999996, 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0077165920000000004, 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:57.760 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 102430 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741961+0000", 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741961+0000", 2024-04-26T10:33:57.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741959+0000", 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999976 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741991+0000", 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1955999999999997e-05 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:57.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.741998+0000", 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1199999999999996e-06 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.742004+0000", 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2430000000000002e-06 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.742546+0000", 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00054160700000000005 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.742639+0000", 2024-04-26T10:33:57.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3354000000000001e-05 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.742734+0000", 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4630999999999996e-05 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746592+0000", 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038582949999999999 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.764 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:102427 5.e e32/16 5:75c15e62:::benchmark_data_smithi043_45180_object102426:head v 32'6365, mlcod=32'6362)", 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.743133+0000", 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.006422344, 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065939689999999999, 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743133+0000", 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:57.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743133+0000", 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743132+0000", 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743189+0000", 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6030999999999999e-05 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:57.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743199+0000", 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0115999999999999e-05 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743205+0000", 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1739999999999997e-06 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743879+0000", 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00067375599999999996 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743894+0000", 2024-04-26T10:33:57.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5760000000000002e-05 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:102428 5.b e32/16 5:d6003daa:::benchmark_data_smithi043_45180_object102427:head v 32'6481, mlcod=32'6478)", 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.743271+0000", 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0062846680000000002, 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064972299999999997, 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743271+0000", 2024-04-26T10:33:57.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743271+0000", 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743270+0000", 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743334+0000", 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3732000000000006e-05 2024-04-26T10:33:57.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:57.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743342+0000", 2024-04-26T10:33:57.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2160000000000006e-06 2024-04-26T10:33:57.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743348+0000", 2024-04-26T10:33:57.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5759999999999996e-06 2024-04-26T10:33:57.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:57.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.745654+0000", 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023057960000000001 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.745670+0000", 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6452000000000001e-05 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:102431 5.1 e32/16 5:8996ec34:::benchmark_data_smithi043_45180_object102430:head v 32'6465, mlcod=32'6463)", 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.743340+0000", 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0062158580000000003, 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.006475008, 2024-04-26T10:33:57.771 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743340+0000", 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743340+0000", 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743339+0000", 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743392+0000", 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3208999999999998e-05 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743404+0000", 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1603999999999999e-05 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743413+0000", 2024-04-26T10:33:57.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7949999999999996e-06 2024-04-26T10:33:57.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:57.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743441+0000", 2024-04-26T10:33:57.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8121999999999999e-05 2024-04-26T10:33:57.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:57.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.743453+0000", 2024-04-26T10:33:57.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.272e-05 2024-04-26T10:33:57.774 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:102433 5.0 e32/16 5:04a20e9b:::benchmark_data_smithi043_45180_object102432:head v 32'6395, mlcod=32'6393)", 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.745268+0000", 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0042871369999999999, 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045858060000000004, 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.745268+0000", 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.745268+0000", 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.745268+0000", 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:57.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.745319+0000", 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1749999999999997e-05 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.745329+0000", 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2860000000000005e-06 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.745336+0000", 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2910000000000002e-06 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:57.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.745375+0000", 2024-04-26T10:33:57.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8852e-05 2024-04-26T10:33:57.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:57.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.745392+0000", 2024-04-26T10:33:57.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7373000000000001e-05 2024-04-26T10:33:57.778 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.778 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:57.778 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.778 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:102434 5.1 e32/16 5:8dd6d26d:::benchmark_data_smithi043_45180_object102433:head v 32'6466, mlcod=32'6463)", 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.746416+0000", 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0031398060000000002, 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034824859999999999, 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746416+0000", 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746416+0000", 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746415+0000", 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746468+0000", 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3402999999999997e-05 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746475+0000", 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:33:57.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746479+0000", 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5389999999999999e-06 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746510+0000", 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1047000000000003e-05 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746529+0000", 2024-04-26T10:33:57.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9320000000000001e-05 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:102439 5.4 e32/16 5:23181039:::benchmark_data_smithi043_45180_object102438:head v 32'6386, mlcod=32'6384)", 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.746845+0000", 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.002710554, 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030912959999999999, 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:57.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746845+0000", 2024-04-26T10:33:57.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:57.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746845+0000", 2024-04-26T10:33:57.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:57.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746845+0000", 2024-04-26T10:33:57.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746933+0000", 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8687e-05 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746939+0000", 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9050000000000002e-06 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746942+0000", 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.287e-06 2024-04-26T10:33:57.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:57.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746975+0000", 2024-04-26T10:33:57.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2351999999999998e-05 2024-04-26T10:33:57.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:57.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.746988+0000", 2024-04-26T10:33:57.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3626e-05 2024-04-26T10:33:57.785 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.785 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:57.785 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.786 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:102435 5.1 e32/16 5:8c6f1560:::benchmark_data_smithi043_45180_object102434:head v 32'6467, mlcod=32'6463)", 2024-04-26T10:33:57.786 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.748067+0000", 2024-04-26T10:33:57.786 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0014880679999999999, 2024-04-26T10:33:57.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019069639999999999, 2024-04-26T10:33:57.786 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:57.786 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:57.786 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:57.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:57.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748067+0000", 2024-04-26T10:33:57.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748067+0000", 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748067+0000", 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748178+0000", 2024-04-26T10:33:57.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110938 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748188+0000", 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9320000000000008e-06 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748193+0000", 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3800000000000002e-06 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748250+0000", 2024-04-26T10:33:57.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7275000000000003e-05 2024-04-26T10:33:57.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:57.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748268+0000", 2024-04-26T10:33:57.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8014000000000001e-05 2024-04-26T10:33:57.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.789 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:57.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.789 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:102440 5.7 e32/16 5:ee81d04d:::benchmark_data_smithi043_45180_object102439:head v 32'6359, mlcod=32'6357)", 2024-04-26T10:33:57.789 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.748893+0000", 2024-04-26T10:33:57.789 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00066226100000000003, 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011170189999999999, 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748893+0000", 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748893+0000", 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748893+0000", 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748950+0000", 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7234999999999997e-05 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748958+0000", 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.627e-06 2024-04-26T10:33:57.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.748962+0000", 2024-04-26T10:33:57.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3889999999999998e-06 2024-04-26T10:33:57.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:57.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.749010+0000", 2024-04-26T10:33:57.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.774e-05 2024-04-26T10:33:57.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:57.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.749022+0000", 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.218e-05 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:102441 5.8 e32/16 5:1a9aa6e4:::benchmark_data_smithi043_45180_object102440:head v 32'6548, mlcod=32'6546)", 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.749490+0000", 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.5134000000000004e-05, 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000554825, 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:57.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.749490+0000", 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.749490+0000", 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.749490+0000", 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:57.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:57.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.749547+0000", 2024-04-26T10:33:57.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6807e-05 2024-04-26T10:33:57.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:57.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.749555+0000", 2024-04-26T10:33:57.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9289999999999998e-06 2024-04-26T10:33:57.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.749559+0000", 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7999999999999998e-06 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.749600+0000", 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0772000000000002e-05 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.749621+0000", 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1219000000000001e-05 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:102443 5.6 5.5ed378e6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.750010+0000", 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9995451, 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1045999999999997e-05, 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 102443 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:57.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.750010+0000", 2024-04-26T10:33:57.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:57.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.750010+0000", 2024-04-26T10:33:57.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:57.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:57.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.750009+0000", 2024-04-26T10:33:57.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:57.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.750056+0000", 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7036999999999997e-05 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.750070+0000", 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3908e-05 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.750075+0000", 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9710000000000003e-06 2024-04-26T10:33:57.799 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.800 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:57.800 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.800 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:57.800 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:33:57.800 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 13 2024-04-26T10:33:57.800 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:57.801 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:57.802 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:57.801+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:57.902 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:57.900+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:57.986 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:57.986 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:33:57.986 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:33:57.986 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:33:57.986 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:57.998 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:33:58.042 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:58.041+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:58.103 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:58.102+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:58.188 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.381904505000001, 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.189 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:33:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:33:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:33:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:33:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:33:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:33:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:33:58.194 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.381903520000002, 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:33:58.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:33:58.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:33:58.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.381834897000001, 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:58.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.203 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.381783117000001, 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.381723267000002, 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.209 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:33:58.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:33:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:33:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.380010562999999, 2024-04-26T10:33:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:33:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.214 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:33:58.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:33:58.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:33:58.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:33:58.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:33:58.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:33:58.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.219 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.379895496, 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:58.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:33:58.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:33:58.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:33:58.223 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.379802355999999, 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.224 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:33:58.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:33:58.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:33:58.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:33:58.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:33:58.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:33:58.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.229 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.379608196, 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:58.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:33:58.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.233 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.378400828, 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:33:58.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.37759192, 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.237 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:33:58.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:33:58.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:33:58.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:58.242 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.377488381999999, 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:33:58.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:33:58.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:33:58.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.377411509000002, 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.249 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:33:58.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:33:58.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:33:58.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:33:58.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:33:58.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:33:58.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:33:58.254 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.254 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.254 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.377296125000001, 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:58.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:33:58.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:33:58.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:33:58.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:48295 5.a 5:5d08b1be:::benchmark_data_smithi043_45180_object48294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 25.288434932000001, 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020783243999999999, 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 48295 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894138+0000", 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894137+0000", 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894198+0000", 2024-04-26T10:33:58.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0192999999999998e-05 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894209+0000", 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1486e-05 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894217+0000", 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1370000000000002e-06 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894251+0000", 2024-04-26T10:33:58.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3636000000000001e-05 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894361+0000", 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010988 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.894441+0000", 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0549000000000004e-05 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.897398+0000", 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002956232 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914869+0000", 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017471582999999999 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914901+0000", 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1578999999999997e-05 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:32.914922+0000", 2024-04-26T10:33:58.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0965999999999999e-05 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:96001 5.8 e31/16 5:1d7dd672:::benchmark_data_smithi043_45180_object96000:head v 31'6109, mlcod=31'6107)", 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:54.592750+0000", 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5898232189999999, 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.022218347999999999, 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:54.592750+0000", 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:54.592750+0000", 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:54.592750+0000", 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:54.592784+0000", 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3603999999999999e-05 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:54.594787+0000", 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020031200000000002 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:54.594795+0000", 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9359999999999999e-06 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:54.594827+0000", 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2381e-05 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:54.594841+0000", 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4419999999999999e-05 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:54.614942+0000", 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020100979000000001 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:54.614969+0000", 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6152e-05 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:102385 5.a 5:5d64fd8d:::benchmark_data_smithi043_45180_object102384:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.708018+0000", 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.47455565799999999, 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.024585424000000002, 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.268 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 102385 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.708018+0000", 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.708018+0000", 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.708017+0000", 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.708146+0000", 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012887599999999999 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.708155+0000", 2024-04-26T10:33:58.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.867e-06 2024-04-26T10:33:58.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.708162+0000", 2024-04-26T10:33:58.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.153e-06 2024-04-26T10:33:58.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.710553+0000", 2024-04-26T10:33:58.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023914029999999998 2024-04-26T10:33:58.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.710711+0000", 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000157603 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.710902+0000", 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00019094899999999999 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.725929+0000", 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.015027309000000001 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.732501+0000", 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.006572339 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.732558+0000", 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6790999999999999e-05 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.732603+0000", 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4901000000000003e-05 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.273 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:102388 5.a 5:5488e399:::benchmark_data_smithi043_45180_object102387:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.710889+0000", 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.47168411900000001, 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.021816489000000001, 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 102388 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.274 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.710889+0000", 2024-04-26T10:33:58.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.710889+0000", 2024-04-26T10:33:58.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.710888+0000", 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.710944+0000", 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5452999999999999e-05 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.710952+0000", 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3909999999999998e-06 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.710958+0000", 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.268e-06 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.712624+0000", 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001665581 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.712762+0000", 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138169 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.712909+0000", 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014651099999999999 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.725961+0000", 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013052452000000001 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.732618+0000", 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.006656347 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.732670+0000", 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2886999999999997e-05 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.732706+0000", 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5376999999999997e-05 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:102391 5.c 5:365af1ce:::benchmark_data_smithi043_45180_object102390:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.712565+0000", 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.47000802899999999, 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.023061687000000001, 2024-04-26T10:33:58.279 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 102391 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.712565+0000", 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.712565+0000", 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.712565+0000", 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.712607+0000", 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2011000000000001e-05 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.712616+0000", 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7970000000000006e-06 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.712622+0000", 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5950000000000004e-06 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.712667+0000", 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4518999999999998e-05 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.712766+0000", 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9369000000000004e-05 2024-04-26T10:33:58.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.712917+0000", 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000151187 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.725829+0000", 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012912132999999999 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.735478+0000", 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0096488830000000005 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.735584+0000", 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106057 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.735627+0000", 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2777000000000001e-05 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:102393 5.a 5:561e8e69:::benchmark_data_smithi043_45180_object102392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:57.713969+0000", 2024-04-26T10:33:58.284 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.46860472600000003, 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.025006189000000002, 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 102393 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.713969+0000", 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.713969+0000", 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.713968+0000", 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.714040+0000", 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1699999999999995e-05 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.714050+0000", 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0791999999999999e-05 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.714057+0000", 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8109999999999997e-06 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.728234+0000", 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0141767 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:33:58.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.728383+0000", 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014935400000000001 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.728546+0000", 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016310200000000001 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.732469+0000", 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00392246 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.738890+0000", 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064210830000000002 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.738943+0000", 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3148e-05 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:57.738975+0000", 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1823999999999999e-05 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.289 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.290 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:33:58.290 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:33:58.290 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:33:58.292 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:58.289+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:58.292 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:33:58.420 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 41 16 103671 103655 157.998 119.25 0.00255816 0.00632149 2024-04-26T10:33:58.445 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:58.445 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:58.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.445 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103660 5.9 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.445 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:33:58.445 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.061864369000000002, 2024-04-26T10:33:58.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.061894818999999997, 2024-04-26T10:33:58.445 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.445 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:58.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.446 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103660 2024-04-26T10:33:58.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.446 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:33:58.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:33:58.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382365+0000", 2024-04-26T10:33:58.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382430+0000", 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4850000000000004e-05 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382439+0000", 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382445+0000", 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0229999999999998e-06 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382482+0000", 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6909000000000002e-05 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382613+0000", 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013072600000000001 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382756+0000", 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000143306 2024-04-26T10:33:58.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385090+0000", 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002333786 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103662 5.f 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.059420558999999998, 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.059505241, 2024-04-26T10:33:58.452 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103662 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384809+0000", 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384908+0000", 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9146000000000002e-05 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384921+0000", 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2622e-05 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384931+0000", 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0108e-05 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384984+0000", 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2849000000000002e-05 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017266800000000001 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385313+0000", 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015649300000000001 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388446+0000", 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003133481 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.456 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103664 5.9 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.059137874999999999, 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.059267601000000003, 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103664 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.457 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385092+0000", 2024-04-26T10:33:58.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385145+0000", 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3143000000000003e-05 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0473e-05 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385163+0000", 2024-04-26T10:33:58.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385193+0000", 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0638e-05 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385284+0000", 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599000000000005e-05 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385375+0000", 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0606999999999995e-05 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387556+0000", 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021809529999999998 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103666 5.f 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:33:58.461 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.057374502000000001, 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.057548425, 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103666 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386855+0000", 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386928+0000", 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386937+0000", 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1090000000000004e-06 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386945+0000", 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386981+0000", 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5899999999999998e-05 2024-04-26T10:33:58.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387071+0000", 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9954e-05 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387161+0000", 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0898999999999998e-05 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390584+0000", 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034229030000000001 2024-04-26T10:33:58.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103667 5.f 5:f4dc36e8:::benchmark_data_smithi043_45180_object103666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.056513432000000002, 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.056730456999999998, 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.466 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103667 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387783+0000", 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5973e-05 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387791+0000", 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1850000000000004e-06 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387796+0000", 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388469+0000", 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0006734 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388547+0000", 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7188999999999996e-05 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388630+0000", 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3892000000000002e-05 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390598+0000", 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00196759 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 5 2024-04-26T10:33:58.470 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:58.471 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:58.390+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:58.472 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:33:58.492 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:58.491+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:58.593 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:58.591+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:58.648 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:58.648 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:33:58.648 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:33:58.648 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:33:58.648 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:58.662 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:33:58.703 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:58.701+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:58.795 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:58.794+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:58.876 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:33:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:33:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:33:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:33:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:16 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:33:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.879496703000001, 2024-04-26T10:33:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020879298000000001, 2024-04-26T10:33:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994017+0000", 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1459999999999999e-06 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994021+0000", 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2169999999999996e-06 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994025+0000", 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3450000000000002e-06 2024-04-26T10:33:58.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996368+0000", 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002342841 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996374+0000", 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6590000000000001e-06 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010589+0000", 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014214648999999999 2024-04-26T10:33:58.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010670+0000", 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1463000000000003e-05 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010824+0000", 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000154007 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.013067+0000", 2024-04-26T10:33:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022428629999999999 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014821+0000", 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017534530000000001 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014860+0000", 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9264000000000002e-05 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014895+0000", 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4619999999999997e-05 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.073401576999998, 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:95997 5.7 5:ef48f664:::benchmark_data_smithi043_45180_object95996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:58.888 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.2881920960000004, 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024010581999999999, 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 95997 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585344+0000", 2024-04-26T10:33:58.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4491e-05 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585350+0000", 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1099999999999999e-06 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585355+0000", 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5430000000000004e-06 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592076+0000", 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067208470000000003 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592209+0000", 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013344400000000001 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592320+0000", 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011081700000000001 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.594282+0000", 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019622699999999999 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609277+0000", 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014995066 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609308+0000", 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1242999999999999e-05 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609331+0000", 2024-04-26T10:33:58.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2150999999999998e-05 2024-04-26T10:33:58.894 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.894 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.894 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.894 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101453 5.f 5:f3a9423f:::benchmark_data_smithi043_45180_object101452:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:58.894 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.269703+0000", 2024-04-26T10:33:58.894 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.6038086069999999, 2024-04-26T10:33:58.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020808193999999999, 2024-04-26T10:33:58.894 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.894 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101453 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269703+0000", 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269703+0000", 2024-04-26T10:33:58.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269703+0000", 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269847+0000", 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014370799999999999 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269854+0000", 2024-04-26T10:33:58.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7360000000000001e-06 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269859+0000", 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9339999999999997e-06 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269889+0000", 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9448999999999999e-05 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270000+0000", 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111566 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270130+0000", 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129758 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276243+0000", 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061132529999999999 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.290455+0000", 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014212103 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.290490+0000", 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4567999999999998e-05 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.290512+0000", 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1716e-05 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101455 5.f 5:fbcc5be4:::benchmark_data_smithi043_45180_object101454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.603530908, 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02195165, 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101455 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270103+0000", 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122309 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270111+0000", 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3999999999999992e-06 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270118+0000", 2024-04-26T10:33:58.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9179999999999997e-06 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272018+0000", 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018998610000000001 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272126+0000", 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010844999999999999 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272225+0000", 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8381999999999994e-05 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278402+0000", 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061767009999999997 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291830+0000", 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013428756 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291894+0000", 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3189999999999996e-05 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291933+0000", 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9297e-05 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101456 5.f 5:f61cae04:::benchmark_data_smithi043_45180_object101455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:33:58.905 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.603249726, 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021829133000000001, 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101456 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270361+0000", 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9395999999999995e-05 2024-04-26T10:33:58.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270369+0000", 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5490000000000001e-06 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270374+0000", 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5130000000000004e-06 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273610+0000", 2024-04-26T10:33:58.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003235791 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273723+0000", 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112833 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273861+0000", 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013803 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278411+0000", 2024-04-26T10:33:58.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045506380000000001 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291986+0000", 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013574409000000001 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292037+0000", 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1041000000000001e-05 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292091+0000", 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4617000000000002e-05 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101459 5.f 5:f6287f2a:::benchmark_data_smithi043_45180_object101458:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.6013368180000001, 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022608105999999999, 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.911 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101459 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272227+0000", 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2669e-05 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272236+0000", 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0210000000000005e-06 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272243+0000", 2024-04-26T10:33:58.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7469999999999999e-06 2024-04-26T10:33:58.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276304+0000", 2024-04-26T10:33:58.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040604789999999997 2024-04-26T10:33:58.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276386+0000", 2024-04-26T10:33:58.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2278000000000001e-05 2024-04-26T10:33:58.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276477+0000", 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0713999999999999e-05 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278905+0000", 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024288249999999999 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294715+0000", 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015809976999999999 2024-04-26T10:33:58.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294747+0000", 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1814999999999999e-05 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294783+0000", 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6180999999999998e-05 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101461 5.f 5:fcae472f:::benchmark_data_smithi043_45180_object101460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.600543558, 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021972760000000001, 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101461 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272968+0000", 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273035+0000", 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7477000000000005e-05 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273043+0000", 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4159999999999998e-06 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273049+0000", 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4509999999999997e-06 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277407+0000", 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043580529999999998 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277489+0000", 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1333000000000002e-05 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277574+0000", 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5042000000000003e-05 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278908+0000", 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013341360000000001 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294832+0000", 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015924462 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294899+0000", 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6984999999999996e-05 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294941+0000", 2024-04-26T10:33:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2113000000000002e-05 2024-04-26T10:33:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:102375 5.2 5:4767b3ca:::benchmark_data_smithi043_45180_object102374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.705502+0000", 2024-04-26T10:33:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.168010067, 2024-04-26T10:33:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020632167999999999, 2024-04-26T10:33:58.922 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 102375 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705502+0000", 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705502+0000", 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705501+0000", 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705552+0000", 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1008999999999999e-05 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705561+0000", 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.85e-06 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705568+0000", 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2910000000000002e-06 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705599+0000", 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0729999999999999e-05 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705682+0000", 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3149e-05 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705776+0000", 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4034000000000001e-05 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.712195+0000", 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0064184050000000003 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.726076+0000", 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013881001 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.726109+0000", 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3407e-05 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.726134+0000", 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5170000000000001e-05 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.927 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:102382 5.2 5:4e9d92ee:::benchmark_data_smithi043_45180_object102381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.1662447970000001, 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021126853000000001, 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 102382 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.928 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:33:58.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707330+0000", 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3274000000000004e-05 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707339+0000", 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9700000000000005e-06 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707346+0000", 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709272+0000", 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019264169999999999 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709387+0000", 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115333 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:58.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709479+0000", 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1555e-05 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.712520+0000", 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030408729999999999 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728336+0000", 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015815929999999999 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728370+0000", 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4496999999999999e-05 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728394+0000", 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3793000000000001e-05 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:102397 5.2 5:4581c7c6:::benchmark_data_smithi043_45180_object102396:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.714966+0000", 2024-04-26T10:33:58.933 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 1.158545962, 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020959388999999998, 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 102397 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.714966+0000", 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.714966+0000", 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.714965+0000", 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715020+0000", 2024-04-26T10:33:58.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5303000000000002e-05 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715031+0000", 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0871e-05 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715038+0000", 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0040000000000002e-06 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715069+0000", 2024-04-26T10:33:58.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0565000000000003e-05 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715161+0000", 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1644000000000006e-05 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715252+0000", 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1930999999999998e-05 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.717863+0000", 2024-04-26T10:33:58.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026101309999999999 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.735843+0000", 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017980576000000002 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.735888+0000", 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5188000000000002e-05 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.735925+0000", 2024-04-26T10:33:58.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7135000000000003e-05 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103328 5.6 e32/16 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head v 32'6425, mlcod=32'6423)", 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.68915226799999996, 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064716840999999997, 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184359+0000", 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184419+0000", 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9345999999999997e-05 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184425+0000", 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1190000000000002e-06 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184429+0000", 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.296e-06 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184461+0000", 2024-04-26T10:33:58.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2122999999999997e-05 2024-04-26T10:33:58.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184477+0000", 2024-04-26T10:33:58.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5877000000000001e-05 2024-04-26T10:33:58.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249048+0000", 2024-04-26T10:33:58.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064570494000000006 2024-04-26T10:33:58.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249077+0000", 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9081000000000002e-05 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103327 5.c e32/16 5:3133c183:::benchmark_data_smithi043_45180_object103326:head v 32'6430, mlcod=32'6425)", 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.68898566999999999, 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064984741999999998, 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.943 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:33:58.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184592+0000", 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6027999999999999e-05 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184597+0000", 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8570000000000003e-06 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184600+0000", 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3390000000000001e-06 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184620+0000", 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9890000000000001e-05 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184631+0000", 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1073999999999999e-05 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249477+0000", 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064845485999999994 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249511+0000", 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4508000000000002e-05 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103329 5.6 e32/16 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head v 32'6426, mlcod=32'6423)", 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.68515184900000003, 2024-04-26T10:33:58.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063744996999999998, 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188359+0000", 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188389+0000", 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9416000000000001e-05 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243409+0000", 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.055020409999999999 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243419+0000", 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0071000000000001e-05 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243465+0000", 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5799e-05 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243491+0000", 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5619999999999999e-05 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252067+0000", 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085763809999999992 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252105+0000", 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8040999999999997e-05 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103337 5.d e32/16 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head v 32'6429, mlcod=32'6427)", 2024-04-26T10:33:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.68508147200000002, 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.057982037, 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188430+0000", 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188500+0000", 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0062999999999996e-05 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243434+0000", 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.054933760999999998 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243442+0000", 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243490+0000", 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8312000000000001e-05 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243511+0000", 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0781999999999999e-05 2024-04-26T10:33:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246370+0000", 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028590930000000001 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246413+0000", 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2413000000000002e-05 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.955 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103660 5.9 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.49114582699999998, 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.067661676000000004, 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103660 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382365+0000", 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382430+0000", 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4850000000000004e-05 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382439+0000", 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382445+0000", 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0229999999999998e-06 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382482+0000", 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6909000000000002e-05 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382613+0000", 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013072600000000001 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382756+0000", 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000143306 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385090+0000", 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002333786 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449925+0000", 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064835173999999995 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449985+0000", 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0124999999999998e-05 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450028+0000", 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2457999999999999e-05 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103662 5.f 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.48870201699999999, 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.068705924000000002, 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.961 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103662 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384809+0000", 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384908+0000", 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9146000000000002e-05 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384921+0000", 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2622e-05 2024-04-26T10:33:58.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384931+0000", 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0108e-05 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384984+0000", 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2849000000000002e-05 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017266800000000001 2024-04-26T10:33:58.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385313+0000", 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015649300000000001 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388446+0000", 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003133481 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453401+0000", 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064955075000000001 2024-04-26T10:33:58.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453462+0000", 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1134000000000001e-05 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453516+0000", 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3477999999999999e-05 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103664 5.9 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.48841933300000001, 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.065076041000000001, 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103664 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385092+0000", 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385145+0000", 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3143000000000003e-05 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0473e-05 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385163+0000", 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385193+0000", 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0638e-05 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385284+0000", 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599000000000005e-05 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385375+0000", 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0606999999999995e-05 2024-04-26T10:33:58.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387556+0000", 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021809529999999998 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450072+0000", 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062516408999999995 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450123+0000", 2024-04-26T10:33:58.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1406000000000002e-05 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450169+0000", 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5380000000000003e-05 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103666 5.f 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.48665596, 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066830159, 2024-04-26T10:33:58.972 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103666 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386855+0000", 2024-04-26T10:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386928+0000", 2024-04-26T10:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-04-26T10:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386937+0000", 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1090000000000004e-06 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386945+0000", 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386981+0000", 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5899999999999998e-05 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387071+0000", 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9954e-05 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387161+0000", 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0898999999999998e-05 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390584+0000", 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034229030000000001 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453579+0000", 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062994267000000007 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453640+0000", 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1162999999999997e-05 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453686+0000", 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6493999999999999e-05 2024-04-26T10:33:58.977 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103667 5.f 5:f4dc36e8:::benchmark_data_smithi043_45180_object103666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:33:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.48579488999999998, 2024-04-26T10:33:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066218387000000004, 2024-04-26T10:33:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:33:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:33:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:33:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:33:58.978 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103667 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387783+0000", 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5973e-05 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387791+0000", 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1850000000000004e-06 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387796+0000", 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388469+0000", 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0006734 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388547+0000", 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7188999999999996e-05 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388630+0000", 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3892000000000002e-05 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390598+0000", 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00196759 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453803+0000", 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063205069000000003 2024-04-26T10:33:58.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453844+0000", 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1248999999999998e-05 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453936+0000", 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1201999999999999e-05 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:33:58.983 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:33:58.985 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:33:58.985 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:58.983+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:59.086 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:59.085+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:59.160 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:59.160 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:33:59.160 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.160 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:105241 5.e 5:78b3b5d2:::benchmark_data_smithi043_45180_object105240:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:59.155271+0000", 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0035190019999999998, 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035411710000000001, 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 105241 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155271+0000", 2024-04-26T10:33:59.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155271+0000", 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155271+0000", 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:59.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155315+0000", 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4119999999999998e-05 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155327+0000", 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2404e-05 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155335+0000", 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6299999999999998e-06 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156652+0000", 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00131734 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156728+0000", 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5630999999999995e-05 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156810+0000", 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2177999999999998e-05 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:59.164 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:105242 5.e 5.4dcde7fe (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:59.155735+0000", 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0030552259999999999, 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00312598, 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 105242 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:59.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155735+0000", 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155735+0000", 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155734+0000", 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:59.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155817+0000", 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2466999999999995e-05 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155829+0000", 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2019e-05 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155836+0000", 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5970000000000003e-06 2024-04-26T10:33:59.167 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:105243 5.8 5.34c254e8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:59.156501+0000", 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0022895279999999999, 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002392988, 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 105243 2024-04-26T10:33:59.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156501+0000", 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156501+0000", 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:59.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156500+0000", 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156583+0000", 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3376999999999998e-05 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156595+0000", 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1102e-05 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156602+0000", 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8800000000000008e-06 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:105245 5.4 5:29a360ae:::benchmark_data_smithi043_45180_object105244:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:59.156887+0000", 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00190362, 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020427280000000002, 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:59.171 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 105245 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156887+0000", 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156887+0000", 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:59.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156886+0000", 2024-04-26T10:33:59.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:59.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:59.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156947+0000", 2024-04-26T10:33:59.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0726000000000001e-05 2024-04-26T10:33:59.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:59.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156967+0000", 2024-04-26T10:33:59.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9958000000000001e-05 2024-04-26T10:33:59.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:59.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156975+0000", 2024-04-26T10:33:59.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2889999999999998e-06 2024-04-26T10:33:59.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:59.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.157017+0000", 2024-04-26T10:33:59.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2153000000000001e-05 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.157145+0000", 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012741799999999999 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.157278+0000", 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013336399999999999 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.176 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:105246 5.e 5.7ff01dde (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:59.176 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:59.156987+0000", 2024-04-26T10:33:59.176 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001803079, 2024-04-26T10:33:59.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001997137, 2024-04-26T10:33:59.176 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:59.176 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:33:59.176 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:59.176 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:59.176 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:59.176 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 105246 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156987+0000", 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156987+0000", 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156987+0000", 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.157018+0000", 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0923000000000002e-05 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.157027+0000", 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.1039999999999996e-06 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.157033+0000", 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0299999999999999e-06 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:105230 5.d 5:b80c6028:::benchmark_data_smithi043_45180_object105229:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:59.152155+0000", 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0066349149999999999, 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0068913810000000002, 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:59.179 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 105230 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152155+0000", 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152155+0000", 2024-04-26T10:33:59.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152154+0000", 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152263+0000", 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000108596 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:59.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152277+0000", 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4267000000000001e-05 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152287+0000", 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5060000000000001e-06 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152334+0000", 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7169000000000002e-05 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152456+0000", 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000122397 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152580+0000", 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012355600000000001 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155613+0000", 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003032903 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:59.183 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:105232 5.9 e32/16 5:9a611558:::benchmark_data_smithi043_45180_object105231:head v 32'6576, mlcod=32'6573)", 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:59.152899+0000", 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0058913359999999996, 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0062389969999999996, 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152899+0000", 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152899+0000", 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152898+0000", 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152952+0000", 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3399000000000002e-05 2024-04-26T10:33:59.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152963+0000", 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1615e-05 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.152972+0000", 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5150000000000006e-06 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.153004+0000", 2024-04-26T10:33:59.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1801999999999998e-05 2024-04-26T10:33:59.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:59.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.153022+0000", 2024-04-26T10:33:59.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.8567999999999999e-05 2024-04-26T10:33:59.187 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.187 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:59.187 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.187 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:105233 5.0 5:046b5a51:::benchmark_data_smithi043_45180_object105232:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:59.187 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:59.154463+0000", 2024-04-26T10:33:59.187 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0043274430000000003, 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0047388179999999997, 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 105233 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154463+0000", 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154463+0000", 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154462+0000", 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154535+0000", 2024-04-26T10:33:59.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3213999999999994e-05 2024-04-26T10:33:59.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:59.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154545+0000", 2024-04-26T10:33:59.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3130000000000004e-06 2024-04-26T10:33:59.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:59.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154552+0000", 2024-04-26T10:33:59.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3309999999999998e-06 2024-04-26T10:33:59.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154592+0000", 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0218e-05 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154729+0000", 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0001373 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154877+0000", 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000147823 2024-04-26T10:33:59.191 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:105235 5.e 5:7a329979:::benchmark_data_smithi043_45180_object105234:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:59.154715+0000", 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0040749310000000004, 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0045752129999999998, 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 105235 2024-04-26T10:33:59.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154715+0000", 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154715+0000", 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:59.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154715+0000", 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154866+0000", 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000150989 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154884+0000", 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.8156e-05 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154892+0000", 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1040000000000007e-06 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154941+0000", 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9027999999999999e-05 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155024+0000", 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3378e-05 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155111+0000", 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6107999999999996e-05 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:105237 5.8 5:12eb22ba:::benchmark_data_smithi043_45180_object105236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:59.154912+0000", 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0038784499999999999, 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0044695109999999998, 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:59.196 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 105237 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154912+0000", 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154912+0000", 2024-04-26T10:33:59.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:59.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154911+0000", 2024-04-26T10:33:59.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:33:59.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:59.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154945+0000", 2024-04-26T10:33:59.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4010000000000001e-05 2024-04-26T10:33:59.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154954+0000", 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6489999999999997e-06 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154960+0000", 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.596e-06 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156390+0000", 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014296929999999999 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156464+0000", 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4159999999999995e-05 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156549+0000", 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4593999999999997e-05 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:105238 5.0 5:04adff1e:::benchmark_data_smithi043_45180_object105237:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:59.154967+0000", 2024-04-26T10:33:59.200 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0038232919999999998, 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0045094469999999998, 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 105238 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154967+0000", 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:33:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154967+0000", 2024-04-26T10:33:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:33:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:33:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154966+0000", 2024-04-26T10:33:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:33:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:33:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.154998+0000", 2024-04-26T10:33:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1259e-05 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155008+0000", 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0202e-05 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.155014+0000", 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4540000000000004e-06 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:33:59.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156533+0000", 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001518976 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156650+0000", 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011687499999999999 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:59.156790+0000", 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000139357 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:33:59.204 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.205 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:33:59.205 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:33:59.205 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 11 2024-04-26T10:33:59.205 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:59.206 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:59.204+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:59.207 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:33:59.276 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:33:59.306 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:59.305+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:59.384 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:33:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:33:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:33:59.384 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:33:59.384 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:33:59.399 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:33:59.420 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 42 15 105852 105837 157.483 136.375 0.00408059 0.00634741 2024-04-26T10:33:59.429 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:33:59.442 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:59.441+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:59.452 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:33:59.474 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:33:59.475 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:33:59.475 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:33:59.475 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:33:59.508 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:59.506+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:59.567 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:59.567 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:59.570 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:33:59.584 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:33:59.629 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:59.629+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:33:59.710 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:33:59.709+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:33:59.758 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:33:59.758 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:33:59.758 INFO:tasks.thrashosds.thrasher:Reweighting osd 1 to 0.36190670241308687 2024-04-26T10:33:59.758 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 0.36190670241308687 2024-04-26T10:33:59.775 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:33:59.775 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:33:59.791 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:33:59.811 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:33:59.810+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:33:59.912 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:33:59.912+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:00.013 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:00.013 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:00.013 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:00.012+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:00.029 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:00.114 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:00.114+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:00.215 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:00.213+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:00.231 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:00.231 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:00.248 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:00.315 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:00.314+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:00.416 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:00.415+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:00.420 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 43 16 107896 107880 156.789 127.688 0.0059008 0.006375 2024-04-26T10:34:00.425 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:00.425 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:00.439 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:00.451 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-26T10:34:00.451 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.1 to 0.361907 (5ca5) 2024-04-26T10:34:00.517 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:00.516+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:00.606 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:00.606 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:00.616 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:00.618 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:00.616+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:00.718 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:00.716+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:00.742 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:00.742 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:00.751 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:00.820 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:00.818+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:00.879 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:00.880 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:00.890 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:00.921 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:00.920+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:01.021 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:01.021+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:01.057 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:01.057 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:01.067 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:01.122 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:01.121+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:01.194 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:01.194 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:01.204 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:01.223 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:01.222+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:01.324 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:01.323+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:01.335 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:01.335 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:01.345 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:01.421 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 44 16 107996 107980 153.368 6.25 0.00265566 0.00637597 2024-04-26T10:34:01.431 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:01.429+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:01.488 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:01.518 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:01.519 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:01.527 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:01.525+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:01.529 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:01.628 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:01.626+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:01.646 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:01.666 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:01.685 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:01.686 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:01.687 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:01.687 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:01.699 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:01.699 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:01.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:01.699 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:01.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.699 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:01.699 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:01.699 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.895049974000003, 2024-04-26T10:34:01.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:01.699 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.699 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.699 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.700 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.700 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.700 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:01.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.700 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:01.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:01.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:01.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:01.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:01.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:01.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:01.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:01.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:01.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:01.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:01.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:01.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:01.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.706 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:01.706 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:01.706 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.895048989000003, 2024-04-26T10:34:01.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:01.706 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.706 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.706 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:01.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:01.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:01.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:01.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:01.710 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.710 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.710 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.710 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:01.710 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:01.710 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.894980365999999, 2024-04-26T10:34:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:01.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:01.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:01.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:01.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:01.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:01.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:01.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:01.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:01.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:01.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:01.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:01.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:01.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:01.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:01.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:01.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:01.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:01.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:01.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:01.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.717 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:01.717 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:01.717 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.894928585999999, 2024-04-26T10:34:01.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:01.717 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.717 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.717 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.717 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.717 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.717 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:01.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.717 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:01.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:01.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:01.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:01.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:01.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:01.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:01.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:01.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:01.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:01.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:01.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:01.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:01.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:01.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:01.722 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.722 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.723 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.723 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:01.723 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:01.723 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.894868735999999, 2024-04-26T10:34:01.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:01.723 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.723 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.723 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.723 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.723 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.723 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:01.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:01.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:01.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:01.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:01.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:01.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.728 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.893156032, 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:01.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:01.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:01.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:01.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:01.734 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.734 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.734 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.734 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:01.734 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:01.734 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.893040964999997, 2024-04-26T10:34:01.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:01.734 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.734 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.734 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:01.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:01.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:01.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:01.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:01.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:01.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:01.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:01.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:01.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:01.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:01.738 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.892947825, 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:01.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:01.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:01.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:01.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:01.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:01.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:01.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:01.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:01.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:01.744 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.892753665000001, 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:01.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:01.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:01.748 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.891546296999998, 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:01.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:01.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.890737389000002, 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.752 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:01.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.757 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.758 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.758 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:01.758 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:01.758 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.890633850999997, 2024-04-26T10:34:01.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:01.758 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.758 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.758 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.758 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:01.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:01.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:01.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:01.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:01.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:01.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.763 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.890556977999999, 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.764 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 33.890441594000002, 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:01.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:01.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5137975409999997, 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:01.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:01.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:01.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:01.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:01.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:01.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:01.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5117676929999999, 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.778 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.779 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.779 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.779 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.779 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:01.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.779 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:01.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:01.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:01.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:01.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:01.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:01.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:01.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:01.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:01.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:01.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:01.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:01.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:01.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:01.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5112918899999999, 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:01.784 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.785 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.785 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.785 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.785 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.785 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:01.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.785 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:01.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:01.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:01.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:01.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:01.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:01.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:01.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:01.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:01.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:01.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:01.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:01.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:01.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:01.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:01.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:01.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:01.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:01.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:01.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:01.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:01.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.790 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.790 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.790 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:01.790 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:01.790 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5093248360000002, 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:01.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:01.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:01.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:01.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:01.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:01.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103336 5.6 5:6c0cef20:::benchmark_data_smithi043_45180_object103335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5072155309999999, 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064107786, 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.796 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.797 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103336 2024-04-26T10:34:01.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.797 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:01.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:01.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188502+0000", 2024-04-26T10:34:01.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:01.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188540+0000", 2024-04-26T10:34:01.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8445000000000002e-05 2024-04-26T10:34:01.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188553+0000", 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2768e-05 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188563+0000", 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9760000000000007e-06 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191877+0000", 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003313908 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192004+0000", 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012663 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192143+0000", 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013964199999999999 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.196467+0000", 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043232230000000002 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252539+0000", 2024-04-26T10:34:01.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056072085000000001 2024-04-26T10:34:01.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252577+0000", 2024-04-26T10:34:01.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8730999999999999e-05 2024-04-26T10:34:01.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252611+0000", 2024-04-26T10:34:01.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3769000000000001e-05 2024-04-26T10:34:01.802 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.802 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.802 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.802 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:01.802 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:01.802 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 3.5066570979999998, 2024-04-26T10:34:01.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:01.802 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:01.802 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:01.802 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:01.802 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:01.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:01.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:01.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:01.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:01.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:01.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:01.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:01.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:01.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:01.807 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:01.809 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:01.810 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:01.807+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:01.910 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:01.909+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:01.948 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:01.948 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:34:01.949 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-04-26T10:34:01.949 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:01.959 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:02.011 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:02.010+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:02.085 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:34:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:34:02.086 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:34:02.086 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:02.095 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:02.112 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:02.111+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:02.212 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:02.211+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:02.223 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:34:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:34:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(mds.0.3:16 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-26T10:34:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:34:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.227175021999997, 2024-04-26T10:34:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020879298000000001, 2024-04-26T10:34:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994015+0000", 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:34:02.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994017+0000", 2024-04-26T10:34:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1459999999999999e-06 2024-04-26T10:34:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994021+0000", 2024-04-26T10:34:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2169999999999996e-06 2024-04-26T10:34:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.994025+0000", 2024-04-26T10:34:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3450000000000002e-06 2024-04-26T10:34:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996368+0000", 2024-04-26T10:34:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002342841 2024-04-26T10:34:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:34:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:51.996374+0000", 2024-04-26T10:34:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6590000000000001e-06 2024-04-26T10:34:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010589+0000", 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014214648999999999 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010670+0000", 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1463000000000003e-05 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.010824+0000", 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000154007 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.013067+0000", 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022428629999999999 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014821+0000", 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017534530000000001 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014860+0000", 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9264000000000002e-05 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:32:52.014895+0000", 2024-04-26T10:34:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4619999999999997e-05 2024-04-26T10:34:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.421079896000002, 2024-04-26T10:34:02.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:34:02.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:34:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:34:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:34:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:34:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:34:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:34:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:34:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:34:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:34:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:34:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:34:02.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:95997 5.7 5:ef48f664:::benchmark_data_smithi043_45180_object95996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 7.6358704150000003, 2024-04-26T10:34:02.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024010581999999999, 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 95997 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585344+0000", 2024-04-26T10:34:02.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4491e-05 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585350+0000", 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1099999999999999e-06 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585355+0000", 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5430000000000004e-06 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592076+0000", 2024-04-26T10:34:02.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067208470000000003 2024-04-26T10:34:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592209+0000", 2024-04-26T10:34:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013344400000000001 2024-04-26T10:34:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592320+0000", 2024-04-26T10:34:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011081700000000001 2024-04-26T10:34:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.594282+0000", 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019622699999999999 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609277+0000", 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014995066 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609308+0000", 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1242999999999999e-05 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609331+0000", 2024-04-26T10:34:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2150999999999998e-05 2024-04-26T10:34:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101453 5.f 5:f3a9423f:::benchmark_data_smithi043_45180_object101452:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.269703+0000", 2024-04-26T10:34:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9514869260000003, 2024-04-26T10:34:02.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020808193999999999, 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101453 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269703+0000", 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269703+0000", 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269703+0000", 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269847+0000", 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014370799999999999 2024-04-26T10:34:02.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269854+0000", 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7360000000000001e-06 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269859+0000", 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9339999999999997e-06 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269889+0000", 2024-04-26T10:34:02.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9448999999999999e-05 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270000+0000", 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111566 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270130+0000", 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129758 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276243+0000", 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061132529999999999 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.290455+0000", 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014212103 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.290490+0000", 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4567999999999998e-05 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.290512+0000", 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1716e-05 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101455 5.f 5:fbcc5be4:::benchmark_data_smithi043_45180_object101454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9512092269999997, 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02195165, 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.248 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101455 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270103+0000", 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122309 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270111+0000", 2024-04-26T10:34:02.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3999999999999992e-06 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270118+0000", 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9179999999999997e-06 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272018+0000", 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018998610000000001 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272126+0000", 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010844999999999999 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272225+0000", 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8381999999999994e-05 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278402+0000", 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061767009999999997 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291830+0000", 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013428756 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291894+0000", 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3189999999999996e-05 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291933+0000", 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9297e-05 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.253 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101456 5.f 5:f61cae04:::benchmark_data_smithi043_45180_object101455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9509280450000004, 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021829133000000001, 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101456 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.254 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270361+0000", 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9395999999999995e-05 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270369+0000", 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5490000000000001e-06 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270374+0000", 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5130000000000004e-06 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273610+0000", 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003235791 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273723+0000", 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112833 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273861+0000", 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013803 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278411+0000", 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045506380000000001 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291986+0000", 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013574409000000001 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292037+0000", 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1041000000000001e-05 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292091+0000", 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4617000000000002e-05 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101459 5.f 5:f6287f2a:::benchmark_data_smithi043_45180_object101458:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.949015137, 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022608105999999999, 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.259 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101459 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272227+0000", 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2669e-05 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272236+0000", 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0210000000000005e-06 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272243+0000", 2024-04-26T10:34:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7469999999999999e-06 2024-04-26T10:34:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276304+0000", 2024-04-26T10:34:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040604789999999997 2024-04-26T10:34:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276386+0000", 2024-04-26T10:34:02.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2278000000000001e-05 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276477+0000", 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0713999999999999e-05 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278905+0000", 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024288249999999999 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294715+0000", 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015809976999999999 2024-04-26T10:34:02.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294747+0000", 2024-04-26T10:34:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1814999999999999e-05 2024-04-26T10:34:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294783+0000", 2024-04-26T10:34:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6180999999999998e-05 2024-04-26T10:34:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101461 5.f 5:fcae472f:::benchmark_data_smithi043_45180_object101460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9482218769999999, 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021972760000000001, 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101461 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272968+0000", 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273035+0000", 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7477000000000005e-05 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273043+0000", 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4159999999999998e-06 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273049+0000", 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4509999999999997e-06 2024-04-26T10:34:02.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277407+0000", 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043580529999999998 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277489+0000", 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1333000000000002e-05 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277574+0000", 2024-04-26T10:34:02.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5042000000000003e-05 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278908+0000", 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013341360000000001 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294832+0000", 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015924462 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294899+0000", 2024-04-26T10:34:02.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6984999999999996e-05 2024-04-26T10:34:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294941+0000", 2024-04-26T10:34:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2113000000000002e-05 2024-04-26T10:34:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:102375 5.2 5:4767b3ca:::benchmark_data_smithi043_45180_object102374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.705502+0000", 2024-04-26T10:34:02.270 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5156883859999999, 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020632167999999999, 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 102375 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705502+0000", 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705502+0000", 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705501+0000", 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705552+0000", 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1008999999999999e-05 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705561+0000", 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.85e-06 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705568+0000", 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2910000000000002e-06 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705599+0000", 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0729999999999999e-05 2024-04-26T10:34:02.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705682+0000", 2024-04-26T10:34:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3149e-05 2024-04-26T10:34:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.705776+0000", 2024-04-26T10:34:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4034000000000001e-05 2024-04-26T10:34:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.712195+0000", 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0064184050000000003 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.726076+0000", 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013881001 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.726109+0000", 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3407e-05 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.726134+0000", 2024-04-26T10:34:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5170000000000001e-05 2024-04-26T10:34:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:102382 5.2 5:4e9d92ee:::benchmark_data_smithi043_45180_object102381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.513923116, 2024-04-26T10:34:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021126853000000001, 2024-04-26T10:34:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.276 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 102382 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:02.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707330+0000", 2024-04-26T10:34:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3274000000000004e-05 2024-04-26T10:34:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707339+0000", 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9700000000000005e-06 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707346+0000", 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709272+0000", 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019264169999999999 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709387+0000", 2024-04-26T10:34:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115333 2024-04-26T10:34:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709479+0000", 2024-04-26T10:34:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1555e-05 2024-04-26T10:34:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.712520+0000", 2024-04-26T10:34:02.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030408729999999999 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728336+0000", 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015815929999999999 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728370+0000", 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4496999999999999e-05 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728394+0000", 2024-04-26T10:34:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3793000000000001e-05 2024-04-26T10:34:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:102397 5.2 5:4581c7c6:::benchmark_data_smithi043_45180_object102396:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.714966+0000", 2024-04-26T10:34:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5062242809999997, 2024-04-26T10:34:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020959388999999998, 2024-04-26T10:34:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 102397 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.714966+0000", 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.714966+0000", 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.714965+0000", 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715020+0000", 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5303000000000002e-05 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715031+0000", 2024-04-26T10:34:02.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0871e-05 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715038+0000", 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0040000000000002e-06 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715069+0000", 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0565000000000003e-05 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715161+0000", 2024-04-26T10:34:02.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1644000000000006e-05 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715252+0000", 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1930999999999998e-05 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.717863+0000", 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026101309999999999 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.735843+0000", 2024-04-26T10:34:02.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017980576000000002 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.735888+0000", 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5188000000000002e-05 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.735925+0000", 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7135000000000003e-05 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103328 5.6 e32/16 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head v 32'6425, mlcod=32'6423)", 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.0368305869999999, 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064716840999999997, 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184359+0000", 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184419+0000", 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9345999999999997e-05 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184425+0000", 2024-04-26T10:34:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1190000000000002e-06 2024-04-26T10:34:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184429+0000", 2024-04-26T10:34:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.296e-06 2024-04-26T10:34:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184461+0000", 2024-04-26T10:34:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2122999999999997e-05 2024-04-26T10:34:02.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184477+0000", 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5877000000000001e-05 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249048+0000", 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064570494000000006 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249077+0000", 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9081000000000002e-05 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.291 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103327 5.c e32/16 5:3133c183:::benchmark_data_smithi043_45180_object103326:head v 32'6430, mlcod=32'6425)", 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.036663989, 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064984741999999998, 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:02.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184592+0000", 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6027999999999999e-05 2024-04-26T10:34:02.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184597+0000", 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8570000000000003e-06 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184600+0000", 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3390000000000001e-06 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184620+0000", 2024-04-26T10:34:02.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9890000000000001e-05 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184631+0000", 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1073999999999999e-05 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249477+0000", 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064845485999999994 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249511+0000", 2024-04-26T10:34:02.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4508000000000002e-05 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103329 5.6 e32/16 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head v 32'6426, mlcod=32'6423)", 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.0328301680000003, 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063744996999999998, 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188359+0000", 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188389+0000", 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9416000000000001e-05 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243409+0000", 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.055020409999999999 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243419+0000", 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0071000000000001e-05 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243465+0000", 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5799e-05 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243491+0000", 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5619999999999999e-05 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252067+0000", 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085763809999999992 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252105+0000", 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8040999999999997e-05 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103337 5.d e32/16 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head v 32'6429, mlcod=32'6427)", 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.0327597910000001, 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.057982037, 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.300 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188430+0000", 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188500+0000", 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0062999999999996e-05 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243434+0000", 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.054933760999999998 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243442+0000", 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:34:02.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243490+0000", 2024-04-26T10:34:02.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8312000000000001e-05 2024-04-26T10:34:02.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243511+0000", 2024-04-26T10:34:02.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0781999999999999e-05 2024-04-26T10:34:02.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246370+0000", 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028590930000000001 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246413+0000", 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2413000000000002e-05 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103660 5.9 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:02.304 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.8388241459999999, 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.067661676000000004, 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103660 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382365+0000", 2024-04-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382430+0000", 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4850000000000004e-05 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382439+0000", 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382445+0000", 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0229999999999998e-06 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382482+0000", 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6909000000000002e-05 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382613+0000", 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013072600000000001 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382756+0000", 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000143306 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385090+0000", 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002333786 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449925+0000", 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064835173999999995 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449985+0000", 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0124999999999998e-05 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450028+0000", 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2457999999999999e-05 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103662 5.f 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.8363803359999999, 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.068705924000000002, 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.310 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103662 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384809+0000", 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384908+0000", 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9146000000000002e-05 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384921+0000", 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2622e-05 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384931+0000", 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0108e-05 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384984+0000", 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2849000000000002e-05 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017266800000000001 2024-04-26T10:34:02.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:02.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385313+0000", 2024-04-26T10:34:02.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015649300000000001 2024-04-26T10:34:02.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388446+0000", 2024-04-26T10:34:02.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003133481 2024-04-26T10:34:02.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453401+0000", 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064955075000000001 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453462+0000", 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1134000000000001e-05 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453516+0000", 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3477999999999999e-05 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103664 5.9 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.8360976519999999, 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.065076041000000001, 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103664 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385092+0000", 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385145+0000", 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3143000000000003e-05 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0473e-05 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385163+0000", 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-04-26T10:34:02.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385193+0000", 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0638e-05 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385284+0000", 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599000000000005e-05 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385375+0000", 2024-04-26T10:34:02.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0606999999999995e-05 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387556+0000", 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021809529999999998 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450072+0000", 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062516408999999995 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450123+0000", 2024-04-26T10:34:02.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1406000000000002e-05 2024-04-26T10:34:02.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450169+0000", 2024-04-26T10:34:02.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5380000000000003e-05 2024-04-26T10:34:02.321 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.321 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.321 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.321 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103666 5.f 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.321 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:02.321 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.8343342790000001, 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066830159, 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103666 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386855+0000", 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386928+0000", 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-04-26T10:34:02.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386937+0000", 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1090000000000004e-06 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386945+0000", 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386981+0000", 2024-04-26T10:34:02.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5899999999999998e-05 2024-04-26T10:34:02.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387071+0000", 2024-04-26T10:34:02.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9954e-05 2024-04-26T10:34:02.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:02.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387161+0000", 2024-04-26T10:34:02.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0898999999999998e-05 2024-04-26T10:34:02.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390584+0000", 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034229030000000001 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453579+0000", 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062994267000000007 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453640+0000", 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1162999999999997e-05 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453686+0000", 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6493999999999999e-05 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103667 5.f 5:f4dc36e8:::benchmark_data_smithi043_45180_object103666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.8334732090000001, 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066218387000000004, 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.327 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103667 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:02.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387783+0000", 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5973e-05 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387791+0000", 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1850000000000004e-06 2024-04-26T10:34:02.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387796+0000", 2024-04-26T10:34:02.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-04-26T10:34:02.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:02.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388469+0000", 2024-04-26T10:34:02.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0006734 2024-04-26T10:34:02.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:02.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388547+0000", 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7188999999999996e-05 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388630+0000", 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3892000000000002e-05 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390598+0000", 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00196759 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453803+0000", 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063205069000000003 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453844+0000", 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1248999999999998e-05 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453936+0000", 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1201999999999999e-05 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.333 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:02.333 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:02.333 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:02.334 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:02.333+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:02.335 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:02.421 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 45 16 107996 107980 149.96 0 - 0.00637597 2024-04-26T10:34:02.436 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:02.434+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:02.470 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:34:02.475 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:02.476 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:02.476 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 0 2024-04-26T10:34:02.476 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:02.486 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:02.536 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:02.535+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:02.637 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:02.635+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:02.645 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:02.645 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:02.645 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:02.645 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:02.645 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:02.654 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:02.738 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:02.736+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:02.839 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:02.838+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:02.852 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 35.049589597000001, 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 35.048761517000003, 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 35.047832454000002, 2024-04-26T10:34:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 35.047147013, 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103337 5.d 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.66148834, 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.058853520999999999, 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103337 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188132+0000", 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6197000000000003e-05 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188144+0000", 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2001000000000001e-05 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188152+0000", 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9349999999999994e-06 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188185+0000", 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3436000000000003e-05 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188275+0000", 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9995999999999997e-05 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188365+0000", 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0254999999999996e-05 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.194973+0000", 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066073490000000002 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246781+0000", 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.051808372999999998 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246865+0000", 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3498999999999995e-05 2024-04-26T10:34:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246920+0000", 2024-04-26T10:34:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5208999999999999e-05 2024-04-26T10:34:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.4708565709999997, 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:02.886 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:02.886 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.886 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.886 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.886 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:02.886 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:02.886 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.886 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.886 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.886 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:02.886 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:02.886 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.886 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.887 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.4706372669999999, 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.888 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.889 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.890 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.890 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.890 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:02.890 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:02.890 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.890 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.890 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.890 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:02.890 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:02.890 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.890 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.890 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.891 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.892 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:02.892 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:02.892 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.892 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.892 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.892 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:02.892 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:02.893 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.893 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.893 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.893 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:02.893 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:02.893 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.893 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.893 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.893 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:02.893 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:02.893 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.894 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.894 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.894 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:02.894 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:02.894 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.894 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.894 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.894 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.894 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.894 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.894 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:02.894 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.4705574620000004, 2024-04-26T10:34:02.894 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.895 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.899 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.469193432, 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.901 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.901 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.901 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.901 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:02.901 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.901 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.901 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.901 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.901 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:02.901 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.901 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.902 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:02.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:02.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:02.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:02.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:02.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.904 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:02.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:02.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.905 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.905 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:02.905 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:02.905 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.905 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.905 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.905 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:02.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:02.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.906 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.906 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:02.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:02.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.906 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.906 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:02.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:02.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.907 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:02.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:02.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.907 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:02.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:02.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.4685990950000001, 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.908 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:02.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:02.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:02.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:02.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.913 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.914 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.914 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:02.914 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.4678387390000003, 2024-04-26T10:34:02.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:02.914 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.914 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.914 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.914 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.914 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.914 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:02.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:02.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:02.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:02.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.918 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.918 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.918 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:02.918 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:02.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.918 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.918 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.918 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.4672212790000003, 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.920 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.921 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:02.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:02.924 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.4666562760000001, 2024-04-26T10:34:02.925 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:02.926 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.926 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.926 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.926 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.926 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.926 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:02.926 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.926 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.926 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.926 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.926 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:02.926 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.927 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.928 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.929 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.930 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.930 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.930 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:02.930 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.4661129639999997, 2024-04-26T10:34:02.930 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:02.930 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.930 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.930 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.930 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.930 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.930 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:02.930 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:02.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:02.933 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.933 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.933 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.933 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:02.933 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:02.933 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.933 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.933 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.933 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:02.934 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:02.934 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.934 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.934 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.934 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:02.934 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:02.934 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.934 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.934 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.934 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:02.934 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:02.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.935 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.935 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.935 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:02.935 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:02.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.935 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.935 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.935 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:02.935 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:02.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.935 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.935 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.936 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:02.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:02.936 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.936 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.936 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.936 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.936 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.936 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:02.936 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:02.936 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.464640964, 2024-04-26T10:34:02.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:02.936 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.936 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.937 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:02.938 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.938 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.938 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.938 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:02.938 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.938 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.938 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.938 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:02.938 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:02.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.938 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.940 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:02.941 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.942 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.942 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.942 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.942 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:02.942 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:02.942 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.464075544, 2024-04-26T10:34:02.942 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:02.942 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.942 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.942 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.942 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.943 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:02.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:02.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:02.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:02.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:02.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:02.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:02.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:02.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:02.946 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:02.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.946 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:02.946 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:02.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.947 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:02.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:02.947 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.947 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.947 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.948 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.948 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:02.948 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:02.948 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.4640106939999997, 2024-04-26T10:34:02.948 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:02.948 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.948 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.949 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.949 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.949 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.949 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:02.949 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.949 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.950 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.950 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.950 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:02.950 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.950 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.950 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.951 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.951 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:02.951 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.951 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.951 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.951 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:02.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:02.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.952 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.952 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.952 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:02.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:02.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.953 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.953 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.953 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:02.953 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:02.953 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.954 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.954 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.954 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:02.954 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:02.954 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.954 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.958 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.958 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:02.958 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:02.958 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.958 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.958 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.958 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:02.959 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:02.959 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.959 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.959 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:02.959 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:02.959 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.960 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.960 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.960 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.960 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.960 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:02.960 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:02.960 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.4632497139999998, 2024-04-26T10:34:02.960 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:02.960 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.961 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:02.961 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.961 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.961 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.961 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:02.961 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.961 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.961 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.961 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.961 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:02.961 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.961 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.961 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:02.962 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.963 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.963 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.963 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:02.963 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:02.963 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.963 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.963 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.963 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:02.963 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:02.963 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.963 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.963 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.963 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.4622282860000002, 2024-04-26T10:34:02.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.965 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.966 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.967 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103647 5.b e32/16 ondisk, result = 0)", 2024-04-26T10:34:02.968 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:02.969 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.4622095870000003, 2024-04-26T10:34:02.969 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060768513000000003, 2024-04-26T10:34:02.969 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:02.969 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:02.969 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:02.969 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.970 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:02.970 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:02.970 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.970 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.970 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387344+0000", 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387350+0000", 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.22e-06 2024-04-26T10:34:02.971 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447917+0000", 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060567523999999998 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447925+0000", 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7689999999999996e-06 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448004+0000", 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9246000000000007e-05 2024-04-26T10:34:02.972 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448012+0000", 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3490000000000003e-06 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448114+0000", 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010205299999999999 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:02.973 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:02.974 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:02.975 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:02.973+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:02.976 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:03.075 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:03.074+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:03.168 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:03.168 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:03.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.168 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:109304 5.a 5.4c291faa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:03.168 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.164978+0000", 2024-04-26T10:34:03.168 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001251254, 2024-04-26T10:34:03.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012727210000000001, 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 109304 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.164978+0000", 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.164978+0000", 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.164977+0000", 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165034+0000", 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7031000000000003e-05 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165045+0000", 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0295000000000001e-05 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165052+0000", 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4540000000000001e-06 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.171 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:109305 5.a 5.3dc3eca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:03.172 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.165486+0000", 2024-04-26T10:34:03.172 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.000743182, 2024-04-26T10:34:03.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00085168699999999995, 2024-04-26T10:34:03.172 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.172 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:03.172 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.172 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.172 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.172 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 109305 2024-04-26T10:34:03.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.172 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165486+0000", 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165486+0000", 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165485+0000", 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165547+0000", 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1332000000000002e-05 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165558+0000", 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1411e-05 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165565+0000", 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9609999999999999e-06 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.174 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:109306 5.3 5.e0e1d093 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.165572+0000", 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00065710400000000004, 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00082799200000000005, 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 109306 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.175 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165572+0000", 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165572+0000", 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165572+0000", 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165605+0000", 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3445000000000003e-05 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165613+0000", 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9950000000000005e-06 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165619+0000", 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3290000000000001e-06 2024-04-26T10:34:03.177 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:109307 5.c 5:33d370ed:::benchmark_data_smithi043_45180_object109306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.165628+0000", 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00060131900000000001, 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00083443600000000003, 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 109307 2024-04-26T10:34:03.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165628+0000", 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165628+0000", 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165628+0000", 2024-04-26T10:34:03.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165702+0000", 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4369000000000006e-05 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165711+0000", 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8119999999999997e-06 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165716+0000", 2024-04-26T10:34:03.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3820000000000003e-06 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165765+0000", 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8430000000000002e-05 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165892+0000", 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000126959 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166035+0000", 2024-04-26T10:34:03.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014320700000000001 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:109310 5.b 5.9bcfdd6b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.166112+0000", 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00011704100000000001, 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00042181899999999998, 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.182 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 109310 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166112+0000", 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166112+0000", 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166112+0000", 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166153+0000", 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1247e-05 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166166+0000", 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2862e-05 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166172+0000", 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6780000000000003e-06 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:109308 5.2 e35/16)", 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.166244+0000", 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9999857, 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033967999999999997, 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166244+0000", 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166244+0000", 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166243+0000", 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166330+0000", 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6106999999999994e-05 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166339+0000", 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.268e-06 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166345+0000", 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7899999999999996e-06 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.187 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:109309 5.e e35/16 5:72c9cc36:::benchmark_data_smithi043_45180_object109308:head v 35'6779, mlcod=35'6777)", 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.166301+0000", 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9999285, 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000329418, 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166301+0000", 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166301+0000", 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166300+0000", 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166385+0000", 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4451999999999997e-05 2024-04-26T10:34:03.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166396+0000", 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1627999999999999e-05 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166403+0000", 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6329999999999999e-06 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166438+0000", 2024-04-26T10:34:03.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5250000000000003e-05 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.166458+0000", 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0404e-05 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:109291 5.8 e35/16 5:172bda94:::benchmark_data_smithi043_45180_object109290:head v 35'7016, mlcod=35'7010)", 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.159172+0000", 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0070570930000000004, 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0075210980000000004, 2024-04-26T10:34:03.191 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.159172+0000", 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.159172+0000", 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.159172+0000", 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.159259+0000", 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7284e-05 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.159266+0000", 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0929999999999997e-06 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.159272+0000", 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6779999999999997e-06 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162928+0000", 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036560239999999999 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162949+0000", 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1101e-05 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:109296 5.b 5:dca96455:::benchmark_data_smithi043_45180_object109295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.159700+0000", 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0065294330000000003, 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070575430000000003, 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 109296 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.159700+0000", 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.159700+0000", 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.159699+0000", 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.159764+0000", 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4615000000000004e-05 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.159772+0000", 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6729999999999998e-06 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.159779+0000", 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3219999999999998e-06 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162300+0000", 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025209640000000001 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162439+0000", 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013956600000000001 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0,1", 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162598+0000", 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015866799999999999 2024-04-26T10:34:03.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165188+0000", 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025903710000000002 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165925+0000", 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073675699999999999 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.199 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:109297 5.3 5:ca22e27b:::benchmark_data_smithi043_45180_object109296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.160899+0000", 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.005330329, 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0059519810000000003, 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 109297 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.160899+0000", 2024-04-26T10:34:03.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.160899+0000", 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.160898+0000", 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161105+0000", 2024-04-26T10:34:03.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000207047 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161119+0000", 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3336000000000001e-05 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161128+0000", 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9910000000000008e-06 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165215+0000", 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004087846 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165336+0000", 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000120615 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165472+0000", 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013605299999999999 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:109298 5.a 5:537ea57f:::benchmark_data_smithi043_45180_object109297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.161162+0000", 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.005067205, 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057636149999999997, 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 109298 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161162+0000", 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161162+0000", 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161162+0000", 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161244+0000", 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2636e-05 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161251+0000", 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0110000000000003e-06 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161258+0000", 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1239999999999999e-06 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161286+0000", 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8177000000000001e-05 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161386+0000", 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9049000000000007e-05 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161490+0000", 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000104236 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165177+0000", 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036871220000000001 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:109300 5.5 5:a6c4d4a7:::benchmark_data_smithi043_45180_object109299:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.161267+0000", 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0049628229999999999, 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057293980000000001, 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.208 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 109300 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161267+0000", 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161267+0000", 2024-04-26T10:34:03.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161266+0000", 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161347+0000", 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0582999999999997e-05 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161354+0000", 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8890000000000002e-06 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161364+0000", 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.944e-06 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161411+0000", 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6136e-05 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161544+0000", 2024-04-26T10:34:03.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000133848 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.161705+0000", 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016084500000000001 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:109299 5.9 e35/34 5:923a1085:::benchmark_data_smithi043_45180_object109298:head v 35'6850, mlcod=35'6845)", 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.162341+0000", 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0038886300000000001, 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0046975389999999997, 2024-04-26T10:34:03.212 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162341+0000", 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162341+0000", 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162340+0000", 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162346+0000", 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5929999999999996e-06 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162355+0000", 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6390000000000004e-06 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162370+0000", 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4233000000000001e-05 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162430+0000", 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0047999999999998e-05 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162450+0000", 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9803999999999999e-05 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:109301 5.5 5:a36fe859:::benchmark_data_smithi043_45180_object109300:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.162521+0000", 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0037084029999999999, 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045526409999999996, 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 109301 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162521+0000", 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162521+0000", 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162520+0000", 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162552+0000", 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2141000000000003e-05 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162562+0000", 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9729999999999992e-06 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.162569+0000", 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.216e-06 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165116+0000", 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025467789999999999 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165250+0000", 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000133659 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165405+0000", 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015478700000000001 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "MOSDPGPushReply(5.b 35/34 [PushReplyOp(5:d035df79:::benchmark_data_smithi043_45180_object29614:head)])", 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.163321+0000", 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0029084179999999999, 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0037924510000000001, 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163321+0000", 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163321+0000", 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163321+0000", 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163324+0000", 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.738e-06 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163333+0000", 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1610000000000003e-06 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163341+0000", 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8109999999999992e-06 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:109302 5.f e35/34 5:f991cc68:::benchmark_data_smithi043_45180_object109301:head v 35'6647, mlcod=35'6645)", 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.163654+0000", 2024-04-26T10:34:03.222 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0025757290000000001, 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034985699999999999, 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163654+0000", 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163654+0000", 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163653+0000", 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163658+0000", 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8790000000000002e-06 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163668+0000", 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8879999999999992e-06 2024-04-26T10:34:03.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163674+0000", 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6269999999999997e-06 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163707+0000", 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3793e-05 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163733+0000", 2024-04-26T10:34:03.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5230000000000001e-05 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:109300 5.5 e35/16)", 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.163720+0000", 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0025089639999999998, 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034693269999999999, 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163720+0000", 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163720+0000", 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163720+0000", 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163723+0000", 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9050000000000001e-06 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163729+0000", 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3690000000000003e-06 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.163733+0000", 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8179999999999997e-06 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.228 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:109303 5.a 5:59d666cb:::benchmark_data_smithi043_45180_object109302:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:03.164024+0000", 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.002205594, 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003195519, 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 109303 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.164024+0000", 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.164024+0000", 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.164023+0000", 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.164050+0000", 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6621000000000001e-05 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.164059+0000", 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1600000000000004e-06 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.164065+0000", 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9850000000000003e-06 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165197+0000", 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011324779999999999 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165283+0000", 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5702e-05 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:03.165385+0000", 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101752 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.232 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.233 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.233 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.233 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:34:03.233 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 18 2024-04-26T10:34:03.233 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:03.234 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:03.233+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:03.235 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:03.335 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:03.333+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:03.421 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 46 16 109792 109776 149.14 56.125 0.0104643 0.0067025 2024-04-26T10:34:03.435 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:03.434+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:03.463 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-26T10:34:03.467 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:03.467 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:03.468 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:34:03.468 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:34:03.468 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:03.482 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:03.536 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:03.534+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:03.637 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:03.635+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:03.674 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:03.674 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:03.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:03.674 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:03.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.870429295999998, 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:03.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:03.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:03.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:03.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:03.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:03.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:03.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:03.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:03.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:03.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:03.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:03.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:03.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:03.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:03.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:03.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:03.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:03.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:03.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:03.681 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.681 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.681 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.681 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:03.681 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:03.682 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.870428310999998, 2024-04-26T10:34:03.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:03.682 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.682 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.682 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:03.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:03.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:03.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:03.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:03.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:03.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:03.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:03.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:03.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:03.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:03.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:03.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:03.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:03.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:03.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:03.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:03.688 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.688 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.688 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.688 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:03.688 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:03.688 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.870359688000001, 2024-04-26T10:34:03.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:03.688 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.688 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.688 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:03.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:03.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:03.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:03.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:03.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:03.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:03.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:03.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:03.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:03.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:03.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:03.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:03.694 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.694 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.694 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.694 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:03.694 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:03.694 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.870307908000001, 2024-04-26T10:34:03.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:03.695 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.695 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.695 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.695 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.695 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.695 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:03.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.695 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:03.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:03.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:03.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:03.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:03.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:03.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:03.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:03.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:03.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:03.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:03.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:03.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:03.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:03.700 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.701 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.701 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.701 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:03.701 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:03.701 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.870248058000001, 2024-04-26T10:34:03.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:03.701 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.701 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.701 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.701 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.701 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.702 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:03.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.702 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:03.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:03.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:03.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:03.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:03.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:03.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:03.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:03.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:03.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:03.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:03.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:03.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:03.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:03.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:03.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:03.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:03.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:03.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:03.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:03.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:03.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:03.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:03.707 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.708 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.708 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.708 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:03.708 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:03.708 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.868535354000002, 2024-04-26T10:34:03.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:03.708 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.708 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.708 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.708 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.709 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.709 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:03.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.709 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:03.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:03.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:03.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:03.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:03.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:03.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:03.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:03.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:03.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:03.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:03.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:03.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:03.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:03.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:03.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:03.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:03.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:03.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:03.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:03.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:03.716 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.716 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.716 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.716 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:03.716 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:03.716 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.868420286999999, 2024-04-26T10:34:03.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:03.716 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.717 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.717 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:03.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:03.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:03.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:03.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:03.721 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.721 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.721 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.721 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:03.721 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:03.721 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.868327147000002, 2024-04-26T10:34:03.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:03.722 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.722 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.722 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.722 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.722 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.722 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:03.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.722 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:03.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:03.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:03.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:03.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:03.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:03.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:03.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:03.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:03.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:03.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:03.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:03.728 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.728 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.728 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.728 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:03.728 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:03.728 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.868132987000003, 2024-04-26T10:34:03.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:03.728 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.728 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.728 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:03.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:03.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:03.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:03.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:03.732 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.732 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.732 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.732 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:03.733 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:03.733 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.866925619, 2024-04-26T10:34:03.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:03.733 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.733 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:03.733 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:03.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:03.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:03.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:03.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:03.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:03.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:03.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:03.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.866116710999997, 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.737 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:03.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.738 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:03.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:03.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:03.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:03.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:03.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:03.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:03.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:03.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:03.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:03.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:03.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:03.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:03.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:03.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:03.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:03.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:03.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:03.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:03.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:03.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.744 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.744 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:03.744 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:03.744 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.866013172999999, 2024-04-26T10:34:03.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:03.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:03.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:03.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:03.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:03.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:03.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:03.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:03.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:03.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:03.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:03.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:03.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:03.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:03.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:03.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.865936300000001, 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.751 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.752 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.752 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:03.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.752 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:03.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:03.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:03.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:03.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:03.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:03.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:03.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:03.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:03.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:03.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:03.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:03.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.865820915999997, 2024-04-26T10:34:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:03.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.761 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.489176863, 2024-04-26T10:34:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.762 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:03.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:03.767 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.4871470149999997, 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.768 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.4866712120000001, 2024-04-26T10:34:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:03.774 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:03.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:03.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:03.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:03.783 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.4847041579999996, 2024-04-26T10:34:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:03.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:03.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103336 5.6 5:6c0cef20:::benchmark_data_smithi043_45180_object103335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:03.789 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.4825948530000002, 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064107786, 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103336 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188502+0000", 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188540+0000", 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8445000000000002e-05 2024-04-26T10:34:03.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188553+0000", 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2768e-05 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188563+0000", 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9760000000000007e-06 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191877+0000", 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003313908 2024-04-26T10:34:03.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192004+0000", 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012663 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192143+0000", 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013964199999999999 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.196467+0000", 2024-04-26T10:34:03.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043232230000000002 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252539+0000", 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056072085000000001 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252577+0000", 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8730999999999999e-05 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252611+0000", 2024-04-26T10:34:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3769000000000001e-05 2024-04-26T10:34:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.48203642, 2024-04-26T10:34:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:03.795 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:03.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:03.800 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:03.801 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:03.801 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:03.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:34:03.803 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:03.802+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:03.804 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:03.905 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:03.904+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:03.954 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:03.975 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:03.991 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:03.991 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:03.996 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:03.998 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:03.998 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:03.998 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:04.005 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:04.004+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:04.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:04.105 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:04.104+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:04.186 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:04.187 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:04.201 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:04.206 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:04.205+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:04.308 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:04.307+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:04.412 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:04.411+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:04.421 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 47 16 111830 111814 148.676 127.375 0.0130944 0.00672341 2024-04-26T10:34:04.428 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:04.428 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:04.443 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:04.510 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:04.508+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:04.605 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:04.605 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:04.610 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:04.608+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:04.619 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:04.711 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:04.710+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:04.780 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:04.780 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:04.793 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:04.836 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:04.835+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:04.913 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:04.912+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:04.954 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:04.955 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:04.968 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:05.015 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:05.013+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:05.116 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:05.115+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:05.166 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:05.166 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:05.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:05.223 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:05.221+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:05.317 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:05.316+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:05.415 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:05.415 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:05.418 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:05.417+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:05.421 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 48 16 113838 113822 148.193 125.5 0.00440048 0.00674505 2024-04-26T10:34:05.431 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:05.470 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:34:05.470 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:34:05.470 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T10:34:05.470 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T10:34:05.476 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:34:05.519 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:05.517+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:05.620 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:05.618+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:05.624 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:05.624 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:05.642 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:05.721 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:05.720+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:05.821 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:05.820+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:05.822 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:05.823 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:05.838 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:05.851 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:05.851 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-26T10:34:05.851 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 37, 2024-04-26T10:34:05.851 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "6d35b773-83ef-4e54-be62-89cec0b09327", 2024-04-26T10:34:05.851 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-04-26T10:32:36.651799+0000", 2024-04-26T10:34:05.851 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-04-26T10:34:04.456264+0000", 2024-04-26T10:34:05.851 INFO:teuthology.orchestra.run.smithi043.stdout: "last_up_change": "2024-04-26T10:32:44.545583+0000", 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: "last_in_change": "2024-04-26T10:32:37.588200+0000", 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_num": 5801984, 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_set": [ 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: "noscrub", 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: "pglog_hardlimit", 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: "purged_snapdirs", 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_deletes", 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: "sortbitwise" 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_version": 4, 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T10:34:05.852 INFO:teuthology.orchestra.run.smithi043.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_snapshot": "", 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_max": 5, 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd": 3, 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: "require_min_compat_client": "luminous", 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: "min_compat_client": "jewel", 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: "require_osd_release": "reef", 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_crimson": false, 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: "pools": [ 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 1, 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": ".mgr", 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.037545+0000", 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:05.853 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 1, 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 1, 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 1, 2024-04-26T10:34:05.854 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 1, 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 1, 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:05.855 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:05.856 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:05.857 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:05.858 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:05.858 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:05.858 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:05.858 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:05.858 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:05.858 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:34:05.858 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_max": 32, 2024-04-26T10:34:05.858 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 1 2024-04-26T10:34:05.858 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.858 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:05.858 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": {} 2024-04-26T10:34:05.858 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.858 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 2.9900000095367432, 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 2.9900000095367432, 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 2, 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 2, 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 2, 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "rbd", 2024-04-26T10:34:05.859 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.393201+0000", 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 8, 2024-04-26T10:34:05.860 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 8, 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 8, 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 8, 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 8, 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:05.861 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:05.862 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:05.863 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd": {} 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.5, 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.5, 2024-04-26T10:34:05.864 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.5, 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.5, 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 3, 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_metadata", 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:49.859710+0000", 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:05.865 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 32, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 32, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 32, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 32, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 32, 2024-04-26T10:34:05.866 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "14", 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:05.868 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:05.868 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:05.868 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:05.868 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:05.868 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:05.868 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:05.868 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:05.868 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:05.868 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:05.868 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:05.868 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:05.868 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:05.868 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:05.869 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:05.870 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:05.870 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:05.870 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:05.870 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:05.870 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:34:05.870 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_bias": 4, 2024-04-26T10:34:05.870 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 16, 2024-04-26T10:34:05.870 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_priority": 5 2024-04-26T10:34:05.870 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.870 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:05.870 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:34:05.870 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": "cephfs" 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.309999942779541, 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.309999942779541, 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.309999942779541, 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.309999942779541, 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.871 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 4, 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_data", 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:50.968196+0000", 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:05.872 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 64, 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 64, 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 64, 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 64, 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 64, 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "15", 2024-04-26T10:34:05.873 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:05.874 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:05.875 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 64, 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.876 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: "data": "cephfs" 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.2699999809265137, 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.2699999809265137, 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.2699999809265137, 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.2699999809265137, 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:05.877 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 5, 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "unique_pool_0", 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:33:15.284422+0000", 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:05.878 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 16, 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 16, 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 16, 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 16, 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 16, 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:05.879 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "18", 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:05.880 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:05.881 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:05.882 INFO:teuthology.orchestra.run.smithi043.stdout: "rados": {} 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.5, 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.5, 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.5, 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.5, 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:34:05.883 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "32399f03-8160-43f7-a69f-1db73f105676", 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 36, 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:34:05.884 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:05.885 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.885 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:05.885 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6800", 2024-04-26T10:34:05.885 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:05.885 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.885 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.885 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:05.885 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6801", 2024-04-26T10:34:05.885 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:05.885 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.885 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.885 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.885 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6802", 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6803", 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.886 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6806", 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6807", 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.887 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6804", 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6805", 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.112:6801/41771", 2024-04-26T10:34:05.888 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.112:6803/41771", 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.112:6807/41771", 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.112:6805/41771", 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "89e46a83-bfff-458f-bbac-258edb6ddad2", 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 0.3618927001953125, 2024-04-26T10:34:05.889 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:34:05.890 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:34:05.890 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:34:05.890 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:34:05.890 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 16, 2024-04-26T10:34:05.890 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:34:05.890 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:34:05.890 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:34:05.890 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:05.890 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.890 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:05.890 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6800", 2024-04-26T10:34:05.890 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:05.890 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6801", 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6802", 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.891 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6803", 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6806", 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.892 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6807", 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6804", 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.893 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6805", 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.186:6801/41804", 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.186:6803/41804", 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.186:6807/41804", 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.186:6805/41804", 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:34:05.894 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "24c9e06d-1386-4075-b64e-d6c1d57c57bb", 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 34, 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:34:05.895 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6800", 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6801", 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.896 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6802", 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6803", 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.897 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6806", 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6807", 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.898 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6804", 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6805", 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.187:6801/41919", 2024-04-26T10:34:05.899 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.187:6803/41919", 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.187:6807/41919", 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.187:6805/41919", 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_xinfo": [ 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:34:05.900 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.579572+0000", 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.596783+0000", 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.901 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.902 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:34:05.902 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:34:05.902 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:34:05.902 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:34:05.902 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:34:05.902 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:34:05.902 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.632883+0000", 2024-04-26T10:34:05.902 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:34:05.902 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.902 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:05.902 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap": [], 2024-04-26T10:34:05.902 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_items": [], 2024-04-26T10:34:05.902 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_primaries": [], 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_temp": [ 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: "pgid": "5.0", 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: 2, 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: 1 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: "pgid": "5.4", 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: 2, 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: 1 2024-04-26T10:34:05.903 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: "pgid": "5.9", 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: 1 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: "pgid": "5.b", 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: 2, 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: 1 2024-04-26T10:34:05.904 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: "pgid": "5.d", 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: 1 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: "pgid": "5.f", 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: 1 2024-04-26T10:34:05.905 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_temp": [], 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklist": {}, 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: "range_blocklist": {}, 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profiles": { 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: "default": { 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-failure-domain": "osd", 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: "k": "2", 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: "m": "1", 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin": "jerasure", 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: "technique": "reed_sol_van" 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.906 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:05.907 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps_queue": [], 2024-04-26T10:34:05.907 INFO:teuthology.orchestra.run.smithi043.stdout: "new_removed_snaps": [], 2024-04-26T10:34:05.907 INFO:teuthology.orchestra.run.smithi043.stdout: "new_purged_snaps": [], 2024-04-26T10:34:05.907 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_node_flags": {}, 2024-04-26T10:34:05.907 INFO:teuthology.orchestra.run.smithi043.stdout: "device_class_flags": {}, 2024-04-26T10:34:05.907 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": { 2024-04-26T10:34:05.907 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_enabled": false, 2024-04-26T10:34:05.907 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_bucket_count": 0, 2024-04-26T10:34:05.907 INFO:teuthology.orchestra.run.smithi043.stdout: "degraded_stretch_mode": 0, 2024-04-26T10:34:05.907 INFO:teuthology.orchestra.run.smithi043.stdout: "recovering_stretch_mode": 0, 2024-04-26T10:34:05.907 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_bucket": 0 2024-04-26T10:34:05.907 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:05.907 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-26T10:34:05.909 INFO:tasks.thrashosds.thrasher:j is {'epoch': 37, 'fsid': '6d35b773-83ef-4e54-be62-89cec0b09327', 'created': '2024-04-26T10:32:36.651799+0000', 'modified': '2024-04-26T10:34:04.456264+0000', 'last_up_change': '2024-04-26T10:32:44.545583+0000', 'last_in_change': '2024-04-26T10:32:37.588200+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:32:45.037545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:32:45.393201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:32:49.859710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:32:50.968196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.2699999809265137, 'score_stable': 1.2699999809265137, 'optimal_score': 1, 'raw_score_acting': 1.2699999809265137, 'raw_score_stable': 1.2699999809265137, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-26T10:33:15.284422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '32399f03-8160-43f7-a69f-1db73f105676', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 36, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 41771}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 41771}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 41771}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 41771}]}, 'public_addr': '172.21.15.112:6801/41771', 'cluster_addr': '172.21.15.112:6803/41771', 'heartbeat_back_addr': '172.21.15.112:6807/41771', 'heartbeat_front_addr': '172.21.15.112:6805/41771', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '89e46a83-bfff-458f-bbac-258edb6ddad2', 'up': 1, 'in': 1, 'weight': 0.3618927001953125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6800', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6801', 'nonce': 41804}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6802', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6803', 'nonce': 41804}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6806', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6807', 'nonce': 41804}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6804', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6805', 'nonce': 41804}]}, 'public_addr': '172.21.15.186:6801/41804', 'cluster_addr': '172.21.15.186:6803/41804', 'heartbeat_back_addr': '172.21.15.186:6807/41804', 'heartbeat_front_addr': '172.21.15.186:6805/41804', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '24c9e06d-1386-4075-b64e-d6c1d57c57bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 41919}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 41919}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 41919}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 41919}]}, 'public_addr': '172.21.15.187:6801/41919', 'cluster_addr': '172.21.15.187:6803/41919', 'heartbeat_back_addr': '172.21.15.187:6807/41919', 'heartbeat_front_addr': '172.21.15.187:6805/41919', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.579572+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.596783+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.632883+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '5.0', 'osds': [2, 1]}, {'pgid': '5.4', 'osds': [2, 1]}, {'pgid': '5.9', 'osds': [0, 1]}, {'pgid': '5.b', 'osds': [2, 1]}, {'pgid': '5.d', 'osds': [0, 1]}, {'pgid': '5.f', 'osds': [0, 1]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T10:34:05.909 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:34:05.923 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:05.921+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:06.010 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:06.022 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:06.021+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:06.081 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:06.082 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:06.096 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:06.140 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:06.138+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:06.170 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:06.191 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:06.213 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:06.215 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:06.215 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:06.215 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:06.224 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:06.222+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:06.280 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:06.282 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:34:06.283 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:06.283 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:34:06.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:34:06.283 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:06.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.479728004999998, 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:34:06.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:34:06.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:95997 5.7 5:ef48f664:::benchmark_data_smithi043_45180_object95996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 11.694518523999999, 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024010581999999999, 2024-04-26T10:34:06.289 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 95997 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585344+0000", 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4491e-05 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585350+0000", 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1099999999999999e-06 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585355+0000", 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5430000000000004e-06 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592076+0000", 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067208470000000003 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592209+0000", 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013344400000000001 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592320+0000", 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011081700000000001 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.594282+0000", 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019622699999999999 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609277+0000", 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014995066 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609308+0000", 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1242999999999999e-05 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609331+0000", 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2150999999999998e-05 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.294 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101455 5.f 5:fbcc5be4:::benchmark_data_smithi043_45180_object101454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.0098573359999996, 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02195165, 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101455 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270103+0000", 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122309 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270111+0000", 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3999999999999992e-06 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270118+0000", 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9179999999999997e-06 2024-04-26T10:34:06.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272018+0000", 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018998610000000001 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272126+0000", 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010844999999999999 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272225+0000", 2024-04-26T10:34:06.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8381999999999994e-05 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278402+0000", 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061767009999999997 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291830+0000", 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013428756 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291894+0000", 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3189999999999996e-05 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291933+0000", 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9297e-05 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101456 5.f 5:f61cae04:::benchmark_data_smithi043_45180_object101455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.0095761539999994, 2024-04-26T10:34:06.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021829133000000001, 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101456 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270361+0000", 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9395999999999995e-05 2024-04-26T10:34:06.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270369+0000", 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5490000000000001e-06 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270374+0000", 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5130000000000004e-06 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273610+0000", 2024-04-26T10:34:06.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003235791 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273723+0000", 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112833 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273861+0000", 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013803 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278411+0000", 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045506380000000001 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291986+0000", 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013574409000000001 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292037+0000", 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1041000000000001e-05 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292091+0000", 2024-04-26T10:34:06.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4617000000000002e-05 2024-04-26T10:34:06.306 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.306 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.306 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.306 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101459 5.f 5:f6287f2a:::benchmark_data_smithi043_45180_object101458:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:06.306 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:06.306 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.0076632459999999, 2024-04-26T10:34:06.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022608105999999999, 2024-04-26T10:34:06.306 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.306 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.306 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101459 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:06.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272227+0000", 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2669e-05 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272236+0000", 2024-04-26T10:34:06.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0210000000000005e-06 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272243+0000", 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7469999999999999e-06 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276304+0000", 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040604789999999997 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276386+0000", 2024-04-26T10:34:06.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2278000000000001e-05 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276477+0000", 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0713999999999999e-05 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278905+0000", 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024288249999999999 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294715+0000", 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015809976999999999 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294747+0000", 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1814999999999999e-05 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294783+0000", 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6180999999999998e-05 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101461 5.f 5:fcae472f:::benchmark_data_smithi043_45180_object101460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.0068699859999999, 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021972760000000001, 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101461 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272968+0000", 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273035+0000", 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7477000000000005e-05 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273043+0000", 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4159999999999998e-06 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273049+0000", 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4509999999999997e-06 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277407+0000", 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043580529999999998 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277489+0000", 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1333000000000002e-05 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277574+0000", 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5042000000000003e-05 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278908+0000", 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013341360000000001 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294832+0000", 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015924462 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294899+0000", 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6984999999999996e-05 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294941+0000", 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2113000000000002e-05 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:102382 5.2 5:4e9d92ee:::benchmark_data_smithi043_45180_object102381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.5725712250000008, 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021126853000000001, 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 102382 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:06.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707330+0000", 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3274000000000004e-05 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707339+0000", 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9700000000000005e-06 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707346+0000", 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709272+0000", 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019264169999999999 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709387+0000", 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115333 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709479+0000", 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1555e-05 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.712520+0000", 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030408729999999999 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728336+0000", 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015815929999999999 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728370+0000", 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4496999999999999e-05 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728394+0000", 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3793000000000001e-05 2024-04-26T10:34:06.322 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:102397 5.2 5:4581c7c6:::benchmark_data_smithi043_45180_object102396:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.714966+0000", 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.5648723899999997, 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020959388999999998, 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 102397 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.323 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.714966+0000", 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.714966+0000", 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.714965+0000", 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715020+0000", 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5303000000000002e-05 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715031+0000", 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0871e-05 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715038+0000", 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0040000000000002e-06 2024-04-26T10:34:06.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715069+0000", 2024-04-26T10:34:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0565000000000003e-05 2024-04-26T10:34:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715161+0000", 2024-04-26T10:34:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1644000000000006e-05 2024-04-26T10:34:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:06.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.715252+0000", 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1930999999999998e-05 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.717863+0000", 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026101309999999999 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.735843+0000", 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017980576000000002 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.735888+0000", 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5188000000000002e-05 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.735925+0000", 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7135000000000003e-05 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103328 5.6 e32/16 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head v 32'6425, mlcod=32'6423)", 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.0954786960000007, 2024-04-26T10:34:06.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064716840999999997, 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184359+0000", 2024-04-26T10:34:06.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184419+0000", 2024-04-26T10:34:06.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9345999999999997e-05 2024-04-26T10:34:06.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184425+0000", 2024-04-26T10:34:06.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1190000000000002e-06 2024-04-26T10:34:06.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184429+0000", 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.296e-06 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184461+0000", 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2122999999999997e-05 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184477+0000", 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5877000000000001e-05 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249048+0000", 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064570494000000006 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249077+0000", 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9081000000000002e-05 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.332 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103327 5.c e32/16 5:3133c183:::benchmark_data_smithi043_45180_object103326:head v 32'6430, mlcod=32'6425)", 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.0953120980000008, 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064984741999999998, 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:06.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184592+0000", 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6027999999999999e-05 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184597+0000", 2024-04-26T10:34:06.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8570000000000003e-06 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184600+0000", 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3390000000000001e-06 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184620+0000", 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9890000000000001e-05 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184631+0000", 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1073999999999999e-05 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249477+0000", 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064845485999999994 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249511+0000", 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4508000000000002e-05 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103329 5.6 e32/16 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head v 32'6426, mlcod=32'6423)", 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.0914782770000002, 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063744996999999998, 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:06.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188359+0000", 2024-04-26T10:34:06.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188389+0000", 2024-04-26T10:34:06.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9416000000000001e-05 2024-04-26T10:34:06.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243409+0000", 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.055020409999999999 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243419+0000", 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0071000000000001e-05 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243465+0000", 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5799e-05 2024-04-26T10:34:06.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243491+0000", 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5619999999999999e-05 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252067+0000", 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085763809999999992 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252105+0000", 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8040999999999997e-05 2024-04-26T10:34:06.340 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103337 5.d e32/16 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head v 32'6429, mlcod=32'6427)", 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.0914079000000001, 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.057982037, 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188430+0000", 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188500+0000", 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0062999999999996e-05 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243434+0000", 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.054933760999999998 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243442+0000", 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243490+0000", 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8312000000000001e-05 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243511+0000", 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0781999999999999e-05 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246370+0000", 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028590930000000001 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246413+0000", 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2413000000000002e-05 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103660 5.9 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 7.8974722550000003, 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.067661676000000004, 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.345 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103660 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:06.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382365+0000", 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382430+0000", 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4850000000000004e-05 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382439+0000", 2024-04-26T10:34:06.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382445+0000", 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0229999999999998e-06 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382482+0000", 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6909000000000002e-05 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382613+0000", 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013072600000000001 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382756+0000", 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000143306 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385090+0000", 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002333786 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449925+0000", 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064835173999999995 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449985+0000", 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0124999999999998e-05 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450028+0000", 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2457999999999999e-05 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103662 5.f 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 7.8950284450000003, 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.068705924000000002, 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103662 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.351 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384809+0000", 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384908+0000", 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9146000000000002e-05 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384921+0000", 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2622e-05 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384931+0000", 2024-04-26T10:34:06.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0108e-05 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384984+0000", 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2849000000000002e-05 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017266800000000001 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:06.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385313+0000", 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015649300000000001 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388446+0000", 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003133481 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453401+0000", 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064955075000000001 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453462+0000", 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1134000000000001e-05 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453516+0000", 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3477999999999999e-05 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103664 5.9 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:06.356 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 7.8947457610000003, 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.065076041000000001, 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103664 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385092+0000", 2024-04-26T10:34:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385145+0000", 2024-04-26T10:34:06.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3143000000000003e-05 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0473e-05 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385163+0000", 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385193+0000", 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0638e-05 2024-04-26T10:34:06.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385284+0000", 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599000000000005e-05 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385375+0000", 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0606999999999995e-05 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387556+0000", 2024-04-26T10:34:06.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021809529999999998 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450072+0000", 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062516408999999995 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450123+0000", 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1406000000000002e-05 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450169+0000", 2024-04-26T10:34:06.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5380000000000003e-05 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103666 5.f 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 7.8929823880000001, 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066830159, 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.362 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103666 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386855+0000", 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386928+0000", 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386937+0000", 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1090000000000004e-06 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386945+0000", 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386981+0000", 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5899999999999998e-05 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387071+0000", 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9954e-05 2024-04-26T10:34:06.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387161+0000", 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0898999999999998e-05 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390584+0000", 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034229030000000001 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453579+0000", 2024-04-26T10:34:06.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062994267000000007 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453640+0000", 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1162999999999997e-05 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453686+0000", 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6493999999999999e-05 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103667 5.f 5:f4dc36e8:::benchmark_data_smithi043_45180_object103666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 7.8921213180000001, 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066218387000000004, 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103667 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387783+0000", 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5973e-05 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387791+0000", 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1850000000000004e-06 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387796+0000", 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-04-26T10:34:06.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388469+0000", 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0006734 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388547+0000", 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7188999999999996e-05 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388630+0000", 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3892000000000002e-05 2024-04-26T10:34:06.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390598+0000", 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00196759 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453803+0000", 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063205069000000003 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453844+0000", 2024-04-26T10:34:06.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1248999999999998e-05 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453936+0000", 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1201999999999999e-05 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:107998 5.9 5:9ce23eb0:::benchmark_data_smithi043_45180_object107997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.784202938, 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025313064, 2024-04-26T10:34:06.373 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107998 2024-04-26T10:34:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495634+0000", 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495754+0000", 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119893 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495769+0000", 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4769999999999999e-05 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495781+0000", 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1858999999999999e-05 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502521+0000", 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067402410000000001 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502675+0000", 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015405099999999999 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1,2", 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502846+0000", 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000171001 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.505743+0000", 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028975490000000001 2024-04-26T10:34:06.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.508006+0000", 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022627620000000002 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520788+0000", 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012782244 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520846+0000", 2024-04-26T10:34:06.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7976999999999997e-05 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520949+0000", 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102267 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:107974 5.b e35/34 5:daaeafb8:::benchmark_data_smithi043_45180_object107973:head v 35'6822, mlcod=0'0)", 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.765176115, 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020988144, 2024-04-26T10:34:06.379 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514661+0000", 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514668+0000", 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0249999999999997e-06 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514678+0000", 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7950000000000002e-06 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514686+0000", 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9049999999999997e-06 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514872+0000", 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018605499999999999 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514900+0000", 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7758000000000001e-05 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.535626+0000", 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020725958999999999 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.535651+0000", 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-05 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:108005 5.c e35/16 5:3b5c73fa:::benchmark_data_smithi043_45180_object108004:head v 35'6720, mlcod=33'6718)", 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:06.383 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.7651151020000002, 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025223481999999998, 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514766+0000", 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2818999999999998e-05 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514773+0000", 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999996e-06 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514777+0000", 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6199999999999998e-06 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522074+0000", 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072964029999999999 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522096+0000", 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2027000000000001e-05 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539924+0000", 2024-04-26T10:34:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017827749 2024-04-26T10:34:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539947+0000", 2024-04-26T10:34:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3232999999999999e-05 2024-04-26T10:34:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:06.387 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:06.387 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:06.389 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:06.387+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:06.390 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-26T10:34:04.997994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":7024479066,"num_objects":107200,"num_object_clones":0,"num_object_copies":214400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107200,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":107424,"num_write_kb":6862738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60672,"ondisk_log_size":60672,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":13962572,"kb_used_data":13618220,"kb_used_omap":4,"kb_used_meta":344315,"kb_avail":269152948,"statfs":{"total":289910292480,"available":275612618752,"internally_reserved":0,"allocated":13945057280,"data_stored":13944344217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":352578898},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,3,5,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000628"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437757+0000","last_change":"2024-04-26T10:32:51.998840+0000","last_active":"2024-04-26T10:33:54.437757+0000","last_peered":"2024-04-26T10:33:54.437757+0000","last_clean":"2024-04-26T10:33:54.437757+0000","last_became_active":"2024-04-26T10:32:51.998236+0000","last_became_peered":"2024-04-26T10:32:51.998236+0000","last_unstale":"2024-04-26T10:33:54.437757+0000","last_undegraded":"2024-04-26T10:33:54.437757+0000","last_fullsized":"2024-04-26T10:33:54.437757+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437467+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:33:54.437467+0000","last_peered":"2024-04-26T10:33:54.437467+0000","last_clean":"2024-04-26T10:33:54.437467+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:33:54.437467+0000","last_undegraded":"2024-04-26T10:33:54.437467+0000","last_fullsized":"2024-04-26T10:33:54.437467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435964+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:33:54.435964+0000","last_peered":"2024-04-26T10:33:54.435964+0000","last_clean":"2024-04-26T10:33:54.435964+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:33:54.435964+0000","last_undegraded":"2024-04-26T10:33:54.435964+0000","last_fullsized":"2024-04-26T10:33:54.435964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435991+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:33:54.435991+0000","last_peered":"2024-04-26T10:33:54.435991+0000","last_clean":"2024-04-26T10:33:54.435991+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:33:54.435991+0000","last_undegraded":"2024-04-26T10:33:54.435991+0000","last_fullsized":"2024-04-26T10:33:54.435991+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436870+0000","last_change":"2024-04-26T10:32:51.999420+0000","last_active":"2024-04-26T10:33:54.436870+0000","last_peered":"2024-04-26T10:33:54.436870+0000","last_clean":"2024-04-26T10:33:54.436870+0000","last_became_active":"2024-04-26T10:32:51.999046+0000","last_became_peered":"2024-04-26T10:32:51.999046+0000","last_unstale":"2024-04-26T10:33:54.436870+0000","last_undegraded":"2024-04-26T10:33:54.436870+0000","last_fullsized":"2024-04-26T10:33:54.436870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:49:10.442986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435226+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:33:54.435226+0000","last_peered":"2024-04-26T10:33:54.435226+0000","last_clean":"2024-04-26T10:33:54.435226+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:33:54.435226+0000","last_undegraded":"2024-04-26T10:33:54.435226+0000","last_fullsized":"2024-04-26T10:33:54.435226+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435499+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:33:54.435499+0000","last_peered":"2024-04-26T10:33:54.435499+0000","last_clean":"2024-04-26T10:33:54.435499+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:33:54.435499+0000","last_undegraded":"2024-04-26T10:33:54.435499+0000","last_fullsized":"2024-04-26T10:33:54.435499+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434507+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:33:54.434507+0000","last_peered":"2024-04-26T10:33:54.434507+0000","last_clean":"2024-04-26T10:33:54.434507+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:33:54.434507+0000","last_undegraded":"2024-04-26T10:33:54.434507+0000","last_fullsized":"2024-04-26T10:33:54.434507+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436371+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:33:54.436371+0000","last_peered":"2024-04-26T10:33:54.436371+0000","last_clean":"2024-04-26T10:33:54.436371+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:33:54.436371+0000","last_undegraded":"2024-04-26T10:33:54.436371+0000","last_fullsized":"2024-04-26T10:33:54.436371+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437504+0000","last_change":"2024-04-26T10:32:52.000612+0000","last_active":"2024-04-26T10:33:54.437504+0000","last_peered":"2024-04-26T10:33:54.437504+0000","last_clean":"2024-04-26T10:33:54.437504+0000","last_became_active":"2024-04-26T10:32:51.998958+0000","last_became_peered":"2024-04-26T10:32:51.998958+0000","last_unstale":"2024-04-26T10:33:54.437504+0000","last_undegraded":"2024-04-26T10:33:54.437504+0000","last_fullsized":"2024-04-26T10:33:54.437504+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435930+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:33:54.435930+0000","last_peered":"2024-04-26T10:33:54.435930+0000","last_clean":"2024-04-26T10:33:54.435930+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:33:54.435930+0000","last_undegraded":"2024-04-26T10:33:54.435930+0000","last_fullsized":"2024-04-26T10:33:54.435930+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436759+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:33:54.436759+0000","last_peered":"2024-04-26T10:33:54.436759+0000","last_clean":"2024-04-26T10:33:54.436759+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:33:54.436759+0000","last_undegraded":"2024-04-26T10:33:54.436759+0000","last_fullsized":"2024-04-26T10:33:54.436759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437018+0000","last_change":"2024-04-26T10:32:52.000261+0000","last_active":"2024-04-26T10:33:54.437018+0000","last_peered":"2024-04-26T10:33:54.437018+0000","last_clean":"2024-04-26T10:33:54.437018+0000","last_became_active":"2024-04-26T10:32:51.999284+0000","last_became_peered":"2024-04-26T10:32:51.999284+0000","last_unstale":"2024-04-26T10:33:54.437018+0000","last_undegraded":"2024-04-26T10:33:54.437018+0000","last_fullsized":"2024-04-26T10:33:54.437018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435594+0000","last_change":"2024-04-26T10:32:52.003123+0000","last_active":"2024-04-26T10:33:54.435594+0000","last_peered":"2024-04-26T10:33:54.435594+0000","last_clean":"2024-04-26T10:33:54.435594+0000","last_became_active":"2024-04-26T10:32:52.001353+0000","last_became_peered":"2024-04-26T10:32:52.001353+0000","last_unstale":"2024-04-26T10:33:54.435594+0000","last_undegraded":"2024-04-26T10:33:54.435594+0000","last_fullsized":"2024-04-26T10:33:54.435594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:59:49.869670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435414+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:33:54.435414+0000","last_peered":"2024-04-26T10:33:54.435414+0000","last_clean":"2024-04-26T10:33:54.435414+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:33:54.435414+0000","last_undegraded":"2024-04-26T10:33:54.435414+0000","last_fullsized":"2024-04-26T10:33:54.435414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434584+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:33:54.434584+0000","last_peered":"2024-04-26T10:33:54.434584+0000","last_clean":"2024-04-26T10:33:54.434584+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:33:54.434584+0000","last_undegraded":"2024-04-26T10:33:54.434584+0000","last_fullsized":"2024-04-26T10:33:54.434584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436430+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:33:54.436430+0000","last_peered":"2024-04-26T10:33:54.436430+0000","last_clean":"2024-04-26T10:33:54.436430+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:33:54.436430+0000","last_undegraded":"2024-04-26T10:33:54.436430+0000","last_fullsized":"2024-04-26T10:33:54.436430+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437595+0000","last_change":"2024-04-26T10:32:52.000693+0000","last_active":"2024-04-26T10:33:54.437595+0000","last_peered":"2024-04-26T10:33:54.437595+0000","last_clean":"2024-04-26T10:33:54.437595+0000","last_became_active":"2024-04-26T10:32:51.999406+0000","last_became_peered":"2024-04-26T10:32:51.999406+0000","last_unstale":"2024-04-26T10:33:54.437595+0000","last_undegraded":"2024-04-26T10:33:54.437595+0000","last_fullsized":"2024-04-26T10:33:54.437595+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.438697+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:33:54.438697+0000","last_peered":"2024-04-26T10:33:54.438697+0000","last_clean":"2024-04-26T10:33:54.438697+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:33:54.438697+0000","last_undegraded":"2024-04-26T10:33:54.438697+0000","last_fullsized":"2024-04-26T10:33:54.438697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435953+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:33:54.435953+0000","last_peered":"2024-04-26T10:33:54.435953+0000","last_clean":"2024-04-26T10:33:54.435953+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:33:54.435953+0000","last_undegraded":"2024-04-26T10:33:54.435953+0000","last_fullsized":"2024-04-26T10:33:54.435953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434782+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:33:54.434782+0000","last_peered":"2024-04-26T10:33:54.434782+0000","last_clean":"2024-04-26T10:33:54.434782+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:33:54.434782+0000","last_undegraded":"2024-04-26T10:33:54.434782+0000","last_fullsized":"2024-04-26T10:33:54.434782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437043+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:33:54.437043+0000","last_peered":"2024-04-26T10:33:54.437043+0000","last_clean":"2024-04-26T10:33:54.437043+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:33:54.437043+0000","last_undegraded":"2024-04-26T10:33:54.437043+0000","last_fullsized":"2024-04-26T10:33:54.437043+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435108+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:33:54.435108+0000","last_peered":"2024-04-26T10:33:54.435108+0000","last_clean":"2024-04-26T10:33:54.435108+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:33:54.435108+0000","last_undegraded":"2024-04-26T10:33:54.435108+0000","last_fullsized":"2024-04-26T10:33:54.435108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436825+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:33:54.436825+0000","last_peered":"2024-04-26T10:33:54.436825+0000","last_clean":"2024-04-26T10:33:54.436825+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:33:54.436825+0000","last_undegraded":"2024-04-26T10:33:54.436825+0000","last_fullsized":"2024-04-26T10:33:54.436825+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437746+0000","last_change":"2024-04-26T10:32:52.004089+0000","last_active":"2024-04-26T10:33:54.437746+0000","last_peered":"2024-04-26T10:33:54.437746+0000","last_clean":"2024-04-26T10:33:54.437746+0000","last_became_active":"2024-04-26T10:32:52.003802+0000","last_became_peered":"2024-04-26T10:32:52.003802+0000","last_unstale":"2024-04-26T10:33:54.437746+0000","last_undegraded":"2024-04-26T10:33:54.437746+0000","last_fullsized":"2024-04-26T10:33:54.437746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436426+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:33:54.436426+0000","last_peered":"2024-04-26T10:33:54.436426+0000","last_clean":"2024-04-26T10:33:54.436426+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:33:54.436426+0000","last_undegraded":"2024-04-26T10:33:54.436426+0000","last_fullsized":"2024-04-26T10:33:54.436426+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435917+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:33:54.435917+0000","last_peered":"2024-04-26T10:33:54.435917+0000","last_clean":"2024-04-26T10:33:54.435917+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:33:54.435917+0000","last_undegraded":"2024-04-26T10:33:54.435917+0000","last_fullsized":"2024-04-26T10:33:54.435917+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436958+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:33:54.436958+0000","last_peered":"2024-04-26T10:33:54.436958+0000","last_clean":"2024-04-26T10:33:54.436958+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:33:54.436958+0000","last_undegraded":"2024-04-26T10:33:54.436958+0000","last_fullsized":"2024-04-26T10:33:54.436958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437339+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:33:54.437339+0000","last_peered":"2024-04-26T10:33:54.437339+0000","last_clean":"2024-04-26T10:33:54.437339+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:33:54.437339+0000","last_undegraded":"2024-04-26T10:33:54.437339+0000","last_fullsized":"2024-04-26T10:33:54.437339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435178+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:33:54.435178+0000","last_peered":"2024-04-26T10:33:54.435178+0000","last_clean":"2024-04-26T10:33:54.435178+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:33:54.435178+0000","last_undegraded":"2024-04-26T10:33:54.435178+0000","last_fullsized":"2024-04-26T10:33:54.435178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436497+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:33:54.436497+0000","last_peered":"2024-04-26T10:33:54.436497+0000","last_clean":"2024-04-26T10:33:54.436497+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:33:54.436497+0000","last_undegraded":"2024-04-26T10:33:54.436497+0000","last_fullsized":"2024-04-26T10:33:54.436497+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434896+0000","last_change":"2024-04-26T10:32:51.588353+0000","last_active":"2024-04-26T10:33:54.434896+0000","last_peered":"2024-04-26T10:33:54.434896+0000","last_clean":"2024-04-26T10:33:54.434896+0000","last_became_active":"2024-04-26T10:32:51.587981+0000","last_became_peered":"2024-04-26T10:32:51.587981+0000","last_unstale":"2024-04-26T10:33:54.434896+0000","last_undegraded":"2024-04-26T10:33:54.434896+0000","last_fullsized":"2024-04-26T10:33:54.434896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:20.810803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437669+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:33:54.437669+0000","last_peered":"2024-04-26T10:33:54.437669+0000","last_clean":"2024-04-26T10:33:54.437669+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:33:54.437669+0000","last_undegraded":"2024-04-26T10:33:54.437669+0000","last_fullsized":"2024-04-26T10:33:54.437669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436670+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:33:54.436670+0000","last_peered":"2024-04-26T10:33:54.436670+0000","last_clean":"2024-04-26T10:33:54.436670+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:33:54.436670+0000","last_undegraded":"2024-04-26T10:33:54.436670+0000","last_fullsized":"2024-04-26T10:33:54.436670+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434749+0000","last_change":"2024-04-26T10:32:52.008030+0000","last_active":"2024-04-26T10:33:54.434749+0000","last_peered":"2024-04-26T10:33:54.434749+0000","last_clean":"2024-04-26T10:33:54.434749+0000","last_became_active":"2024-04-26T10:32:52.007158+0000","last_became_peered":"2024-04-26T10:32:52.007158+0000","last_unstale":"2024-04-26T10:33:54.434749+0000","last_undegraded":"2024-04-26T10:33:54.434749+0000","last_fullsized":"2024-04-26T10:33:54.434749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434864+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:33:54.434864+0000","last_peered":"2024-04-26T10:33:54.434864+0000","last_clean":"2024-04-26T10:33:54.434864+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:33:54.434864+0000","last_undegraded":"2024-04-26T10:33:54.434864+0000","last_fullsized":"2024-04-26T10:33:54.434864+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435303+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:33:54.435303+0000","last_peered":"2024-04-26T10:33:54.435303+0000","last_clean":"2024-04-26T10:33:54.435303+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:33:54.435303+0000","last_undegraded":"2024-04-26T10:33:54.435303+0000","last_fullsized":"2024-04-26T10:33:54.435303+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436941+0000","last_change":"2024-04-26T10:32:51.586732+0000","last_active":"2024-04-26T10:33:54.436941+0000","last_peered":"2024-04-26T10:33:54.436941+0000","last_clean":"2024-04-26T10:33:54.436941+0000","last_became_active":"2024-04-26T10:32:51.586533+0000","last_became_peered":"2024-04-26T10:32:51.586533+0000","last_unstale":"2024-04-26T10:33:54.436941+0000","last_undegraded":"2024-04-26T10:33:54.436941+0000","last_fullsized":"2024-04-26T10:33:54.436941+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435027+0000","last_change":"2024-04-26T10:32:52.007650+0000","last_active":"2024-04-26T10:33:54.435027+0000","last_peered":"2024-04-26T10:33:54.435027+0000","last_clean":"2024-04-26T10:33:54.435027+0000","last_became_active":"2024-04-26T10:32:52.007261+0000","last_became_peered":"2024-04-26T10:32:52.007261+0000","last_unstale":"2024-04-26T10:33:54.435027+0000","last_undegraded":"2024-04-26T10:33:54.435027+0000","last_fullsized":"2024-04-26T10:33:54.435027+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435893+0000","last_change":"2024-04-26T10:32:51.584497+0000","last_active":"2024-04-26T10:33:54.435893+0000","last_peered":"2024-04-26T10:33:54.435893+0000","last_clean":"2024-04-26T10:33:54.435893+0000","last_became_active":"2024-04-26T10:32:51.583460+0000","last_became_peered":"2024-04-26T10:32:51.583460+0000","last_unstale":"2024-04-26T10:33:54.435893+0000","last_undegraded":"2024-04-26T10:33:54.435893+0000","last_fullsized":"2024-04-26T10:33:54.435893+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435278+0000","last_change":"2024-04-26T10:32:52.001738+0000","last_active":"2024-04-26T10:33:54.435278+0000","last_peered":"2024-04-26T10:33:54.435278+0000","last_clean":"2024-04-26T10:33:54.435278+0000","last_became_active":"2024-04-26T10:32:51.999263+0000","last_became_peered":"2024-04-26T10:32:51.999263+0000","last_unstale":"2024-04-26T10:33:54.435278+0000","last_undegraded":"2024-04-26T10:33:54.435278+0000","last_fullsized":"2024-04-26T10:33:54.435278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:14.966669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435067+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:33:54.435067+0000","last_peered":"2024-04-26T10:33:54.435067+0000","last_clean":"2024-04-26T10:33:54.435067+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:33:54.435067+0000","last_undegraded":"2024-04-26T10:33:54.435067+0000","last_fullsized":"2024-04-26T10:33:54.435067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437320+0000","last_change":"2024-04-26T10:32:52.000043+0000","last_active":"2024-04-26T10:33:54.437320+0000","last_peered":"2024-04-26T10:33:54.437320+0000","last_clean":"2024-04-26T10:33:54.437320+0000","last_became_active":"2024-04-26T10:32:51.999069+0000","last_became_peered":"2024-04-26T10:32:51.999069+0000","last_unstale":"2024-04-26T10:33:54.437320+0000","last_undegraded":"2024-04-26T10:33:54.437320+0000","last_fullsized":"2024-04-26T10:33:54.437320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435043+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:33:54.435043+0000","last_peered":"2024-04-26T10:33:54.435043+0000","last_clean":"2024-04-26T10:33:54.435043+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:33:54.435043+0000","last_undegraded":"2024-04-26T10:33:54.435043+0000","last_fullsized":"2024-04-26T10:33:54.435043+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437249+0000","last_change":"2024-04-26T10:32:52.000628+0000","last_active":"2024-04-26T10:33:54.437249+0000","last_peered":"2024-04-26T10:33:54.437249+0000","last_clean":"2024-04-26T10:33:54.437249+0000","last_became_active":"2024-04-26T10:32:51.998121+0000","last_became_peered":"2024-04-26T10:32:51.998121+0000","last_unstale":"2024-04-26T10:33:54.437249+0000","last_undegraded":"2024-04-26T10:33:54.437249+0000","last_fullsized":"2024-04-26T10:33:54.437249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:23:35.293526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436572+0000","last_change":"2024-04-26T10:32:51.584210+0000","last_active":"2024-04-26T10:33:54.436572+0000","last_peered":"2024-04-26T10:33:54.436572+0000","last_clean":"2024-04-26T10:33:54.436572+0000","last_became_active":"2024-04-26T10:32:51.583823+0000","last_became_peered":"2024-04-26T10:32:51.583823+0000","last_unstale":"2024-04-26T10:33:54.436572+0000","last_undegraded":"2024-04-26T10:33:54.436572+0000","last_fullsized":"2024-04-26T10:33:54.436572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.121333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436545+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:33:54.436545+0000","last_peered":"2024-04-26T10:33:54.436545+0000","last_clean":"2024-04-26T10:33:54.436545+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:33:54.436545+0000","last_undegraded":"2024-04-26T10:33:54.436545+0000","last_fullsized":"2024-04-26T10:33:54.436545+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434899+0000","last_change":"2024-04-26T10:32:51.584088+0000","last_active":"2024-04-26T10:33:54.434899+0000","last_peered":"2024-04-26T10:33:54.434899+0000","last_clean":"2024-04-26T10:33:54.434899+0000","last_became_active":"2024-04-26T10:32:51.583020+0000","last_became_peered":"2024-04-26T10:32:51.583020+0000","last_unstale":"2024-04-26T10:33:54.434899+0000","last_undegraded":"2024-04-26T10:33:54.434899+0000","last_fullsized":"2024-04-26T10:33:54.434899+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436769+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:33:54.436769+0000","last_peered":"2024-04-26T10:33:54.436769+0000","last_clean":"2024-04-26T10:33:54.436769+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:33:54.436769+0000","last_undegraded":"2024-04-26T10:33:54.436769+0000","last_fullsized":"2024-04-26T10:33:54.436769+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"32'6698","reported_seq":6722,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.018360+0000","last_change":"2024-04-26T10:33:16.342202+0000","last_active":"2024-04-26T10:34:00.018360+0000","last_peered":"2024-04-26T10:34:00.018360+0000","last_clean":"2024-04-26T10:34:00.018360+0000","last_became_active":"2024-04-26T10:33:16.341991+0000","last_became_peered":"2024-04-26T10:33:16.341991+0000","last_unstale":"2024-04-26T10:34:00.018360+0000","last_undegraded":"2024-04-26T10:34:00.018360+0000","last_fullsized":"2024-04-26T10:34:00.018360+0000","mapping_epoch":16,"log_start":"23'2900","ondisk_log_start":"23'2900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3798,"log_dups_size":0,"ondisk_log_size":3798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:05:14.018308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438960128,"num_objects":6698,"num_object_clones":0,"num_object_copies":13396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6698,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6698,"num_write_kb":428672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436387+0000","last_change":"2024-04-26T10:32:51.583791+0000","last_active":"2024-04-26T10:33:54.436387+0000","last_peered":"2024-04-26T10:33:54.436387+0000","last_clean":"2024-04-26T10:33:54.436387+0000","last_became_active":"2024-04-26T10:32:51.583103+0000","last_became_peered":"2024-04-26T10:32:51.583103+0000","last_unstale":"2024-04-26T10:33:54.436387+0000","last_undegraded":"2024-04-26T10:33:54.436387+0000","last_fullsized":"2024-04-26T10:33:54.436387+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436496+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:33:54.436496+0000","last_peered":"2024-04-26T10:33:54.436496+0000","last_clean":"2024-04-26T10:33:54.436496+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:33:54.436496+0000","last_undegraded":"2024-04-26T10:33:54.436496+0000","last_fullsized":"2024-04-26T10:33:54.436496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"32'6885","reported_seq":6909,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.022929+0000","last_change":"2024-04-26T10:33:16.346351+0000","last_active":"2024-04-26T10:34:00.022929+0000","last_peered":"2024-04-26T10:34:00.022929+0000","last_clean":"2024-04-26T10:34:00.022929+0000","last_became_active":"2024-04-26T10:33:16.346122+0000","last_became_peered":"2024-04-26T10:33:16.346122+0000","last_unstale":"2024-04-26T10:34:00.022929+0000","last_undegraded":"2024-04-26T10:34:00.022929+0000","last_fullsized":"2024-04-26T10:34:00.022929+0000","mapping_epoch":16,"log_start":"23'2900","ondisk_log_start":"23'2900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3985,"log_dups_size":0,"ondisk_log_size":3985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:13.714464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451215360,"num_objects":6885,"num_object_clones":0,"num_object_copies":13770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6885,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6885,"num_write_kb":440640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437358+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:33:54.437358+0000","last_peered":"2024-04-26T10:33:54.437358+0000","last_clean":"2024-04-26T10:33:54.437358+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:33:54.437358+0000","last_undegraded":"2024-04-26T10:33:54.437358+0000","last_fullsized":"2024-04-26T10:33:54.437358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436665+0000","last_change":"2024-04-26T10:32:51.997516+0000","last_active":"2024-04-26T10:33:54.436665+0000","last_peered":"2024-04-26T10:33:54.436665+0000","last_clean":"2024-04-26T10:33:54.436665+0000","last_became_active":"2024-04-26T10:32:51.996896+0000","last_became_peered":"2024-04-26T10:32:51.996896+0000","last_unstale":"2024-04-26T10:33:54.436665+0000","last_undegraded":"2024-04-26T10:33:54.436665+0000","last_fullsized":"2024-04-26T10:33:54.436665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:51.552418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"32'6779","reported_seq":6803,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.022886+0000","last_change":"2024-04-26T10:33:16.344883+0000","last_active":"2024-04-26T10:34:00.022886+0000","last_peered":"2024-04-26T10:34:00.022886+0000","last_clean":"2024-04-26T10:34:00.022886+0000","last_became_active":"2024-04-26T10:33:16.344582+0000","last_became_peered":"2024-04-26T10:33:16.344582+0000","last_unstale":"2024-04-26T10:34:00.022886+0000","last_undegraded":"2024-04-26T10:34:00.022886+0000","last_fullsized":"2024-04-26T10:34:00.022886+0000","mapping_epoch":16,"log_start":"23'2800","ondisk_log_start":"23'2800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3979,"log_dups_size":0,"ondisk_log_size":3979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:27.495754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444268544,"num_objects":6779,"num_object_clones":0,"num_object_copies":13558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6779,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6779,"num_write_kb":433856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436114+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:33:54.436114+0000","last_peered":"2024-04-26T10:33:54.436114+0000","last_clean":"2024-04-26T10:33:54.436114+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:33:54.436114+0000","last_undegraded":"2024-04-26T10:33:54.436114+0000","last_fullsized":"2024-04-26T10:33:54.436114+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435393+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:33:54.435393+0000","last_peered":"2024-04-26T10:33:54.435393+0000","last_clean":"2024-04-26T10:33:54.435393+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:33:54.435393+0000","last_undegraded":"2024-04-26T10:33:54.435393+0000","last_fullsized":"2024-04-26T10:33:54.435393+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"32'6758","reported_seq":6782,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.029368+0000","last_change":"2024-04-26T10:33:16.346212+0000","last_active":"2024-04-26T10:34:00.029368+0000","last_peered":"2024-04-26T10:34:00.029368+0000","last_clean":"2024-04-26T10:34:00.029368+0000","last_became_active":"2024-04-26T10:33:16.346004+0000","last_became_peered":"2024-04-26T10:33:16.346004+0000","last_unstale":"2024-04-26T10:34:00.029368+0000","last_undegraded":"2024-04-26T10:34:00.029368+0000","last_fullsized":"2024-04-26T10:34:00.029368+0000","mapping_epoch":16,"log_start":"24'3200","ondisk_log_start":"24'3200","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:27.495754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442892288,"num_objects":6758,"num_object_clones":0,"num_object_copies":13516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6758,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6758,"num_write_kb":432512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435699+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:33:54.435699+0000","last_peered":"2024-04-26T10:33:54.435699+0000","last_clean":"2024-04-26T10:33:54.435699+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:33:54.435699+0000","last_undegraded":"2024-04-26T10:33:54.435699+0000","last_fullsized":"2024-04-26T10:33:54.435699+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437103+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:33:54.437103+0000","last_peered":"2024-04-26T10:33:54.437103+0000","last_clean":"2024-04-26T10:33:54.437103+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:33:54.437103+0000","last_undegraded":"2024-04-26T10:33:54.437103+0000","last_fullsized":"2024-04-26T10:33:54.437103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"32'6666","reported_seq":6690,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.027730+0000","last_change":"2024-04-26T10:33:16.342132+0000","last_active":"2024-04-26T10:34:00.027730+0000","last_peered":"2024-04-26T10:34:00.027730+0000","last_clean":"2024-04-26T10:34:00.027730+0000","last_became_active":"2024-04-26T10:33:16.341805+0000","last_became_peered":"2024-04-26T10:33:16.341805+0000","last_unstale":"2024-04-26T10:34:00.027730+0000","last_undegraded":"2024-04-26T10:34:00.027730+0000","last_fullsized":"2024-04-26T10:34:00.027730+0000","mapping_epoch":16,"log_start":"23'2700","ondisk_log_start":"23'2700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3966,"log_dups_size":0,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:41.522561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436862976,"num_objects":6666,"num_object_clones":0,"num_object_copies":13332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6666,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6666,"num_write_kb":426624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437035+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:33:54.437035+0000","last_peered":"2024-04-26T10:33:54.437035+0000","last_clean":"2024-04-26T10:33:54.437035+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:33:54.437035+0000","last_undegraded":"2024-04-26T10:33:54.437035+0000","last_fullsized":"2024-04-26T10:33:54.437035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435783+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:33:54.435783+0000","last_peered":"2024-04-26T10:33:54.435783+0000","last_clean":"2024-04-26T10:33:54.435783+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:33:54.435783+0000","last_undegraded":"2024-04-26T10:33:54.435783+0000","last_fullsized":"2024-04-26T10:33:54.435783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"32'6667","reported_seq":6689,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.030851+0000","last_change":"2024-04-26T10:33:16.349242+0000","last_active":"2024-04-26T10:34:00.030851+0000","last_peered":"2024-04-26T10:34:00.030851+0000","last_clean":"2024-04-26T10:34:00.030851+0000","last_became_active":"2024-04-26T10:33:16.349063+0000","last_became_peered":"2024-04-26T10:33:16.349063+0000","last_unstale":"2024-04-26T10:34:00.030851+0000","last_undegraded":"2024-04-26T10:34:00.030851+0000","last_fullsized":"2024-04-26T10:34:00.030851+0000","mapping_epoch":16,"log_start":"24'3100","ondisk_log_start":"24'3100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":0,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:09.297624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436928512,"num_objects":6667,"num_object_clones":0,"num_object_copies":13334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6667,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6667,"num_write_kb":426688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435273+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:33:54.435273+0000","last_peered":"2024-04-26T10:33:54.435273+0000","last_clean":"2024-04-26T10:33:54.435273+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:33:54.435273+0000","last_undegraded":"2024-04-26T10:33:54.435273+0000","last_fullsized":"2024-04-26T10:33:54.435273+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436067+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:33:54.436067+0000","last_peered":"2024-04-26T10:33:54.436067+0000","last_clean":"2024-04-26T10:33:54.436067+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:33:54.436067+0000","last_undegraded":"2024-04-26T10:33:54.436067+0000","last_fullsized":"2024-04-26T10:33:54.436067+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"32'6509","reported_seq":6533,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.022522+0000","last_change":"2024-04-26T10:33:16.342286+0000","last_active":"2024-04-26T10:34:00.022522+0000","last_peered":"2024-04-26T10:34:00.022522+0000","last_clean":"2024-04-26T10:34:00.022522+0000","last_became_active":"2024-04-26T10:33:16.342045+0000","last_became_peered":"2024-04-26T10:33:16.342045+0000","last_unstale":"2024-04-26T10:34:00.022522+0000","last_undegraded":"2024-04-26T10:34:00.022522+0000","last_fullsized":"2024-04-26T10:34:00.022522+0000","mapping_epoch":16,"log_start":"23'2800","ondisk_log_start":"23'2800","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3709,"log_dups_size":0,"ondisk_log_size":3709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:08:42.706792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426573824,"num_objects":6509,"num_object_clones":0,"num_object_copies":13018,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6509,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6509,"num_write_kb":416576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436444+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:33:54.436444+0000","last_peered":"2024-04-26T10:33:54.436444+0000","last_clean":"2024-04-26T10:33:54.436444+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:33:54.436444+0000","last_undegraded":"2024-04-26T10:33:54.436444+0000","last_fullsized":"2024-04-26T10:33:54.436444+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434892+0000","last_change":"2024-04-26T10:32:52.004444+0000","last_active":"2024-04-26T10:33:54.434892+0000","last_peered":"2024-04-26T10:33:54.434892+0000","last_clean":"2024-04-26T10:33:54.434892+0000","last_became_active":"2024-04-26T10:32:52.003360+0000","last_became_peered":"2024-04-26T10:32:52.003360+0000","last_unstale":"2024-04-26T10:33:54.434892+0000","last_undegraded":"2024-04-26T10:33:54.434892+0000","last_fullsized":"2024-04-26T10:33:54.434892+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:40:20.180213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"32'6648","reported_seq":6672,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.017346+0000","last_change":"2024-04-26T10:33:16.344866+0000","last_active":"2024-04-26T10:34:00.017346+0000","last_peered":"2024-04-26T10:34:00.017346+0000","last_clean":"2024-04-26T10:34:00.017346+0000","last_became_active":"2024-04-26T10:33:16.344614+0000","last_became_peered":"2024-04-26T10:33:16.344614+0000","last_unstale":"2024-04-26T10:34:00.017346+0000","last_undegraded":"2024-04-26T10:34:00.017346+0000","last_fullsized":"2024-04-26T10:34:00.017346+0000","mapping_epoch":16,"log_start":"23'2700","ondisk_log_start":"23'2700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3948,"log_dups_size":0,"ondisk_log_size":3948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435683328,"num_objects":6648,"num_object_clones":0,"num_object_copies":13296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6648,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6648,"num_write_kb":425472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436727+0000","last_change":"2024-04-26T10:32:51.584385+0000","last_active":"2024-04-26T10:33:54.436727+0000","last_peered":"2024-04-26T10:33:54.436727+0000","last_clean":"2024-04-26T10:33:54.436727+0000","last_became_active":"2024-04-26T10:32:51.584025+0000","last_became_peered":"2024-04-26T10:32:51.584025+0000","last_unstale":"2024-04-26T10:33:54.436727+0000","last_undegraded":"2024-04-26T10:33:54.436727+0000","last_fullsized":"2024-04-26T10:33:54.436727+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:57.247011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436546+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:33:54.436546+0000","last_peered":"2024-04-26T10:33:54.436546+0000","last_clean":"2024-04-26T10:33:54.436546+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:33:54.436546+0000","last_undegraded":"2024-04-26T10:33:54.436546+0000","last_fullsized":"2024-04-26T10:33:54.436546+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"32'6685","reported_seq":6709,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.018994+0000","last_change":"2024-04-26T10:33:16.349280+0000","last_active":"2024-04-26T10:34:00.018994+0000","last_peered":"2024-04-26T10:34:00.018994+0000","last_clean":"2024-04-26T10:34:00.018994+0000","last_became_active":"2024-04-26T10:33:16.349010+0000","last_became_peered":"2024-04-26T10:33:16.349010+0000","last_unstale":"2024-04-26T10:34:00.018994+0000","last_undegraded":"2024-04-26T10:34:00.018994+0000","last_fullsized":"2024-04-26T10:34:00.018994+0000","mapping_epoch":16,"log_start":"23'3100","ondisk_log_start":"23'3100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3585,"log_dups_size":0,"ondisk_log_size":3585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:08.933996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438108160,"num_objects":6685,"num_object_clones":0,"num_object_copies":13370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6685,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6685,"num_write_kb":427840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436743+0000","last_change":"2024-04-26T10:32:46.555353+0000","last_active":"2024-04-26T10:33:54.436743+0000","last_peered":"2024-04-26T10:33:54.436743+0000","last_clean":"2024-04-26T10:33:54.436743+0000","last_became_active":"2024-04-26T10:32:46.555005+0000","last_became_peered":"2024-04-26T10:32:46.555005+0000","last_unstale":"2024-04-26T10:33:54.436743+0000","last_undegraded":"2024-04-26T10:33:54.436743+0000","last_fullsized":"2024-04-26T10:33:54.436743+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436031+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:33:54.436031+0000","last_peered":"2024-04-26T10:33:54.436031+0000","last_clean":"2024-04-26T10:33:54.436031+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:33:54.436031+0000","last_undegraded":"2024-04-26T10:33:54.436031+0000","last_fullsized":"2024-04-26T10:33:54.436031+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437134+0000","last_change":"2024-04-26T10:32:52.004199+0000","last_active":"2024-04-26T10:33:54.437134+0000","last_peered":"2024-04-26T10:33:54.437134+0000","last_clean":"2024-04-26T10:33:54.437134+0000","last_became_active":"2024-04-26T10:32:52.003894+0000","last_became_peered":"2024-04-26T10:32:52.003894+0000","last_unstale":"2024-04-26T10:33:54.437134+0000","last_undegraded":"2024-04-26T10:33:54.437134+0000","last_fullsized":"2024-04-26T10:33:54.437134+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"32'6666","reported_seq":6690,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.009962+0000","last_change":"2024-04-26T10:33:16.349302+0000","last_active":"2024-04-26T10:34:00.009962+0000","last_peered":"2024-04-26T10:34:00.009962+0000","last_clean":"2024-04-26T10:34:00.009962+0000","last_became_active":"2024-04-26T10:33:16.348992+0000","last_became_peered":"2024-04-26T10:33:16.348992+0000","last_unstale":"2024-04-26T10:34:00.009962+0000","last_undegraded":"2024-04-26T10:34:00.009962+0000","last_fullsized":"2024-04-26T10:34:00.009962+0000","mapping_epoch":16,"log_start":"23'3100","ondisk_log_start":"23'3100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3566,"log_dups_size":0,"ondisk_log_size":3566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:15.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436862976,"num_objects":6666,"num_object_clones":0,"num_object_copies":13332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6666,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6666,"num_write_kb":426624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435650+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:33:54.435650+0000","last_peered":"2024-04-26T10:33:54.435650+0000","last_clean":"2024-04-26T10:33:54.435650+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:33:54.435650+0000","last_undegraded":"2024-04-26T10:33:54.435650+0000","last_fullsized":"2024-04-26T10:33:54.435650+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434994+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:33:54.434994+0000","last_peered":"2024-04-26T10:33:54.434994+0000","last_clean":"2024-04-26T10:33:54.434994+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:33:54.434994+0000","last_undegraded":"2024-04-26T10:33:54.434994+0000","last_fullsized":"2024-04-26T10:33:54.434994+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436617+0000","last_change":"2024-04-26T10:32:52.007589+0000","last_active":"2024-04-26T10:33:54.436617+0000","last_peered":"2024-04-26T10:33:54.436617+0000","last_clean":"2024-04-26T10:33:54.436617+0000","last_became_active":"2024-04-26T10:32:52.007289+0000","last_became_peered":"2024-04-26T10:32:52.007289+0000","last_unstale":"2024-04-26T10:33:54.436617+0000","last_undegraded":"2024-04-26T10:33:54.436617+0000","last_fullsized":"2024-04-26T10:33:54.436617+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"32'6687","reported_seq":6711,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.033418+0000","last_change":"2024-04-26T10:33:16.349181+0000","last_active":"2024-04-26T10:34:00.033418+0000","last_peered":"2024-04-26T10:34:00.033418+0000","last_clean":"2024-04-26T10:34:00.033418+0000","last_became_active":"2024-04-26T10:33:16.348981+0000","last_became_peered":"2024-04-26T10:33:16.348981+0000","last_unstale":"2024-04-26T10:34:00.033418+0000","last_undegraded":"2024-04-26T10:34:00.033418+0000","last_fullsized":"2024-04-26T10:34:00.033418+0000","mapping_epoch":16,"log_start":"24'3100","ondisk_log_start":"24'3100","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438239232,"num_objects":6687,"num_object_clones":0,"num_object_copies":13374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6687,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6687,"num_write_kb":427968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435035+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:33:54.435035+0000","last_peered":"2024-04-26T10:33:54.435035+0000","last_clean":"2024-04-26T10:33:54.435035+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:33:54.435035+0000","last_undegraded":"2024-04-26T10:33:54.435035+0000","last_fullsized":"2024-04-26T10:33:54.435035+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436734+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:33:54.436734+0000","last_peered":"2024-04-26T10:33:54.436734+0000","last_clean":"2024-04-26T10:33:54.436734+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:33:54.436734+0000","last_undegraded":"2024-04-26T10:33:54.436734+0000","last_fullsized":"2024-04-26T10:33:54.436734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436642+0000","last_change":"2024-04-26T10:32:52.009270+0000","last_active":"2024-04-26T10:33:54.436642+0000","last_peered":"2024-04-26T10:33:54.436642+0000","last_clean":"2024-04-26T10:33:54.436642+0000","last_became_active":"2024-04-26T10:32:52.008599+0000","last_became_peered":"2024-04-26T10:32:52.008599+0000","last_unstale":"2024-04-26T10:33:54.436642+0000","last_undegraded":"2024-04-26T10:33:54.436642+0000","last_fullsized":"2024-04-26T10:33:54.436642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"32'6661","reported_seq":6682,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.031064+0000","last_change":"2024-04-26T10:33:16.346300+0000","last_active":"2024-04-26T10:34:00.031064+0000","last_peered":"2024-04-26T10:34:00.031064+0000","last_clean":"2024-04-26T10:34:00.031064+0000","last_became_active":"2024-04-26T10:33:16.346123+0000","last_became_peered":"2024-04-26T10:33:16.346123+0000","last_unstale":"2024-04-26T10:34:00.031064+0000","last_undegraded":"2024-04-26T10:34:00.031064+0000","last_fullsized":"2024-04-26T10:34:00.031064+0000","mapping_epoch":16,"log_start":"23'2700","ondisk_log_start":"23'2700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3961,"log_dups_size":0,"ondisk_log_size":3961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:08.933996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436535296,"num_objects":6661,"num_object_clones":0,"num_object_copies":13322,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6661,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6661,"num_write_kb":426304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434925+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:33:54.434925+0000","last_peered":"2024-04-26T10:33:54.434925+0000","last_clean":"2024-04-26T10:33:54.434925+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:33:54.434925+0000","last_undegraded":"2024-04-26T10:33:54.434925+0000","last_fullsized":"2024-04-26T10:33:54.434925+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":227,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434667+0000","last_change":"2024-04-26T10:32:46.555694+0000","last_active":"2024-04-26T10:33:54.434667+0000","last_peered":"2024-04-26T10:33:54.434667+0000","last_clean":"2024-04-26T10:33:54.434667+0000","last_became_active":"2024-04-26T10:32:46.555391+0000","last_became_peered":"2024-04-26T10:32:46.555391+0000","last_unstale":"2024-04-26T10:33:54.434667+0000","last_undegraded":"2024-04-26T10:33:54.434667+0000","last_fullsized":"2024-04-26T10:33:54.434667+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434970+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:33:54.434970+0000","last_peered":"2024-04-26T10:33:54.434970+0000","last_clean":"2024-04-26T10:33:54.434970+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:33:54.434970+0000","last_undegraded":"2024-04-26T10:33:54.434970+0000","last_fullsized":"2024-04-26T10:33:54.434970+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436017+0000","last_change":"2024-04-26T10:32:52.006765+0000","last_active":"2024-04-26T10:33:54.436017+0000","last_peered":"2024-04-26T10:33:54.436017+0000","last_clean":"2024-04-26T10:33:54.436017+0000","last_became_active":"2024-04-26T10:32:52.004110+0000","last_became_peered":"2024-04-26T10:32:52.004110+0000","last_unstale":"2024-04-26T10:33:54.436017+0000","last_undegraded":"2024-04-26T10:33:54.436017+0000","last_fullsized":"2024-04-26T10:33:54.436017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:47.156703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"32'6640","reported_seq":6664,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.001706+0000","last_change":"2024-04-26T10:33:16.344693+0000","last_active":"2024-04-26T10:34:00.001706+0000","last_peered":"2024-04-26T10:34:00.001706+0000","last_clean":"2024-04-26T10:34:00.001706+0000","last_became_active":"2024-04-26T10:33:16.344478+0000","last_became_peered":"2024-04-26T10:33:16.344478+0000","last_unstale":"2024-04-26T10:34:00.001706+0000","last_undegraded":"2024-04-26T10:34:00.001706+0000","last_fullsized":"2024-04-26T10:34:00.001706+0000","mapping_epoch":16,"log_start":"23'2900","ondisk_log_start":"23'2900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3740,"log_dups_size":0,"ondisk_log_size":3740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:24.298876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435159040,"num_objects":6640,"num_object_clones":0,"num_object_copies":13280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6640,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6640,"num_write_kb":424960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434728+0000","last_change":"2024-04-26T10:32:46.555501+0000","last_active":"2024-04-26T10:33:54.434728+0000","last_peered":"2024-04-26T10:33:54.434728+0000","last_clean":"2024-04-26T10:33:54.434728+0000","last_became_active":"2024-04-26T10:32:46.555252+0000","last_became_peered":"2024-04-26T10:32:46.555252+0000","last_unstale":"2024-04-26T10:33:54.434728+0000","last_undegraded":"2024-04-26T10:33:54.434728+0000","last_fullsized":"2024-04-26T10:33:54.434728+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434877+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:33:54.434877+0000","last_peered":"2024-04-26T10:33:54.434877+0000","last_clean":"2024-04-26T10:33:54.434877+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:33:54.434877+0000","last_undegraded":"2024-04-26T10:33:54.434877+0000","last_fullsized":"2024-04-26T10:33:54.434877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437544+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:33:54.437544+0000","last_peered":"2024-04-26T10:33:54.437544+0000","last_clean":"2024-04-26T10:33:54.437544+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:33:54.437544+0000","last_undegraded":"2024-04-26T10:33:54.437544+0000","last_fullsized":"2024-04-26T10:33:54.437544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"32'6786","reported_seq":6809,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.023070+0000","last_change":"2024-04-26T10:33:16.344694+0000","last_active":"2024-04-26T10:34:00.023070+0000","last_peered":"2024-04-26T10:34:00.023070+0000","last_clean":"2024-04-26T10:34:00.023070+0000","last_became_active":"2024-04-26T10:33:16.344461+0000","last_became_peered":"2024-04-26T10:33:16.344461+0000","last_unstale":"2024-04-26T10:34:00.023070+0000","last_undegraded":"2024-04-26T10:34:00.023070+0000","last_fullsized":"2024-04-26T10:34:00.023070+0000","mapping_epoch":16,"log_start":"23'3000","ondisk_log_start":"23'3000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3786,"log_dups_size":0,"ondisk_log_size":3786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:29.374096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":444727296,"num_objects":6786,"num_object_clones":0,"num_object_copies":13572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6786,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6786,"num_write_kb":434304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437082+0000","last_change":"2024-04-26T10:32:46.556007+0000","last_active":"2024-04-26T10:33:54.437082+0000","last_peered":"2024-04-26T10:33:54.437082+0000","last_clean":"2024-04-26T10:33:54.437082+0000","last_became_active":"2024-04-26T10:32:46.555738+0000","last_became_peered":"2024-04-26T10:32:46.555738+0000","last_unstale":"2024-04-26T10:33:54.437082+0000","last_undegraded":"2024-04-26T10:33:54.437082+0000","last_fullsized":"2024-04-26T10:33:54.437082+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:04.230186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436870+0000","last_change":"2024-04-26T10:32:51.589352+0000","last_active":"2024-04-26T10:33:54.436870+0000","last_peered":"2024-04-26T10:33:54.436870+0000","last_clean":"2024-04-26T10:33:54.436870+0000","last_became_active":"2024-04-26T10:32:51.589006+0000","last_became_peered":"2024-04-26T10:32:51.589006+0000","last_unstale":"2024-04-26T10:33:54.436870+0000","last_undegraded":"2024-04-26T10:33:54.436870+0000","last_fullsized":"2024-04-26T10:33:54.436870+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436929+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:33:54.436929+0000","last_peered":"2024-04-26T10:33:54.436929+0000","last_clean":"2024-04-26T10:33:54.436929+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:33:54.436929+0000","last_undegraded":"2024-04-26T10:33:54.436929+0000","last_fullsized":"2024-04-26T10:33:54.436929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"32'6748","reported_seq":6772,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.013671+0000","last_change":"2024-04-26T10:33:16.344714+0000","last_active":"2024-04-26T10:34:00.013671+0000","last_peered":"2024-04-26T10:34:00.013671+0000","last_clean":"2024-04-26T10:34:00.013671+0000","last_became_active":"2024-04-26T10:33:16.344500+0000","last_became_peered":"2024-04-26T10:33:16.344500+0000","last_unstale":"2024-04-26T10:34:00.013671+0000","last_undegraded":"2024-04-26T10:34:00.013671+0000","last_fullsized":"2024-04-26T10:34:00.013671+0000","mapping_epoch":16,"log_start":"23'3000","ondisk_log_start":"23'3000","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3748,"log_dups_size":0,"ondisk_log_size":3748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:19.056484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442236928,"num_objects":6748,"num_object_clones":0,"num_object_copies":13496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6748,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6748,"num_write_kb":431872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436469+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:33:54.436469+0000","last_peered":"2024-04-26T10:33:54.436469+0000","last_clean":"2024-04-26T10:33:54.436469+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:33:54.436469+0000","last_undegraded":"2024-04-26T10:33:54.436469+0000","last_fullsized":"2024-04-26T10:33:54.436469+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436614+0000","last_change":"2024-04-26T10:32:46.555394+0000","last_active":"2024-04-26T10:33:54.436614+0000","last_peered":"2024-04-26T10:33:54.436614+0000","last_clean":"2024-04-26T10:33:54.436614+0000","last_became_active":"2024-04-26T10:32:46.555053+0000","last_became_peered":"2024-04-26T10:32:46.555053+0000","last_unstale":"2024-04-26T10:33:54.436614+0000","last_undegraded":"2024-04-26T10:33:54.436614+0000","last_fullsized":"2024-04-26T10:33:54.436614+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:26:29.770562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434746+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:33:54.434746+0000","last_peered":"2024-04-26T10:33:54.434746+0000","last_clean":"2024-04-26T10:33:54.434746+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:33:54.434746+0000","last_undegraded":"2024-04-26T10:33:54.434746+0000","last_fullsized":"2024-04-26T10:33:54.434746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"32'6693","reported_seq":6717,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T10:34:00.030786+0000","last_change":"2024-04-26T10:33:16.344949+0000","last_active":"2024-04-26T10:34:00.030786+0000","last_peered":"2024-04-26T10:34:00.030786+0000","last_clean":"2024-04-26T10:34:00.030786+0000","last_became_active":"2024-04-26T10:33:16.344650+0000","last_became_peered":"2024-04-26T10:33:16.344650+0000","last_unstale":"2024-04-26T10:34:00.030786+0000","last_undegraded":"2024-04-26T10:34:00.030786+0000","last_fullsized":"2024-04-26T10:34:00.030786+0000","mapping_epoch":16,"log_start":"23'2700","ondisk_log_start":"23'2700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3993,"log_dups_size":0,"ondisk_log_size":3993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:15.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438632448,"num_objects":6693,"num_object_clones":0,"num_object_copies":13386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6693,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6693,"num_write_kb":428352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436436+0000","last_change":"2024-04-26T10:32:46.555191+0000","last_active":"2024-04-26T10:33:54.436436+0000","last_peered":"2024-04-26T10:33:54.436436+0000","last_clean":"2024-04-26T10:33:54.436436+0000","last_became_active":"2024-04-26T10:32:46.554892+0000","last_became_peered":"2024-04-26T10:32:46.554892+0000","last_unstale":"2024-04-26T10:33:54.436436+0000","last_undegraded":"2024-04-26T10:33:54.436436+0000","last_fullsized":"2024-04-26T10:33:54.436436+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:55:37.397784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436466+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:33:54.436466+0000","last_peered":"2024-04-26T10:33:54.436466+0000","last_clean":"2024-04-26T10:33:54.436466+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:33:54.436466+0000","last_undegraded":"2024-04-26T10:33:54.436466+0000","last_fullsized":"2024-04-26T10:33:54.436466+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436583+0000","last_change":"2024-04-26T10:32:52.001408+0000","last_active":"2024-04-26T10:33:54.436583+0000","last_peered":"2024-04-26T10:33:54.436583+0000","last_clean":"2024-04-26T10:33:54.436583+0000","last_became_active":"2024-04-26T10:32:52.000668+0000","last_became_peered":"2024-04-26T10:32:52.000668+0000","last_unstale":"2024-04-26T10:33:54.436583+0000","last_undegraded":"2024-04-26T10:33:54.436583+0000","last_fullsized":"2024-04-26T10:33:54.436583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436976+0000","last_change":"2024-04-26T10:32:51.586234+0000","last_active":"2024-04-26T10:33:54.436976+0000","last_peered":"2024-04-26T10:33:54.436976+0000","last_clean":"2024-04-26T10:33:54.436976+0000","last_became_active":"2024-04-26T10:32:51.586004+0000","last_became_peered":"2024-04-26T10:32:51.586004+0000","last_unstale":"2024-04-26T10:33:54.436976+0000","last_undegraded":"2024-04-26T10:33:54.436976+0000","last_fullsized":"2024-04-26T10:33:54.436976+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:03.977752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437455+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:33:54.437455+0000","last_peered":"2024-04-26T10:33:54.437455+0000","last_clean":"2024-04-26T10:33:54.437455+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:33:54.437455+0000","last_undegraded":"2024-04-26T10:33:54.437455+0000","last_fullsized":"2024-04-26T10:33:54.437455+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435864+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:33:54.435864+0000","last_peered":"2024-04-26T10:33:54.435864+0000","last_clean":"2024-04-26T10:33:54.435864+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:33:54.435864+0000","last_undegraded":"2024-04-26T10:33:54.435864+0000","last_fullsized":"2024-04-26T10:33:54.435864+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434856+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:33:54.434856+0000","last_peered":"2024-04-26T10:33:54.434856+0000","last_clean":"2024-04-26T10:33:54.434856+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:33:54.434856+0000","last_undegraded":"2024-04-26T10:33:54.434856+0000","last_fullsized":"2024-04-26T10:33:54.434856+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437232+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:33:54.437232+0000","last_peered":"2024-04-26T10:33:54.437232+0000","last_clean":"2024-04-26T10:33:54.437232+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:33:54.437232+0000","last_undegraded":"2024-04-26T10:33:54.437232+0000","last_fullsized":"2024-04-26T10:33:54.437232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.435315+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:33:54.435315+0000","last_peered":"2024-04-26T10:33:54.435315+0000","last_clean":"2024-04-26T10:33:54.435315+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:33:54.435315+0000","last_undegraded":"2024-04-26T10:33:54.435315+0000","last_fullsized":"2024-04-26T10:33:54.435315+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436586+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:33:54.436586+0000","last_peered":"2024-04-26T10:33:54.436586+0000","last_clean":"2024-04-26T10:33:54.436586+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:33:54.436586+0000","last_undegraded":"2024-04-26T10:33:54.436586+0000","last_fullsized":"2024-04-26T10:33:54.436586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436756+0000","last_change":"2024-04-26T10:32:51.999341+0000","last_active":"2024-04-26T10:33:54.436756+0000","last_peered":"2024-04-26T10:33:54.436756+0000","last_clean":"2024-04-26T10:33:54.436756+0000","last_became_active":"2024-04-26T10:32:51.998256+0000","last_became_peered":"2024-04-26T10:32:51.998256+0000","last_unstale":"2024-04-26T10:33:54.436756+0000","last_undegraded":"2024-04-26T10:33:54.436756+0000","last_fullsized":"2024-04-26T10:33:54.436756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.436558+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:33:54.436558+0000","last_peered":"2024-04-26T10:33:54.436558+0000","last_clean":"2024-04-26T10:33:54.436558+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:33:54.436558+0000","last_undegraded":"2024-04-26T10:33:54.436558+0000","last_fullsized":"2024-04-26T10:33:54.436558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434975+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:33:54.434975+0000","last_peered":"2024-04-26T10:33:54.434975+0000","last_clean":"2024-04-26T10:33:54.434975+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:33:54.434975+0000","last_undegraded":"2024-04-26T10:33:54.434975+0000","last_fullsized":"2024-04-26T10:33:54.434975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434816+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:33:54.434816+0000","last_peered":"2024-04-26T10:33:54.434816+0000","last_clean":"2024-04-26T10:33:54.434816+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:33:54.434816+0000","last_undegraded":"2024-04-26T10:33:54.434816+0000","last_fullsized":"2024-04-26T10:33:54.434816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.434959+0000","last_change":"2024-04-26T10:32:52.004844+0000","last_active":"2024-04-26T10:33:54.434959+0000","last_peered":"2024-04-26T10:33:54.434959+0000","last_clean":"2024-04-26T10:33:54.434959+0000","last_became_active":"2024-04-26T10:32:52.004484+0000","last_became_peered":"2024-04-26T10:32:52.004484+0000","last_unstale":"2024-04-26T10:33:54.434959+0000","last_undegraded":"2024-04-26T10:33:54.434959+0000","last_fullsized":"2024-04-26T10:33:54.434959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437220+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:33:54.437220+0000","last_peered":"2024-04-26T10:33:54.437220+0000","last_clean":"2024-04-26T10:33:54.437220+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:33:54.437220+0000","last_undegraded":"2024-04-26T10:33:54.437220+0000","last_fullsized":"2024-04-26T10:33:54.437220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437215+0000","last_change":"2024-04-26T10:32:52.007818+0000","last_active":"2024-04-26T10:33:54.437215+0000","last_peered":"2024-04-26T10:33:54.437215+0000","last_clean":"2024-04-26T10:33:54.437215+0000","last_became_active":"2024-04-26T10:32:52.007552+0000","last_became_peered":"2024-04-26T10:32:52.007552+0000","last_unstale":"2024-04-26T10:33:54.437215+0000","last_undegraded":"2024-04-26T10:33:54.437215+0000","last_fullsized":"2024-04-26T10:33:54.437215+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-26T10:33:54.437622+0000","last_change":"2024-04-26T10:32:52.010309+0000","last_active":"2024-04-26T10:33:54.437622+0000","last_peered":"2024-04-26T10:33:54.437622+0000","last_clean":"2024-04-26T10:33:54.437622+0000","last_became_active":"2024-04-26T10:32:52.009152+0000","last_became_peered":"2024-04-26T10:32:52.009152+0000","last_unstale":"2024-04-26T10:33:54.437622+0000","last_undegraded":"2024-04-26T10:33:54.437622+0000","last_fullsized":"2024-04-26T10:33:54.437622+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":7023886336,"num_objects":107176,"num_object_clones":0,"num_object_copies":214352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107176,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107176,"num_write_kb":6859264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14049083392,"data_stored":14049083392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60476,"ondisk_log_size":60476,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738386,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5699548,"kb_used_data":5582292,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":88672292,"statfs":{"total":96636764160,"available":90800427008,"internally_reserved":0,"allocated":5716267008,"data_stored":5716044383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":120060358},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,3,5,4],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.19900000000000001}]},{"osd":1,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.216},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.22600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4322940,"kb_used_data":4211440,"kb_used_omap":1,"kb_used_meta":111486,"kb_avail":90048900,"statfs":{"total":96636764160,"available":92210073600,"internally_reserved":0,"allocated":4312514560,"data_stored":4312265553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114162118},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.219}]},{"osd":2,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.23100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738385,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3940084,"kb_used_data":3824488,"kb_used_omap":1,"kb_used_meta":115582,"kb_avail":90431756,"statfs":{"total":96636764160,"available":92602118144,"internally_reserved":0,"allocated":3916275712,"data_stored":3916034281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":118356422},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.188},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.25900000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":2.0720000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":2.0030000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4374396928,"data_stored":4374396928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3952017408,"data_stored":3952017408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5722669056,"data_stored":5722669056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:34:06.394 INFO:tasks.thrashosds.thrasher:Setting 4.2e to [1, 0, 2] 2024-04-26T10:34:06.395 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.2e', '1', '0', '2'] 2024-04-26T10:34:06.395 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.2e 1 0 2 2024-04-26T10:34:06.395 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:06.421 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 49 16 115912 115896 147.814 129.625 0.0117027 0.00676259 2024-04-26T10:34:06.472 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-26T10:34:06.490 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:06.488+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:06.554 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:06.554 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:06.554 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.554 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:116178 5.0 e38/34 5:083cd5a5:::benchmark_data_smithi043_45180_object116177:head v 38'7228, mlcod=38'7226)", 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:06.550075+0000", 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.003759732, 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037849009999999998, 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550075+0000", 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:06.555 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550075+0000", 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550074+0000", 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550129+0000", 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4823e-05 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.556 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550139+0000", 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7289999999999995e-06 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550144+0000", 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.831e-06 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550178+0000", 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4131000000000002e-05 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.557 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:06.558 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550193+0000", 2024-04-26T10:34:06.558 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5512999999999999e-05 2024-04-26T10:34:06.558 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.558 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:06.558 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.558 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.558 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.558 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:116180 5.8 5:189c0117:::benchmark_data_smithi043_45180_object116179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:06.558 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:06.550756+0000", 2024-04-26T10:34:06.558 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0030781189999999998, 2024-04-26T10:34:06.558 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0031683150000000001, 2024-04-26T10:34:06.558 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:06.558 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 116180 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550756+0000", 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550756+0000", 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.559 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550755+0000", 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550877+0000", 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000121346 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550890+0000", 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3141e-05 2024-04-26T10:34:06.560 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550898+0000", 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0830000000000004e-06 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.550942+0000", 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4359e-05 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.551106+0000", 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00016367500000000001 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.561 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.562 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:06.562 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:06.551314+0000", 2024-04-26T10:34:06.562 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00020803999999999999 2024-04-26T10:34:06.562 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.562 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:06.562 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.562 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.562 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:34:06.562 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 2 2024-04-26T10:34:06.562 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:06.566 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:06.590 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:06.589+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:06.691 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:06.690+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:06.731 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:06.731 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:06.731 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:06.731 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:06.731 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:06.745 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:06.792 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:06.790+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:06.795 INFO:teuthology.orchestra.run.smithi043.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-26T10:34:06.798 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T10:34:06.799 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-26T10:34:06.893 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:06.891+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:06.941 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:06.941 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:06.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:06.941 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:06.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.941 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:06.941 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:06.941 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 39.138211619000003, 2024-04-26T10:34:06.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:06.942 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:06.942 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.942 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:06.942 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:06.942 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.942 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:06.942 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.942 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:06.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.942 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:06.942 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:06.942 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.942 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:06.943 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:06.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:06.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:06.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.946 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:06.946 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:06.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:06.946 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:06.946 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:06.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:06.947 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:06.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:06.947 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.947 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:06.947 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.947 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.947 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:06.947 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:06.947 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 39.137383538999998, 2024-04-26T10:34:06.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:06.947 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.948 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.949 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.950 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.951 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.952 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:06.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:06.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.952 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.952 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:06.952 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:06.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:06.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.952 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.952 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:06.952 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:06.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:06.952 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.953 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:06.953 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.953 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.953 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.953 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:06.953 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:06.953 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 39.136454475999997, 2024-04-26T10:34:06.953 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:06.953 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:06.953 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.953 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:06.953 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:06.954 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.954 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:06.954 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.954 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:06.954 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.954 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:06.954 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:06.954 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.954 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.954 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.954 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:06.954 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:06.955 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.955 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.955 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.955 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:06.955 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:06.955 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.955 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.955 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.955 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:06.955 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:06.955 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:06.955 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.956 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.956 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:06.956 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:06.956 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:06.956 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.956 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.956 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.956 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:06.956 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:06.956 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.957 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.957 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:06.957 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:06.957 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:06.957 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.957 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.957 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:06.957 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:06.957 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:06.957 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.957 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.957 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:06.958 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:06.958 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:06.958 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.958 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.958 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:06.958 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:06.958 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:06.958 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.959 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.959 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:06.959 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:06.959 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.959 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:06.959 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:06.959 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:06.959 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.959 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:06.959 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 39.135769035000003, 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:06.960 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.961 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.962 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:06.962 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:06.962 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.962 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.962 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.962 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:06.962 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:06.962 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:06.962 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.962 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.962 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:06.962 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:06.962 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:06.963 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.963 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.963 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.963 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:06.963 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:06.963 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.963 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.963 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:06.963 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:06.963 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:06.963 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:06.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:06.965 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.966 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:06.966 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.966 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.966 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.966 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103337 5.d 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:06.966 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:06.966 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.7501103620000009, 2024-04-26T10:34:06.966 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.058853520999999999, 2024-04-26T10:34:06.966 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:06.966 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.966 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:06.966 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:06.966 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103337 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.967 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188132+0000", 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6197000000000003e-05 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188144+0000", 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2001000000000001e-05 2024-04-26T10:34:06.968 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.969 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.969 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.969 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188152+0000", 2024-04-26T10:34:06.969 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9349999999999994e-06 2024-04-26T10:34:06.969 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.969 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.969 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:06.969 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188185+0000", 2024-04-26T10:34:06.969 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3436000000000003e-05 2024-04-26T10:34:06.970 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.970 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.970 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:06.970 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188275+0000", 2024-04-26T10:34:06.970 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9995999999999997e-05 2024-04-26T10:34:06.970 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.970 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.970 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:06.970 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188365+0000", 2024-04-26T10:34:06.970 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0254999999999996e-05 2024-04-26T10:34:06.970 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.970 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.970 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.194973+0000", 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066073490000000002 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246781+0000", 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.051808372999999998 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246865+0000", 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3498999999999995e-05 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.971 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246920+0000", 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5208999999999999e-05 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.5594785929999997, 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.972 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.973 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:06.974 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:06.975 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:06.976 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.977 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.978 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:06.978 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:06.978 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.5592592889999999, 2024-04-26T10:34:06.978 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:06.978 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:06.978 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.978 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:06.978 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:06.978 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.978 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:06.978 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.978 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:06.978 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.979 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:06.979 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:06.979 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.979 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.979 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.979 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:06.979 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:06.979 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.979 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.979 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.979 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:06.980 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:06.980 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.980 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.980 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.980 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:06.980 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:06.980 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:06.980 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.980 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.980 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:06.980 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:06.980 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:06.980 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:06.981 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:06.982 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.982 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.982 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:06.982 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:06.982 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:06.982 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.982 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.982 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:06.982 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:06.982 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:06.982 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.982 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:06.983 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.984 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:06.984 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.984 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.984 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.984 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:06.984 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:06.984 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.5591794839999995, 2024-04-26T10:34:06.984 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:06.984 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:06.984 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.984 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:06.984 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.985 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:06.986 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:06.987 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.987 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.987 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.987 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:06.987 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:06.987 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.987 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.987 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:06.987 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:06.987 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:06.987 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.987 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.987 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:06.988 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:06.988 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:06.988 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.988 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.988 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:06.988 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:06.988 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:06.989 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.989 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.989 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:06.989 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:06.989 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:06.989 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.989 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.989 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.989 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:06.990 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:06.990 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.990 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.990 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:06.990 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:06.990 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:06.990 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.990 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.990 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.557815454, 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:06.991 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.992 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.993 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.994 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:06.994 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:06.994 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:06.994 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.994 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.994 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:06.994 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:06.994 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:06.994 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.994 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.994 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.995 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:06.996 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.5572211169999992, 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.998 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:06.998 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:06.998 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.998 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.998 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.998 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:06.998 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:06.998 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:06.998 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.998 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.998 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:06.998 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:06.999 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:06.999 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.999 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.999 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:06.999 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:06.999 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:06.999 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.999 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:06.999 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:06.999 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:06.999 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:06.999 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:06.999 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.000 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.000 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:07.000 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:07.000 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.000 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.000 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:07.000 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:07.000 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:07.000 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.000 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.000 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:07.001 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:07.001 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:07.001 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.001 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.001 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:07.001 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:07.001 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:07.002 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.002 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.002 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:07.002 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:07.002 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:07.002 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.003 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.003 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.003 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:07.003 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:07.003 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.003 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.003 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:07.004 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:07.004 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:07.004 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.004 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.004 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:07.004 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:07.005 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:07.005 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.005 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:07.005 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.005 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.005 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.005 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:07.006 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:07.006 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.5564607610000003, 2024-04-26T10:34:07.006 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:07.006 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:07.006 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.006 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:07.007 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:07.007 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.007 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:07.007 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.007 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:07.007 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.008 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:07.008 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:07.008 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.008 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.008 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.008 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:07.008 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:07.009 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.009 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.009 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.009 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:07.009 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:07.009 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:07.010 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.010 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.010 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:07.010 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:07.010 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:07.010 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.010 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.010 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:07.011 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:07.011 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:07.011 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.011 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.011 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.011 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:07.011 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:07.012 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.012 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.012 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:07.012 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:07.012 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:07.012 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.013 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.013 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:07.013 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:07.013 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:07.013 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.013 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.013 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:07.014 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:07.014 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:07.014 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.014 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.014 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.014 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:07.015 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:07.015 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.015 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.015 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:07.015 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:07.015 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:07.016 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.016 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.016 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:07.016 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:07.016 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:07.016 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.017 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.017 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:07.017 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:07.017 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:07.017 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.017 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:07.018 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.018 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.018 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.018 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:07.018 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:07.018 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.5558433009999995, 2024-04-26T10:34:07.019 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:07.019 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:07.019 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.019 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:07.019 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:07.019 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.020 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:07.020 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.020 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:07.020 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.020 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:07.020 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:07.020 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.021 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.021 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:07.021 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:07.021 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.022 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.022 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:07.022 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:07.022 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:07.022 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.023 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.023 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:07.023 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:07.023 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:07.023 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.023 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.024 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:07.024 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:07.024 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:07.024 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.024 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.024 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.025 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:07.025 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:07.025 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.025 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.025 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:07.025 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:07.026 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:07.026 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.026 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.026 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:07.026 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:07.027 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:07.027 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.027 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.027 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.027 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:07.027 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:07.028 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.028 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.028 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.028 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:07.028 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:07.028 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.029 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.029 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:07.029 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:07.029 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:07.029 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.030 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.030 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:07.030 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:07.030 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:07.030 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.030 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.031 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:07.031 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:07.031 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:07.031 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.031 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:07.031 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.031 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.032 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.032 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:07.032 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:07.032 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.5552782979999993, 2024-04-26T10:34:07.032 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:07.032 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:07.032 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.032 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:07.033 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.033 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:07.033 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:07.033 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.033 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.033 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.033 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:07.034 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:07.034 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.034 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.034 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.034 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:07.034 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:07.034 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.034 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.034 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.035 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:07.035 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:07.035 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:07.035 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.035 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.035 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:07.035 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:07.035 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:07.036 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.036 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.036 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.036 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:07.036 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:07.036 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.036 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.036 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:07.036 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:07.036 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:07.036 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.036 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.036 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:07.037 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:07.037 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:07.037 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.037 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.037 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:07.037 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:07.037 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:07.037 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.037 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.037 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:07.037 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:07.037 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:07.037 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.5547349859999997, 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.038 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:07.039 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.039 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:07.039 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.039 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:07.039 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:07.039 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.039 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.039 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.039 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:07.039 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:07.039 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.039 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:07.040 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.041 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.041 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.041 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:07.041 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:07.041 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.041 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.041 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:07.041 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:07.041 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:07.041 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.041 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.041 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:07.041 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:07.042 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:07.042 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.042 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.042 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:07.042 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:07.042 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:07.042 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.042 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.042 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.042 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:07.042 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:07.042 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:07.043 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.553262986, 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.044 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:07.045 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.046 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.047 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:07.047 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:07.047 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.047 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.047 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:07.047 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:07.047 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:07.047 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.047 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.047 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:07.047 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:07.047 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:07.047 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:07.048 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.049 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.5526975659999991, 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.050 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.051 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.052 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.053 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.5526327159999997, 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:07.054 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:07.055 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:07.056 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:07.057 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.058 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:07.058 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.058 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.058 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.058 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:07.058 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:07.058 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.5518717360000007, 2024-04-26T10:34:07.058 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:07.058 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:07.058 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:07.058 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:07.058 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.058 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.059 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.060 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.061 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.5508503079999993, 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:07.062 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:07.063 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:07.064 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:07.065 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103647 5.b e32/16 ondisk, result = 0)", 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.5508316089999994, 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060768513000000003, 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:07.066 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387344+0000", 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.067 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387350+0000", 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.22e-06 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447917+0000", 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060567523999999998 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447925+0000", 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7689999999999996e-06 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.068 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448004+0000", 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9246000000000007e-05 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448012+0000", 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3490000000000003e-06 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448114+0000", 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010205299999999999 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:07.069 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.070 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:07.070 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:07.070 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:07.071 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:07.072 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:07.069+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:07.173 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:07.171+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:07.266 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:07.266 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:07.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.266 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:117628 5.b 5:d5f1cc5f:::benchmark_data_smithi043_45180_object117627:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:07.266 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:07.250009+0000", 2024-04-26T10:34:07.266 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.010519026000000001, 2024-04-26T10:34:07.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010549650000000001, 2024-04-26T10:34:07.266 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.266 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:07.267 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.267 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.267 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.267 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 117628 2024-04-26T10:34:07.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.267 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.250009+0000", 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.250009+0000", 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.250008+0000", 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.250091+0000", 2024-04-26T10:34:07.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2509000000000006e-05 2024-04-26T10:34:07.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.250102+0000", 2024-04-26T10:34:07.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1287999999999999e-05 2024-04-26T10:34:07.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.250109+0000", 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8199999999999999e-06 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.252237+0000", 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021281400000000002 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.254099+0000", 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001862437 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0,1", 2024-04-26T10:34:07.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.254478+0000", 2024-04-26T10:34:07.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000378408 2024-04-26T10:34:07.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257851+0000", 2024-04-26T10:34:07.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033728790000000001 2024-04-26T10:34:07.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.259801+0000", 2024-04-26T10:34:07.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019502479999999999 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:117643 5.b 5:d4ea5a21:::benchmark_data_smithi043_45180_object117642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:07.257943+0000", 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0025852510000000002, 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027305900000000002, 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.272 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 117643 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257943+0000", 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257943+0000", 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257942+0000", 2024-04-26T10:34:07.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257994+0000", 2024-04-26T10:34:07.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1921e-05 2024-04-26T10:34:07.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258011+0000", 2024-04-26T10:34:07.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6838e-05 2024-04-26T10:34:07.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258018+0000", 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7320000000000001e-06 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.260047+0000", 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020293640000000001 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.260189+0000", 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000141521 2024-04-26T10:34:07.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0,1", 2024-04-26T10:34:07.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.260340+0000", 2024-04-26T10:34:07.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015169000000000001 2024-04-26T10:34:07.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.276 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.276 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:117644 5.c 5:3bf8535e:::benchmark_data_smithi043_45180_object117643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:07.258024+0000", 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00250432, 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002731196, 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 117644 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258024+0000", 2024-04-26T10:34:07.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258024+0000", 2024-04-26T10:34:07.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258023+0000", 2024-04-26T10:34:07.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258068+0000", 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5218e-05 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258082+0000", 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3563999999999999e-05 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258087+0000", 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3290000000000001e-06 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258125+0000", 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7397999999999997e-05 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258248+0000", 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012297100000000001 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258375+0000", 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012743300000000001 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:117645 5.3 5.8b097413 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:07.258097+0000", 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0024314480000000001, 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027326080000000001, 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:07.281 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 117645 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258097+0000", 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258097+0000", 2024-04-26T10:34:07.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258096+0000", 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258125+0000", 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8750000000000001e-05 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258132+0000", 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0339999999999999e-06 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258137+0000", 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3329999999999996e-06 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:117648 5.c 5.f5e4ce9c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:07.259172+0000", 2024-04-26T10:34:07.284 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001356105, 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00171361, 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 117648 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.259172+0000", 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.259172+0000", 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.259171+0000", 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.259689+0000", 2024-04-26T10:34:07.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000518068 2024-04-26T10:34:07.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.259701+0000", 2024-04-26T10:34:07.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2072000000000001e-05 2024-04-26T10:34:07.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.259710+0000", 2024-04-26T10:34:07.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5320000000000006e-06 2024-04-26T10:34:07.287 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.287 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.287 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.288 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:117649 5.4 5:20ec5e58:::benchmark_data_smithi043_45180_object117648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:07.288 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:07.259720+0000", 2024-04-26T10:34:07.288 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00080776600000000002, 2024-04-26T10:34:07.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012195419999999999, 2024-04-26T10:34:07.288 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.288 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:07.288 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.288 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.288 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.288 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 117649 2024-04-26T10:34:07.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.289 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.259720+0000", 2024-04-26T10:34:07.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.259720+0000", 2024-04-26T10:34:07.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.259720+0000", 2024-04-26T10:34:07.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.259745+0000", 2024-04-26T10:34:07.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5364e-05 2024-04-26T10:34:07.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.259756+0000", 2024-04-26T10:34:07.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1269e-05 2024-04-26T10:34:07.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.259763+0000", 2024-04-26T10:34:07.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3430000000000001e-06 2024-04-26T10:34:07.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.260043+0000", 2024-04-26T10:34:07.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00028015899999999999 2024-04-26T10:34:07.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.260149+0000", 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106449 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0,1", 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.260252+0000", 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010273200000000001 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "MOSDPGPushReply(5.b 38/34 [PushReplyOp(5:d1b54fcb:::benchmark_data_smithi043_45180_object114236:head)])", 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:07.253912+0000", 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0066162759999999999, 2024-04-26T10:34:07.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0070692239999999998, 2024-04-26T10:34:07.293 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.293 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:07.293 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.253912+0000", 2024-04-26T10:34:07.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.253912+0000", 2024-04-26T10:34:07.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.253912+0000", 2024-04-26T10:34:07.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967296 2024-04-26T10:34:07.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.253914+0000", 2024-04-26T10:34:07.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.48e-06 2024-04-26T10:34:07.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.253920+0000", 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7420000000000003e-06 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.253924+0000", 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1309999999999999e-06 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.296 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:117638 5.8 e38/16 5:155ab753:::benchmark_data_smithi043_45180_object117637:head v 38'7558, mlcod=38'7554)", 2024-04-26T10:34:07.296 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:07.257592+0000", 2024-04-26T10:34:07.296 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0029362619999999998, 2024-04-26T10:34:07.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003419034, 2024-04-26T10:34:07.296 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.296 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:07.296 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257592+0000", 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257592+0000", 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257591+0000", 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257617+0000", 2024-04-26T10:34:07.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5276e-05 2024-04-26T10:34:07.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257623+0000", 2024-04-26T10:34:07.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8689999999999998e-06 2024-04-26T10:34:07.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257634+0000", 2024-04-26T10:34:07.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0366999999999999e-05 2024-04-26T10:34:07.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257666+0000", 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2310000000000001e-05 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257678+0000", 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1732e-05 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.299 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:117641 5.3 5:cf003dcb:::benchmark_data_smithi043_45180_object117640:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:07.257681+0000", 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.002847086, 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003364803, 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 117641 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257681+0000", 2024-04-26T10:34:07.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257681+0000", 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257680+0000", 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257711+0000", 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1019000000000002e-05 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257721+0000", 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3989999999999993e-06 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257726+0000", 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8110000000000002e-06 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257880+0000", 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015457700000000001 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258022+0000", 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014193699999999999 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.258179+0000", 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015713700000000001 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.303 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:117642 5.3 5.c00155a3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:07.257730+0000", 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0027976870000000001, 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033564409999999999, 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 117642 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.304 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257730+0000", 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257730+0000", 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257730+0000", 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257750+0000", 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0152e-05 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257757+0000", 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:07.257760+0000", 2024-04-26T10:34:07.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3830000000000001e-06 2024-04-26T10:34:07.307 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.307 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.307 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.307 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.307 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:34:07.307 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 10 2024-04-26T10:34:07.307 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:07.309 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:07.309 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:07.306+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:07.409 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:07.408+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:07.421 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 50 16 117948 117932 147.402 127.25 0.00792415 0.00678145 2024-04-26T10:34:07.513 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:07.511+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:07.540 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:07.541 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:07.541 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:34:07.541 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:34:07.541 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:07.557 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:07.640 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:07.639+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:07.712 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:07.711+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:07.798 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:07.798 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:07.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:07.798 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:07.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.798 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:07.798 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:07.798 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.994539345, 2024-04-26T10:34:07.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:07.799 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.799 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.799 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.799 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.799 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.799 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:07.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.799 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:07.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:07.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:07.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:07.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:07.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:07.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:07.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:07.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:07.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.99453836, 2024-04-26T10:34:07.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:07.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:07.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:07.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:07.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:07.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.994469737000003, 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:07.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:07.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:07.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:07.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:07.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:07.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:07.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:07.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:07.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:07.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:07.814 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.814 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.814 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.814 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.994417957000003, 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:07.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:07.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:07.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:07.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:07.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:07.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:07.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:07.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.994358106999996, 2024-04-26T10:34:07.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:07.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:07.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:07.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:07.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:07.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:07.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:07.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:07.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:07.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:07.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:07.826 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.826 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.826 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.826 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:07.826 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:07.826 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.992645402999997, 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.827 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.828 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:07.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:07.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:07.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:07.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.829 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.829 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:07.829 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:07.829 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.829 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:07.831 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:07.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.832 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.832 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:07.832 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:07.832 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.832 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.832 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.832 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.832 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.832 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:07.832 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:07.832 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.992530336000002, 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.833 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:07.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:07.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:07.834 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.834 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.834 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.834 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:07.834 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.835 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.836 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.992437195999997, 2024-04-26T10:34:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:07.837 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.838 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:07.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.838 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:07.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.838 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.838 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.838 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:07.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:07.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:07.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:07.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:07.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:07.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:07.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:07.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:07.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:07.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:07.842 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.842 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.843 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.843 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:07.843 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:07.843 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.992243035999998, 2024-04-26T10:34:07.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:07.843 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.843 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.843 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:07.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:07.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:07.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:07.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:07.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:07.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:07.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:07.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:07.847 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.991035668000002, 2024-04-26T10:34:07.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:07.848 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.848 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:07.848 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:07.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:07.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:07.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:07.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:07.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:07.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:07.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:07.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:07.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.850 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.850 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:07.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.990226759999999, 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:07.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:07.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:07.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:07.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:07.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:07.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:07.857 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:07.858 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.990123222000001, 2024-04-26T10:34:07.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:07.858 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.858 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.858 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.858 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.858 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.858 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:07.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.858 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:07.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:07.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:07.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:07.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:07.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:07.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:07.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:07.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:07.863 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.990046348999996, 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:07.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:07.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 39.989930964999999, 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:07.869 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:07.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:07.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:07.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:07.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:07.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:07.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:07.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:07.873 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.873 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.873 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.873 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:07.873 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:07.873 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.6132869119999995, 2024-04-26T10:34:07.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:07.873 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.873 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:07.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:07.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:07.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:07.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:07.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:07.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:07.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:07.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:07.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:07.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:07.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:07.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:07.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:07.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:07.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:07.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:07.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:07.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:07.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:07.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.6112570640000001, 2024-04-26T10:34:07.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:07.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:07.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:07.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:07.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:07.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.882 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:07.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:07.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.882 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.883 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:07.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:07.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:07.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:07.885 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.885 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.885 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.886 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:07.886 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:07.886 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.6107812609999996, 2024-04-26T10:34:07.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:07.886 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.886 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.886 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.886 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.886 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.886 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:07.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.886 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:07.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:07.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:07.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:07.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.608814207, 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.892 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.893 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:07.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:07.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:07.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:07.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:07.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103336 5.6 5:6c0cef20:::benchmark_data_smithi043_45180_object103335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.6067049020000006, 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064107786, 2024-04-26T10:34:07.897 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103336 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188502+0000", 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188540+0000", 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8445000000000002e-05 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188553+0000", 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2768e-05 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188563+0000", 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9760000000000007e-06 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191877+0000", 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003313908 2024-04-26T10:34:07.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192004+0000", 2024-04-26T10:34:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012663 2024-04-26T10:34:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192143+0000", 2024-04-26T10:34:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013964199999999999 2024-04-26T10:34:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.196467+0000", 2024-04-26T10:34:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043232230000000002 2024-04-26T10:34:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252539+0000", 2024-04-26T10:34:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056072085000000001 2024-04-26T10:34:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252577+0000", 2024-04-26T10:34:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8730999999999999e-05 2024-04-26T10:34:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252611+0000", 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3769000000000001e-05 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 9.6061464690000005, 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:07.903 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:07.904 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:07.904 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:07.904 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:07.904 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:07.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.904 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:07.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:07.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:07.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:07.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:07.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:07.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:07.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:07.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:07.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:07.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:07.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:07.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:07.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:07.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:07.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:07.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:07.909 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.909 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.909 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.909 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:07.909 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:07.909 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:07.910 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:07.909+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:07.911 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:08.011 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:08.010+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:08.098 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:119268 5.3 e38/16 5:cf42c0b1:::benchmark_data_smithi043_45180_object119267:head v 38'7392, mlcod=38'7390)", 2024-04-26T10:34:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:08.094535+0000", 2024-04-26T10:34:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0028078589999999998, 2024-04-26T10:34:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028252809999999998, 2024-04-26T10:34:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094535+0000", 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094535+0000", 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094534+0000", 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094591+0000", 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7012999999999998e-05 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094603+0000", 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1596999999999999e-05 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094611+0000", 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3729999999999993e-06 2024-04-26T10:34:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094638+0000", 2024-04-26T10:34:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7100000000000001e-05 2024-04-26T10:34:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094651+0000", 2024-04-26T10:34:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3288000000000001e-05 2024-04-26T10:34:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:119271 5.2 5:426534ff:::benchmark_data_smithi043_45180_object119270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:08.094641+0000", 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0027018939999999998, 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027631420000000001, 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 119271 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094641+0000", 2024-04-26T10:34:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094641+0000", 2024-04-26T10:34:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094639+0000", 2024-04-26T10:34:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094707+0000", 2024-04-26T10:34:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7799000000000006e-05 2024-04-26T10:34:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094719+0000", 2024-04-26T10:34:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1775e-05 2024-04-26T10:34:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094730+0000", 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1231e-05 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094772+0000", 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1492999999999997e-05 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094919+0000", 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000147453 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.095082+0000", 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016242599999999999 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:119270 5.b e38/34 5:dcb9de62:::benchmark_data_smithi043_45180_object119269:head v 38'7513, mlcod=38'7511)", 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:08.096193+0000", 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0011497930000000001, 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012559870000000001, 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096193+0000", 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096193+0000", 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096192+0000", 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096196+0000", 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8399999999999997e-06 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096203+0000", 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6499999999999999e-06 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096207+0000", 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.374e-06 2024-04-26T10:34:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096239+0000", 2024-04-26T10:34:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2175999999999998e-05 2024-04-26T10:34:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096252+0000", 2024-04-26T10:34:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2309e-05 2024-04-26T10:34:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:119269 5.3 e38/16 5:cca85b44:::benchmark_data_smithi043_45180_object119268:head v 38'7393, mlcod=38'7390)", 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:08.096262+0000", 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.001080695, 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001238662, 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096262+0000", 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096262+0000", 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096262+0000", 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096356+0000", 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4807000000000002e-05 2024-04-26T10:34:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096366+0000", 2024-04-26T10:34:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4339999999999998e-06 2024-04-26T10:34:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096372+0000", 2024-04-26T10:34:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2910000000000004e-06 2024-04-26T10:34:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096402+0000", 2024-04-26T10:34:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9836e-05 2024-04-26T10:34:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096419+0000", 2024-04-26T10:34:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6959000000000001e-05 2024-04-26T10:34:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:119272 5.1 5:8edfc20a:::benchmark_data_smithi043_45180_object119271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:08.096686+0000", 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00065654000000000005, 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000879881, 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 119272 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096686+0000", 2024-04-26T10:34:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096686+0000", 2024-04-26T10:34:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096685+0000", 2024-04-26T10:34:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096741+0000", 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6137999999999997e-05 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096749+0000", 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.0970000000000006e-06 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096755+0000", 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1800000000000004e-06 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096795+0000", 2024-04-26T10:34:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9941000000000003e-05 2024-04-26T10:34:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096926+0000", 2024-04-26T10:34:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013124600000000001 2024-04-26T10:34:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.097122+0000", 2024-04-26T10:34:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000196472 2024-04-26T10:34:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:119274 5.1 5.c077fb81 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:08.096912+0000", 2024-04-26T10:34:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00043097300000000002, 2024-04-26T10:34:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071466300000000004, 2024-04-26T10:34:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 119274 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096912+0000", 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096912+0000", 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096908+0000", 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999967 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096965+0000", 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6385000000000003e-05 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096970+0000", 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3380000000000004e-06 2024-04-26T10:34:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096974+0000", 2024-04-26T10:34:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.788e-06 2024-04-26T10:34:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:119275 5.2 5:46015f0b:::benchmark_data_smithi043_45180_object119274:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:08.096979+0000", 2024-04-26T10:34:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.000363383, 2024-04-26T10:34:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00070970099999999997, 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 119275 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096979+0000", 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096979+0000", 2024-04-26T10:34:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.096979+0000", 2024-04-26T10:34:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.097050+0000", 2024-04-26T10:34:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1542e-05 2024-04-26T10:34:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.097057+0000", 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0999999999999998e-06 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.097063+0000", 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8189999999999997e-06 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.097095+0000", 2024-04-26T10:34:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:08.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:08.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.097204+0000", 2024-04-26T10:34:08.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108912 2024-04-26T10:34:08.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:08.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.097290+0000", 2024-04-26T10:34:08.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6471999999999995e-05 2024-04-26T10:34:08.126 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.126 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:119259 5.1 5:86ef5882:::benchmark_data_smithi043_45180_object119258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:08.089731+0000", 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0076119270000000001, 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.008036049, 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 119259 2024-04-26T10:34:08.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.089731+0000", 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.089731+0000", 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.089730+0000", 2024-04-26T10:34:08.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.089864+0000", 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013459999999999999 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.089874+0000", 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8539999999999992e-06 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.089881+0000", 2024-04-26T10:34:08.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.759e-06 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.089923+0000", 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1566000000000001e-05 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.090052+0000", 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012969699999999999 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.090210+0000", 2024-04-26T10:34:08.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015789600000000001 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.094936+0000", 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047262459999999999 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:119261 5.2 5:44051fa1:::benchmark_data_smithi043_45180_object119260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:08.090106+0000", 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0072364700000000001, 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0077074609999999997, 2024-04-26T10:34:08.131 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 119261 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.090106+0000", 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:08.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.090106+0000", 2024-04-26T10:34:08.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:08.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:08.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.090105+0000", 2024-04-26T10:34:08.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:08.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:08.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.090197+0000", 2024-04-26T10:34:08.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1804000000000004e-05 2024-04-26T10:34:08.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.090221+0000", 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3957000000000001e-05 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.090231+0000", 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8260000000000005e-06 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.090260+0000", 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9522999999999998e-05 2024-04-26T10:34:08.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:08.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.090344+0000", 2024-04-26T10:34:08.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4085000000000006e-05 2024-04-26T10:34:08.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:08.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.090486+0000", 2024-04-26T10:34:08.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0001416 2024-04-26T10:34:08.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:08.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:08.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:08.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.093764+0000", 2024-04-26T10:34:08.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032780959999999999 2024-04-26T10:34:08.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.136 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:08.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:08.136 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:34:08.136 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 9 2024-04-26T10:34:08.136 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:08.137 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:08.135+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:08.138 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:08.227 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:34:08.238 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:08.236+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:08.313 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:08.313 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:34:08.313 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:34:08.313 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:34:08.313 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:08.326 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:08.339 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:08.337+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:08.381 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:08.401 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:08.421 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 51 16 119926 119910 146.936 123.625 0.00465984 0.00680311 2024-04-26T10:34:08.422 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:08.423 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:08.423 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:08.424 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:08.440 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:08.438+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:08.486 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:34:08.541 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:08.539+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:08.544 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:08.545 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:08.560 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:08.642 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:08.640+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:08.720 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:08.720 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:08.734 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:08.743 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:08.741+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:08.843 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:08.841+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:08.899 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:08.899 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:08.915 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:08.944 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:08.942+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:09.045 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:09.044+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:09.079 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:09.079 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:09.093 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:09.146 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:09.144+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:09.249 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:09.245+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:09.294 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:09.294 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:09.310 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:09.351 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:09.349+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:09.421 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 52 16 121933 121917 146.522 125.438 0.00686701 0.00682227 2024-04-26T10:34:09.449 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:09.447+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:09.482 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-26T10:34:09.545 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:09.545 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:09.549 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:09.548+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:09.560 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:09.651 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:09.649+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:09.747 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:09.747 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:09.751 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:09.750+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:09.766 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:09.852 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:09.850+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:09.946 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:09.947 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:09.953 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:09.951+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:09.962 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:10.054 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:10.052+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:10.147 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:10.147 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:10.155 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:10.153+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:10.162 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:10.256 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:10.254+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:10.358 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:10.356+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:10.382 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:10.382 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:10.397 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:10.421 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 53 16 123881 123865 146.055 121.75 0.0110645 0.00684447 2024-04-26T10:34:10.436 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:10.457 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:10.455+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:10.558 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:10.557+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:10.561 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:10.561 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:10.575 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:10.590 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:10.611 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:10.634 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:10.636 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:10.636 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:10.636 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:10.659 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:10.658+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:10.760 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:10.758+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:10.772 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:10.772 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:10.772 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:10.772 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:10.772 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:10.786 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:10.861 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:10.860+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:10.961 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:10.961+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:10.990 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:10.990 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:10.990 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:10.991 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:10.991 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.991 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:10.991 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:10.991 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 43.186351797999997, 2024-04-26T10:34:10.991 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:10.992 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:10.992 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:10.992 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:10.992 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:10.992 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:10.992 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:10.993 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.993 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:10.993 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.993 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:10.993 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:10.993 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:10.993 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.993 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.993 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:10.993 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:10.993 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:10.993 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.994 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.994 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:10.994 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:10.994 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:10.994 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.994 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.994 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:10.994 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:10.994 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:10.994 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.994 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.994 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.995 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:10.996 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.997 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.997 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:10.997 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:10.997 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:10.997 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.997 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.997 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:10.997 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:10.997 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:10.997 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.997 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.997 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:10.997 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:10.998 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:10.998 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:10.998 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:10.998 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:10.998 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.998 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.998 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:10.998 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:10.998 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 43.185523717999999, 2024-04-26T10:34:10.998 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:10.998 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:10.998 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:10.999 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.000 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.001 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:11.002 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:11.003 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:11.004 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.004 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.004 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.004 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.004 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.004 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:11.004 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:11.004 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 43.184594654999998, 2024-04-26T10:34:11.004 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:11.004 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.004 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.004 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:11.004 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:11.005 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.005 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:11.005 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.005 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.005 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.005 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.005 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:11.005 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.005 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.006 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.006 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.006 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:11.006 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.006 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.006 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.006 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.007 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:11.007 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.007 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.007 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.007 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.007 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:11.008 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:11.008 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.008 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.008 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.008 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:11.008 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:11.008 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.009 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.009 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.009 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:11.009 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:11.009 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.009 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.010 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.010 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:11.010 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:11.010 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.010 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.010 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.010 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:11.010 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:11.010 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.010 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.010 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:11.010 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:11.011 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:11.011 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.011 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.011 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:11.011 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:11.011 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:11.011 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.011 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.011 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.011 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:11.011 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:11.011 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.011 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.012 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.012 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:11.012 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:11.012 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.012 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.012 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.012 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:11.012 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:11.012 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.012 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.012 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.013 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.013 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.013 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:11.013 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:11.013 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 43.183909214000003, 2024-04-26T10:34:11.013 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:11.013 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.013 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.013 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:11.013 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:11.014 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.014 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:11.014 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.014 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.014 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.014 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.014 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:11.014 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.014 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.014 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:11.015 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:11.016 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:11.017 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:11.018 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.018 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.018 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.018 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:11.018 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:11.018 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.018 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.018 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.018 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:11.018 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:11.018 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.019 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.019 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.019 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:11.019 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:11.019 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.019 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.019 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.019 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.019 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.020 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103337 5.d 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:11.020 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:11.020 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.798250541, 2024-04-26T10:34:11.020 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.058853520999999999, 2024-04-26T10:34:11.020 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.020 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.020 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:11.020 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:11.020 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.020 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103337 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:11.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.022 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.022 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.022 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188132+0000", 2024-04-26T10:34:11.022 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6197000000000003e-05 2024-04-26T10:34:11.022 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.022 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.022 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.022 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188144+0000", 2024-04-26T10:34:11.022 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2001000000000001e-05 2024-04-26T10:34:11.022 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.022 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.022 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.022 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188152+0000", 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9349999999999994e-06 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188185+0000", 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3436000000000003e-05 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188275+0000", 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9995999999999997e-05 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:11.023 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188365+0000", 2024-04-26T10:34:11.024 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0254999999999996e-05 2024-04-26T10:34:11.024 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.024 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.024 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:11.024 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.194973+0000", 2024-04-26T10:34:11.024 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066073490000000002 2024-04-26T10:34:11.024 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.024 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.024 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.024 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246781+0000", 2024-04-26T10:34:11.024 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.051808372999999998 2024-04-26T10:34:11.024 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.024 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.025 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.025 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246865+0000", 2024-04-26T10:34:11.025 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3498999999999995e-05 2024-04-26T10:34:11.025 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.025 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.025 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.025 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246920+0000", 2024-04-26T10:34:11.025 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5208999999999999e-05 2024-04-26T10:34:11.025 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.025 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.025 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.025 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.025 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.026 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:11.026 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:11.026 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.607618772, 2024-04-26T10:34:11.026 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:11.026 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.026 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.026 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:11.026 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:11.026 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.026 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:11.026 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.026 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.026 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.027 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.027 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:11.027 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.027 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.027 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.027 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.027 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:11.027 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.027 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.027 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.027 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.027 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:11.027 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.028 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:11.029 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:11.030 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:11.030 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.030 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.030 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:11.030 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:11.030 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:11.030 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.030 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.031 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.031 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:11.031 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:11.031 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.031 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.031 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.031 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:11.031 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:11.031 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.031 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.607399468000001, 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.032 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.033 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:11.033 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:11.033 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.033 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:11.033 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.033 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.033 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.033 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.033 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:11.033 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.033 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.033 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.033 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.034 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:11.034 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.034 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.034 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.034 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.034 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:11.034 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.034 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.034 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.034 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.034 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:11.034 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:11.035 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.035 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.035 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.035 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:11.035 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:11.035 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.035 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.035 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.035 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:11.035 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:11.035 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.035 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.036 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.036 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:11.036 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:11.036 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.036 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.036 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.036 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:11.036 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:11.036 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.036 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:11.037 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.038 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.038 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.038 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:11.038 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:11.038 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.038 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.038 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.038 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:11.038 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:11.038 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.038 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.038 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.039 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.039 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.039 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:11.039 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:11.039 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.607319663, 2024-04-26T10:34:11.039 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:11.039 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.039 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.039 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:11.039 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:11.039 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.040 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:11.040 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.040 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.040 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.040 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.040 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:11.041 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.041 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.041 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.041 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.041 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:11.041 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.042 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.042 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.042 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.042 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:11.042 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.042 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.043 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.043 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.043 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:11.043 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:11.043 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.043 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.043 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.043 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:11.043 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:11.044 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.044 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.044 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.044 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:11.044 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:11.044 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.044 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.044 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.044 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.045 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:11.046 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:11.046 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:11.046 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.046 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.046 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.046 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:11.046 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:11.046 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.046 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.046 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.046 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:11.046 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:11.046 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.605955633000001, 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:11.047 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.048 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.049 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:11.050 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:11.050 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.050 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.050 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.050 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:11.050 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:11.050 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.050 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.050 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.050 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:11.050 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:11.050 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.050 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:11.051 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:11.052 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.605361296, 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.053 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.054 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.054 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.054 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:11.054 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.054 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.054 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.054 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.054 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:11.054 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.054 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.054 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.054 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.054 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.055 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.056 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.057 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:11.057 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:11.057 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:11.057 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.057 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.057 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:11.057 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:11.057 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:11.057 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.057 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.057 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.057 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:11.058 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:11.058 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.058 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.058 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.058 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:11.058 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:11.058 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.058 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.058 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.058 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:11.058 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:11.058 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.058 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.604600939999999, 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.059 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.060 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:11.061 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:11.062 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:11.063 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.60398348, 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.064 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.065 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.066 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.066 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:11.066 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:11.066 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.066 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.066 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.066 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:11.066 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:11.066 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.066 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.066 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.066 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:11.066 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:11.067 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.068 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.069 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:11.070 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:11.070 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.603418477, 2024-04-26T10:34:11.070 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:11.070 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.070 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.070 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.070 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.070 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.070 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:11.070 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.070 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.070 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.071 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.071 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:11.071 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.071 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.071 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.071 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.071 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:11.072 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.072 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.072 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.072 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.072 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:11.072 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:11.072 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.073 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.073 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.073 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:11.073 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:11.073 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.073 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.074 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.074 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:11.074 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:11.074 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.074 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.074 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.075 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:11.075 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:11.076 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.076 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.076 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.076 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:11.076 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:11.076 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.077 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.077 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.077 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:11.077 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:11.077 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.077 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.077 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.078 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:11.078 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:11.078 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.078 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.078 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.079 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.079 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.079 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:11.079 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:11.079 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.602875165, 2024-04-26T10:34:11.079 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:11.079 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.080 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.080 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:11.080 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:11.080 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.080 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:11.080 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.080 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.081 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.081 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.082 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:11.082 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.082 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.082 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.082 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.082 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:11.083 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.083 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.083 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.083 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.083 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:11.083 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.084 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.084 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.084 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.084 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:11.084 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:11.084 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.085 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.085 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.085 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:11.085 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:11.085 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.085 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.086 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.086 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:11.086 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:11.086 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.086 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.087 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.087 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:11.088 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:11.088 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.088 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.088 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.088 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:11.088 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:11.089 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.089 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.089 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:11.089 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:11.089 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:11.089 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.090 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.090 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.090 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:11.090 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:11.090 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.091 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.091 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:11.091 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:11.091 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:11.091 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.091 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.092 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.092 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:11.092 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:11.092 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.092 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.093 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.093 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:11.093 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:11.094 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.094 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.094 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.094 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.094 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.094 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:11.095 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:11.095 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.601403165000001, 2024-04-26T10:34:11.095 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:11.095 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.095 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.096 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:11.096 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:11.096 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.096 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:11.096 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.096 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.097 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.097 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.097 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:11.097 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.097 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.097 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.098 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.098 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:11.098 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.098 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.098 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.099 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.099 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:11.100 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:11.100 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.100 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.100 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.100 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:11.101 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:11.101 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.101 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.101 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.101 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:11.101 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:11.102 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.102 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.102 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.102 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:11.102 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:11.103 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.103 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.103 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.103 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:11.103 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:11.103 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.104 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.104 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.104 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:11.104 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:11.104 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.104 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.105 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:11.105 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:11.105 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:11.105 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.106 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.106 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.106 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:11.106 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:11.106 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.106 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.106 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:11.106 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:11.107 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:11.107 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.107 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.107 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.107 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:11.107 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:11.107 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.108 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.108 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.108 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:11.108 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:11.108 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.108 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.108 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.108 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.108 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.109 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:11.109 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:11.109 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.600837745, 2024-04-26T10:34:11.109 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:11.109 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.109 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.109 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.110 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.110 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.110 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:11.110 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.110 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.110 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.111 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.111 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:11.111 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.111 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.111 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.111 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.111 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:11.111 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.111 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.111 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.111 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.111 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.112 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.113 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.114 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:11.114 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:11.114 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.114 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.114 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.114 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.114 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.114 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:11.114 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:11.114 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.600772895, 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.115 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:11.116 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.117 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.118 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.119 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.119 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.119 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:11.119 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:11.119 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.600011915, 2024-04-26T10:34:11.119 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:11.119 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.119 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:11.119 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.119 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.119 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.119 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:11.119 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.120 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.121 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.122 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:11.122 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:11.122 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.122 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.122 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.122 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:11.122 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:11.122 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.122 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.122 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.122 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:11.122 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:11.122 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.598990487, 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.123 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:11.124 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.124 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.124 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.124 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.124 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:11.124 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.125 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.125 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.125 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.125 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:11.125 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.125 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.126 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.126 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.126 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:11.126 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:11.126 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.126 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.127 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.127 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:11.127 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:11.127 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.127 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.127 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.127 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:11.127 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:11.127 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.127 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.127 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.127 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:11.128 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:11.128 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.128 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.128 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.128 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:11.129 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:11.129 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.129 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.129 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:11.129 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:11.129 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:11.129 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.129 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.129 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.129 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:11.129 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:11.129 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.129 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.130 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.130 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.130 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.130 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103647 5.b e32/16 ondisk, result = 0)", 2024-04-26T10:34:11.130 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:11.130 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.598971788, 2024-04-26T10:34:11.130 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060768513000000003, 2024-04-26T10:34:11.130 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:11.130 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:11.130 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:11.131 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.131 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:11.131 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:11.131 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.131 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.131 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.131 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:11.131 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:11.131 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:11.131 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.131 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.131 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387344+0000", 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387350+0000", 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.22e-06 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447917+0000", 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060567523999999998 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.132 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447925+0000", 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7689999999999996e-06 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448004+0000", 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9246000000000007e-05 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448012+0000", 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3490000000000003e-06 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:11.133 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:11.134 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448114+0000", 2024-04-26T10:34:11.134 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010205299999999999 2024-04-26T10:34:11.134 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.134 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.134 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.134 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:11.134 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:11.134 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:11.136 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:11.136 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:11.134+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:11.236 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:11.236+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:11.331 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:11.331 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:11.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.332 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:125716 5.6 5:68fd7350:::benchmark_data_smithi043_45180_object125715:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T10:34:11.332 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.323433+0000", 2024-04-26T10:34:11.332 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0056962719999999996, 2024-04-26T10:34:11.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057174089999999997, 2024-04-26T10:34:11.333 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.333 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:11.333 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.333 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.333 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.336 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 125716 2024-04-26T10:34:11.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.337 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.323433+0000", 2024-04-26T10:34:11.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.338 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.338 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.338 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.338 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.323433+0000", 2024-04-26T10:34:11.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.339 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.323432+0000", 2024-04-26T10:34:11.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:11.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.323508+0000", 2024-04-26T10:34:11.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6483999999999995e-05 2024-04-26T10:34:11.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.323517+0000", 2024-04-26T10:34:11.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8149999999999995e-06 2024-04-26T10:34:11.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.323526+0000", 2024-04-26T10:34:11.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:11.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.325169+0000", 2024-04-26T10:34:11.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001643055 2024-04-26T10:34:11.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.325306+0000", 2024-04-26T10:34:11.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013728699999999999 2024-04-26T10:34:11.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:11.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.325458+0000", 2024-04-26T10:34:11.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000152318 2024-04-26T10:34:11.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328469+0000", 2024-04-26T10:34:11.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0030105359999999999 2024-04-26T10:34:11.349 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:125715 5.e e39/16 5:7162edb9:::benchmark_data_smithi043_45180_object125714:head v 39'7783, mlcod=39'7778)", 2024-04-26T10:34:11.350 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.323615+0000", 2024-04-26T10:34:11.351 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0055144740000000001, 2024-04-26T10:34:11.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0055872109999999999, 2024-04-26T10:34:11.351 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.351 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:11.351 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.323615+0000", 2024-04-26T10:34:11.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.323615+0000", 2024-04-26T10:34:11.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.323614+0000", 2024-04-26T10:34:11.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.323669+0000", 2024-04-26T10:34:11.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4942999999999999e-05 2024-04-26T10:34:11.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.356 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.323677+0000", 2024-04-26T10:34:11.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.554e-06 2024-04-26T10:34:11.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.356 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.323681+0000", 2024-04-26T10:34:11.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9559999999999996e-06 2024-04-26T10:34:11.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.324352+0000", 2024-04-26T10:34:11.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00067088800000000002 2024-04-26T10:34:11.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.324378+0000", 2024-04-26T10:34:11.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5848999999999999e-05 2024-04-26T10:34:11.359 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.359 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.359 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.360 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:125713 5.9 e39/34 5:99d14f02:::benchmark_data_smithi043_45180_object125712:head v 39'7879, mlcod=39'7877)", 2024-04-26T10:34:11.360 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.324823+0000", 2024-04-26T10:34:11.360 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0043056700000000002, 2024-04-26T10:34:11.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044126080000000002, 2024-04-26T10:34:11.360 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.361 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:11.361 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.324823+0000", 2024-04-26T10:34:11.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.324823+0000", 2024-04-26T10:34:11.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.363 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.363 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.324823+0000", 2024-04-26T10:34:11.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.324827+0000", 2024-04-26T10:34:11.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2760000000000002e-06 2024-04-26T10:34:11.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.324835+0000", 2024-04-26T10:34:11.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2819999999999996e-06 2024-04-26T10:34:11.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.324841+0000", 2024-04-26T10:34:11.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6409999999999999e-06 2024-04-26T10:34:11.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.324976+0000", 2024-04-26T10:34:11.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013518800000000001 2024-04-26T10:34:11.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.324988+0000", 2024-04-26T10:34:11.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1911e-05 2024-04-26T10:34:11.369 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.369 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.370 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.370 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:125701 5.8 e39/16 5:1e72cd39:::benchmark_data_smithi043_45180_object125700:head v 39'8097, mlcod=39'8092)", 2024-04-26T10:34:11.370 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.315336+0000", 2024-04-26T10:34:11.370 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.013793058, 2024-04-26T10:34:11.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.013932698, 2024-04-26T10:34:11.371 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.371 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:11.371 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.315336+0000", 2024-04-26T10:34:11.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.315336+0000", 2024-04-26T10:34:11.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.315335+0000", 2024-04-26T10:34:11.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.315392+0000", 2024-04-26T10:34:11.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7201999999999999e-05 2024-04-26T10:34:11.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.315405+0000", 2024-04-26T10:34:11.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2666e-05 2024-04-26T10:34:11.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.315411+0000", 2024-04-26T10:34:11.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2539999999999998e-06 2024-04-26T10:34:11.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.322337+0000", 2024-04-26T10:34:11.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069251039999999996 2024-04-26T10:34:11.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.322359+0000", 2024-04-26T10:34:11.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2606999999999999e-05 2024-04-26T10:34:11.379 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.379 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.379 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.380 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:125718 5.1 e39/16 5:869b92f0:::benchmark_data_smithi043_45180_object125717:head v 39'7891, mlcod=39'7889)", 2024-04-26T10:34:11.380 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.325775+0000", 2024-04-26T10:34:11.380 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0033539059999999998, 2024-04-26T10:34:11.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035290270000000001, 2024-04-26T10:34:11.380 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.381 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:11.381 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.325775+0000", 2024-04-26T10:34:11.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.382 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.382 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.325775+0000", 2024-04-26T10:34:11.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.325775+0000", 2024-04-26T10:34:11.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.384 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.384 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.325872+0000", 2024-04-26T10:34:11.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7872000000000001e-05 2024-04-26T10:34:11.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.325883+0000", 2024-04-26T10:34:11.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0207000000000001e-05 2024-04-26T10:34:11.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.325889+0000", 2024-04-26T10:34:11.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1800000000000001e-06 2024-04-26T10:34:11.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326225+0000", 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000335819 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326241+0000", 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6288999999999999e-05 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.388 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:125719 5.d e39/34 5:b5e1b8e5:::benchmark_data_smithi043_45180_object125718:head v 39'7837, mlcod=39'7835)", 2024-04-26T10:34:11.388 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.326038+0000", 2024-04-26T10:34:11.388 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0030913939999999999, 2024-04-26T10:34:11.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033151230000000001, 2024-04-26T10:34:11.388 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.388 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:11.388 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326038+0000", 2024-04-26T10:34:11.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326038+0000", 2024-04-26T10:34:11.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326037+0000", 2024-04-26T10:34:11.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326041+0000", 2024-04-26T10:34:11.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.941e-06 2024-04-26T10:34:11.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326049+0000", 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8930000000000005e-06 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326054+0000", 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8949999999999997e-06 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326093+0000", 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8918999999999998e-05 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.392 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326113+0000", 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0618000000000001e-05 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:125720 5.7 e39/16 5:e20fc13b:::benchmark_data_smithi043_45180_object125719:head v 39'7800, mlcod=39'7798)", 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.326074+0000", 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.003055229, 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033115919999999999, 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326074+0000", 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326074+0000", 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326073+0000", 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326128+0000", 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4681e-05 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326135+0000", 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4740000000000002e-06 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326139+0000", 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7249999999999997e-06 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326177+0000", 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7800999999999999e-05 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.326195+0000", 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7955999999999999e-05 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:125708 5.0 e39/34)", 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.327527+0000", 2024-04-26T10:34:11.396 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001602207, 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001889335, 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327527+0000", 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327527+0000", 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327527+0000", 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967296 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327528+0000", 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.725e-06 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327533+0000", 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327537+0000", 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.895e-06 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:125717 5.b 5:d6a7dff9:::benchmark_data_smithi043_45180_object125716:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.327668+0000", 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0014604889999999999, 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001781304, 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:11.399 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 125717 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327668+0000", 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327668+0000", 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327667+0000", 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327704+0000", 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7163999999999999e-05 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327715+0000", 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0434999999999999e-05 2024-04-26T10:34:11.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327722+0000", 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4769999999999997e-06 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327766+0000", 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3853000000000002e-05 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327914+0000", 2024-04-26T10:34:11.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014821499999999999 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0,1", 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328083+0000", 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016819400000000001 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:125721 5.a 5:5c81bc7f:::benchmark_data_smithi043_45180_object125720:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.328014+0000", 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001114596, 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001480391, 2024-04-26T10:34:11.403 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 125721 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328014+0000", 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328014+0000", 2024-04-26T10:34:11.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328014+0000", 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328079+0000", 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4987999999999995e-05 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328085+0000", 2024-04-26T10:34:11.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6019999999999996e-06 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328090+0000", 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4120000000000003e-06 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328128+0000", 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8501999999999998e-05 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328255+0000", 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012723899999999999 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328346+0000", 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0420000000000005e-05 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:125722 5.0 5.7a4c0c20 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.328099+0000", 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001030155, 2024-04-26T10:34:11.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001435497, 2024-04-26T10:34:11.408 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.408 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:11.408 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.408 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.408 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.408 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 125722 2024-04-26T10:34:11.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.408 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328099+0000", 2024-04-26T10:34:11.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328099+0000", 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328098+0000", 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328197+0000", 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8521000000000001e-05 2024-04-26T10:34:11.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328205+0000", 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5809999999999997e-06 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328211+0000", 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0090000000000004e-06 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:125708 5.0 5:0089f7c0:::benchmark_data_smithi043_45180_object125707:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.317366+0000", 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.011762932, 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.012201267, 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 125708 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.317366+0000", 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.317366+0000", 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.317365+0000", 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.317431+0000", 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5296000000000006e-05 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.317439+0000", 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1300000000000001e-06 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.317445+0000", 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7039999999999997e-06 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.325275+0000", 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0078293449999999997 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.325403+0000", 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000127854 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0,1", 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.325551+0000", 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000147913 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.414 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:125723 5.7 e39/16 5:e97e0572:::benchmark_data_smithi043_45180_object125722:head v 39'7801, mlcod=39'7798)", 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.328664+0000", 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.000465353, 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00094278600000000004, 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328664+0000", 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328664+0000", 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328663+0000", 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328721+0000", 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7642999999999997e-05 2024-04-26T10:34:11.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328728+0000", 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5290000000000003e-06 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328733+0000", 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.352e-06 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328769+0000", 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5964000000000003e-05 2024-04-26T10:34:11.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.328788+0000", 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9477e-05 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "MOSDPGPushReply(5.b 39/34 [PushReplyOp(5:d2f4e99e:::benchmark_data_smithi043_45180_object7242:head)])", 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.329283+0000", 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9998455, 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00035511199999999998, 2024-04-26T10:34:11.418 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.329283+0000", 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.329283+0000", 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.329283+0000", 2024-04-26T10:34:11.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.329288+0000", 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4489999999999998e-06 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.329297+0000", 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6610000000000006e-06 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.329304+0000", 2024-04-26T10:34:11.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.43e-06 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:125712 5.0 e39/34)", 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.329433+0000", 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9996958, 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023549899999999999, 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.329433+0000", 2024-04-26T10:34:11.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.329433+0000", 2024-04-26T10:34:11.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.329433+0000", 2024-04-26T10:34:11.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.329436+0000", 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3799999999999998e-06 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.329442+0000", 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9909999999999999e-06 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.329447+0000", 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1800000000000004e-06 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.423 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:125709 5.e e39/16 5:7917bd0d:::benchmark_data_smithi043_45180_object125708:head v 39'7782, mlcod=39'7778)", 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.320225+0000", 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0089036199999999992, 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0094742090000000008, 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.320225+0000", 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.320225+0000", 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.320225+0000", 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.320277+0000", 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2519999999999999e-05 2024-04-26T10:34:11.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.320288+0000", 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0264e-05 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.320295+0000", 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0199999999999997e-06 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.322302+0000", 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020078689999999998 2024-04-26T10:34:11.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.322329+0000", 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6364e-05 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:125697 5.8 e39/16 5:11b62c84:::benchmark_data_smithi043_45180_object125696:head v 39'8096, mlcod=39'8092)", 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.311666+0000", 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.017463378000000002, 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018066741000000001, 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.311666+0000", 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.311666+0000", 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.311665+0000", 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.311727+0000", 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1398999999999999e-05 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.311735+0000", 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7460000000000006e-06 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.311740+0000", 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1749999999999996e-06 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.317000+0000", 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0052594570000000004 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.317023+0000", 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2881999999999999e-05 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.430 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:125712 5.0 5:01c145dc:::benchmark_data_smithi043_45180_object125711:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:11.322673+0000", 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0064560939999999999, 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.007094698, 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 125712 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.322673+0000", 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.322673+0000", 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.322672+0000", 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.322699+0000", 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7101999999999999e-05 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.322780+0000", 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0456000000000004e-05 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.322788+0000", 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.174e-06 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327266+0000", 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044778680000000003 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327364+0000", 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7930000000000006e-05 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0,1", 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:11.327458+0000", 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4654000000000005e-05 2024-04-26T10:34:11.434 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.435 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.435 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.435 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.435 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:34:11.435 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 18 2024-04-26T10:34:11.435 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:11.436 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 54 16 125911 125895 145.699 126.875 0.010359 0.00686066 2024-04-26T10:34:11.437 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:11.437 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:11.434+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:11.496 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:34:11.537 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:11.536+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:11.643 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:11.640+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:11.677 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:11.677 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:11.677 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:34:11.677 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:34:11.677 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:11.694 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:11.739 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:11.738+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:11.800 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:34:11.800 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T10:34:11.840 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:11.840+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:11.934 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:11.934 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:11.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:11.934 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:11.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.934 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:11.934 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:11.934 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.130360187000001, 2024-04-26T10:34:11.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:11.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:11.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:11.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:11.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.130359202000001, 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.940 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:11.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:11.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:11.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:11.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:11.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:11.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:11.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.130290578999997, 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.944 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:11.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:11.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:11.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.130238798999997, 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:11.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:11.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:11.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.130178948999998, 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:11.955 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:11.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:11.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.960 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.128466244999998, 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:11.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:11.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:11.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.128351178000003, 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.966 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:11.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:11.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.128258037999998, 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.970 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:11.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:11.974 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.975 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.128063877999999, 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.976 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.977 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.979 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.126856510000003, 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:11.980 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:11.981 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:11.982 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.983 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.126047602, 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.984 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.985 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.986 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.987 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.988 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.125944064000002, 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.993 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:11.994 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.125867190999998, 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:11.995 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.996 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.997 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.998 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:11.999 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.000 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.001 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:12.001 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:12.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:12.001 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.001 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:12.001 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.001 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.001 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.001 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:12.001 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:12.001 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 44.125751807, 2024-04-26T10:34:12.001 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:12.002 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:12.002 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:12.002 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:12.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:12.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:12.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.002 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.002 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:12.002 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:12.002 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.002 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:12.003 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:12.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.004 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.004 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.004 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:12.004 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:12.004 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:12.005 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.749107754000001, 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.006 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:12.011 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.747077905999999, 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:12.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:12.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:12.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:12.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:12.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:12.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:12.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:12.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:12.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:12.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:12.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:12.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:12.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.746602103000001, 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:12.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:12.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:12.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:12.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:12.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:12.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:12.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:12.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:12.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:12.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:12.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:12.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:12.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:12.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:12.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:12.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:12.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:12.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:12.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:12.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:12.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:12.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:12.024 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.024 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:12.024 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.024 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:12.024 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:12.024 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.744635048999999, 2024-04-26T10:34:12.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:12.024 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:12.025 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.025 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:12.025 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:12.025 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.025 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:12.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.025 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:12.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:12.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:12.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:12.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:12.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:12.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:12.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:12.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:12.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:12.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:12.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:12.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:12.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:12.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:12.030 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.030 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:12.030 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103336 5.6 5:6c0cef20:::benchmark_data_smithi043_45180_object103335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.742525744, 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064107786, 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103336 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:12.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188502+0000", 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188540+0000", 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8445000000000002e-05 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188553+0000", 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2768e-05 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188563+0000", 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9760000000000007e-06 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191877+0000", 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003313908 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192004+0000", 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012663 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192143+0000", 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013964199999999999 2024-04-26T10:34:12.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.196467+0000", 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043232230000000002 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252539+0000", 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056072085000000001 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252577+0000", 2024-04-26T10:34:12.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8730999999999999e-05 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252611+0000", 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3769000000000001e-05 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 13.741967311, 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:12.036 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:12.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:12.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:12.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:12.042 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.042 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:12.042 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.042 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:12.042 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:12.042 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:12.044 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:12.041+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:12.044 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:12.144 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:12.143+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:12.231 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:12.231 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:12.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.231 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:127445 5.3 e39/16 5:ca0e97d8:::benchmark_data_smithi043_45180_object127444:head v 39'7875, mlcod=39'7872)", 2024-04-26T10:34:12.231 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:12.219104+0000", 2024-04-26T10:34:12.231 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0069053120000000003, 2024-04-26T10:34:12.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069241320000000004, 2024-04-26T10:34:12.231 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.231 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.219104+0000", 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.219104+0000", 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.219104+0000", 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.219159+0000", 2024-04-26T10:34:12.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4963999999999998e-05 2024-04-26T10:34:12.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.219163+0000", 2024-04-26T10:34:12.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.25e-06 2024-04-26T10:34:12.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.219167+0000", 2024-04-26T10:34:12.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0949999999999998e-06 2024-04-26T10:34:12.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.220190+0000", 2024-04-26T10:34:12.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010229200000000001 2024-04-26T10:34:12.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.220208+0000", 2024-04-26T10:34:12.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8198000000000001e-05 2024-04-26T10:34:12.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.235 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.235 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.235 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:127449 5.f 5:f3558b6f:::benchmark_data_smithi043_45180_object127448:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T10:34:12.235 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:12.220743+0000", 2024-04-26T10:34:12.235 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0052665740000000004, 2024-04-26T10:34:12.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053712849999999999, 2024-04-26T10:34:12.235 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.235 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:12.235 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.235 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 127449 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.220743+0000", 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.220743+0000", 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.220742+0000", 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.220790+0000", 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7678e-05 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.220801+0000", 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1012999999999999e-05 2024-04-26T10:34:12.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.220809+0000", 2024-04-26T10:34:12.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2740000000000007e-06 2024-04-26T10:34:12.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.220852+0000", 2024-04-26T10:34:12.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3341999999999999e-05 2024-04-26T10:34:12.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.220994+0000", 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141991 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1,2", 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.221159+0000", 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016510299999999999 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225580+0000", 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044204689999999998 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225992+0000", 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00041186100000000002 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:127451 5.9 5:9502413c:::benchmark_data_smithi043_45180_object127450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:12.221427+0000", 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.004582516, 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047452919999999999, 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 127451 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.221427+0000", 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.221427+0000", 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.221426+0000", 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.221499+0000", 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2559999999999996e-05 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.221507+0000", 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6369999999999999e-06 2024-04-26T10:34:12.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.221512+0000", 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0719999999999999e-06 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.221542+0000", 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0555999999999997e-05 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.221630+0000", 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7788999999999996e-05 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1,2", 2024-04-26T10:34:12.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.221726+0000", 2024-04-26T10:34:12.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6250999999999997e-05 2024-04-26T10:34:12.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.224624+0000", 2024-04-26T10:34:12.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028977819999999998 2024-04-26T10:34:12.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225968+0000", 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001344345 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:127452 5.3 e39/16 5:ce492383:::benchmark_data_smithi043_45180_object127451:head v 39'7876, mlcod=39'7872)", 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:12.225542+0000", 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00046704400000000001, 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00072604699999999996, 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225542+0000", 2024-04-26T10:34:12.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225542+0000", 2024-04-26T10:34:12.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225542+0000", 2024-04-26T10:34:12.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225629+0000", 2024-04-26T10:34:12.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6551999999999994e-05 2024-04-26T10:34:12.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225635+0000", 2024-04-26T10:34:12.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4069999999999998e-06 2024-04-26T10:34:12.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225640+0000", 2024-04-26T10:34:12.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7090000000000001e-06 2024-04-26T10:34:12.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225670+0000", 2024-04-26T10:34:12.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0128e-05 2024-04-26T10:34:12.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225688+0000", 2024-04-26T10:34:12.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8372999999999998e-05 2024-04-26T10:34:12.249 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.249 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.249 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.249 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:127453 5.d 5:bfdcc349:::benchmark_data_smithi043_45180_object127452:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T10:34:12.250 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:12.225668+0000", 2024-04-26T10:34:12.250 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.000341916, 2024-04-26T10:34:12.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067105599999999995, 2024-04-26T10:34:12.250 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.250 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:12.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.250 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.250 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 127453 2024-04-26T10:34:12.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.250 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225668+0000", 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225668+0000", 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225667+0000", 2024-04-26T10:34:12.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225714+0000", 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7030000000000002e-05 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225723+0000", 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0710000000000001e-06 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225730+0000", 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:34:12.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225763+0000", 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3083000000000002e-05 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.225859+0000", 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6606000000000003e-05 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1,2", 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.226005+0000", 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000145935 2024-04-26T10:34:12.253 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:127458 5.9 5:9fa06e71:::benchmark_data_smithi043_45180_object127457:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:12.226135+0000", 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9998751, 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029543100000000002, 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.254 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 127458 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.226135+0000", 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.226135+0000", 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.226134+0000", 2024-04-26T10:34:12.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.226156+0000", 2024-04-26T10:34:12.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1889e-05 2024-04-26T10:34:12.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.226167+0000", 2024-04-26T10:34:12.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0812000000000001e-05 2024-04-26T10:34:12.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.226173+0000", 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5799999999999997e-06 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.226204+0000", 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1235999999999997e-05 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.226299+0000", 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4744e-05 2024-04-26T10:34:12.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1,2", 2024-04-26T10:34:12.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:12.226404+0000", 2024-04-26T10:34:12.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105154 2024-04-26T10:34:12.258 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.258 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.258 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.258 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.258 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:34:12.258 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 6 2024-04-26T10:34:12.258 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:12.260 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:12.258+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:12.260 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:12.362 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:12.359+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:12.422 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 55 16 127866 127850 145.272 122.188 0.00632814 0.00688106 2024-04-26T10:34:12.441 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:12.441 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:34:12.442 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:34:12.442 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:34:12.442 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:12.456 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:12.461 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:12.460+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:12.489 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-26T10:34:12.489 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T10:34:12.502 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T10:34:12.563 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:12.562+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:12.641 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:12.641 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:34:12.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:34:12.641 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:12.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.641 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:12.642 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:12.642 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.837732957, 2024-04-26T10:34:12.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:34:12.642 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.642 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.642 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.642 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.642 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.642 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:34:12.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.642 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:34:12.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:34:12.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:34:12.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:34:12.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:34:12.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:34:12.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:95997 5.7 5:ef48f664:::benchmark_data_smithi043_45180_object95996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.052523476000001, 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024010581999999999, 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 95997 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585344+0000", 2024-04-26T10:34:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4491e-05 2024-04-26T10:34:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585350+0000", 2024-04-26T10:34:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1099999999999999e-06 2024-04-26T10:34:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585355+0000", 2024-04-26T10:34:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5430000000000004e-06 2024-04-26T10:34:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592076+0000", 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067208470000000003 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592209+0000", 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013344400000000001 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592320+0000", 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011081700000000001 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.594282+0000", 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019622699999999999 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609277+0000", 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014995066 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609308+0000", 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1242999999999999e-05 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609331+0000", 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2150999999999998e-05 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101455 5.f 5:fbcc5be4:::benchmark_data_smithi043_45180_object101454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 15.367862288, 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02195165, 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.653 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.654 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.654 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.654 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101455 2024-04-26T10:34:12.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.654 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:12.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270103+0000", 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122309 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270111+0000", 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3999999999999992e-06 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270118+0000", 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9179999999999997e-06 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272018+0000", 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018998610000000001 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272126+0000", 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010844999999999999 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272225+0000", 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8381999999999994e-05 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278402+0000", 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061767009999999997 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291830+0000", 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013428756 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291894+0000", 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3189999999999996e-05 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291933+0000", 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9297e-05 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101456 5.f 5:f61cae04:::benchmark_data_smithi043_45180_object101455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 15.367581105999999, 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021829133000000001, 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101456 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270361+0000", 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9395999999999995e-05 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270369+0000", 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5490000000000001e-06 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270374+0000", 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5130000000000004e-06 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273610+0000", 2024-04-26T10:34:12.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003235791 2024-04-26T10:34:12.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273723+0000", 2024-04-26T10:34:12.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112833 2024-04-26T10:34:12.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:12.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273861+0000", 2024-04-26T10:34:12.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013803 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278411+0000", 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045506380000000001 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291986+0000", 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013574409000000001 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292037+0000", 2024-04-26T10:34:12.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1041000000000001e-05 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292091+0000", 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4617000000000002e-05 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101459 5.f 5:f6287f2a:::benchmark_data_smithi043_45180_object101458:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 15.365668198, 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022608105999999999, 2024-04-26T10:34:12.664 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101459 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272227+0000", 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2669e-05 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272236+0000", 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0210000000000005e-06 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272243+0000", 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7469999999999999e-06 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276304+0000", 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040604789999999997 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276386+0000", 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2278000000000001e-05 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276477+0000", 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0713999999999999e-05 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278905+0000", 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024288249999999999 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294715+0000", 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015809976999999999 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294747+0000", 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1814999999999999e-05 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294783+0000", 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6180999999999998e-05 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.669 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101461 5.f 5:fcae472f:::benchmark_data_smithi043_45180_object101460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 15.364874938, 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021972760000000001, 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101461 2024-04-26T10:34:12.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272968+0000", 2024-04-26T10:34:12.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273035+0000", 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7477000000000005e-05 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273043+0000", 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4159999999999998e-06 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273049+0000", 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4509999999999997e-06 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277407+0000", 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043580529999999998 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277489+0000", 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1333000000000002e-05 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277574+0000", 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5042000000000003e-05 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278908+0000", 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013341360000000001 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294832+0000", 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015924462 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294899+0000", 2024-04-26T10:34:12.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6984999999999996e-05 2024-04-26T10:34:12.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294941+0000", 2024-04-26T10:34:12.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2113000000000002e-05 2024-04-26T10:34:12.675 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.675 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.675 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:102382 5.2 5:4e9d92ee:::benchmark_data_smithi043_45180_object102381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.930576177000001, 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021126853000000001, 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 102382 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707330+0000", 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3274000000000004e-05 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707339+0000", 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9700000000000005e-06 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707346+0000", 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709272+0000", 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019264169999999999 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709387+0000", 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115333 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709479+0000", 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1555e-05 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.712520+0000", 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030408729999999999 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728336+0000", 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015815929999999999 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728370+0000", 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4496999999999999e-05 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728394+0000", 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3793000000000001e-05 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103328 5.6 e32/16 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head v 32'6425, mlcod=32'6423)", 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.453483648000001, 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064716840999999997, 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.681 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184359+0000", 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184419+0000", 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9345999999999997e-05 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184425+0000", 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1190000000000002e-06 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184429+0000", 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.296e-06 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184461+0000", 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2122999999999997e-05 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184477+0000", 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5877000000000001e-05 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249048+0000", 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064570494000000006 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249077+0000", 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9081000000000002e-05 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103327 5.c e32/16 5:3133c183:::benchmark_data_smithi043_45180_object103326:head v 32'6430, mlcod=32'6425)", 2024-04-26T10:34:12.685 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:12.686 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.453317050000001, 2024-04-26T10:34:12.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064984741999999998, 2024-04-26T10:34:12.686 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.686 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.686 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:12.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184592+0000", 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6027999999999999e-05 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184597+0000", 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8570000000000003e-06 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184600+0000", 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3390000000000001e-06 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184620+0000", 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9890000000000001e-05 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184631+0000", 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1073999999999999e-05 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249477+0000", 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064845485999999994 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249511+0000", 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4508000000000002e-05 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103329 5.6 e32/16 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head v 32'6426, mlcod=32'6423)", 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.449483229, 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063744996999999998, 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188359+0000", 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188389+0000", 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9416000000000001e-05 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243409+0000", 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.055020409999999999 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243419+0000", 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0071000000000001e-05 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243465+0000", 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5799e-05 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243491+0000", 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5619999999999999e-05 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252067+0000", 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085763809999999992 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252105+0000", 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8040999999999997e-05 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.693 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103337 5.d e32/16 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head v 32'6429, mlcod=32'6427)", 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.449412852, 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.057982037, 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188430+0000", 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188500+0000", 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0062999999999996e-05 2024-04-26T10:34:12.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243434+0000", 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.054933760999999998 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243442+0000", 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243490+0000", 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8312000000000001e-05 2024-04-26T10:34:12.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243511+0000", 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0781999999999999e-05 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246370+0000", 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028590930000000001 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246413+0000", 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2413000000000002e-05 2024-04-26T10:34:12.697 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103660 5.9 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.255477207, 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.067661676000000004, 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.698 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103660 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382365+0000", 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382430+0000", 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4850000000000004e-05 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382439+0000", 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382445+0000", 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0229999999999998e-06 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382482+0000", 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6909000000000002e-05 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382613+0000", 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013072600000000001 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382756+0000", 2024-04-26T10:34:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000143306 2024-04-26T10:34:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385090+0000", 2024-04-26T10:34:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002333786 2024-04-26T10:34:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449925+0000", 2024-04-26T10:34:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064835173999999995 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449985+0000", 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0124999999999998e-05 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450028+0000", 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2457999999999999e-05 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103662 5.f 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.253033396999999, 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.068705924000000002, 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103662 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384809+0000", 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384908+0000", 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9146000000000002e-05 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384921+0000", 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2622e-05 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384931+0000", 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0108e-05 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384984+0000", 2024-04-26T10:34:12.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2849000000000002e-05 2024-04-26T10:34:12.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:12.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017266800000000001 2024-04-26T10:34:12.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:12.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385313+0000", 2024-04-26T10:34:12.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015649300000000001 2024-04-26T10:34:12.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388446+0000", 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003133481 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453401+0000", 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064955075000000001 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453462+0000", 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1134000000000001e-05 2024-04-26T10:34:12.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453516+0000", 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3477999999999999e-05 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103664 5.9 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.252750712999999, 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.065076041000000001, 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.709 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103664 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385092+0000", 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385145+0000", 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3143000000000003e-05 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0473e-05 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385163+0000", 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385193+0000", 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0638e-05 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385284+0000", 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599000000000005e-05 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385375+0000", 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0606999999999995e-05 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387556+0000", 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021809529999999998 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450072+0000", 2024-04-26T10:34:12.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062516408999999995 2024-04-26T10:34:12.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450123+0000", 2024-04-26T10:34:12.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1406000000000002e-05 2024-04-26T10:34:12.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450169+0000", 2024-04-26T10:34:12.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5380000000000003e-05 2024-04-26T10:34:12.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.715 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.715 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103666 5.f 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:12.715 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:12.715 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.25098734, 2024-04-26T10:34:12.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066830159, 2024-04-26T10:34:12.715 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.715 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.715 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103666 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386855+0000", 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386928+0000", 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386937+0000", 2024-04-26T10:34:12.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1090000000000004e-06 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386945+0000", 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386981+0000", 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5899999999999998e-05 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387071+0000", 2024-04-26T10:34:12.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9954e-05 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387161+0000", 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0898999999999998e-05 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390584+0000", 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034229030000000001 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453579+0000", 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062994267000000007 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453640+0000", 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1162999999999997e-05 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453686+0000", 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6493999999999999e-05 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103667 5.f 5:f4dc36e8:::benchmark_data_smithi043_45180_object103666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.250126269999999, 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066218387000000004, 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103667 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387783+0000", 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5973e-05 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387791+0000", 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1850000000000004e-06 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387796+0000", 2024-04-26T10:34:12.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388469+0000", 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0006734 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388547+0000", 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7188999999999996e-05 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388630+0000", 2024-04-26T10:34:12.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3892000000000002e-05 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390598+0000", 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00196759 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453803+0000", 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063205069000000003 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453844+0000", 2024-04-26T10:34:12.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1248999999999998e-05 2024-04-26T10:34:12.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453936+0000", 2024-04-26T10:34:12.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1201999999999999e-05 2024-04-26T10:34:12.726 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.726 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.726 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.726 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:107998 5.9 5:9ce23eb0:::benchmark_data_smithi043_45180_object107997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:12.726 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.14220789, 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025313064, 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107998 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495634+0000", 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495754+0000", 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119893 2024-04-26T10:34:12.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495769+0000", 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4769999999999999e-05 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495781+0000", 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1858999999999999e-05 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502521+0000", 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067402410000000001 2024-04-26T10:34:12.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502675+0000", 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015405099999999999 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1,2", 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502846+0000", 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000171001 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.505743+0000", 2024-04-26T10:34:12.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028975490000000001 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.508006+0000", 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022627620000000002 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520788+0000", 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012782244 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520846+0000", 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7976999999999997e-05 2024-04-26T10:34:12.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520949+0000", 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102267 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:107974 5.b e35/34 5:daaeafb8:::benchmark_data_smithi043_45180_object107973:head v 35'6822, mlcod=0'0)", 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.123181067000001, 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020988144, 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.732 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514661+0000", 2024-04-26T10:34:12.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:12.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514668+0000", 2024-04-26T10:34:12.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0249999999999997e-06 2024-04-26T10:34:12.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514678+0000", 2024-04-26T10:34:12.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7950000000000002e-06 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514686+0000", 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9049999999999997e-06 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514872+0000", 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018605499999999999 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514900+0000", 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7758000000000001e-05 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.535626+0000", 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020725958999999999 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.535651+0000", 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-05 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:108005 5.c e35/16 5:3b5c73fa:::benchmark_data_smithi043_45180_object108004:head v 35'6720, mlcod=33'6718)", 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 10.123120053999999, 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025223481999999998, 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514766+0000", 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2818999999999998e-05 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514773+0000", 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999996e-06 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514777+0000", 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6199999999999998e-06 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522074+0000", 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072964029999999999 2024-04-26T10:34:12.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522096+0000", 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2027000000000001e-05 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539924+0000", 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017827749 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539947+0000", 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3232999999999999e-05 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.740 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "MOSDPGPushReply(5.9 38/34 [PushReplyOp(5:91d0b3ac:::benchmark_data_smithi043_45180_object10370:head)])", 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5391666090000005, 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022588196000000001, 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098679+0000", 2024-04-26T10:34:12.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.295e-06 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098683+0000", 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8659999999999999e-06 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098687+0000", 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.67e-06 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:12.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.121146+0000", 2024-04-26T10:34:12.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022459798 2024-04-26T10:34:12.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:12.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:12.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:12.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.121265+0000", 2024-04-26T10:34:12.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011866000000000001 2024-04-26T10:34:12.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.744 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:12.744 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:12.744 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:12.745 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:34:12.746 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:12.744+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:12.747 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:12.847 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:12.846+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:12.897 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:12.908 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:12.908 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:128861 5.8 5:1c4e4374:::benchmark_data_smithi043_45180_object128860:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:12.903393+0000", 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0046401369999999999, 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0046612299999999997, 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 128861 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:12.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:12.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.903393+0000", 2024-04-26T10:34:12.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:12.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:12.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.903393+0000", 2024-04-26T10:34:12.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:12.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:12.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.903392+0000", 2024-04-26T10:34:12.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.903450+0000", 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8184999999999999e-05 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.903458+0000", 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0530000000000007e-06 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.903463+0000", 2024-04-26T10:34:12.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2480000000000004e-06 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.903491+0000", 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7328999999999999e-05 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.903585+0000", 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.4687999999999999e-05 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.903675+0000", 2024-04-26T10:34:12.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9543999999999995e-05 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:128864 5.8 5:18cf3186:::benchmark_data_smithi043_45180_object128863:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:12.906219+0000", 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001814106, 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001897396, 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:12.913 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 128864 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.906219+0000", 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.906219+0000", 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:12.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.906218+0000", 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.906347+0000", 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012934700000000001 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.906367+0000", 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0284000000000001e-05 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.906375+0000", 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7710000000000006e-06 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.906423+0000", 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8074000000000001e-05 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.906579+0000", 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015566000000000001 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.906733+0000", 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015410599999999999 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:128865 5.a e40/16 5:5f913e96:::benchmark_data_smithi043_45180_object128864:head v 40'8165, mlcod=40'8163)", 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:12.907007+0000", 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0010256499999999999, 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0011526520000000001, 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:12.917 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907007+0000", 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907007+0000", 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907007+0000", 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907073+0000", 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6486e-05 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907081+0000", 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6149999999999999e-06 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907090+0000", 2024-04-26T10:34:12.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2939999999999994e-06 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907115+0000", 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5299999999999998e-05 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907130+0000", 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4134000000000001e-05 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.920 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:128863 5.4 e40/34 5:28026c5d:::benchmark_data_smithi043_45180_object128862:head v 40'8034, mlcod=40'8032)", 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:12.907101+0000", 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00093204500000000005, 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0010926950000000001, 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907101+0000", 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:12.921 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907101+0000", 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907101+0000", 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907129+0000", 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8864999999999999e-05 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:12.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907134+0000", 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7430000000000002e-06 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907138+0000", 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.878e-06 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907169+0000", 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1053999999999998e-05 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:12.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:12.907188+0000", 2024-04-26T10:34:12.924 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.8805999999999999e-05 2024-04-26T10:34:12.924 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:12.924 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:12.924 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:12.924 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:12.924 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:34:12.924 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 4 2024-04-26T10:34:12.924 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:12.925 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:12.926 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:12.938 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:12.939 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:12.939 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:12.939 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:12.947 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:12.947+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:13.048 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:13.046+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:13.087 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:13.087 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:13.101 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:13.149 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:13.147+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:13.249 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:13.249+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:13.266 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:13.266 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:13.280 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:13.350 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:13.349+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:13.422 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 56 16 129887 129871 144.933 126.312 0.0106378 0.00689723 2024-04-26T10:34:13.451 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:13.450+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:13.473 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:13.474 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:13.489 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:13.493 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T10:34:13.505 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T10:34:13.553 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:13.552+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:13.624 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:13.624 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:13.634 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:13.654 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:13.653+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:13.754 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:13.754+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:13.760 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:13.760 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:13.770 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:13.856 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:13.855+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:13.896 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:13.897 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:13.906 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:13.956 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:13.955+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:14.031 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:14.031 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:14.041 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:14.085 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:14.084+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:14.158 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:14.157+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:14.167 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:14.167 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:14.177 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:14.259 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:14.258+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:14.315 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:14.316 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:14.326 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:14.368 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:14.367+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:14.422 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 57 16 130027 130011 142.544 8.75 0.00352009 0.00689993 2024-04-26T10:34:14.461 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:14.460+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:14.494 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:14.494 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:14.503 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T10:34:14.504 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:34:14.508 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:14.517 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T10:34:14.517 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:34:14.562 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:14.561+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:14.642 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:14.642 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:14.651 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:14.695 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:14.693+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:14.763 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:14.762+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:14.778 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:14.778 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:14.788 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:14.864 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:14.864+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:14.910 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:14.912 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:34:14.922 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-04-26T10:34:14.495994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8069974874,"num_objects":123153,"num_object_clones":0,"num_object_copies":246306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":43599,"num_objects_unfound":0,"num_objects_dirty":123153,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":123377,"num_write_kb":7883730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2207,"num_bytes_recovered":144378028,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50868,"ondisk_log_size":50868,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":248,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":16258044,"kb_used_data":15791452,"kb_used_omap":4,"kb_used_meta":466555,"kb_avail":266857476,"statfs":{"total":289910292480,"available":273262055424,"internally_reserved":0,"allocated":16170446848,"data_stored":16169586273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":477752658},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,8,3,4,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":655884288,"num_objects":10008,"num_object_clones":0,"num_object_copies":20016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2124,"num_objects_unfound":0,"num_objects_dirty":10008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10008,"num_write_kb":640512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1455,"num_bytes_recovered":95354880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.497418"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473915+0000","last_change":"2024-04-26T10:34:01.438793+0000","last_active":"2024-04-26T10:34:06.473915+0000","last_peered":"2024-04-26T10:34:06.473915+0000","last_clean":"2024-04-26T10:34:06.473915+0000","last_became_active":"2024-04-26T10:34:01.437541+0000","last_became_peered":"2024-04-26T10:34:01.437541+0000","last_unstale":"2024-04-26T10:34:06.473915+0000","last_undegraded":"2024-04-26T10:34:06.473915+0000","last_fullsized":"2024-04-26T10:34:06.473915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:47.962795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474630+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:34:06.474630+0000","last_peered":"2024-04-26T10:34:06.474630+0000","last_clean":"2024-04-26T10:34:06.474630+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:34:06.474630+0000","last_undegraded":"2024-04-26T10:34:06.474630+0000","last_fullsized":"2024-04-26T10:34:06.474630+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469845+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:34:06.469845+0000","last_peered":"2024-04-26T10:34:06.469845+0000","last_clean":"2024-04-26T10:34:06.469845+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:34:06.469845+0000","last_undegraded":"2024-04-26T10:34:06.469845+0000","last_fullsized":"2024-04-26T10:34:06.469845+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469706+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:34:06.469706+0000","last_peered":"2024-04-26T10:34:06.469706+0000","last_clean":"2024-04-26T10:34:06.469706+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:34:06.469706+0000","last_undegraded":"2024-04-26T10:34:06.469706+0000","last_fullsized":"2024-04-26T10:34:06.469706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.475666+0000","last_change":"2024-04-26T10:34:01.438103+0000","last_active":"2024-04-26T10:34:06.475666+0000","last_peered":"2024-04-26T10:34:06.475666+0000","last_clean":"2024-04-26T10:34:06.475666+0000","last_became_active":"2024-04-26T10:34:01.437590+0000","last_became_peered":"2024-04-26T10:34:01.437590+0000","last_unstale":"2024-04-26T10:34:06.475666+0000","last_undegraded":"2024-04-26T10:34:06.475666+0000","last_fullsized":"2024-04-26T10:34:06.475666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:21.422420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467936+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:34:06.467936+0000","last_peered":"2024-04-26T10:34:06.467936+0000","last_clean":"2024-04-26T10:34:06.467936+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:34:06.467936+0000","last_undegraded":"2024-04-26T10:34:06.467936+0000","last_fullsized":"2024-04-26T10:34:06.467936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470203+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:34:06.470203+0000","last_peered":"2024-04-26T10:34:06.470203+0000","last_clean":"2024-04-26T10:34:06.470203+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:34:06.470203+0000","last_undegraded":"2024-04-26T10:34:06.470203+0000","last_fullsized":"2024-04-26T10:34:06.470203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467442+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:34:06.467442+0000","last_peered":"2024-04-26T10:34:06.467442+0000","last_clean":"2024-04-26T10:34:06.467442+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:34:06.467442+0000","last_undegraded":"2024-04-26T10:34:06.467442+0000","last_fullsized":"2024-04-26T10:34:06.467442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473984+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:34:06.473984+0000","last_peered":"2024-04-26T10:34:06.473984+0000","last_clean":"2024-04-26T10:34:06.473984+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:34:06.473984+0000","last_undegraded":"2024-04-26T10:34:06.473984+0000","last_fullsized":"2024-04-26T10:34:06.473984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473304+0000","last_change":"2024-04-26T10:34:01.439560+0000","last_active":"2024-04-26T10:34:06.473304+0000","last_peered":"2024-04-26T10:34:06.473304+0000","last_clean":"2024-04-26T10:34:06.473304+0000","last_became_active":"2024-04-26T10:34:01.437810+0000","last_became_peered":"2024-04-26T10:34:01.437810+0000","last_unstale":"2024-04-26T10:34:06.473304+0000","last_undegraded":"2024-04-26T10:34:06.473304+0000","last_fullsized":"2024-04-26T10:34:06.473304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:32.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469747+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:34:06.469747+0000","last_peered":"2024-04-26T10:34:06.469747+0000","last_clean":"2024-04-26T10:34:06.469747+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:34:06.469747+0000","last_undegraded":"2024-04-26T10:34:06.469747+0000","last_fullsized":"2024-04-26T10:34:06.469747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473125+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:34:06.473125+0000","last_peered":"2024-04-26T10:34:06.473125+0000","last_clean":"2024-04-26T10:34:06.473125+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:34:06.473125+0000","last_undegraded":"2024-04-26T10:34:06.473125+0000","last_fullsized":"2024-04-26T10:34:06.473125+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.475583+0000","last_change":"2024-04-26T10:34:01.438028+0000","last_active":"2024-04-26T10:34:06.475583+0000","last_peered":"2024-04-26T10:34:06.475583+0000","last_clean":"2024-04-26T10:34:06.475583+0000","last_became_active":"2024-04-26T10:34:01.437253+0000","last_became_peered":"2024-04-26T10:34:01.437253+0000","last_unstale":"2024-04-26T10:34:06.475583+0000","last_undegraded":"2024-04-26T10:34:06.475583+0000","last_fullsized":"2024-04-26T10:34:06.475583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:29.763867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468345+0000","last_change":"2024-04-26T10:34:01.433272+0000","last_active":"2024-04-26T10:34:06.468345+0000","last_peered":"2024-04-26T10:34:06.468345+0000","last_clean":"2024-04-26T10:34:06.468345+0000","last_became_active":"2024-04-26T10:34:01.432857+0000","last_became_peered":"2024-04-26T10:34:01.432857+0000","last_unstale":"2024-04-26T10:34:06.468345+0000","last_undegraded":"2024-04-26T10:34:06.468345+0000","last_fullsized":"2024-04-26T10:34:06.468345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:32.930095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470104+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:34:06.470104+0000","last_peered":"2024-04-26T10:34:06.470104+0000","last_clean":"2024-04-26T10:34:06.470104+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:34:06.470104+0000","last_undegraded":"2024-04-26T10:34:06.470104+0000","last_fullsized":"2024-04-26T10:34:06.470104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467447+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:34:06.467447+0000","last_peered":"2024-04-26T10:34:06.467447+0000","last_clean":"2024-04-26T10:34:06.467447+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:34:06.467447+0000","last_undegraded":"2024-04-26T10:34:06.467447+0000","last_fullsized":"2024-04-26T10:34:06.467447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474030+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:34:06.474030+0000","last_peered":"2024-04-26T10:34:06.474030+0000","last_clean":"2024-04-26T10:34:06.474030+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:34:06.474030+0000","last_undegraded":"2024-04-26T10:34:06.474030+0000","last_fullsized":"2024-04-26T10:34:06.474030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473396+0000","last_change":"2024-04-26T10:34:01.436869+0000","last_active":"2024-04-26T10:34:06.473396+0000","last_peered":"2024-04-26T10:34:06.473396+0000","last_clean":"2024-04-26T10:34:06.473396+0000","last_became_active":"2024-04-26T10:34:01.436574+0000","last_became_peered":"2024-04-26T10:34:01.436574+0000","last_unstale":"2024-04-26T10:34:06.473396+0000","last_undegraded":"2024-04-26T10:34:06.473396+0000","last_fullsized":"2024-04-26T10:34:06.473396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:51.972969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473463+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:34:06.473463+0000","last_peered":"2024-04-26T10:34:06.473463+0000","last_clean":"2024-04-26T10:34:06.473463+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:34:06.473463+0000","last_undegraded":"2024-04-26T10:34:06.473463+0000","last_fullsized":"2024-04-26T10:34:06.473463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469627+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:34:06.469627+0000","last_peered":"2024-04-26T10:34:06.469627+0000","last_clean":"2024-04-26T10:34:06.469627+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:34:06.469627+0000","last_undegraded":"2024-04-26T10:34:06.469627+0000","last_fullsized":"2024-04-26T10:34:06.469627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467806+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:34:06.467806+0000","last_peered":"2024-04-26T10:34:06.467806+0000","last_clean":"2024-04-26T10:34:06.467806+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:34:06.467806+0000","last_undegraded":"2024-04-26T10:34:06.467806+0000","last_fullsized":"2024-04-26T10:34:06.467806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470963+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:34:06.470963+0000","last_peered":"2024-04-26T10:34:06.470963+0000","last_clean":"2024-04-26T10:34:06.470963+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:34:06.470963+0000","last_undegraded":"2024-04-26T10:34:06.470963+0000","last_fullsized":"2024-04-26T10:34:06.470963+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473919+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:34:06.473919+0000","last_peered":"2024-04-26T10:34:06.473919+0000","last_clean":"2024-04-26T10:34:06.473919+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:34:06.473919+0000","last_undegraded":"2024-04-26T10:34:06.473919+0000","last_fullsized":"2024-04-26T10:34:06.473919+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473365+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:34:06.473365+0000","last_peered":"2024-04-26T10:34:06.473365+0000","last_clean":"2024-04-26T10:34:06.473365+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:34:06.473365+0000","last_undegraded":"2024-04-26T10:34:06.473365+0000","last_fullsized":"2024-04-26T10:34:06.473365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470875+0000","last_change":"2024-04-26T10:34:01.438942+0000","last_active":"2024-04-26T10:34:06.470875+0000","last_peered":"2024-04-26T10:34:06.470875+0000","last_clean":"2024-04-26T10:34:06.470875+0000","last_became_active":"2024-04-26T10:34:01.438663+0000","last_became_peered":"2024-04-26T10:34:01.438663+0000","last_unstale":"2024-04-26T10:34:06.470875+0000","last_undegraded":"2024-04-26T10:34:06.470875+0000","last_fullsized":"2024-04-26T10:34:06.470875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:16.648639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473398+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:34:06.473398+0000","last_peered":"2024-04-26T10:34:06.473398+0000","last_clean":"2024-04-26T10:34:06.473398+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:34:06.473398+0000","last_undegraded":"2024-04-26T10:34:06.473398+0000","last_fullsized":"2024-04-26T10:34:06.473398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469794+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:34:06.469794+0000","last_peered":"2024-04-26T10:34:06.469794+0000","last_clean":"2024-04-26T10:34:06.469794+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:34:06.469794+0000","last_undegraded":"2024-04-26T10:34:06.469794+0000","last_fullsized":"2024-04-26T10:34:06.469794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470893+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:34:06.470893+0000","last_peered":"2024-04-26T10:34:06.470893+0000","last_clean":"2024-04-26T10:34:06.470893+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:34:06.470893+0000","last_undegraded":"2024-04-26T10:34:06.470893+0000","last_fullsized":"2024-04-26T10:34:06.470893+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470741+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:34:06.470741+0000","last_peered":"2024-04-26T10:34:06.470741+0000","last_clean":"2024-04-26T10:34:06.470741+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:34:06.470741+0000","last_undegraded":"2024-04-26T10:34:06.470741+0000","last_fullsized":"2024-04-26T10:34:06.470741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473995+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:34:06.473995+0000","last_peered":"2024-04-26T10:34:06.473995+0000","last_clean":"2024-04-26T10:34:06.473995+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:34:06.473995+0000","last_undegraded":"2024-04-26T10:34:06.473995+0000","last_fullsized":"2024-04-26T10:34:06.473995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473500+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:34:06.473500+0000","last_peered":"2024-04-26T10:34:06.473500+0000","last_clean":"2024-04-26T10:34:06.473500+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:34:06.473500+0000","last_undegraded":"2024-04-26T10:34:06.473500+0000","last_fullsized":"2024-04-26T10:34:06.473500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.472722+0000","last_change":"2024-04-26T10:34:01.436900+0000","last_active":"2024-04-26T10:34:06.472722+0000","last_peered":"2024-04-26T10:34:06.472722+0000","last_clean":"2024-04-26T10:34:06.472722+0000","last_became_active":"2024-04-26T10:34:01.436499+0000","last_became_peered":"2024-04-26T10:34:01.436499+0000","last_unstale":"2024-04-26T10:34:06.472722+0000","last_undegraded":"2024-04-26T10:34:06.472722+0000","last_fullsized":"2024-04-26T10:34:06.472722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:28.355388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.471801+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:34:06.471801+0000","last_peered":"2024-04-26T10:34:06.471801+0000","last_clean":"2024-04-26T10:34:06.471801+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:34:06.471801+0000","last_undegraded":"2024-04-26T10:34:06.471801+0000","last_fullsized":"2024-04-26T10:34:06.471801+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474373+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:34:06.474373+0000","last_peered":"2024-04-26T10:34:06.474373+0000","last_clean":"2024-04-26T10:34:06.474373+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:34:06.474373+0000","last_undegraded":"2024-04-26T10:34:06.474373+0000","last_fullsized":"2024-04-26T10:34:06.474373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.472583+0000","last_change":"2024-04-26T10:34:01.437670+0000","last_active":"2024-04-26T10:34:06.472583+0000","last_peered":"2024-04-26T10:34:06.472583+0000","last_clean":"2024-04-26T10:34:06.472583+0000","last_became_active":"2024-04-26T10:34:01.437383+0000","last_became_peered":"2024-04-26T10:34:01.437383+0000","last_unstale":"2024-04-26T10:34:06.472583+0000","last_undegraded":"2024-04-26T10:34:06.472583+0000","last_fullsized":"2024-04-26T10:34:06.472583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:25.108114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469806+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:34:06.469806+0000","last_peered":"2024-04-26T10:34:06.469806+0000","last_clean":"2024-04-26T10:34:06.469806+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:34:06.469806+0000","last_undegraded":"2024-04-26T10:34:06.469806+0000","last_fullsized":"2024-04-26T10:34:06.469806+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.475105+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:34:06.475105+0000","last_peered":"2024-04-26T10:34:06.475105+0000","last_clean":"2024-04-26T10:34:06.475105+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:34:06.475105+0000","last_undegraded":"2024-04-26T10:34:06.475105+0000","last_fullsized":"2024-04-26T10:34:06.475105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469597+0000","last_change":"2024-04-26T10:34:01.449793+0000","last_active":"2024-04-26T10:34:06.469597+0000","last_peered":"2024-04-26T10:34:06.469597+0000","last_clean":"2024-04-26T10:34:06.469597+0000","last_became_active":"2024-04-26T10:34:01.433323+0000","last_became_peered":"2024-04-26T10:34:01.433323+0000","last_unstale":"2024-04-26T10:34:06.469597+0000","last_undegraded":"2024-04-26T10:34:06.469597+0000","last_fullsized":"2024-04-26T10:34:06.469597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:35.651791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474315+0000","last_change":"2024-04-26T10:34:01.438424+0000","last_active":"2024-04-26T10:34:06.474315+0000","last_peered":"2024-04-26T10:34:06.474315+0000","last_clean":"2024-04-26T10:34:06.474315+0000","last_became_active":"2024-04-26T10:34:01.437188+0000","last_became_peered":"2024-04-26T10:34:01.437188+0000","last_unstale":"2024-04-26T10:34:06.474315+0000","last_undegraded":"2024-04-26T10:34:06.474315+0000","last_fullsized":"2024-04-26T10:34:06.474315+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:44.273603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":59,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469501+0000","last_change":"2024-04-26T10:34:01.455880+0000","last_active":"2024-04-26T10:34:06.469501+0000","last_peered":"2024-04-26T10:34:06.469501+0000","last_clean":"2024-04-26T10:34:06.469501+0000","last_became_active":"2024-04-26T10:34:01.434157+0000","last_became_peered":"2024-04-26T10:34:01.434157+0000","last_unstale":"2024-04-26T10:34:06.469501+0000","last_undegraded":"2024-04-26T10:34:06.469501+0000","last_fullsized":"2024-04-26T10:34:06.469501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:42.836464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469402+0000","last_change":"2024-04-26T10:34:01.438160+0000","last_active":"2024-04-26T10:34:06.469402+0000","last_peered":"2024-04-26T10:34:06.469402+0000","last_clean":"2024-04-26T10:34:06.469402+0000","last_became_active":"2024-04-26T10:34:01.437781+0000","last_became_peered":"2024-04-26T10:34:01.437781+0000","last_unstale":"2024-04-26T10:34:06.469402+0000","last_undegraded":"2024-04-26T10:34:06.469402+0000","last_fullsized":"2024-04-26T10:34:06.469402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:28.151883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468160+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:34:06.468160+0000","last_peered":"2024-04-26T10:34:06.468160+0000","last_clean":"2024-04-26T10:34:06.468160+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:34:06.468160+0000","last_undegraded":"2024-04-26T10:34:06.468160+0000","last_fullsized":"2024-04-26T10:34:06.468160+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473212+0000","last_change":"2024-04-26T10:34:01.438955+0000","last_active":"2024-04-26T10:34:06.473212+0000","last_peered":"2024-04-26T10:34:06.473212+0000","last_clean":"2024-04-26T10:34:06.473212+0000","last_became_active":"2024-04-26T10:34:01.438690+0000","last_became_peered":"2024-04-26T10:34:01.438690+0000","last_unstale":"2024-04-26T10:34:06.473212+0000","last_undegraded":"2024-04-26T10:34:06.473212+0000","last_fullsized":"2024-04-26T10:34:06.473212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:33.103721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474429+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:34:06.474429+0000","last_peered":"2024-04-26T10:34:06.474429+0000","last_clean":"2024-04-26T10:34:06.474429+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:34:06.474429+0000","last_undegraded":"2024-04-26T10:34:06.474429+0000","last_fullsized":"2024-04-26T10:34:06.474429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473714+0000","last_change":"2024-04-26T10:34:01.436881+0000","last_active":"2024-04-26T10:34:06.473714+0000","last_peered":"2024-04-26T10:34:06.473714+0000","last_clean":"2024-04-26T10:34:06.473714+0000","last_became_active":"2024-04-26T10:34:01.436660+0000","last_became_peered":"2024-04-26T10:34:01.436660+0000","last_unstale":"2024-04-26T10:34:06.473714+0000","last_undegraded":"2024-04-26T10:34:06.473714+0000","last_fullsized":"2024-04-26T10:34:06.473714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:33.793931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470131+0000","last_change":"2024-04-26T10:34:01.434589+0000","last_active":"2024-04-26T10:34:06.470131+0000","last_peered":"2024-04-26T10:34:06.470131+0000","last_clean":"2024-04-26T10:34:06.470131+0000","last_became_active":"2024-04-26T10:34:01.434300+0000","last_became_peered":"2024-04-26T10:34:01.434300+0000","last_unstale":"2024-04-26T10:34:06.470131+0000","last_undegraded":"2024-04-26T10:34:06.470131+0000","last_fullsized":"2024-04-26T10:34:06.470131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:11.525948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473573+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:34:06.473573+0000","last_peered":"2024-04-26T10:34:06.473573+0000","last_clean":"2024-04-26T10:34:06.473573+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:34:06.473573+0000","last_undegraded":"2024-04-26T10:34:06.473573+0000","last_fullsized":"2024-04-26T10:34:06.473573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":61,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467669+0000","last_change":"2024-04-26T10:34:01.446048+0000","last_active":"2024-04-26T10:34:06.467669+0000","last_peered":"2024-04-26T10:34:06.467669+0000","last_clean":"2024-04-26T10:34:06.467669+0000","last_became_active":"2024-04-26T10:34:01.433327+0000","last_became_peered":"2024-04-26T10:34:01.433327+0000","last_unstale":"2024-04-26T10:34:06.467669+0000","last_undegraded":"2024-04-26T10:34:06.467669+0000","last_fullsized":"2024-04-26T10:34:06.467669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:20.809240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474576+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:34:06.474576+0000","last_peered":"2024-04-26T10:34:06.474576+0000","last_clean":"2024-04-26T10:34:06.474576+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:34:06.474576+0000","last_undegraded":"2024-04-26T10:34:06.474576+0000","last_fullsized":"2024-04-26T10:34:06.474576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"39'7719","reported_seq":9859,"reported_epoch":39,"state":"active+remapped+backfilling","last_fresh":"2024-04-26T10:34:10.040578+0000","last_change":"2024-04-26T10:34:02.505526+0000","last_active":"2024-04-26T10:34:10.040578+0000","last_peered":"2024-04-26T10:34:10.040578+0000","last_clean":"2024-04-26T10:34:00.436967+0000","last_became_active":"2024-04-26T10:34:02.488513+0000","last_became_peered":"2024-04-26T10:34:02.488513+0000","last_unstale":"2024-04-26T10:34:10.040578+0000","last_undegraded":"2024-04-26T10:34:10.040578+0000","last_fullsized":"2024-04-26T10:34:10.040578+0000","mapping_epoch":34,"log_start":"28'4791","ondisk_log_start":"28'4791","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2928,"log_dups_size":1042,"ondisk_log_size":2928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:58.343363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505872384,"num_objects":7719,"num_object_clones":0,"num_object_copies":15438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":6578,"num_objects_unfound":0,"num_objects_dirty":7719,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7719,"num_write_kb":494016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1051,"num_bytes_recovered":68878336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":7719}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470743+0000","last_change":"2024-04-26T10:34:01.457740+0000","last_active":"2024-04-26T10:34:06.470743+0000","last_peered":"2024-04-26T10:34:06.470743+0000","last_clean":"2024-04-26T10:34:06.470743+0000","last_became_active":"2024-04-26T10:34:01.438142+0000","last_became_peered":"2024-04-26T10:34:01.438142+0000","last_unstale":"2024-04-26T10:34:06.470743+0000","last_undegraded":"2024-04-26T10:34:06.470743+0000","last_fullsized":"2024-04-26T10:34:06.470743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:08.178851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473277+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:34:06.473277+0000","last_peered":"2024-04-26T10:34:06.473277+0000","last_clean":"2024-04-26T10:34:06.473277+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:34:06.473277+0000","last_undegraded":"2024-04-26T10:34:06.473277+0000","last_fullsized":"2024-04-26T10:34:06.473277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"39'7932","reported_seq":7963,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.015536+0000","last_change":"2024-04-26T10:33:16.346351+0000","last_active":"2024-04-26T10:34:10.015536+0000","last_peered":"2024-04-26T10:34:10.015536+0000","last_clean":"2024-04-26T10:34:10.015536+0000","last_became_active":"2024-04-26T10:33:16.346122+0000","last_became_peered":"2024-04-26T10:33:16.346122+0000","last_unstale":"2024-04-26T10:34:10.015536+0000","last_undegraded":"2024-04-26T10:34:10.015536+0000","last_fullsized":"2024-04-26T10:34:10.015536+0000","mapping_epoch":16,"log_start":"23'2900","ondisk_log_start":"23'2900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":5032,"log_dups_size":0,"ondisk_log_size":5032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:13.714464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519831552,"num_objects":7932,"num_object_clones":0,"num_object_copies":15864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7932,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7932,"num_write_kb":507648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474723+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:34:06.474723+0000","last_peered":"2024-04-26T10:34:06.474723+0000","last_clean":"2024-04-26T10:34:06.474723+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:34:06.474723+0000","last_undegraded":"2024-04-26T10:34:06.474723+0000","last_fullsized":"2024-04-26T10:34:06.474723+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473137+0000","last_change":"2024-04-26T10:34:01.438592+0000","last_active":"2024-04-26T10:34:06.473137+0000","last_peered":"2024-04-26T10:34:06.473137+0000","last_clean":"2024-04-26T10:34:06.473137+0000","last_became_active":"2024-04-26T10:34:01.437548+0000","last_became_peered":"2024-04-26T10:34:01.437548+0000","last_unstale":"2024-04-26T10:34:06.473137+0000","last_undegraded":"2024-04-26T10:34:06.473137+0000","last_fullsized":"2024-04-26T10:34:06.473137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:43.841694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"39'7762","reported_seq":10087,"reported_epoch":39,"state":"active+remapped+backfilling","last_fresh":"2024-04-26T10:34:10.062851+0000","last_change":"2024-04-26T10:34:02.530126+0000","last_active":"2024-04-26T10:34:10.062851+0000","last_peered":"2024-04-26T10:34:10.062851+0000","last_clean":"2024-04-26T10:34:00.443121+0000","last_became_active":"2024-04-26T10:34:02.510251+0000","last_became_peered":"2024-04-26T10:34:02.510251+0000","last_unstale":"2024-04-26T10:34:10.062851+0000","last_undegraded":"2024-04-26T10:34:10.062851+0000","last_fullsized":"2024-04-26T10:34:10.062851+0000","mapping_epoch":34,"log_start":"28'4864","ondisk_log_start":"28'4864","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":1042,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:04.366202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":508690432,"num_objects":7762,"num_object_clones":0,"num_object_copies":15524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":6533,"num_objects_unfound":0,"num_objects_dirty":7762,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7762,"num_write_kb":496768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1143,"num_bytes_recovered":74907648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7762}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470176+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:34:06.470176+0000","last_peered":"2024-04-26T10:34:06.470176+0000","last_clean":"2024-04-26T10:34:06.470176+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:34:06.470176+0000","last_undegraded":"2024-04-26T10:34:06.470176+0000","last_fullsized":"2024-04-26T10:34:06.470176+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468162+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:34:06.468162+0000","last_peered":"2024-04-26T10:34:06.468162+0000","last_clean":"2024-04-26T10:34:06.468162+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:34:06.468162+0000","last_undegraded":"2024-04-26T10:34:06.468162+0000","last_fullsized":"2024-04-26T10:34:06.468162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"39'7802","reported_seq":7833,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.025399+0000","last_change":"2024-04-26T10:33:16.346212+0000","last_active":"2024-04-26T10:34:10.025399+0000","last_peered":"2024-04-26T10:34:10.025399+0000","last_clean":"2024-04-26T10:34:10.025399+0000","last_became_active":"2024-04-26T10:33:16.346004+0000","last_became_peered":"2024-04-26T10:33:16.346004+0000","last_unstale":"2024-04-26T10:34:10.025399+0000","last_undegraded":"2024-04-26T10:34:10.025399+0000","last_fullsized":"2024-04-26T10:34:10.025399+0000","mapping_epoch":16,"log_start":"28'4854","ondisk_log_start":"28'4854","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2948,"log_dups_size":1042,"ondisk_log_size":2948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:27.495754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":511311872,"num_objects":7802,"num_object_clones":0,"num_object_copies":15604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7802,"num_write_kb":499328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469261+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:34:06.469261+0000","last_peered":"2024-04-26T10:34:06.469261+0000","last_clean":"2024-04-26T10:34:06.469261+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:34:06.469261+0000","last_undegraded":"2024-04-26T10:34:06.469261+0000","last_fullsized":"2024-04-26T10:34:06.469261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.475758+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:34:06.475758+0000","last_peered":"2024-04-26T10:34:06.475758+0000","last_clean":"2024-04-26T10:34:06.475758+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:34:06.475758+0000","last_undegraded":"2024-04-26T10:34:06.475758+0000","last_fullsized":"2024-04-26T10:34:06.475758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"39'7673","reported_seq":7711,"reported_epoch":39,"state":"active+remapped+backfill_wait","last_fresh":"2024-04-26T10:34:09.998655+0000","last_change":"2024-04-26T10:34:02.510073+0000","last_active":"2024-04-26T10:34:09.998655+0000","last_peered":"2024-04-26T10:34:09.998655+0000","last_clean":"2024-04-26T10:34:00.445985+0000","last_became_active":"2024-04-26T10:34:02.502550+0000","last_became_peered":"2024-04-26T10:34:02.502550+0000","last_unstale":"2024-04-26T10:34:09.998655+0000","last_undegraded":"2024-04-26T10:34:09.998655+0000","last_fullsized":"2024-04-26T10:34:09.998655+0000","mapping_epoch":34,"log_start":"28'4772","ondisk_log_start":"28'4772","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2901,"log_dups_size":1042,"ondisk_log_size":2901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.146925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502857728,"num_objects":7673,"num_object_clones":0,"num_object_copies":15346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":7673,"num_objects_unfound":0,"num_objects_dirty":7673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7673,"num_write_kb":491072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":7673}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.475674+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:34:06.475674+0000","last_peered":"2024-04-26T10:34:06.475674+0000","last_clean":"2024-04-26T10:34:06.475674+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:34:06.475674+0000","last_undegraded":"2024-04-26T10:34:06.475674+0000","last_fullsized":"2024-04-26T10:34:06.475674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469291+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:34:06.469291+0000","last_peered":"2024-04-26T10:34:06.469291+0000","last_clean":"2024-04-26T10:34:06.469291+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:34:06.469291+0000","last_undegraded":"2024-04-26T10:34:06.469291+0000","last_fullsized":"2024-04-26T10:34:06.469291+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"39'7717","reported_seq":7747,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.037081+0000","last_change":"2024-04-26T10:33:16.349242+0000","last_active":"2024-04-26T10:34:10.037081+0000","last_peered":"2024-04-26T10:34:10.037081+0000","last_clean":"2024-04-26T10:34:10.037081+0000","last_became_active":"2024-04-26T10:33:16.349063+0000","last_became_peered":"2024-04-26T10:33:16.349063+0000","last_unstale":"2024-04-26T10:34:10.037081+0000","last_undegraded":"2024-04-26T10:34:10.037081+0000","last_fullsized":"2024-04-26T10:34:10.037081+0000","mapping_epoch":16,"log_start":"28'4762","ondisk_log_start":"28'4762","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2955,"log_dups_size":1042,"ondisk_log_size":2955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:09.297624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505741312,"num_objects":7717,"num_object_clones":0,"num_object_copies":15434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7717,"num_write_kb":493888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468013+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:34:06.468013+0000","last_peered":"2024-04-26T10:34:06.468013+0000","last_clean":"2024-04-26T10:34:06.468013+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:34:06.468013+0000","last_undegraded":"2024-04-26T10:34:06.468013+0000","last_fullsized":"2024-04-26T10:34:06.468013+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470106+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:34:06.470106+0000","last_peered":"2024-04-26T10:34:06.470106+0000","last_clean":"2024-04-26T10:34:06.470106+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:34:06.470106+0000","last_undegraded":"2024-04-26T10:34:06.470106+0000","last_fullsized":"2024-04-26T10:34:06.470106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"39'7453","reported_seq":7490,"reported_epoch":39,"state":"active+remapped+backfill_wait","last_fresh":"2024-04-26T10:34:10.006518+0000","last_change":"2024-04-26T10:34:02.498534+0000","last_active":"2024-04-26T10:34:10.006518+0000","last_peered":"2024-04-26T10:34:10.006518+0000","last_clean":"2024-04-26T10:34:00.444805+0000","last_became_active":"2024-04-26T10:34:02.494740+0000","last_became_peered":"2024-04-26T10:34:02.494740+0000","last_unstale":"2024-04-26T10:34:10.006518+0000","last_undegraded":"2024-04-26T10:34:10.006518+0000","last_fullsized":"2024-04-26T10:34:10.006518+0000","mapping_epoch":34,"log_start":"27'4505","ondisk_log_start":"27'4505","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2948,"log_dups_size":942,"ondisk_log_size":2948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:31.620362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":488439808,"num_objects":7453,"num_object_clones":0,"num_object_copies":14906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":7453,"num_objects_unfound":0,"num_objects_dirty":7453,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7453,"num_write_kb":476992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":7453}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470456+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:34:06.470456+0000","last_peered":"2024-04-26T10:34:06.470456+0000","last_clean":"2024-04-26T10:34:06.470456+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:34:06.470456+0000","last_undegraded":"2024-04-26T10:34:06.470456+0000","last_fullsized":"2024-04-26T10:34:06.470456+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469853+0000","last_change":"2024-04-26T10:34:01.433646+0000","last_active":"2024-04-26T10:34:06.469853+0000","last_peered":"2024-04-26T10:34:06.469853+0000","last_clean":"2024-04-26T10:34:06.469853+0000","last_became_active":"2024-04-26T10:34:01.433183+0000","last_became_peered":"2024-04-26T10:34:01.433183+0000","last_unstale":"2024-04-26T10:34:06.469853+0000","last_undegraded":"2024-04-26T10:34:06.469853+0000","last_fullsized":"2024-04-26T10:34:06.469853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:39.230972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"39'7629","reported_seq":7660,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.039687+0000","last_change":"2024-04-26T10:33:16.344866+0000","last_active":"2024-04-26T10:34:10.039687+0000","last_peered":"2024-04-26T10:34:10.039687+0000","last_clean":"2024-04-26T10:34:10.039687+0000","last_became_active":"2024-04-26T10:33:16.344614+0000","last_became_peered":"2024-04-26T10:33:16.344614+0000","last_unstale":"2024-04-26T10:34:10.039687+0000","last_undegraded":"2024-04-26T10:34:10.039687+0000","last_fullsized":"2024-04-26T10:34:10.039687+0000","mapping_epoch":16,"log_start":"23'2700","ondisk_log_start":"23'2700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":4929,"log_dups_size":0,"ondisk_log_size":4929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":499974144,"num_objects":7629,"num_object_clones":0,"num_object_copies":15258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7629,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7629,"num_write_kb":488256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.472640+0000","last_change":"2024-04-26T10:34:01.435538+0000","last_active":"2024-04-26T10:34:06.472640+0000","last_peered":"2024-04-26T10:34:06.472640+0000","last_clean":"2024-04-26T10:34:06.472640+0000","last_became_active":"2024-04-26T10:34:01.435184+0000","last_became_peered":"2024-04-26T10:34:01.435184+0000","last_unstale":"2024-04-26T10:34:06.472640+0000","last_undegraded":"2024-04-26T10:34:06.472640+0000","last_fullsized":"2024-04-26T10:34:06.472640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:35.066804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474189+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:34:06.474189+0000","last_peered":"2024-04-26T10:34:06.474189+0000","last_clean":"2024-04-26T10:34:06.474189+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:34:06.474189+0000","last_undegraded":"2024-04-26T10:34:06.474189+0000","last_fullsized":"2024-04-26T10:34:06.474189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"39'7630","reported_seq":7661,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.042604+0000","last_change":"2024-04-26T10:33:16.349280+0000","last_active":"2024-04-26T10:34:10.042604+0000","last_peered":"2024-04-26T10:34:10.042604+0000","last_clean":"2024-04-26T10:34:10.042604+0000","last_became_active":"2024-04-26T10:33:16.349010+0000","last_became_peered":"2024-04-26T10:33:16.349010+0000","last_unstale":"2024-04-26T10:34:10.042604+0000","last_undegraded":"2024-04-26T10:34:10.042604+0000","last_fullsized":"2024-04-26T10:34:10.042604+0000","mapping_epoch":16,"log_start":"28'4771","ondisk_log_start":"28'4771","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2859,"log_dups_size":1042,"ondisk_log_size":2859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:08.933996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":500039680,"num_objects":7630,"num_object_clones":0,"num_object_copies":15260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7630,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7630,"num_write_kb":488320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473562+0000","last_change":"2024-04-26T10:34:01.438826+0000","last_active":"2024-04-26T10:34:06.473562+0000","last_peered":"2024-04-26T10:34:06.473562+0000","last_clean":"2024-04-26T10:34:06.473562+0000","last_became_active":"2024-04-26T10:34:01.437674+0000","last_became_peered":"2024-04-26T10:34:01.437674+0000","last_unstale":"2024-04-26T10:34:06.473562+0000","last_undegraded":"2024-04-26T10:34:06.473562+0000","last_fullsized":"2024-04-26T10:34:06.473562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:31:36.790687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469955+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:34:06.469955+0000","last_peered":"2024-04-26T10:34:06.469955+0000","last_clean":"2024-04-26T10:34:06.469955+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:34:06.469955+0000","last_undegraded":"2024-04-26T10:34:06.469955+0000","last_fullsized":"2024-04-26T10:34:06.469955+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467812+0000","last_change":"2024-04-26T10:34:01.434248+0000","last_active":"2024-04-26T10:34:06.467812+0000","last_peered":"2024-04-26T10:34:06.467812+0000","last_clean":"2024-04-26T10:34:06.467812+0000","last_became_active":"2024-04-26T10:34:01.433212+0000","last_became_peered":"2024-04-26T10:34:01.433212+0000","last_unstale":"2024-04-26T10:34:06.467812+0000","last_undegraded":"2024-04-26T10:34:06.467812+0000","last_fullsized":"2024-04-26T10:34:06.467812+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:32.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"39'7634","reported_seq":7663,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.051787+0000","last_change":"2024-04-26T10:33:16.349302+0000","last_active":"2024-04-26T10:34:10.051787+0000","last_peered":"2024-04-26T10:34:10.051787+0000","last_clean":"2024-04-26T10:34:10.051787+0000","last_became_active":"2024-04-26T10:33:16.348992+0000","last_became_peered":"2024-04-26T10:33:16.348992+0000","last_unstale":"2024-04-26T10:34:10.051787+0000","last_undegraded":"2024-04-26T10:34:10.051787+0000","last_fullsized":"2024-04-26T10:34:10.051787+0000","mapping_epoch":16,"log_start":"28'4757","ondisk_log_start":"28'4757","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":1042,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:15.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":500301824,"num_objects":7634,"num_object_clones":0,"num_object_copies":15268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7634,"num_write_kb":488576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468278+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:34:06.468278+0000","last_peered":"2024-04-26T10:34:06.468278+0000","last_clean":"2024-04-26T10:34:06.468278+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:34:06.468278+0000","last_undegraded":"2024-04-26T10:34:06.468278+0000","last_fullsized":"2024-04-26T10:34:06.468278+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468074+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:34:06.468074+0000","last_peered":"2024-04-26T10:34:06.468074+0000","last_clean":"2024-04-26T10:34:06.468074+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:34:06.468074+0000","last_undegraded":"2024-04-26T10:34:06.468074+0000","last_fullsized":"2024-04-26T10:34:06.468074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473362+0000","last_change":"2024-04-26T10:34:01.438928+0000","last_active":"2024-04-26T10:34:06.473362+0000","last_peered":"2024-04-26T10:34:06.473362+0000","last_clean":"2024-04-26T10:34:06.473362+0000","last_became_active":"2024-04-26T10:34:01.438525+0000","last_became_peered":"2024-04-26T10:34:01.438525+0000","last_unstale":"2024-04-26T10:34:06.473362+0000","last_undegraded":"2024-04-26T10:34:06.473362+0000","last_fullsized":"2024-04-26T10:34:06.473362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:48.805704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"39'7667","reported_seq":7698,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.051371+0000","last_change":"2024-04-26T10:33:16.349181+0000","last_active":"2024-04-26T10:34:10.051371+0000","last_peered":"2024-04-26T10:34:10.051371+0000","last_clean":"2024-04-26T10:34:10.051371+0000","last_became_active":"2024-04-26T10:33:16.348981+0000","last_became_peered":"2024-04-26T10:33:16.348981+0000","last_unstale":"2024-04-26T10:34:10.051371+0000","last_undegraded":"2024-04-26T10:34:10.051371+0000","last_fullsized":"2024-04-26T10:34:10.051371+0000","mapping_epoch":16,"log_start":"28'4784","ondisk_log_start":"28'4784","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2883,"log_dups_size":1042,"ondisk_log_size":2883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502464512,"num_objects":7667,"num_object_clones":0,"num_object_copies":15334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7667,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7667,"num_write_kb":490688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473803+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:34:06.473803+0000","last_peered":"2024-04-26T10:34:06.473803+0000","last_clean":"2024-04-26T10:34:06.473803+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:34:06.473803+0000","last_undegraded":"2024-04-26T10:34:06.473803+0000","last_fullsized":"2024-04-26T10:34:06.473803+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473287+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:34:06.473287+0000","last_peered":"2024-04-26T10:34:06.473287+0000","last_clean":"2024-04-26T10:34:06.473287+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:34:06.473287+0000","last_undegraded":"2024-04-26T10:34:06.473287+0000","last_fullsized":"2024-04-26T10:34:06.473287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474457+0000","last_change":"2024-04-26T10:34:01.438811+0000","last_active":"2024-04-26T10:34:06.474457+0000","last_peered":"2024-04-26T10:34:06.474457+0000","last_clean":"2024-04-26T10:34:06.474457+0000","last_became_active":"2024-04-26T10:34:01.437959+0000","last_became_peered":"2024-04-26T10:34:01.437959+0000","last_unstale":"2024-04-26T10:34:06.474457+0000","last_undegraded":"2024-04-26T10:34:06.474457+0000","last_fullsized":"2024-04-26T10:34:06.474457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"39'7673","reported_seq":7711,"reported_epoch":39,"state":"active+remapped+backfill_wait","last_fresh":"2024-04-26T10:34:10.061495+0000","last_change":"2024-04-26T10:34:02.527660+0000","last_active":"2024-04-26T10:34:10.061495+0000","last_peered":"2024-04-26T10:34:10.061495+0000","last_clean":"2024-04-26T10:34:00.447964+0000","last_became_active":"2024-04-26T10:34:02.523429+0000","last_became_peered":"2024-04-26T10:34:02.523429+0000","last_unstale":"2024-04-26T10:34:10.061495+0000","last_undegraded":"2024-04-26T10:34:10.061495+0000","last_fullsized":"2024-04-26T10:34:10.061495+0000","mapping_epoch":34,"log_start":"28'4757","ondisk_log_start":"28'4757","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":1042,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:17.628574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502857728,"num_objects":7673,"num_object_clones":0,"num_object_copies":15346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":7673,"num_objects_unfound":0,"num_objects_dirty":7673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7673,"num_write_kb":491072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7673}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467990+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:34:06.467990+0000","last_peered":"2024-04-26T10:34:06.467990+0000","last_clean":"2024-04-26T10:34:06.467990+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:34:06.467990+0000","last_undegraded":"2024-04-26T10:34:06.467990+0000","last_fullsized":"2024-04-26T10:34:06.467990+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":255,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467546+0000","last_change":"2024-04-26T10:34:04.467960+0000","last_active":"2024-04-26T10:34:06.467546+0000","last_peered":"2024-04-26T10:34:06.467546+0000","last_clean":"2024-04-26T10:34:06.467546+0000","last_became_active":"2024-04-26T10:34:04.467654+0000","last_became_peered":"2024-04-26T10:34:04.467654+0000","last_unstale":"2024-04-26T10:34:06.467546+0000","last_undegraded":"2024-04-26T10:34:06.467546+0000","last_fullsized":"2024-04-26T10:34:06.467546+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:22.456223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474285+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:34:06.474285+0000","last_peered":"2024-04-26T10:34:06.474285+0000","last_clean":"2024-04-26T10:34:06.474285+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:34:06.474285+0000","last_undegraded":"2024-04-26T10:34:06.474285+0000","last_fullsized":"2024-04-26T10:34:06.474285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470031+0000","last_change":"2024-04-26T10:34:01.433570+0000","last_active":"2024-04-26T10:34:06.470031+0000","last_peered":"2024-04-26T10:34:06.470031+0000","last_clean":"2024-04-26T10:34:06.470031+0000","last_became_active":"2024-04-26T10:34:01.433207+0000","last_became_peered":"2024-04-26T10:34:01.433207+0000","last_unstale":"2024-04-26T10:34:06.470031+0000","last_undegraded":"2024-04-26T10:34:06.470031+0000","last_fullsized":"2024-04-26T10:34:06.470031+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:46.417850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"39'7634","reported_seq":7665,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.026116+0000","last_change":"2024-04-26T10:33:16.344693+0000","last_active":"2024-04-26T10:34:10.026116+0000","last_peered":"2024-04-26T10:34:10.026116+0000","last_clean":"2024-04-26T10:34:10.026116+0000","last_became_active":"2024-04-26T10:33:16.344478+0000","last_became_peered":"2024-04-26T10:33:16.344478+0000","last_unstale":"2024-04-26T10:34:10.026116+0000","last_undegraded":"2024-04-26T10:34:10.026116+0000","last_fullsized":"2024-04-26T10:34:10.026116+0000","mapping_epoch":16,"log_start":"28'4733","ondisk_log_start":"28'4733","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2901,"log_dups_size":1042,"ondisk_log_size":2901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:24.298876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":500301824,"num_objects":7634,"num_object_clones":0,"num_object_copies":15268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7634,"num_write_kb":488576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467524+0000","last_change":"2024-04-26T10:34:01.433538+0000","last_active":"2024-04-26T10:34:06.467524+0000","last_peered":"2024-04-26T10:34:06.467524+0000","last_clean":"2024-04-26T10:34:06.467524+0000","last_became_active":"2024-04-26T10:34:01.432838+0000","last_became_peered":"2024-04-26T10:34:01.432838+0000","last_unstale":"2024-04-26T10:34:06.467524+0000","last_undegraded":"2024-04-26T10:34:06.467524+0000","last_fullsized":"2024-04-26T10:34:06.467524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:49.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473215+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:34:06.473215+0000","last_peered":"2024-04-26T10:34:06.473215+0000","last_clean":"2024-04-26T10:34:06.473215+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:34:06.473215+0000","last_undegraded":"2024-04-26T10:34:06.473215+0000","last_fullsized":"2024-04-26T10:34:06.473215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474804+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:34:06.474804+0000","last_peered":"2024-04-26T10:34:06.474804+0000","last_clean":"2024-04-26T10:34:06.474804+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:34:06.474804+0000","last_undegraded":"2024-04-26T10:34:06.474804+0000","last_fullsized":"2024-04-26T10:34:06.474804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"39'7768","reported_seq":7799,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.021502+0000","last_change":"2024-04-26T10:33:16.344694+0000","last_active":"2024-04-26T10:34:10.021502+0000","last_peered":"2024-04-26T10:34:10.021502+0000","last_clean":"2024-04-26T10:34:10.021502+0000","last_became_active":"2024-04-26T10:33:16.344461+0000","last_became_peered":"2024-04-26T10:33:16.344461+0000","last_unstale":"2024-04-26T10:34:10.021502+0000","last_undegraded":"2024-04-26T10:34:10.021502+0000","last_fullsized":"2024-04-26T10:34:10.021502+0000","mapping_epoch":16,"log_start":"28'4884","ondisk_log_start":"28'4884","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":1042,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:29.374096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":509083648,"num_objects":7768,"num_object_clones":0,"num_object_copies":15536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7768,"num_write_kb":497152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473547+0000","last_change":"2024-04-26T10:34:01.438747+0000","last_active":"2024-04-26T10:34:06.473547+0000","last_peered":"2024-04-26T10:34:06.473547+0000","last_clean":"2024-04-26T10:34:06.473547+0000","last_became_active":"2024-04-26T10:34:01.438453+0000","last_became_peered":"2024-04-26T10:34:01.438453+0000","last_unstale":"2024-04-26T10:34:06.473547+0000","last_undegraded":"2024-04-26T10:34:06.473547+0000","last_fullsized":"2024-04-26T10:34:06.473547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.424650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473707+0000","last_change":"2024-04-26T10:34:01.437984+0000","last_active":"2024-04-26T10:34:06.473707+0000","last_peered":"2024-04-26T10:34:06.473707+0000","last_clean":"2024-04-26T10:34:06.473707+0000","last_became_active":"2024-04-26T10:34:01.437279+0000","last_became_peered":"2024-04-26T10:34:01.437279+0000","last_unstale":"2024-04-26T10:34:06.473707+0000","last_undegraded":"2024-04-26T10:34:06.473707+0000","last_fullsized":"2024-04-26T10:34:06.473707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:15.132837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473199+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:34:06.473199+0000","last_peered":"2024-04-26T10:34:06.473199+0000","last_clean":"2024-04-26T10:34:06.473199+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:34:06.473199+0000","last_undegraded":"2024-04-26T10:34:06.473199+0000","last_fullsized":"2024-04-26T10:34:06.473199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'7747","reported_seq":7778,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.023510+0000","last_change":"2024-04-26T10:33:16.344714+0000","last_active":"2024-04-26T10:34:10.023510+0000","last_peered":"2024-04-26T10:34:10.023510+0000","last_clean":"2024-04-26T10:34:10.023510+0000","last_became_active":"2024-04-26T10:33:16.344500+0000","last_became_peered":"2024-04-26T10:33:16.344500+0000","last_unstale":"2024-04-26T10:34:10.023510+0000","last_undegraded":"2024-04-26T10:34:10.023510+0000","last_fullsized":"2024-04-26T10:34:10.023510+0000","mapping_epoch":16,"log_start":"28'4835","ondisk_log_start":"28'4835","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2912,"log_dups_size":1042,"ondisk_log_size":2912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:19.056484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":507707392,"num_objects":7747,"num_object_clones":0,"num_object_copies":15494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7747,"num_write_kb":495808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474111+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:34:06.474111+0000","last_peered":"2024-04-26T10:34:06.474111+0000","last_clean":"2024-04-26T10:34:06.474111+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:34:06.474111+0000","last_undegraded":"2024-04-26T10:34:06.474111+0000","last_fullsized":"2024-04-26T10:34:06.474111+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473738+0000","last_change":"2024-04-26T10:34:01.436635+0000","last_active":"2024-04-26T10:34:06.473738+0000","last_peered":"2024-04-26T10:34:06.473738+0000","last_clean":"2024-04-26T10:34:06.473738+0000","last_became_active":"2024-04-26T10:34:01.436416+0000","last_became_peered":"2024-04-26T10:34:01.436416+0000","last_unstale":"2024-04-26T10:34:06.473738+0000","last_undegraded":"2024-04-26T10:34:06.473738+0000","last_fullsized":"2024-04-26T10:34:06.473738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.472568+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:34:06.472568+0000","last_peered":"2024-04-26T10:34:06.472568+0000","last_clean":"2024-04-26T10:34:06.472568+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:34:06.472568+0000","last_undegraded":"2024-04-26T10:34:06.472568+0000","last_fullsized":"2024-04-26T10:34:06.472568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"39'7689","reported_seq":7725,"reported_epoch":39,"state":"active+remapped+backfill_wait","last_fresh":"2024-04-26T10:34:10.060403+0000","last_change":"2024-04-26T10:34:02.534330+0000","last_active":"2024-04-26T10:34:10.060403+0000","last_peered":"2024-04-26T10:34:10.060403+0000","last_clean":"2024-04-26T10:34:00.424582+0000","last_became_active":"2024-04-26T10:34:02.519692+0000","last_became_peered":"2024-04-26T10:34:02.519692+0000","last_unstale":"2024-04-26T10:34:10.060403+0000","last_undegraded":"2024-04-26T10:34:10.060403+0000","last_fullsized":"2024-04-26T10:34:10.060403+0000","mapping_epoch":34,"log_start":"27'4788","ondisk_log_start":"27'4788","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2901,"log_dups_size":1042,"ondisk_log_size":2901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:31.615511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503906304,"num_objects":7689,"num_object_clones":0,"num_object_copies":15378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":7689,"num_objects_unfound":0,"num_objects_dirty":7689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7689,"num_write_kb":492096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7689}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470738+0000","last_change":"2024-04-26T10:34:01.438292+0000","last_active":"2024-04-26T10:34:06.470738+0000","last_peered":"2024-04-26T10:34:06.470738+0000","last_clean":"2024-04-26T10:34:06.470738+0000","last_became_active":"2024-04-26T10:34:01.437950+0000","last_became_peered":"2024-04-26T10:34:01.437950+0000","last_unstale":"2024-04-26T10:34:06.470738+0000","last_undegraded":"2024-04-26T10:34:06.470738+0000","last_fullsized":"2024-04-26T10:34:06.470738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:07:19.699072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473574+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:34:06.473574+0000","last_peered":"2024-04-26T10:34:06.473574+0000","last_clean":"2024-04-26T10:34:06.473574+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:34:06.473574+0000","last_undegraded":"2024-04-26T10:34:06.473574+0000","last_fullsized":"2024-04-26T10:34:06.473574+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470190+0000","last_change":"2024-04-26T10:34:01.437884+0000","last_active":"2024-04-26T10:34:06.470190+0000","last_peered":"2024-04-26T10:34:06.470190+0000","last_clean":"2024-04-26T10:34:06.470190+0000","last_became_active":"2024-04-26T10:34:01.437546+0000","last_became_peered":"2024-04-26T10:34:01.437546+0000","last_unstale":"2024-04-26T10:34:06.470190+0000","last_undegraded":"2024-04-26T10:34:06.470190+0000","last_fullsized":"2024-04-26T10:34:06.470190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:22.876994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467678+0000","last_change":"2024-04-26T10:34:01.434244+0000","last_active":"2024-04-26T10:34:06.467678+0000","last_peered":"2024-04-26T10:34:06.467678+0000","last_clean":"2024-04-26T10:34:06.467678+0000","last_became_active":"2024-04-26T10:34:01.433509+0000","last_became_peered":"2024-04-26T10:34:01.433509+0000","last_unstale":"2024-04-26T10:34:06.467678+0000","last_undegraded":"2024-04-26T10:34:06.467678+0000","last_fullsized":"2024-04-26T10:34:06.467678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:43.070883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473289+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:34:06.473289+0000","last_peered":"2024-04-26T10:34:06.473289+0000","last_clean":"2024-04-26T10:34:06.473289+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:34:06.473289+0000","last_undegraded":"2024-04-26T10:34:06.473289+0000","last_fullsized":"2024-04-26T10:34:06.473289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469622+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:34:06.469622+0000","last_peered":"2024-04-26T10:34:06.469622+0000","last_clean":"2024-04-26T10:34:06.469622+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:34:06.469622+0000","last_undegraded":"2024-04-26T10:34:06.469622+0000","last_fullsized":"2024-04-26T10:34:06.469622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467916+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:34:06.467916+0000","last_peered":"2024-04-26T10:34:06.467916+0000","last_clean":"2024-04-26T10:34:06.467916+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:34:06.467916+0000","last_undegraded":"2024-04-26T10:34:06.467916+0000","last_fullsized":"2024-04-26T10:34:06.467916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470664+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:34:06.470664+0000","last_peered":"2024-04-26T10:34:06.470664+0000","last_clean":"2024-04-26T10:34:06.470664+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:34:06.470664+0000","last_undegraded":"2024-04-26T10:34:06.470664+0000","last_fullsized":"2024-04-26T10:34:06.470664+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468093+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:34:06.468093+0000","last_peered":"2024-04-26T10:34:06.468093+0000","last_clean":"2024-04-26T10:34:06.468093+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:34:06.468093+0000","last_undegraded":"2024-04-26T10:34:06.468093+0000","last_fullsized":"2024-04-26T10:34:06.468093+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473658+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:34:06.473658+0000","last_peered":"2024-04-26T10:34:06.473658+0000","last_clean":"2024-04-26T10:34:06.473658+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:34:06.473658+0000","last_undegraded":"2024-04-26T10:34:06.473658+0000","last_fullsized":"2024-04-26T10:34:06.473658+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473047+0000","last_change":"2024-04-26T10:34:01.438552+0000","last_active":"2024-04-26T10:34:06.473047+0000","last_peered":"2024-04-26T10:34:06.473047+0000","last_clean":"2024-04-26T10:34:06.473047+0000","last_became_active":"2024-04-26T10:34:01.437928+0000","last_became_peered":"2024-04-26T10:34:01.437928+0000","last_unstale":"2024-04-26T10:34:06.473047+0000","last_undegraded":"2024-04-26T10:34:06.473047+0000","last_fullsized":"2024-04-26T10:34:06.473047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.471062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474272+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:34:06.474272+0000","last_peered":"2024-04-26T10:34:06.474272+0000","last_clean":"2024-04-26T10:34:06.474272+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:34:06.474272+0000","last_undegraded":"2024-04-26T10:34:06.474272+0000","last_fullsized":"2024-04-26T10:34:06.474272+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467708+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:34:06.467708+0000","last_peered":"2024-04-26T10:34:06.467708+0000","last_clean":"2024-04-26T10:34:06.467708+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:34:06.467708+0000","last_undegraded":"2024-04-26T10:34:06.467708+0000","last_fullsized":"2024-04-26T10:34:06.467708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467577+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:34:06.467577+0000","last_peered":"2024-04-26T10:34:06.467577+0000","last_clean":"2024-04-26T10:34:06.467577+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:34:06.467577+0000","last_undegraded":"2024-04-26T10:34:06.467577+0000","last_fullsized":"2024-04-26T10:34:06.467577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473290+0000","last_change":"2024-04-26T10:34:01.435407+0000","last_active":"2024-04-26T10:34:06.473290+0000","last_peered":"2024-04-26T10:34:06.473290+0000","last_clean":"2024-04-26T10:34:06.473290+0000","last_became_active":"2024-04-26T10:34:01.435133+0000","last_became_peered":"2024-04-26T10:34:01.435133+0000","last_unstale":"2024-04-26T10:34:06.473290+0000","last_undegraded":"2024-04-26T10:34:06.473290+0000","last_fullsized":"2024-04-26T10:34:06.473290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:28.025621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.471025+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:34:06.471025+0000","last_peered":"2024-04-26T10:34:06.471025+0000","last_clean":"2024-04-26T10:34:06.471025+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:34:06.471025+0000","last_undegraded":"2024-04-26T10:34:06.471025+0000","last_fullsized":"2024-04-26T10:34:06.471025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.475858+0000","last_change":"2024-04-26T10:34:01.437899+0000","last_active":"2024-04-26T10:34:06.475858+0000","last_peered":"2024-04-26T10:34:06.475858+0000","last_clean":"2024-04-26T10:34:06.475858+0000","last_became_active":"2024-04-26T10:34:01.437206+0000","last_became_peered":"2024-04-26T10:34:01.437206+0000","last_unstale":"2024-04-26T10:34:06.475858+0000","last_undegraded":"2024-04-26T10:34:06.475858+0000","last_fullsized":"2024-04-26T10:34:06.475858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:14.764331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469215+0000","last_change":"2024-04-26T10:34:01.434154+0000","last_active":"2024-04-26T10:34:06.469215+0000","last_peered":"2024-04-26T10:34:06.469215+0000","last_clean":"2024-04-26T10:34:06.469215+0000","last_became_active":"2024-04-26T10:34:01.433673+0000","last_became_peered":"2024-04-26T10:34:01.433673+0000","last_unstale":"2024-04-26T10:34:06.469215+0000","last_undegraded":"2024-04-26T10:34:06.469215+0000","last_fullsized":"2024-04-26T10:34:06.469215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:39.444233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8069382144,"num_objects":123129,"num_object_clones":0,"num_object_copies":246258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":43599,"num_objects_unfound":0,"num_objects_dirty":123129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123129,"num_write_kb":7880256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2194,"num_bytes_recovered":143785984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16295395328,"data_stored":16295395328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50672,"ondisk_log_size":50672,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1676,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738388,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6702732,"kb_used_data":6487040,"kb_used_omap":1,"kb_used_meta":215678,"kb_avail":87669108,"statfs":{"total":96636764160,"available":89773166592,"internally_reserved":0,"allocated":6642728960,"data_stored":6642432296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220854726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,2,2,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.214}]},{"osd":1,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.33200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5048576,"kb_used_data":4905080,"kb_used_omap":1,"kb_used_meta":143486,"kb_avail":89323264,"statfs":{"total":96636764160,"available":91467022336,"internally_reserved":0,"allocated":5022801920,"data_stored":5022508767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146930118},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.16600000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.318}]}]},{"osd":1,"up_from":8,"seq":34359738387,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4506736,"kb_used_data":4399332,"kb_used_omap":1,"kb_used_meta":107390,"kb_avail":89865104,"statfs":{"total":96636764160,"available":92021866496,"internally_reserved":0,"allocated":4504915968,"data_stored":4504645210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109967814},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.25600000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.751},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.19900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5103157248,"data_stored":5103157248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4543479808,"data_stored":4543479808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6648758272,"data_stored":6648758272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:34:14.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:34:14.951 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:14.954 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:14.954 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:14.963 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:14.965 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:14.963+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:15.065 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:15.064+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:15.090 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:15.090 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:15.100 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:15.122 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:15.141 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:15.161 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:15.162 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:15.162 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:15.162 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:15.167 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:15.165+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:15.231 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:15.231 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:34:15.231 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-04-26T10:34:15.231 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:15.242 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:15.286 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:15.285+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:15.319 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:15.321 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:34:15.331 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-04-26T10:34:14.999647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8069974874,"num_objects":123153,"num_object_clones":0,"num_object_copies":246306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":43599,"num_objects_unfound":0,"num_objects_dirty":123153,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":123377,"num_write_kb":7883730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2207,"num_bytes_recovered":144378028,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50868,"ondisk_log_size":50868,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":248,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":16258044,"kb_used_data":15791452,"kb_used_omap":4,"kb_used_meta":466555,"kb_avail":266857476,"statfs":{"total":289910292480,"available":273262055424,"internally_reserved":0,"allocated":16170446848,"data_stored":16169586273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":477752658},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,8,3,4,5],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":655884288,"num_objects":10008,"num_object_clones":0,"num_object_copies":20016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2124,"num_objects_unfound":0,"num_objects_dirty":10008,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10008,"num_write_kb":640512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1455,"num_bytes_recovered":95354880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.513376"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473915+0000","last_change":"2024-04-26T10:34:01.438793+0000","last_active":"2024-04-26T10:34:06.473915+0000","last_peered":"2024-04-26T10:34:06.473915+0000","last_clean":"2024-04-26T10:34:06.473915+0000","last_became_active":"2024-04-26T10:34:01.437541+0000","last_became_peered":"2024-04-26T10:34:01.437541+0000","last_unstale":"2024-04-26T10:34:06.473915+0000","last_undegraded":"2024-04-26T10:34:06.473915+0000","last_fullsized":"2024-04-26T10:34:06.473915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:47.962795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474630+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:34:06.474630+0000","last_peered":"2024-04-26T10:34:06.474630+0000","last_clean":"2024-04-26T10:34:06.474630+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:34:06.474630+0000","last_undegraded":"2024-04-26T10:34:06.474630+0000","last_fullsized":"2024-04-26T10:34:06.474630+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469845+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:34:06.469845+0000","last_peered":"2024-04-26T10:34:06.469845+0000","last_clean":"2024-04-26T10:34:06.469845+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:34:06.469845+0000","last_undegraded":"2024-04-26T10:34:06.469845+0000","last_fullsized":"2024-04-26T10:34:06.469845+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469706+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:34:06.469706+0000","last_peered":"2024-04-26T10:34:06.469706+0000","last_clean":"2024-04-26T10:34:06.469706+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:34:06.469706+0000","last_undegraded":"2024-04-26T10:34:06.469706+0000","last_fullsized":"2024-04-26T10:34:06.469706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.475666+0000","last_change":"2024-04-26T10:34:01.438103+0000","last_active":"2024-04-26T10:34:06.475666+0000","last_peered":"2024-04-26T10:34:06.475666+0000","last_clean":"2024-04-26T10:34:06.475666+0000","last_became_active":"2024-04-26T10:34:01.437590+0000","last_became_peered":"2024-04-26T10:34:01.437590+0000","last_unstale":"2024-04-26T10:34:06.475666+0000","last_undegraded":"2024-04-26T10:34:06.475666+0000","last_fullsized":"2024-04-26T10:34:06.475666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:21.422420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467936+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:34:06.467936+0000","last_peered":"2024-04-26T10:34:06.467936+0000","last_clean":"2024-04-26T10:34:06.467936+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:34:06.467936+0000","last_undegraded":"2024-04-26T10:34:06.467936+0000","last_fullsized":"2024-04-26T10:34:06.467936+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470203+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:34:06.470203+0000","last_peered":"2024-04-26T10:34:06.470203+0000","last_clean":"2024-04-26T10:34:06.470203+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:34:06.470203+0000","last_undegraded":"2024-04-26T10:34:06.470203+0000","last_fullsized":"2024-04-26T10:34:06.470203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467442+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:34:06.467442+0000","last_peered":"2024-04-26T10:34:06.467442+0000","last_clean":"2024-04-26T10:34:06.467442+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:34:06.467442+0000","last_undegraded":"2024-04-26T10:34:06.467442+0000","last_fullsized":"2024-04-26T10:34:06.467442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473984+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:34:06.473984+0000","last_peered":"2024-04-26T10:34:06.473984+0000","last_clean":"2024-04-26T10:34:06.473984+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:34:06.473984+0000","last_undegraded":"2024-04-26T10:34:06.473984+0000","last_fullsized":"2024-04-26T10:34:06.473984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473304+0000","last_change":"2024-04-26T10:34:01.439560+0000","last_active":"2024-04-26T10:34:06.473304+0000","last_peered":"2024-04-26T10:34:06.473304+0000","last_clean":"2024-04-26T10:34:06.473304+0000","last_became_active":"2024-04-26T10:34:01.437810+0000","last_became_peered":"2024-04-26T10:34:01.437810+0000","last_unstale":"2024-04-26T10:34:06.473304+0000","last_undegraded":"2024-04-26T10:34:06.473304+0000","last_fullsized":"2024-04-26T10:34:06.473304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:32.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469747+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:34:06.469747+0000","last_peered":"2024-04-26T10:34:06.469747+0000","last_clean":"2024-04-26T10:34:06.469747+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:34:06.469747+0000","last_undegraded":"2024-04-26T10:34:06.469747+0000","last_fullsized":"2024-04-26T10:34:06.469747+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473125+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:34:06.473125+0000","last_peered":"2024-04-26T10:34:06.473125+0000","last_clean":"2024-04-26T10:34:06.473125+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:34:06.473125+0000","last_undegraded":"2024-04-26T10:34:06.473125+0000","last_fullsized":"2024-04-26T10:34:06.473125+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.475583+0000","last_change":"2024-04-26T10:34:01.438028+0000","last_active":"2024-04-26T10:34:06.475583+0000","last_peered":"2024-04-26T10:34:06.475583+0000","last_clean":"2024-04-26T10:34:06.475583+0000","last_became_active":"2024-04-26T10:34:01.437253+0000","last_became_peered":"2024-04-26T10:34:01.437253+0000","last_unstale":"2024-04-26T10:34:06.475583+0000","last_undegraded":"2024-04-26T10:34:06.475583+0000","last_fullsized":"2024-04-26T10:34:06.475583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:29.763867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468345+0000","last_change":"2024-04-26T10:34:01.433272+0000","last_active":"2024-04-26T10:34:06.468345+0000","last_peered":"2024-04-26T10:34:06.468345+0000","last_clean":"2024-04-26T10:34:06.468345+0000","last_became_active":"2024-04-26T10:34:01.432857+0000","last_became_peered":"2024-04-26T10:34:01.432857+0000","last_unstale":"2024-04-26T10:34:06.468345+0000","last_undegraded":"2024-04-26T10:34:06.468345+0000","last_fullsized":"2024-04-26T10:34:06.468345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:32:32.930095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470104+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:34:06.470104+0000","last_peered":"2024-04-26T10:34:06.470104+0000","last_clean":"2024-04-26T10:34:06.470104+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:34:06.470104+0000","last_undegraded":"2024-04-26T10:34:06.470104+0000","last_fullsized":"2024-04-26T10:34:06.470104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467447+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:34:06.467447+0000","last_peered":"2024-04-26T10:34:06.467447+0000","last_clean":"2024-04-26T10:34:06.467447+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:34:06.467447+0000","last_undegraded":"2024-04-26T10:34:06.467447+0000","last_fullsized":"2024-04-26T10:34:06.467447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474030+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:34:06.474030+0000","last_peered":"2024-04-26T10:34:06.474030+0000","last_clean":"2024-04-26T10:34:06.474030+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:34:06.474030+0000","last_undegraded":"2024-04-26T10:34:06.474030+0000","last_fullsized":"2024-04-26T10:34:06.474030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473396+0000","last_change":"2024-04-26T10:34:01.436869+0000","last_active":"2024-04-26T10:34:06.473396+0000","last_peered":"2024-04-26T10:34:06.473396+0000","last_clean":"2024-04-26T10:34:06.473396+0000","last_became_active":"2024-04-26T10:34:01.436574+0000","last_became_peered":"2024-04-26T10:34:01.436574+0000","last_unstale":"2024-04-26T10:34:06.473396+0000","last_undegraded":"2024-04-26T10:34:06.473396+0000","last_fullsized":"2024-04-26T10:34:06.473396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:51.972969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473463+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:34:06.473463+0000","last_peered":"2024-04-26T10:34:06.473463+0000","last_clean":"2024-04-26T10:34:06.473463+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:34:06.473463+0000","last_undegraded":"2024-04-26T10:34:06.473463+0000","last_fullsized":"2024-04-26T10:34:06.473463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469627+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:34:06.469627+0000","last_peered":"2024-04-26T10:34:06.469627+0000","last_clean":"2024-04-26T10:34:06.469627+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:34:06.469627+0000","last_undegraded":"2024-04-26T10:34:06.469627+0000","last_fullsized":"2024-04-26T10:34:06.469627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467806+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:34:06.467806+0000","last_peered":"2024-04-26T10:34:06.467806+0000","last_clean":"2024-04-26T10:34:06.467806+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:34:06.467806+0000","last_undegraded":"2024-04-26T10:34:06.467806+0000","last_fullsized":"2024-04-26T10:34:06.467806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470963+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:34:06.470963+0000","last_peered":"2024-04-26T10:34:06.470963+0000","last_clean":"2024-04-26T10:34:06.470963+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:34:06.470963+0000","last_undegraded":"2024-04-26T10:34:06.470963+0000","last_fullsized":"2024-04-26T10:34:06.470963+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473919+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:34:06.473919+0000","last_peered":"2024-04-26T10:34:06.473919+0000","last_clean":"2024-04-26T10:34:06.473919+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:34:06.473919+0000","last_undegraded":"2024-04-26T10:34:06.473919+0000","last_fullsized":"2024-04-26T10:34:06.473919+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473365+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:34:06.473365+0000","last_peered":"2024-04-26T10:34:06.473365+0000","last_clean":"2024-04-26T10:34:06.473365+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:34:06.473365+0000","last_undegraded":"2024-04-26T10:34:06.473365+0000","last_fullsized":"2024-04-26T10:34:06.473365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470875+0000","last_change":"2024-04-26T10:34:01.438942+0000","last_active":"2024-04-26T10:34:06.470875+0000","last_peered":"2024-04-26T10:34:06.470875+0000","last_clean":"2024-04-26T10:34:06.470875+0000","last_became_active":"2024-04-26T10:34:01.438663+0000","last_became_peered":"2024-04-26T10:34:01.438663+0000","last_unstale":"2024-04-26T10:34:06.470875+0000","last_undegraded":"2024-04-26T10:34:06.470875+0000","last_fullsized":"2024-04-26T10:34:06.470875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:16.648639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473398+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:34:06.473398+0000","last_peered":"2024-04-26T10:34:06.473398+0000","last_clean":"2024-04-26T10:34:06.473398+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:34:06.473398+0000","last_undegraded":"2024-04-26T10:34:06.473398+0000","last_fullsized":"2024-04-26T10:34:06.473398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469794+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:34:06.469794+0000","last_peered":"2024-04-26T10:34:06.469794+0000","last_clean":"2024-04-26T10:34:06.469794+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:34:06.469794+0000","last_undegraded":"2024-04-26T10:34:06.469794+0000","last_fullsized":"2024-04-26T10:34:06.469794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470893+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:34:06.470893+0000","last_peered":"2024-04-26T10:34:06.470893+0000","last_clean":"2024-04-26T10:34:06.470893+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:34:06.470893+0000","last_undegraded":"2024-04-26T10:34:06.470893+0000","last_fullsized":"2024-04-26T10:34:06.470893+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470741+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:34:06.470741+0000","last_peered":"2024-04-26T10:34:06.470741+0000","last_clean":"2024-04-26T10:34:06.470741+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:34:06.470741+0000","last_undegraded":"2024-04-26T10:34:06.470741+0000","last_fullsized":"2024-04-26T10:34:06.470741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473995+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:34:06.473995+0000","last_peered":"2024-04-26T10:34:06.473995+0000","last_clean":"2024-04-26T10:34:06.473995+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:34:06.473995+0000","last_undegraded":"2024-04-26T10:34:06.473995+0000","last_fullsized":"2024-04-26T10:34:06.473995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473500+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:34:06.473500+0000","last_peered":"2024-04-26T10:34:06.473500+0000","last_clean":"2024-04-26T10:34:06.473500+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:34:06.473500+0000","last_undegraded":"2024-04-26T10:34:06.473500+0000","last_fullsized":"2024-04-26T10:34:06.473500+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.472722+0000","last_change":"2024-04-26T10:34:01.436900+0000","last_active":"2024-04-26T10:34:06.472722+0000","last_peered":"2024-04-26T10:34:06.472722+0000","last_clean":"2024-04-26T10:34:06.472722+0000","last_became_active":"2024-04-26T10:34:01.436499+0000","last_became_peered":"2024-04-26T10:34:01.436499+0000","last_unstale":"2024-04-26T10:34:06.472722+0000","last_undegraded":"2024-04-26T10:34:06.472722+0000","last_fullsized":"2024-04-26T10:34:06.472722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:28.355388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.471801+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:34:06.471801+0000","last_peered":"2024-04-26T10:34:06.471801+0000","last_clean":"2024-04-26T10:34:06.471801+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:34:06.471801+0000","last_undegraded":"2024-04-26T10:34:06.471801+0000","last_fullsized":"2024-04-26T10:34:06.471801+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474373+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:34:06.474373+0000","last_peered":"2024-04-26T10:34:06.474373+0000","last_clean":"2024-04-26T10:34:06.474373+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:34:06.474373+0000","last_undegraded":"2024-04-26T10:34:06.474373+0000","last_fullsized":"2024-04-26T10:34:06.474373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.472583+0000","last_change":"2024-04-26T10:34:01.437670+0000","last_active":"2024-04-26T10:34:06.472583+0000","last_peered":"2024-04-26T10:34:06.472583+0000","last_clean":"2024-04-26T10:34:06.472583+0000","last_became_active":"2024-04-26T10:34:01.437383+0000","last_became_peered":"2024-04-26T10:34:01.437383+0000","last_unstale":"2024-04-26T10:34:06.472583+0000","last_undegraded":"2024-04-26T10:34:06.472583+0000","last_fullsized":"2024-04-26T10:34:06.472583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:25.108114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469806+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:34:06.469806+0000","last_peered":"2024-04-26T10:34:06.469806+0000","last_clean":"2024-04-26T10:34:06.469806+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:34:06.469806+0000","last_undegraded":"2024-04-26T10:34:06.469806+0000","last_fullsized":"2024-04-26T10:34:06.469806+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.475105+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:34:06.475105+0000","last_peered":"2024-04-26T10:34:06.475105+0000","last_clean":"2024-04-26T10:34:06.475105+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:34:06.475105+0000","last_undegraded":"2024-04-26T10:34:06.475105+0000","last_fullsized":"2024-04-26T10:34:06.475105+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469597+0000","last_change":"2024-04-26T10:34:01.449793+0000","last_active":"2024-04-26T10:34:06.469597+0000","last_peered":"2024-04-26T10:34:06.469597+0000","last_clean":"2024-04-26T10:34:06.469597+0000","last_became_active":"2024-04-26T10:34:01.433323+0000","last_became_peered":"2024-04-26T10:34:01.433323+0000","last_unstale":"2024-04-26T10:34:06.469597+0000","last_undegraded":"2024-04-26T10:34:06.469597+0000","last_fullsized":"2024-04-26T10:34:06.469597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:35.651791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474315+0000","last_change":"2024-04-26T10:34:01.438424+0000","last_active":"2024-04-26T10:34:06.474315+0000","last_peered":"2024-04-26T10:34:06.474315+0000","last_clean":"2024-04-26T10:34:06.474315+0000","last_became_active":"2024-04-26T10:34:01.437188+0000","last_became_peered":"2024-04-26T10:34:01.437188+0000","last_unstale":"2024-04-26T10:34:06.474315+0000","last_undegraded":"2024-04-26T10:34:06.474315+0000","last_fullsized":"2024-04-26T10:34:06.474315+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:49:44.273603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":59,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469501+0000","last_change":"2024-04-26T10:34:01.455880+0000","last_active":"2024-04-26T10:34:06.469501+0000","last_peered":"2024-04-26T10:34:06.469501+0000","last_clean":"2024-04-26T10:34:06.469501+0000","last_became_active":"2024-04-26T10:34:01.434157+0000","last_became_peered":"2024-04-26T10:34:01.434157+0000","last_unstale":"2024-04-26T10:34:06.469501+0000","last_undegraded":"2024-04-26T10:34:06.469501+0000","last_fullsized":"2024-04-26T10:34:06.469501+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:42.836464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469402+0000","last_change":"2024-04-26T10:34:01.438160+0000","last_active":"2024-04-26T10:34:06.469402+0000","last_peered":"2024-04-26T10:34:06.469402+0000","last_clean":"2024-04-26T10:34:06.469402+0000","last_became_active":"2024-04-26T10:34:01.437781+0000","last_became_peered":"2024-04-26T10:34:01.437781+0000","last_unstale":"2024-04-26T10:34:06.469402+0000","last_undegraded":"2024-04-26T10:34:06.469402+0000","last_fullsized":"2024-04-26T10:34:06.469402+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:28.151883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468160+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:34:06.468160+0000","last_peered":"2024-04-26T10:34:06.468160+0000","last_clean":"2024-04-26T10:34:06.468160+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:34:06.468160+0000","last_undegraded":"2024-04-26T10:34:06.468160+0000","last_fullsized":"2024-04-26T10:34:06.468160+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473212+0000","last_change":"2024-04-26T10:34:01.438955+0000","last_active":"2024-04-26T10:34:06.473212+0000","last_peered":"2024-04-26T10:34:06.473212+0000","last_clean":"2024-04-26T10:34:06.473212+0000","last_became_active":"2024-04-26T10:34:01.438690+0000","last_became_peered":"2024-04-26T10:34:01.438690+0000","last_unstale":"2024-04-26T10:34:06.473212+0000","last_undegraded":"2024-04-26T10:34:06.473212+0000","last_fullsized":"2024-04-26T10:34:06.473212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:33.103721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474429+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:34:06.474429+0000","last_peered":"2024-04-26T10:34:06.474429+0000","last_clean":"2024-04-26T10:34:06.474429+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:34:06.474429+0000","last_undegraded":"2024-04-26T10:34:06.474429+0000","last_fullsized":"2024-04-26T10:34:06.474429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473714+0000","last_change":"2024-04-26T10:34:01.436881+0000","last_active":"2024-04-26T10:34:06.473714+0000","last_peered":"2024-04-26T10:34:06.473714+0000","last_clean":"2024-04-26T10:34:06.473714+0000","last_became_active":"2024-04-26T10:34:01.436660+0000","last_became_peered":"2024-04-26T10:34:01.436660+0000","last_unstale":"2024-04-26T10:34:06.473714+0000","last_undegraded":"2024-04-26T10:34:06.473714+0000","last_fullsized":"2024-04-26T10:34:06.473714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:33.793931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470131+0000","last_change":"2024-04-26T10:34:01.434589+0000","last_active":"2024-04-26T10:34:06.470131+0000","last_peered":"2024-04-26T10:34:06.470131+0000","last_clean":"2024-04-26T10:34:06.470131+0000","last_became_active":"2024-04-26T10:34:01.434300+0000","last_became_peered":"2024-04-26T10:34:01.434300+0000","last_unstale":"2024-04-26T10:34:06.470131+0000","last_undegraded":"2024-04-26T10:34:06.470131+0000","last_fullsized":"2024-04-26T10:34:06.470131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:11.525948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473573+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:34:06.473573+0000","last_peered":"2024-04-26T10:34:06.473573+0000","last_clean":"2024-04-26T10:34:06.473573+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:34:06.473573+0000","last_undegraded":"2024-04-26T10:34:06.473573+0000","last_fullsized":"2024-04-26T10:34:06.473573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":61,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467669+0000","last_change":"2024-04-26T10:34:01.446048+0000","last_active":"2024-04-26T10:34:06.467669+0000","last_peered":"2024-04-26T10:34:06.467669+0000","last_clean":"2024-04-26T10:34:06.467669+0000","last_became_active":"2024-04-26T10:34:01.433327+0000","last_became_peered":"2024-04-26T10:34:01.433327+0000","last_unstale":"2024-04-26T10:34:06.467669+0000","last_undegraded":"2024-04-26T10:34:06.467669+0000","last_fullsized":"2024-04-26T10:34:06.467669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:20.809240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474576+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:34:06.474576+0000","last_peered":"2024-04-26T10:34:06.474576+0000","last_clean":"2024-04-26T10:34:06.474576+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:34:06.474576+0000","last_undegraded":"2024-04-26T10:34:06.474576+0000","last_fullsized":"2024-04-26T10:34:06.474576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"39'7719","reported_seq":9859,"reported_epoch":39,"state":"active+remapped+backfilling","last_fresh":"2024-04-26T10:34:10.040578+0000","last_change":"2024-04-26T10:34:02.505526+0000","last_active":"2024-04-26T10:34:10.040578+0000","last_peered":"2024-04-26T10:34:10.040578+0000","last_clean":"2024-04-26T10:34:00.436967+0000","last_became_active":"2024-04-26T10:34:02.488513+0000","last_became_peered":"2024-04-26T10:34:02.488513+0000","last_unstale":"2024-04-26T10:34:10.040578+0000","last_undegraded":"2024-04-26T10:34:10.040578+0000","last_fullsized":"2024-04-26T10:34:10.040578+0000","mapping_epoch":34,"log_start":"28'4791","ondisk_log_start":"28'4791","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2928,"log_dups_size":1042,"ondisk_log_size":2928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:58.343363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505872384,"num_objects":7719,"num_object_clones":0,"num_object_copies":15438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":6578,"num_objects_unfound":0,"num_objects_dirty":7719,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7719,"num_write_kb":494016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1051,"num_bytes_recovered":68878336,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":7719}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470743+0000","last_change":"2024-04-26T10:34:01.457740+0000","last_active":"2024-04-26T10:34:06.470743+0000","last_peered":"2024-04-26T10:34:06.470743+0000","last_clean":"2024-04-26T10:34:06.470743+0000","last_became_active":"2024-04-26T10:34:01.438142+0000","last_became_peered":"2024-04-26T10:34:01.438142+0000","last_unstale":"2024-04-26T10:34:06.470743+0000","last_undegraded":"2024-04-26T10:34:06.470743+0000","last_fullsized":"2024-04-26T10:34:06.470743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:08.178851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473277+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:34:06.473277+0000","last_peered":"2024-04-26T10:34:06.473277+0000","last_clean":"2024-04-26T10:34:06.473277+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:34:06.473277+0000","last_undegraded":"2024-04-26T10:34:06.473277+0000","last_fullsized":"2024-04-26T10:34:06.473277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"39'7932","reported_seq":7963,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.015536+0000","last_change":"2024-04-26T10:33:16.346351+0000","last_active":"2024-04-26T10:34:10.015536+0000","last_peered":"2024-04-26T10:34:10.015536+0000","last_clean":"2024-04-26T10:34:10.015536+0000","last_became_active":"2024-04-26T10:33:16.346122+0000","last_became_peered":"2024-04-26T10:33:16.346122+0000","last_unstale":"2024-04-26T10:34:10.015536+0000","last_undegraded":"2024-04-26T10:34:10.015536+0000","last_fullsized":"2024-04-26T10:34:10.015536+0000","mapping_epoch":16,"log_start":"23'2900","ondisk_log_start":"23'2900","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":5032,"log_dups_size":0,"ondisk_log_size":5032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:13.714464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519831552,"num_objects":7932,"num_object_clones":0,"num_object_copies":15864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7932,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7932,"num_write_kb":507648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474723+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:34:06.474723+0000","last_peered":"2024-04-26T10:34:06.474723+0000","last_clean":"2024-04-26T10:34:06.474723+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:34:06.474723+0000","last_undegraded":"2024-04-26T10:34:06.474723+0000","last_fullsized":"2024-04-26T10:34:06.474723+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473137+0000","last_change":"2024-04-26T10:34:01.438592+0000","last_active":"2024-04-26T10:34:06.473137+0000","last_peered":"2024-04-26T10:34:06.473137+0000","last_clean":"2024-04-26T10:34:06.473137+0000","last_became_active":"2024-04-26T10:34:01.437548+0000","last_became_peered":"2024-04-26T10:34:01.437548+0000","last_unstale":"2024-04-26T10:34:06.473137+0000","last_undegraded":"2024-04-26T10:34:06.473137+0000","last_fullsized":"2024-04-26T10:34:06.473137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:43.841694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"39'7762","reported_seq":10087,"reported_epoch":39,"state":"active+remapped+backfilling","last_fresh":"2024-04-26T10:34:10.062851+0000","last_change":"2024-04-26T10:34:02.530126+0000","last_active":"2024-04-26T10:34:10.062851+0000","last_peered":"2024-04-26T10:34:10.062851+0000","last_clean":"2024-04-26T10:34:00.443121+0000","last_became_active":"2024-04-26T10:34:02.510251+0000","last_became_peered":"2024-04-26T10:34:02.510251+0000","last_unstale":"2024-04-26T10:34:10.062851+0000","last_undegraded":"2024-04-26T10:34:10.062851+0000","last_fullsized":"2024-04-26T10:34:10.062851+0000","mapping_epoch":34,"log_start":"28'4864","ondisk_log_start":"28'4864","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2898,"log_dups_size":1042,"ondisk_log_size":2898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:04.366202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":508690432,"num_objects":7762,"num_object_clones":0,"num_object_copies":15524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":6533,"num_objects_unfound":0,"num_objects_dirty":7762,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7762,"num_write_kb":496768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1143,"num_bytes_recovered":74907648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7762}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470176+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:34:06.470176+0000","last_peered":"2024-04-26T10:34:06.470176+0000","last_clean":"2024-04-26T10:34:06.470176+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:34:06.470176+0000","last_undegraded":"2024-04-26T10:34:06.470176+0000","last_fullsized":"2024-04-26T10:34:06.470176+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468162+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:34:06.468162+0000","last_peered":"2024-04-26T10:34:06.468162+0000","last_clean":"2024-04-26T10:34:06.468162+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:34:06.468162+0000","last_undegraded":"2024-04-26T10:34:06.468162+0000","last_fullsized":"2024-04-26T10:34:06.468162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"39'7802","reported_seq":7833,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.025399+0000","last_change":"2024-04-26T10:33:16.346212+0000","last_active":"2024-04-26T10:34:10.025399+0000","last_peered":"2024-04-26T10:34:10.025399+0000","last_clean":"2024-04-26T10:34:10.025399+0000","last_became_active":"2024-04-26T10:33:16.346004+0000","last_became_peered":"2024-04-26T10:33:16.346004+0000","last_unstale":"2024-04-26T10:34:10.025399+0000","last_undegraded":"2024-04-26T10:34:10.025399+0000","last_fullsized":"2024-04-26T10:34:10.025399+0000","mapping_epoch":16,"log_start":"28'4854","ondisk_log_start":"28'4854","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2948,"log_dups_size":1042,"ondisk_log_size":2948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:27.495754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":511311872,"num_objects":7802,"num_object_clones":0,"num_object_copies":15604,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7802,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7802,"num_write_kb":499328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469261+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:34:06.469261+0000","last_peered":"2024-04-26T10:34:06.469261+0000","last_clean":"2024-04-26T10:34:06.469261+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:34:06.469261+0000","last_undegraded":"2024-04-26T10:34:06.469261+0000","last_fullsized":"2024-04-26T10:34:06.469261+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.475758+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:34:06.475758+0000","last_peered":"2024-04-26T10:34:06.475758+0000","last_clean":"2024-04-26T10:34:06.475758+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:34:06.475758+0000","last_undegraded":"2024-04-26T10:34:06.475758+0000","last_fullsized":"2024-04-26T10:34:06.475758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"39'7673","reported_seq":7711,"reported_epoch":39,"state":"active+remapped+backfill_wait","last_fresh":"2024-04-26T10:34:09.998655+0000","last_change":"2024-04-26T10:34:02.510073+0000","last_active":"2024-04-26T10:34:09.998655+0000","last_peered":"2024-04-26T10:34:09.998655+0000","last_clean":"2024-04-26T10:34:00.445985+0000","last_became_active":"2024-04-26T10:34:02.502550+0000","last_became_peered":"2024-04-26T10:34:02.502550+0000","last_unstale":"2024-04-26T10:34:09.998655+0000","last_undegraded":"2024-04-26T10:34:09.998655+0000","last_fullsized":"2024-04-26T10:34:09.998655+0000","mapping_epoch":34,"log_start":"28'4772","ondisk_log_start":"28'4772","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2901,"log_dups_size":1042,"ondisk_log_size":2901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:34:17.146925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502857728,"num_objects":7673,"num_object_clones":0,"num_object_copies":15346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":7673,"num_objects_unfound":0,"num_objects_dirty":7673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7673,"num_write_kb":491072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":7673}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.475674+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:34:06.475674+0000","last_peered":"2024-04-26T10:34:06.475674+0000","last_clean":"2024-04-26T10:34:06.475674+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:34:06.475674+0000","last_undegraded":"2024-04-26T10:34:06.475674+0000","last_fullsized":"2024-04-26T10:34:06.475674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469291+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:34:06.469291+0000","last_peered":"2024-04-26T10:34:06.469291+0000","last_clean":"2024-04-26T10:34:06.469291+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:34:06.469291+0000","last_undegraded":"2024-04-26T10:34:06.469291+0000","last_fullsized":"2024-04-26T10:34:06.469291+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"39'7717","reported_seq":7747,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.037081+0000","last_change":"2024-04-26T10:33:16.349242+0000","last_active":"2024-04-26T10:34:10.037081+0000","last_peered":"2024-04-26T10:34:10.037081+0000","last_clean":"2024-04-26T10:34:10.037081+0000","last_became_active":"2024-04-26T10:33:16.349063+0000","last_became_peered":"2024-04-26T10:33:16.349063+0000","last_unstale":"2024-04-26T10:34:10.037081+0000","last_undegraded":"2024-04-26T10:34:10.037081+0000","last_fullsized":"2024-04-26T10:34:10.037081+0000","mapping_epoch":16,"log_start":"28'4762","ondisk_log_start":"28'4762","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2955,"log_dups_size":1042,"ondisk_log_size":2955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:09.297624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505741312,"num_objects":7717,"num_object_clones":0,"num_object_copies":15434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7717,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7717,"num_write_kb":493888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468013+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:34:06.468013+0000","last_peered":"2024-04-26T10:34:06.468013+0000","last_clean":"2024-04-26T10:34:06.468013+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:34:06.468013+0000","last_undegraded":"2024-04-26T10:34:06.468013+0000","last_fullsized":"2024-04-26T10:34:06.468013+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470106+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:34:06.470106+0000","last_peered":"2024-04-26T10:34:06.470106+0000","last_clean":"2024-04-26T10:34:06.470106+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:34:06.470106+0000","last_undegraded":"2024-04-26T10:34:06.470106+0000","last_fullsized":"2024-04-26T10:34:06.470106+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"39'7453","reported_seq":7490,"reported_epoch":39,"state":"active+remapped+backfill_wait","last_fresh":"2024-04-26T10:34:10.006518+0000","last_change":"2024-04-26T10:34:02.498534+0000","last_active":"2024-04-26T10:34:10.006518+0000","last_peered":"2024-04-26T10:34:10.006518+0000","last_clean":"2024-04-26T10:34:00.444805+0000","last_became_active":"2024-04-26T10:34:02.494740+0000","last_became_peered":"2024-04-26T10:34:02.494740+0000","last_unstale":"2024-04-26T10:34:10.006518+0000","last_undegraded":"2024-04-26T10:34:10.006518+0000","last_fullsized":"2024-04-26T10:34:10.006518+0000","mapping_epoch":34,"log_start":"27'4505","ondisk_log_start":"27'4505","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2948,"log_dups_size":942,"ondisk_log_size":2948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:51:31.620362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":488439808,"num_objects":7453,"num_object_clones":0,"num_object_copies":14906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":7453,"num_objects_unfound":0,"num_objects_dirty":7453,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7453,"num_write_kb":476992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[{"shards":"0,1","objects":7453}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470456+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:34:06.470456+0000","last_peered":"2024-04-26T10:34:06.470456+0000","last_clean":"2024-04-26T10:34:06.470456+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:34:06.470456+0000","last_undegraded":"2024-04-26T10:34:06.470456+0000","last_fullsized":"2024-04-26T10:34:06.470456+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469853+0000","last_change":"2024-04-26T10:34:01.433646+0000","last_active":"2024-04-26T10:34:06.469853+0000","last_peered":"2024-04-26T10:34:06.469853+0000","last_clean":"2024-04-26T10:34:06.469853+0000","last_became_active":"2024-04-26T10:34:01.433183+0000","last_became_peered":"2024-04-26T10:34:01.433183+0000","last_unstale":"2024-04-26T10:34:06.469853+0000","last_undegraded":"2024-04-26T10:34:06.469853+0000","last_fullsized":"2024-04-26T10:34:06.469853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:39.230972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"39'7629","reported_seq":7660,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.039687+0000","last_change":"2024-04-26T10:33:16.344866+0000","last_active":"2024-04-26T10:34:10.039687+0000","last_peered":"2024-04-26T10:34:10.039687+0000","last_clean":"2024-04-26T10:34:10.039687+0000","last_became_active":"2024-04-26T10:33:16.344614+0000","last_became_peered":"2024-04-26T10:33:16.344614+0000","last_unstale":"2024-04-26T10:34:10.039687+0000","last_undegraded":"2024-04-26T10:34:10.039687+0000","last_fullsized":"2024-04-26T10:34:10.039687+0000","mapping_epoch":16,"log_start":"23'2700","ondisk_log_start":"23'2700","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":4929,"log_dups_size":0,"ondisk_log_size":4929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":499974144,"num_objects":7629,"num_object_clones":0,"num_object_copies":15258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7629,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7629,"num_write_kb":488256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.472640+0000","last_change":"2024-04-26T10:34:01.435538+0000","last_active":"2024-04-26T10:34:06.472640+0000","last_peered":"2024-04-26T10:34:06.472640+0000","last_clean":"2024-04-26T10:34:06.472640+0000","last_became_active":"2024-04-26T10:34:01.435184+0000","last_became_peered":"2024-04-26T10:34:01.435184+0000","last_unstale":"2024-04-26T10:34:06.472640+0000","last_undegraded":"2024-04-26T10:34:06.472640+0000","last_fullsized":"2024-04-26T10:34:06.472640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:35.066804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474189+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:34:06.474189+0000","last_peered":"2024-04-26T10:34:06.474189+0000","last_clean":"2024-04-26T10:34:06.474189+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:34:06.474189+0000","last_undegraded":"2024-04-26T10:34:06.474189+0000","last_fullsized":"2024-04-26T10:34:06.474189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"39'7630","reported_seq":7661,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.042604+0000","last_change":"2024-04-26T10:33:16.349280+0000","last_active":"2024-04-26T10:34:10.042604+0000","last_peered":"2024-04-26T10:34:10.042604+0000","last_clean":"2024-04-26T10:34:10.042604+0000","last_became_active":"2024-04-26T10:33:16.349010+0000","last_became_peered":"2024-04-26T10:33:16.349010+0000","last_unstale":"2024-04-26T10:34:10.042604+0000","last_undegraded":"2024-04-26T10:34:10.042604+0000","last_fullsized":"2024-04-26T10:34:10.042604+0000","mapping_epoch":16,"log_start":"28'4771","ondisk_log_start":"28'4771","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2859,"log_dups_size":1042,"ondisk_log_size":2859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:08.933996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":500039680,"num_objects":7630,"num_object_clones":0,"num_object_copies":15260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7630,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7630,"num_write_kb":488320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473562+0000","last_change":"2024-04-26T10:34:01.438826+0000","last_active":"2024-04-26T10:34:06.473562+0000","last_peered":"2024-04-26T10:34:06.473562+0000","last_clean":"2024-04-26T10:34:06.473562+0000","last_became_active":"2024-04-26T10:34:01.437674+0000","last_became_peered":"2024-04-26T10:34:01.437674+0000","last_unstale":"2024-04-26T10:34:06.473562+0000","last_undegraded":"2024-04-26T10:34:06.473562+0000","last_fullsized":"2024-04-26T10:34:06.473562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:31:36.790687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469955+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:34:06.469955+0000","last_peered":"2024-04-26T10:34:06.469955+0000","last_clean":"2024-04-26T10:34:06.469955+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:34:06.469955+0000","last_undegraded":"2024-04-26T10:34:06.469955+0000","last_fullsized":"2024-04-26T10:34:06.469955+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467812+0000","last_change":"2024-04-26T10:34:01.434248+0000","last_active":"2024-04-26T10:34:06.467812+0000","last_peered":"2024-04-26T10:34:06.467812+0000","last_clean":"2024-04-26T10:34:06.467812+0000","last_became_active":"2024-04-26T10:34:01.433212+0000","last_became_peered":"2024-04-26T10:34:01.433212+0000","last_unstale":"2024-04-26T10:34:06.467812+0000","last_undegraded":"2024-04-26T10:34:06.467812+0000","last_fullsized":"2024-04-26T10:34:06.467812+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:32.686291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"39'7634","reported_seq":7663,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.051787+0000","last_change":"2024-04-26T10:33:16.349302+0000","last_active":"2024-04-26T10:34:10.051787+0000","last_peered":"2024-04-26T10:34:10.051787+0000","last_clean":"2024-04-26T10:34:10.051787+0000","last_became_active":"2024-04-26T10:33:16.348992+0000","last_became_peered":"2024-04-26T10:33:16.348992+0000","last_unstale":"2024-04-26T10:34:10.051787+0000","last_undegraded":"2024-04-26T10:34:10.051787+0000","last_fullsized":"2024-04-26T10:34:10.051787+0000","mapping_epoch":16,"log_start":"28'4757","ondisk_log_start":"28'4757","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2877,"log_dups_size":1042,"ondisk_log_size":2877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:15.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":500301824,"num_objects":7634,"num_object_clones":0,"num_object_copies":15268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7634,"num_write_kb":488576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468278+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:34:06.468278+0000","last_peered":"2024-04-26T10:34:06.468278+0000","last_clean":"2024-04-26T10:34:06.468278+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:34:06.468278+0000","last_undegraded":"2024-04-26T10:34:06.468278+0000","last_fullsized":"2024-04-26T10:34:06.468278+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468074+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:34:06.468074+0000","last_peered":"2024-04-26T10:34:06.468074+0000","last_clean":"2024-04-26T10:34:06.468074+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:34:06.468074+0000","last_undegraded":"2024-04-26T10:34:06.468074+0000","last_fullsized":"2024-04-26T10:34:06.468074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473362+0000","last_change":"2024-04-26T10:34:01.438928+0000","last_active":"2024-04-26T10:34:06.473362+0000","last_peered":"2024-04-26T10:34:06.473362+0000","last_clean":"2024-04-26T10:34:06.473362+0000","last_became_active":"2024-04-26T10:34:01.438525+0000","last_became_peered":"2024-04-26T10:34:01.438525+0000","last_unstale":"2024-04-26T10:34:06.473362+0000","last_undegraded":"2024-04-26T10:34:06.473362+0000","last_fullsized":"2024-04-26T10:34:06.473362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:48.805704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"39'7667","reported_seq":7698,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.051371+0000","last_change":"2024-04-26T10:33:16.349181+0000","last_active":"2024-04-26T10:34:10.051371+0000","last_peered":"2024-04-26T10:34:10.051371+0000","last_clean":"2024-04-26T10:34:10.051371+0000","last_became_active":"2024-04-26T10:33:16.348981+0000","last_became_peered":"2024-04-26T10:33:16.348981+0000","last_unstale":"2024-04-26T10:34:10.051371+0000","last_undegraded":"2024-04-26T10:34:10.051371+0000","last_fullsized":"2024-04-26T10:34:10.051371+0000","mapping_epoch":16,"log_start":"28'4784","ondisk_log_start":"28'4784","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2883,"log_dups_size":1042,"ondisk_log_size":2883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502464512,"num_objects":7667,"num_object_clones":0,"num_object_copies":15334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7667,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7667,"num_write_kb":490688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473803+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:34:06.473803+0000","last_peered":"2024-04-26T10:34:06.473803+0000","last_clean":"2024-04-26T10:34:06.473803+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:34:06.473803+0000","last_undegraded":"2024-04-26T10:34:06.473803+0000","last_fullsized":"2024-04-26T10:34:06.473803+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473287+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:34:06.473287+0000","last_peered":"2024-04-26T10:34:06.473287+0000","last_clean":"2024-04-26T10:34:06.473287+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:34:06.473287+0000","last_undegraded":"2024-04-26T10:34:06.473287+0000","last_fullsized":"2024-04-26T10:34:06.473287+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474457+0000","last_change":"2024-04-26T10:34:01.438811+0000","last_active":"2024-04-26T10:34:06.474457+0000","last_peered":"2024-04-26T10:34:06.474457+0000","last_clean":"2024-04-26T10:34:06.474457+0000","last_became_active":"2024-04-26T10:34:01.437959+0000","last_became_peered":"2024-04-26T10:34:01.437959+0000","last_unstale":"2024-04-26T10:34:06.474457+0000","last_undegraded":"2024-04-26T10:34:06.474457+0000","last_fullsized":"2024-04-26T10:34:06.474457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"39'7673","reported_seq":7711,"reported_epoch":39,"state":"active+remapped+backfill_wait","last_fresh":"2024-04-26T10:34:10.061495+0000","last_change":"2024-04-26T10:34:02.527660+0000","last_active":"2024-04-26T10:34:10.061495+0000","last_peered":"2024-04-26T10:34:10.061495+0000","last_clean":"2024-04-26T10:34:00.447964+0000","last_became_active":"2024-04-26T10:34:02.523429+0000","last_became_peered":"2024-04-26T10:34:02.523429+0000","last_unstale":"2024-04-26T10:34:10.061495+0000","last_undegraded":"2024-04-26T10:34:10.061495+0000","last_fullsized":"2024-04-26T10:34:10.061495+0000","mapping_epoch":34,"log_start":"28'4757","ondisk_log_start":"28'4757","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":1042,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:17.628574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502857728,"num_objects":7673,"num_object_clones":0,"num_object_copies":15346,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":7673,"num_objects_unfound":0,"num_objects_dirty":7673,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7673,"num_write_kb":491072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7673}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467990+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:34:06.467990+0000","last_peered":"2024-04-26T10:34:06.467990+0000","last_clean":"2024-04-26T10:34:06.467990+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:34:06.467990+0000","last_undegraded":"2024-04-26T10:34:06.467990+0000","last_fullsized":"2024-04-26T10:34:06.467990+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":255,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467546+0000","last_change":"2024-04-26T10:34:04.467960+0000","last_active":"2024-04-26T10:34:06.467546+0000","last_peered":"2024-04-26T10:34:06.467546+0000","last_clean":"2024-04-26T10:34:06.467546+0000","last_became_active":"2024-04-26T10:34:04.467654+0000","last_became_peered":"2024-04-26T10:34:04.467654+0000","last_unstale":"2024-04-26T10:34:06.467546+0000","last_undegraded":"2024-04-26T10:34:06.467546+0000","last_fullsized":"2024-04-26T10:34:06.467546+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:22.456223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474285+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:34:06.474285+0000","last_peered":"2024-04-26T10:34:06.474285+0000","last_clean":"2024-04-26T10:34:06.474285+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:34:06.474285+0000","last_undegraded":"2024-04-26T10:34:06.474285+0000","last_fullsized":"2024-04-26T10:34:06.474285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470031+0000","last_change":"2024-04-26T10:34:01.433570+0000","last_active":"2024-04-26T10:34:06.470031+0000","last_peered":"2024-04-26T10:34:06.470031+0000","last_clean":"2024-04-26T10:34:06.470031+0000","last_became_active":"2024-04-26T10:34:01.433207+0000","last_became_peered":"2024-04-26T10:34:01.433207+0000","last_unstale":"2024-04-26T10:34:06.470031+0000","last_undegraded":"2024-04-26T10:34:06.470031+0000","last_fullsized":"2024-04-26T10:34:06.470031+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:46.417850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"39'7634","reported_seq":7665,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.026116+0000","last_change":"2024-04-26T10:33:16.344693+0000","last_active":"2024-04-26T10:34:10.026116+0000","last_peered":"2024-04-26T10:34:10.026116+0000","last_clean":"2024-04-26T10:34:10.026116+0000","last_became_active":"2024-04-26T10:33:16.344478+0000","last_became_peered":"2024-04-26T10:33:16.344478+0000","last_unstale":"2024-04-26T10:34:10.026116+0000","last_undegraded":"2024-04-26T10:34:10.026116+0000","last_fullsized":"2024-04-26T10:34:10.026116+0000","mapping_epoch":16,"log_start":"28'4733","ondisk_log_start":"28'4733","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2901,"log_dups_size":1042,"ondisk_log_size":2901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:24.298876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":500301824,"num_objects":7634,"num_object_clones":0,"num_object_copies":15268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7634,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7634,"num_write_kb":488576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467524+0000","last_change":"2024-04-26T10:34:01.433538+0000","last_active":"2024-04-26T10:34:06.467524+0000","last_peered":"2024-04-26T10:34:06.467524+0000","last_clean":"2024-04-26T10:34:06.467524+0000","last_became_active":"2024-04-26T10:34:01.432838+0000","last_became_peered":"2024-04-26T10:34:01.432838+0000","last_unstale":"2024-04-26T10:34:06.467524+0000","last_undegraded":"2024-04-26T10:34:06.467524+0000","last_fullsized":"2024-04-26T10:34:06.467524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:45:49.592085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473215+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:34:06.473215+0000","last_peered":"2024-04-26T10:34:06.473215+0000","last_clean":"2024-04-26T10:34:06.473215+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:34:06.473215+0000","last_undegraded":"2024-04-26T10:34:06.473215+0000","last_fullsized":"2024-04-26T10:34:06.473215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474804+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:34:06.474804+0000","last_peered":"2024-04-26T10:34:06.474804+0000","last_clean":"2024-04-26T10:34:06.474804+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:34:06.474804+0000","last_undegraded":"2024-04-26T10:34:06.474804+0000","last_fullsized":"2024-04-26T10:34:06.474804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"39'7768","reported_seq":7799,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.021502+0000","last_change":"2024-04-26T10:33:16.344694+0000","last_active":"2024-04-26T10:34:10.021502+0000","last_peered":"2024-04-26T10:34:10.021502+0000","last_clean":"2024-04-26T10:34:10.021502+0000","last_became_active":"2024-04-26T10:33:16.344461+0000","last_became_peered":"2024-04-26T10:33:16.344461+0000","last_unstale":"2024-04-26T10:34:10.021502+0000","last_undegraded":"2024-04-26T10:34:10.021502+0000","last_fullsized":"2024-04-26T10:34:10.021502+0000","mapping_epoch":16,"log_start":"28'4884","ondisk_log_start":"28'4884","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":1042,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:29.374096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":509083648,"num_objects":7768,"num_object_clones":0,"num_object_copies":15536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7768,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7768,"num_write_kb":497152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473547+0000","last_change":"2024-04-26T10:34:01.438747+0000","last_active":"2024-04-26T10:34:06.473547+0000","last_peered":"2024-04-26T10:34:06.473547+0000","last_clean":"2024-04-26T10:34:06.473547+0000","last_became_active":"2024-04-26T10:34:01.438453+0000","last_became_peered":"2024-04-26T10:34:01.438453+0000","last_unstale":"2024-04-26T10:34:06.473547+0000","last_undegraded":"2024-04-26T10:34:06.473547+0000","last_fullsized":"2024-04-26T10:34:06.473547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:33.424650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473707+0000","last_change":"2024-04-26T10:34:01.437984+0000","last_active":"2024-04-26T10:34:06.473707+0000","last_peered":"2024-04-26T10:34:06.473707+0000","last_clean":"2024-04-26T10:34:06.473707+0000","last_became_active":"2024-04-26T10:34:01.437279+0000","last_became_peered":"2024-04-26T10:34:01.437279+0000","last_unstale":"2024-04-26T10:34:06.473707+0000","last_undegraded":"2024-04-26T10:34:06.473707+0000","last_fullsized":"2024-04-26T10:34:06.473707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:15.132837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473199+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:34:06.473199+0000","last_peered":"2024-04-26T10:34:06.473199+0000","last_clean":"2024-04-26T10:34:06.473199+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:34:06.473199+0000","last_undegraded":"2024-04-26T10:34:06.473199+0000","last_fullsized":"2024-04-26T10:34:06.473199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'7747","reported_seq":7778,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T10:34:10.023510+0000","last_change":"2024-04-26T10:33:16.344714+0000","last_active":"2024-04-26T10:34:10.023510+0000","last_peered":"2024-04-26T10:34:10.023510+0000","last_clean":"2024-04-26T10:34:10.023510+0000","last_became_active":"2024-04-26T10:33:16.344500+0000","last_became_peered":"2024-04-26T10:33:16.344500+0000","last_unstale":"2024-04-26T10:34:10.023510+0000","last_undegraded":"2024-04-26T10:34:10.023510+0000","last_fullsized":"2024-04-26T10:34:10.023510+0000","mapping_epoch":16,"log_start":"28'4835","ondisk_log_start":"28'4835","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2912,"log_dups_size":1042,"ondisk_log_size":2912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:19.056484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":507707392,"num_objects":7747,"num_object_clones":0,"num_object_copies":15494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7747,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7747,"num_write_kb":495808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474111+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:34:06.474111+0000","last_peered":"2024-04-26T10:34:06.474111+0000","last_clean":"2024-04-26T10:34:06.474111+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:34:06.474111+0000","last_undegraded":"2024-04-26T10:34:06.474111+0000","last_fullsized":"2024-04-26T10:34:06.474111+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473738+0000","last_change":"2024-04-26T10:34:01.436635+0000","last_active":"2024-04-26T10:34:06.473738+0000","last_peered":"2024-04-26T10:34:06.473738+0000","last_clean":"2024-04-26T10:34:06.473738+0000","last_became_active":"2024-04-26T10:34:01.436416+0000","last_became_peered":"2024-04-26T10:34:01.436416+0000","last_unstale":"2024-04-26T10:34:06.473738+0000","last_undegraded":"2024-04-26T10:34:06.473738+0000","last_fullsized":"2024-04-26T10:34:06.473738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.472568+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:34:06.472568+0000","last_peered":"2024-04-26T10:34:06.472568+0000","last_clean":"2024-04-26T10:34:06.472568+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:34:06.472568+0000","last_undegraded":"2024-04-26T10:34:06.472568+0000","last_fullsized":"2024-04-26T10:34:06.472568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"39'7689","reported_seq":7725,"reported_epoch":39,"state":"active+remapped+backfill_wait","last_fresh":"2024-04-26T10:34:10.060403+0000","last_change":"2024-04-26T10:34:02.534330+0000","last_active":"2024-04-26T10:34:10.060403+0000","last_peered":"2024-04-26T10:34:10.060403+0000","last_clean":"2024-04-26T10:34:00.424582+0000","last_became_active":"2024-04-26T10:34:02.519692+0000","last_became_peered":"2024-04-26T10:34:02.519692+0000","last_unstale":"2024-04-26T10:34:10.060403+0000","last_undegraded":"2024-04-26T10:34:10.060403+0000","last_fullsized":"2024-04-26T10:34:10.060403+0000","mapping_epoch":34,"log_start":"27'4788","ondisk_log_start":"27'4788","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2901,"log_dups_size":1042,"ondisk_log_size":2901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:31.615511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":503906304,"num_objects":7689,"num_object_clones":0,"num_object_copies":15378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":7689,"num_objects_unfound":0,"num_objects_dirty":7689,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7689,"num_write_kb":492096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[{"shards":"1,2","objects":7689}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470738+0000","last_change":"2024-04-26T10:34:01.438292+0000","last_active":"2024-04-26T10:34:06.470738+0000","last_peered":"2024-04-26T10:34:06.470738+0000","last_clean":"2024-04-26T10:34:06.470738+0000","last_became_active":"2024-04-26T10:34:01.437950+0000","last_became_peered":"2024-04-26T10:34:01.437950+0000","last_unstale":"2024-04-26T10:34:06.470738+0000","last_undegraded":"2024-04-26T10:34:06.470738+0000","last_fullsized":"2024-04-26T10:34:06.470738+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:07:19.699072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473574+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:34:06.473574+0000","last_peered":"2024-04-26T10:34:06.473574+0000","last_clean":"2024-04-26T10:34:06.473574+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:34:06.473574+0000","last_undegraded":"2024-04-26T10:34:06.473574+0000","last_fullsized":"2024-04-26T10:34:06.473574+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470190+0000","last_change":"2024-04-26T10:34:01.437884+0000","last_active":"2024-04-26T10:34:06.470190+0000","last_peered":"2024-04-26T10:34:06.470190+0000","last_clean":"2024-04-26T10:34:06.470190+0000","last_became_active":"2024-04-26T10:34:01.437546+0000","last_became_peered":"2024-04-26T10:34:01.437546+0000","last_unstale":"2024-04-26T10:34:06.470190+0000","last_undegraded":"2024-04-26T10:34:06.470190+0000","last_fullsized":"2024-04-26T10:34:06.470190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:12:22.876994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467678+0000","last_change":"2024-04-26T10:34:01.434244+0000","last_active":"2024-04-26T10:34:06.467678+0000","last_peered":"2024-04-26T10:34:06.467678+0000","last_clean":"2024-04-26T10:34:06.467678+0000","last_became_active":"2024-04-26T10:34:01.433509+0000","last_became_peered":"2024-04-26T10:34:01.433509+0000","last_unstale":"2024-04-26T10:34:06.467678+0000","last_undegraded":"2024-04-26T10:34:06.467678+0000","last_fullsized":"2024-04-26T10:34:06.467678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:43.070883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473289+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:34:06.473289+0000","last_peered":"2024-04-26T10:34:06.473289+0000","last_clean":"2024-04-26T10:34:06.473289+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:34:06.473289+0000","last_undegraded":"2024-04-26T10:34:06.473289+0000","last_fullsized":"2024-04-26T10:34:06.473289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469622+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:34:06.469622+0000","last_peered":"2024-04-26T10:34:06.469622+0000","last_clean":"2024-04-26T10:34:06.469622+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:34:06.469622+0000","last_undegraded":"2024-04-26T10:34:06.469622+0000","last_fullsized":"2024-04-26T10:34:06.469622+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467916+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:34:06.467916+0000","last_peered":"2024-04-26T10:34:06.467916+0000","last_clean":"2024-04-26T10:34:06.467916+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:34:06.467916+0000","last_undegraded":"2024-04-26T10:34:06.467916+0000","last_fullsized":"2024-04-26T10:34:06.467916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.470664+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:34:06.470664+0000","last_peered":"2024-04-26T10:34:06.470664+0000","last_clean":"2024-04-26T10:34:06.470664+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:34:06.470664+0000","last_undegraded":"2024-04-26T10:34:06.470664+0000","last_fullsized":"2024-04-26T10:34:06.470664+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.468093+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:34:06.468093+0000","last_peered":"2024-04-26T10:34:06.468093+0000","last_clean":"2024-04-26T10:34:06.468093+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:34:06.468093+0000","last_undegraded":"2024-04-26T10:34:06.468093+0000","last_fullsized":"2024-04-26T10:34:06.468093+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473658+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:34:06.473658+0000","last_peered":"2024-04-26T10:34:06.473658+0000","last_clean":"2024-04-26T10:34:06.473658+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:34:06.473658+0000","last_undegraded":"2024-04-26T10:34:06.473658+0000","last_fullsized":"2024-04-26T10:34:06.473658+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473047+0000","last_change":"2024-04-26T10:34:01.438552+0000","last_active":"2024-04-26T10:34:06.473047+0000","last_peered":"2024-04-26T10:34:06.473047+0000","last_clean":"2024-04-26T10:34:06.473047+0000","last_became_active":"2024-04-26T10:34:01.437928+0000","last_became_peered":"2024-04-26T10:34:01.437928+0000","last_unstale":"2024-04-26T10:34:06.473047+0000","last_undegraded":"2024-04-26T10:34:06.473047+0000","last_fullsized":"2024-04-26T10:34:06.473047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:16:06.471062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.474272+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:34:06.474272+0000","last_peered":"2024-04-26T10:34:06.474272+0000","last_clean":"2024-04-26T10:34:06.474272+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:34:06.474272+0000","last_undegraded":"2024-04-26T10:34:06.474272+0000","last_fullsized":"2024-04-26T10:34:06.474272+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467708+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:34:06.467708+0000","last_peered":"2024-04-26T10:34:06.467708+0000","last_clean":"2024-04-26T10:34:06.467708+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:34:06.467708+0000","last_undegraded":"2024-04-26T10:34:06.467708+0000","last_fullsized":"2024-04-26T10:34:06.467708+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.467577+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:34:06.467577+0000","last_peered":"2024-04-26T10:34:06.467577+0000","last_clean":"2024-04-26T10:34:06.467577+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:34:06.467577+0000","last_undegraded":"2024-04-26T10:34:06.467577+0000","last_fullsized":"2024-04-26T10:34:06.467577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.473290+0000","last_change":"2024-04-26T10:34:01.435407+0000","last_active":"2024-04-26T10:34:06.473290+0000","last_peered":"2024-04-26T10:34:06.473290+0000","last_clean":"2024-04-26T10:34:06.473290+0000","last_became_active":"2024-04-26T10:34:01.435133+0000","last_became_peered":"2024-04-26T10:34:01.435133+0000","last_unstale":"2024-04-26T10:34:06.473290+0000","last_undegraded":"2024-04-26T10:34:06.473290+0000","last_fullsized":"2024-04-26T10:34:06.473290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:28.025621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.471025+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:34:06.471025+0000","last_peered":"2024-04-26T10:34:06.471025+0000","last_clean":"2024-04-26T10:34:06.471025+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:34:06.471025+0000","last_undegraded":"2024-04-26T10:34:06.471025+0000","last_fullsized":"2024-04-26T10:34:06.471025+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.475858+0000","last_change":"2024-04-26T10:34:01.437899+0000","last_active":"2024-04-26T10:34:06.475858+0000","last_peered":"2024-04-26T10:34:06.475858+0000","last_clean":"2024-04-26T10:34:06.475858+0000","last_became_active":"2024-04-26T10:34:01.437206+0000","last_became_peered":"2024-04-26T10:34:01.437206+0000","last_unstale":"2024-04-26T10:34:06.475858+0000","last_undegraded":"2024-04-26T10:34:06.475858+0000","last_fullsized":"2024-04-26T10:34:06.475858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:34:14.764331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-26T10:34:06.469215+0000","last_change":"2024-04-26T10:34:01.434154+0000","last_active":"2024-04-26T10:34:06.469215+0000","last_peered":"2024-04-26T10:34:06.469215+0000","last_clean":"2024-04-26T10:34:06.469215+0000","last_became_active":"2024-04-26T10:34:01.433673+0000","last_became_peered":"2024-04-26T10:34:01.433673+0000","last_unstale":"2024-04-26T10:34:06.469215+0000","last_undegraded":"2024-04-26T10:34:06.469215+0000","last_fullsized":"2024-04-26T10:34:06.469215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:39.444233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8069382144,"num_objects":123129,"num_object_clones":0,"num_object_copies":246258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":43599,"num_objects_unfound":0,"num_objects_dirty":123129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123129,"num_write_kb":7880256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2194,"num_bytes_recovered":143785984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16295395328,"data_stored":16295395328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":50672,"ondisk_log_size":50672,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1676,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738388,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6702732,"kb_used_data":6487040,"kb_used_omap":1,"kb_used_meta":215678,"kb_avail":87669108,"statfs":{"total":96636764160,"available":89773166592,"internally_reserved":0,"allocated":6642728960,"data_stored":6642432296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220854726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,2,2,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.214}]},{"osd":1,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.33200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5048576,"kb_used_data":4905080,"kb_used_omap":1,"kb_used_meta":143486,"kb_avail":89323264,"statfs":{"total":96636764160,"available":91467022336,"internally_reserved":0,"allocated":5022801920,"data_stored":5022508767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146930118},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.16600000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.318}]}]},{"osd":1,"up_from":8,"seq":34359738387,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4506736,"kb_used_data":4399332,"kb_used_omap":1,"kb_used_meta":107390,"kb_avail":89865104,"statfs":{"total":96636764160,"available":92021866496,"internally_reserved":0,"allocated":4504915968,"data_stored":4504645210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":109967814},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.25600000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.751},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.19900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5103157248,"data_stored":5103157248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4543479808,"data_stored":4543479808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6648758272,"data_stored":6648758272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:34:15.339 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T10:34:15.368 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:15.368 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:34:15.368 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:34:15.368 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:34:15.368 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:15.369 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:15.367+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:15.378 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:15.422 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 58 16 130053 130037 140.114 1.625 0.00315175 0.00694725 2024-04-26T10:34:15.469 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:15.468+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:15.505 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-26T10:34:15.564 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:34:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:34:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:15.564 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.76134193, 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:34:15.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:34:15.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:34:15.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:34:15.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:95997 5.7 5:ef48f664:::benchmark_data_smithi043_45180_object95996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.976132449000001, 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024010581999999999, 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:15.570 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 95997 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585344+0000", 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4491e-05 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585350+0000", 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1099999999999999e-06 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585355+0000", 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5430000000000004e-06 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592076+0000", 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067208470000000003 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592209+0000", 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013344400000000001 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592320+0000", 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011081700000000001 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.594282+0000", 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019622699999999999 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609277+0000", 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014995066 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609308+0000", 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1242999999999999e-05 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609331+0000", 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2150999999999998e-05 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101455 5.f 5:fbcc5be4:::benchmark_data_smithi043_45180_object101454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:15.575 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.291471261000002, 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02195165, 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101455 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270103+0000", 2024-04-26T10:34:15.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122309 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270111+0000", 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3999999999999992e-06 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270118+0000", 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9179999999999997e-06 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272018+0000", 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018998610000000001 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272126+0000", 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010844999999999999 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272225+0000", 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8381999999999994e-05 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:15.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278402+0000", 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061767009999999997 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291830+0000", 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013428756 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291894+0000", 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3189999999999996e-05 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291933+0000", 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9297e-05 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101456 5.f 5:f61cae04:::benchmark_data_smithi043_45180_object101455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.291190079, 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021829133000000001, 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:15.581 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101456 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270361+0000", 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9395999999999995e-05 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270369+0000", 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5490000000000001e-06 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270374+0000", 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5130000000000004e-06 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273610+0000", 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003235791 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273723+0000", 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112833 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273861+0000", 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013803 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278411+0000", 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045506380000000001 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291986+0000", 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013574409000000001 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292037+0000", 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1041000000000001e-05 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292091+0000", 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4617000000000002e-05 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101459 5.f 5:f6287f2a:::benchmark_data_smithi043_45180_object101458:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:15.586 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.289277170999998, 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022608105999999999, 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101459 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272227+0000", 2024-04-26T10:34:15.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2669e-05 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272236+0000", 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0210000000000005e-06 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272243+0000", 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7469999999999999e-06 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276304+0000", 2024-04-26T10:34:15.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040604789999999997 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276386+0000", 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2278000000000001e-05 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276477+0000", 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0713999999999999e-05 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:15.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278905+0000", 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024288249999999999 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294715+0000", 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015809976999999999 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294747+0000", 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1814999999999999e-05 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294783+0000", 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6180999999999998e-05 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101461 5.f 5:fcae472f:::benchmark_data_smithi043_45180_object101460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.288483911, 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021972760000000001, 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:15.592 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101461 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272968+0000", 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273035+0000", 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7477000000000005e-05 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273043+0000", 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4159999999999998e-06 2024-04-26T10:34:15.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273049+0000", 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4509999999999997e-06 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277407+0000", 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043580529999999998 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277489+0000", 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1333000000000002e-05 2024-04-26T10:34:15.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277574+0000", 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5042000000000003e-05 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278908+0000", 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013341360000000001 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294832+0000", 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015924462 2024-04-26T10:34:15.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294899+0000", 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6984999999999996e-05 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294941+0000", 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2113000000000002e-05 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.597 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:102382 5.2 5:4e9d92ee:::benchmark_data_smithi043_45180_object102381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.854185149999999, 2024-04-26T10:34:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021126853000000001, 2024-04-26T10:34:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:15.598 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 102382 2024-04-26T10:34:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:15.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707330+0000", 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3274000000000004e-05 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707339+0000", 2024-04-26T10:34:15.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9700000000000005e-06 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707346+0000", 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709272+0000", 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019264169999999999 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709387+0000", 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115333 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709479+0000", 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1555e-05 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.712520+0000", 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030408729999999999 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728336+0000", 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015815929999999999 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728370+0000", 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4496999999999999e-05 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728394+0000", 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3793000000000001e-05 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103328 5.6 e32/16 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head v 32'6425, mlcod=32'6423)", 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.377092620999999, 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064716840999999997, 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184359+0000", 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184419+0000", 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9345999999999997e-05 2024-04-26T10:34:15.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184425+0000", 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1190000000000002e-06 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184429+0000", 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.296e-06 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184461+0000", 2024-04-26T10:34:15.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2122999999999997e-05 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184477+0000", 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5877000000000001e-05 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249048+0000", 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064570494000000006 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249077+0000", 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9081000000000002e-05 2024-04-26T10:34:15.607 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103327 5.c e32/16 5:3133c183:::benchmark_data_smithi043_45180_object103326:head v 32'6430, mlcod=32'6425)", 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.376926022999999, 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064984741999999998, 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:15.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184592+0000", 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6027999999999999e-05 2024-04-26T10:34:15.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184597+0000", 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8570000000000003e-06 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184600+0000", 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3390000000000001e-06 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184620+0000", 2024-04-26T10:34:15.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9890000000000001e-05 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184631+0000", 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1073999999999999e-05 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249477+0000", 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064845485999999994 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249511+0000", 2024-04-26T10:34:15.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4508000000000002e-05 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103329 5.6 e32/16 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head v 32'6426, mlcod=32'6423)", 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.373092201999999, 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063744996999999998, 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188359+0000", 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188389+0000", 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9416000000000001e-05 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243409+0000", 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.055020409999999999 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243419+0000", 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0071000000000001e-05 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243465+0000", 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5799e-05 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243491+0000", 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5619999999999999e-05 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252067+0000", 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085763809999999992 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252105+0000", 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8040999999999997e-05 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103337 5.d e32/16 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head v 32'6429, mlcod=32'6427)", 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.373021824999999, 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.057982037, 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.616 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188430+0000", 2024-04-26T10:34:15.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188500+0000", 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0062999999999996e-05 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243434+0000", 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.054933760999999998 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243442+0000", 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243490+0000", 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8312000000000001e-05 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243511+0000", 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0781999999999999e-05 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246370+0000", 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028590930000000001 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246413+0000", 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2413000000000002e-05 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103660 5.9 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:15.620 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.179086179999999, 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.067661676000000004, 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103660 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382365+0000", 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382430+0000", 2024-04-26T10:34:15.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4850000000000004e-05 2024-04-26T10:34:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382439+0000", 2024-04-26T10:34:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:34:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382445+0000", 2024-04-26T10:34:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0229999999999998e-06 2024-04-26T10:34:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382482+0000", 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6909000000000002e-05 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382613+0000", 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013072600000000001 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382756+0000", 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000143306 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385090+0000", 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002333786 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449925+0000", 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064835173999999995 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449985+0000", 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0124999999999998e-05 2024-04-26T10:34:15.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450028+0000", 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2457999999999999e-05 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103662 5.f 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.17664237, 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.068705924000000002, 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.626 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103662 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:15.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384809+0000", 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384908+0000", 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9146000000000002e-05 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384921+0000", 2024-04-26T10:34:15.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2622e-05 2024-04-26T10:34:15.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384931+0000", 2024-04-26T10:34:15.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0108e-05 2024-04-26T10:34:15.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384984+0000", 2024-04-26T10:34:15.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2849000000000002e-05 2024-04-26T10:34:15.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017266800000000001 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385313+0000", 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015649300000000001 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388446+0000", 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003133481 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453401+0000", 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064955075000000001 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453462+0000", 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1134000000000001e-05 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453516+0000", 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3477999999999999e-05 2024-04-26T10:34:15.631 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103664 5.9 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.176359686000001, 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.065076041000000001, 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.632 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103664 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385092+0000", 2024-04-26T10:34:15.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:15.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385145+0000", 2024-04-26T10:34:15.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3143000000000003e-05 2024-04-26T10:34:15.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:15.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0473e-05 2024-04-26T10:34:15.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385163+0000", 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385193+0000", 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0638e-05 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385284+0000", 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599000000000005e-05 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385375+0000", 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0606999999999995e-05 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387556+0000", 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021809529999999998 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450072+0000", 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062516408999999995 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450123+0000", 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1406000000000002e-05 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450169+0000", 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5380000000000003e-05 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103666 5.f 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:15.637 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.174596312999999, 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066830159, 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103666 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386855+0000", 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386928+0000", 2024-04-26T10:34:15.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386937+0000", 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1090000000000004e-06 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386945+0000", 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386981+0000", 2024-04-26T10:34:15.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5899999999999998e-05 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387071+0000", 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9954e-05 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387161+0000", 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0898999999999998e-05 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:15.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390584+0000", 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034229030000000001 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453579+0000", 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062994267000000007 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453640+0000", 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1162999999999997e-05 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453686+0000", 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6493999999999999e-05 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103667 5.f 5:f4dc36e8:::benchmark_data_smithi043_45180_object103666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.173735242999999, 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066218387000000004, 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:15.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103667 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387783+0000", 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5973e-05 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387791+0000", 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1850000000000004e-06 2024-04-26T10:34:15.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387796+0000", 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388469+0000", 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0006734 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388547+0000", 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7188999999999996e-05 2024-04-26T10:34:15.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388630+0000", 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3892000000000002e-05 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390598+0000", 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00196759 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453803+0000", 2024-04-26T10:34:15.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063205069000000003 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453844+0000", 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1248999999999998e-05 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453936+0000", 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1201999999999999e-05 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:107998 5.9 5:9ce23eb0:::benchmark_data_smithi043_45180_object107997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.065816863, 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025313064, 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107998 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495634+0000", 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495754+0000", 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119893 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495769+0000", 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4769999999999999e-05 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495781+0000", 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1858999999999999e-05 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502521+0000", 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067402410000000001 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502675+0000", 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015405099999999999 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1,2", 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502846+0000", 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000171001 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.505743+0000", 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028975490000000001 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.508006+0000", 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022627620000000002 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520788+0000", 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012782244 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520846+0000", 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7976999999999997e-05 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520949+0000", 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102267 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:107974 5.b e35/34 5:daaeafb8:::benchmark_data_smithi043_45180_object107973:head v 35'6822, mlcod=0'0)", 2024-04-26T10:34:15.654 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.046790039999999, 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020988144, 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514661+0000", 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514668+0000", 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0249999999999997e-06 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514678+0000", 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7950000000000002e-06 2024-04-26T10:34:15.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514686+0000", 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9049999999999997e-06 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514872+0000", 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018605499999999999 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514900+0000", 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7758000000000001e-05 2024-04-26T10:34:15.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.535626+0000", 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020725958999999999 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.535651+0000", 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-05 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:108005 5.c e35/16 5:3b5c73fa:::benchmark_data_smithi043_45180_object108004:head v 35'6720, mlcod=33'6718)", 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.046729027, 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025223481999999998, 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514766+0000", 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2818999999999998e-05 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514773+0000", 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999996e-06 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514777+0000", 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6199999999999998e-06 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522074+0000", 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072964029999999999 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522096+0000", 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2027000000000001e-05 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539924+0000", 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017827749 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539947+0000", 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3232999999999999e-05 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "MOSDPGPushReply(5.9 38/34 [PushReplyOp(5:91d0b3ac:::benchmark_data_smithi043_45180_object10370:head)])", 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 7.4627755819999999, 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022588196000000001, 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:15.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:15.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:15.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:15.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:15.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:34:15.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098679+0000", 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.295e-06 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098683+0000", 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8659999999999999e-06 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098687+0000", 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.67e-06 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:15.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.121146+0000", 2024-04-26T10:34:15.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022459798 2024-04-26T10:34:15.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:15.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:15.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:15.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.121265+0000", 2024-04-26T10:34:15.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011866000000000001 2024-04-26T10:34:15.668 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.668 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.668 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.668 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:15.668 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:15.668 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:15.670 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:15.670 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:15.669+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:15.770 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:15.770+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:15.800 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:15.800 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub flag(s) set","count":7},"muted":false}},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":99,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":43,"num_osds":3,"num_up_osds":3,"osd_up_since":1714127564,"num_in_osds":3,"osd_in_since":1714127557,"num_remapped_pgs":1},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":115},{"state_name":"active+remapped+backfill_wait","count":4},{"state_name":"active+remapped+backfilling","count":2}],"num_pgs":121,"num_pools":5,"num_objects":123153,"data_bytes":8069974874,"bytes_used":16648237056,"bytes_avail":273262055424,"bytes_total":289910292480,"misplaced_objects":43599,"misplaced_total":246306,"misplaced_ratio":0.17701152225280747,"recovering_objects_per_sec":263,"recovering_bytes_per_sec":17295188,"recovering_keys_per_sec":0,"num_objects_recovered":1455,"num_bytes_recovered":95354880,"num_keys_recovered":0,"write_bytes_sec":118962367,"read_op_per_sec":0,"write_op_per_sec":1815},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4186}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-26T10:33:56.996864+0000","services":{}},"progress_events":{}} 2024-04-26T10:34:15.814 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T10:34:15.815 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:34:15.844 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:15.844 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:15.844 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.844 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:130864 5.0 5:00677fc9:::benchmark_data_smithi043_45180_object130863:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:34:15.844 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:15.839074+0000", 2024-04-26T10:34:15.845 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0036296280000000002, 2024-04-26T10:34:15.845 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0036530209999999998, 2024-04-26T10:34:15.845 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:15.845 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:15.845 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:15.845 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:15.845 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.845 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 130864 2024-04-26T10:34:15.845 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.845 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:15.846 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.846 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:15.846 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839074+0000", 2024-04-26T10:34:15.846 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.846 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.846 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.846 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:15.846 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839074+0000", 2024-04-26T10:34:15.846 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.846 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.846 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.847 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:15.847 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839073+0000", 2024-04-26T10:34:15.847 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.847 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.847 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.847 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:15.847 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839110+0000", 2024-04-26T10:34:15.847 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6977999999999997e-05 2024-04-26T10:34:15.847 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.847 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.847 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:15.847 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839119+0000", 2024-04-26T10:34:15.847 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8619999999999992e-06 2024-04-26T10:34:15.848 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.848 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.848 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.848 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839126+0000", 2024-04-26T10:34:15.848 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0829999999999998e-06 2024-04-26T10:34:15.848 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.848 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.848 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:15.848 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839157+0000", 2024-04-26T10:34:15.848 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0728000000000001e-05 2024-04-26T10:34:15.848 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.848 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.849 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:15.849 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839233+0000", 2024-04-26T10:34:15.849 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5778000000000005e-05 2024-04-26T10:34:15.849 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.849 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.849 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:15.849 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839311+0000", 2024-04-26T10:34:15.849 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8510000000000006e-05 2024-04-26T10:34:15.849 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.849 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:15.849 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.849 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.850 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.850 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:130866 5.e 5:76703bfe:::benchmark_data_smithi043_45180_object130865:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:34:15.850 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:15.839251+0000", 2024-04-26T10:34:15.850 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0034531219999999999, 2024-04-26T10:34:15.850 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035297430000000001, 2024-04-26T10:34:15.850 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:15.850 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:15.850 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:15.850 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:15.850 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.851 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 130866 2024-04-26T10:34:15.851 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.851 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:15.851 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.851 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:15.851 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839251+0000", 2024-04-26T10:34:15.851 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.851 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.851 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.851 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:15.851 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839251+0000", 2024-04-26T10:34:15.851 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.852 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.852 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.852 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:15.852 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839250+0000", 2024-04-26T10:34:15.852 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:15.852 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.852 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.852 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:15.852 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839328+0000", 2024-04-26T10:34:15.852 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7792000000000003e-05 2024-04-26T10:34:15.852 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.852 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.852 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:15.853 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839340+0000", 2024-04-26T10:34:15.853 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2261e-05 2024-04-26T10:34:15.853 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.853 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.853 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.853 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839348+0000", 2024-04-26T10:34:15.853 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7889999999999995e-06 2024-04-26T10:34:15.853 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.853 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.853 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:15.853 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839383+0000", 2024-04-26T10:34:15.853 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5472999999999997e-05 2024-04-26T10:34:15.854 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.854 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.854 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:15.854 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839502+0000", 2024-04-26T10:34:15.854 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000118581 2024-04-26T10:34:15.854 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.854 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.854 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:15.854 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.839636+0000", 2024-04-26T10:34:15.854 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000134253 2024-04-26T10:34:15.854 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.854 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.854 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:15.855 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841903+0000", 2024-04-26T10:34:15.855 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0022671929999999998 2024-04-26T10:34:15.855 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.855 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:15.855 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.855 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.855 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.855 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:130871 5.0 5:0c0cb98f:::benchmark_data_smithi043_45180_object130870:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:34:15.855 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:15.841139+0000", 2024-04-26T10:34:15.855 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001564902, 2024-04-26T10:34:15.855 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017033079999999999, 2024-04-26T10:34:15.855 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:15.856 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:15.856 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:15.856 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:15.856 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.856 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 130871 2024-04-26T10:34:15.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.856 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:15.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:15.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841139+0000", 2024-04-26T10:34:15.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:15.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841139+0000", 2024-04-26T10:34:15.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:15.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841138+0000", 2024-04-26T10:34:15.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:15.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:15.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841198+0000", 2024-04-26T10:34:15.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0015000000000001e-05 2024-04-26T10:34:15.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.858 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:15.858 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841210+0000", 2024-04-26T10:34:15.858 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1948e-05 2024-04-26T10:34:15.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.858 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.858 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841218+0000", 2024-04-26T10:34:15.858 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2649999999999996e-06 2024-04-26T10:34:15.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.859 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:15.859 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841256+0000", 2024-04-26T10:34:15.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8006000000000002e-05 2024-04-26T10:34:15.859 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.859 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.859 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:15.859 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841380+0000", 2024-04-26T10:34:15.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012427 2024-04-26T10:34:15.859 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.859 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.859 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:15.859 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841519+0000", 2024-04-26T10:34:15.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013832699999999999 2024-04-26T10:34:15.860 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.860 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:15.860 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.860 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.860 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:130872 5.b 5:d21567a3:::benchmark_data_smithi043_45180_object130871:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:34:15.860 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:15.841270+0000", 2024-04-26T10:34:15.860 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001433761, 2024-04-26T10:34:15.860 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016210689999999999, 2024-04-26T10:34:15.860 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:15.860 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:15.860 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:15.860 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:15.861 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.861 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 130872 2024-04-26T10:34:15.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.861 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:15.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:15.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841270+0000", 2024-04-26T10:34:15.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:15.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841270+0000", 2024-04-26T10:34:15.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:15.862 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841269+0000", 2024-04-26T10:34:15.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:15.862 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841345+0000", 2024-04-26T10:34:15.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5995999999999995e-05 2024-04-26T10:34:15.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:15.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841353+0000", 2024-04-26T10:34:15.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5220000000000001e-06 2024-04-26T10:34:15.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841358+0000", 2024-04-26T10:34:15.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6099999999999997e-06 2024-04-26T10:34:15.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:15.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841388+0000", 2024-04-26T10:34:15.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9492000000000002e-05 2024-04-26T10:34:15.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.864 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:15.864 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841465+0000", 2024-04-26T10:34:15.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7405999999999997e-05 2024-04-26T10:34:15.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.864 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:15.864 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841582+0000", 2024-04-26T10:34:15.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000116433 2024-04-26T10:34:15.864 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.864 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:15.865 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.865 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.865 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:130864 5.0 e43/42 ondisk, result = 0)", 2024-04-26T10:34:15.865 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:15.841469+0000", 2024-04-26T10:34:15.865 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001234279, 2024-04-26T10:34:15.865 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014620360000000001, 2024-04-26T10:34:15.865 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:15.865 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:15.865 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:15.865 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.865 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:15.865 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841469+0000", 2024-04-26T10:34:15.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.866 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.866 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.866 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:15.866 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841469+0000", 2024-04-26T10:34:15.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.866 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.866 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.866 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:15.866 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841469+0000", 2024-04-26T10:34:15.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.870 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:15.870 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841473+0000", 2024-04-26T10:34:15.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1710000000000004e-06 2024-04-26T10:34:15.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.870 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:15.870 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841481+0000", 2024-04-26T10:34:15.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1140000000000006e-06 2024-04-26T10:34:15.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.871 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.841488+0000", 2024-04-26T10:34:15.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:34:15.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:15.871 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842830+0000", 2024-04-26T10:34:15.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013422379999999999 2024-04-26T10:34:15.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:15.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842838+0000", 2024-04-26T10:34:15.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.622e-06 2024-04-26T10:34:15.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:15.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842931+0000", 2024-04-26T10:34:15.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3355000000000003e-05 2024-04-26T10:34:15.872 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.872 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:15.872 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.873 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:130873 5.a e43/16 5:5d72cca3:::benchmark_data_smithi043_45180_object130872:head v 43'8277, mlcod=43'8275)", 2024-04-26T10:34:15.873 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:15.842347+0000", 2024-04-26T10:34:15.873 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00035707099999999998, 2024-04-26T10:34:15.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00063279899999999997, 2024-04-26T10:34:15.873 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:15.873 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:15.873 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:15.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:15.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842347+0000", 2024-04-26T10:34:15.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:15.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842347+0000", 2024-04-26T10:34:15.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:15.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842346+0000", 2024-04-26T10:34:15.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:15.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842403+0000", 2024-04-26T10:34:15.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7367999999999997e-05 2024-04-26T10:34:15.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:15.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842412+0000", 2024-04-26T10:34:15.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8899999999999996e-06 2024-04-26T10:34:15.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842418+0000", 2024-04-26T10:34:15.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.224e-06 2024-04-26T10:34:15.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.876 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:15.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842468+0000", 2024-04-26T10:34:15.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9778999999999999e-05 2024-04-26T10:34:15.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.876 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:15.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842490+0000", 2024-04-26T10:34:15.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1878e-05 2024-04-26T10:34:15.876 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.876 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:15.876 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.877 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:130874 5.8 5:11cfdb86:::benchmark_data_smithi043_45180_object130873:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:34:15.877 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:15.842615+0000", 2024-04-26T10:34:15.877 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 8.8315999999999999e-05, 2024-04-26T10:34:15.877 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00044057999999999999, 2024-04-26T10:34:15.877 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:15.877 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:15.877 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:15.877 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:15.877 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.877 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 130874 2024-04-26T10:34:15.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.877 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:15.877 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:15.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842615+0000", 2024-04-26T10:34:15.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:15.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842615+0000", 2024-04-26T10:34:15.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:15.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842615+0000", 2024-04-26T10:34:15.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:15.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:15.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842708+0000", 2024-04-26T10:34:15.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3212000000000001e-05 2024-04-26T10:34:15.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:15.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842716+0000", 2024-04-26T10:34:15.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9519999999999994e-06 2024-04-26T10:34:15.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842721+0000", 2024-04-26T10:34:15.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8799999999999999e-06 2024-04-26T10:34:15.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:15.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842823+0000", 2024-04-26T10:34:15.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000102472 2024-04-26T10:34:15.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:15.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.842954+0000", 2024-04-26T10:34:15.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013073300000000001 2024-04-26T10:34:15.881 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.881 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:15.881 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.881 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:130852 5.e 5:77f00c24:::benchmark_data_smithi043_45180_object130851:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:34:15.881 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:15.835494+0000", 2024-04-26T10:34:15.881 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0072094949999999998, 2024-04-26T10:34:15.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0076459199999999996, 2024-04-26T10:34:15.881 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:15.881 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:15.882 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:15.882 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:15.882 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:15.882 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 130852 2024-04-26T10:34:15.882 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.882 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:15.882 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.882 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:15.882 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.835494+0000", 2024-04-26T10:34:15.882 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.882 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.882 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:15.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.835494+0000", 2024-04-26T10:34:15.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:15.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:15.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.835493+0000", 2024-04-26T10:34:15.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:15.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:15.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.835562+0000", 2024-04-26T10:34:15.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8949999999999995e-05 2024-04-26T10:34:15.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:15.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.835573+0000", 2024-04-26T10:34:15.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0502999999999999e-05 2024-04-26T10:34:15.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:15.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.835580+0000", 2024-04-26T10:34:15.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9199999999999998e-06 2024-04-26T10:34:15.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:15.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.835617+0000", 2024-04-26T10:34:15.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7747000000000003e-05 2024-04-26T10:34:15.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:15.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.835722+0000", 2024-04-26T10:34:15.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000104615 2024-04-26T10:34:15.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:15.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.835815+0000", 2024-04-26T10:34:15.886 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3372e-05 2024-04-26T10:34:15.886 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:15.886 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:15.886 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:15.886 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:15.838560+0000", 2024-04-26T10:34:15.886 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027443010000000002 2024-04-26T10:34:15.886 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.886 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:15.886 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.886 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:15.886 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:34:15.886 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 8 2024-04-26T10:34:15.886 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:15.888 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:15.886+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:15.888 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:15.988 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:15.987+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:16.068 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:16.068 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:16.068 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:16.068 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:16.068 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:16.081 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:16.089 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:16.087+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:16.178 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:16.181 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:34:16.187 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-04-26T10:34:15.499300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8522763098,"num_objects":130062,"num_object_clones":0,"num_object_copies":260124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130062,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":130286,"num_write_kb":8325906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3198,"num_bytes_recovered":208604984,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48959,"ondisk_log_size":48959,"up":242,"acting":241,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":248,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":17256468,"kb_used_data":16761960,"kb_used_omap":4,"kb_used_meta":494459,"kb_avail":265859052,"statfs":{"total":289910292480,"available":272239669248,"internally_reserved":0,"allocated":17164247040,"data_stored":17163347359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":506326354},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":452788224,"num_objects":6909,"num_object_clones":0,"num_object_copies":13818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-43599,"num_objects_unfound":0,"num_objects_dirty":6909,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6909,"num_write_kb":442176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":991,"num_bytes_recovered":64226956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.500441"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510347+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:34:14.510347+0000","last_peered":"2024-04-26T10:34:14.510347+0000","last_clean":"2024-04-26T10:34:14.510347+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:34:14.510347+0000","last_undegraded":"2024-04-26T10:34:14.510347+0000","last_fullsized":"2024-04-26T10:34:14.510347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:26.964955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488460+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:34:13.488460+0000","last_peered":"2024-04-26T10:34:13.488460+0000","last_clean":"2024-04-26T10:34:13.488460+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:34:13.488460+0000","last_undegraded":"2024-04-26T10:34:13.488460+0000","last_fullsized":"2024-04-26T10:34:13.488460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499377+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:34:13.499377+0000","last_peered":"2024-04-26T10:34:13.499377+0000","last_clean":"2024-04-26T10:34:13.499377+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:34:13.499377+0000","last_undegraded":"2024-04-26T10:34:13.499377+0000","last_fullsized":"2024-04-26T10:34:13.499377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499057+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:34:13.499057+0000","last_peered":"2024-04-26T10:34:13.499057+0000","last_clean":"2024-04-26T10:34:13.499057+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:34:13.499057+0000","last_undegraded":"2024-04-26T10:34:13.499057+0000","last_fullsized":"2024-04-26T10:34:13.499057+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513196+0000","last_change":"2024-04-26T10:34:14.507618+0000","last_active":"2024-04-26T10:34:14.513196+0000","last_peered":"2024-04-26T10:34:14.513196+0000","last_clean":"2024-04-26T10:34:14.513196+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:34:14.513196+0000","last_undegraded":"2024-04-26T10:34:14.513196+0000","last_fullsized":"2024-04-26T10:34:14.513196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:27.721106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.493676+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:34:13.493676+0000","last_peered":"2024-04-26T10:34:13.493676+0000","last_clean":"2024-04-26T10:34:13.493676+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:34:13.493676+0000","last_undegraded":"2024-04-26T10:34:13.493676+0000","last_fullsized":"2024-04-26T10:34:13.493676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.502929+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:34:13.502929+0000","last_peered":"2024-04-26T10:34:13.502929+0000","last_clean":"2024-04-26T10:34:13.502929+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:34:13.502929+0000","last_undegraded":"2024-04-26T10:34:13.502929+0000","last_fullsized":"2024-04-26T10:34:13.502929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.493758+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:34:13.493758+0000","last_peered":"2024-04-26T10:34:13.493758+0000","last_clean":"2024-04-26T10:34:13.493758+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:34:13.493758+0000","last_undegraded":"2024-04-26T10:34:13.493758+0000","last_fullsized":"2024-04-26T10:34:13.493758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497249+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:34:13.497249+0000","last_peered":"2024-04-26T10:34:13.497249+0000","last_clean":"2024-04-26T10:34:13.497249+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:34:13.497249+0000","last_undegraded":"2024-04-26T10:34:13.497249+0000","last_fullsized":"2024-04-26T10:34:13.497249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510494+0000","last_change":"2024-04-26T10:34:14.507265+0000","last_active":"2024-04-26T10:34:14.510494+0000","last_peered":"2024-04-26T10:34:14.510494+0000","last_clean":"2024-04-26T10:34:14.510494+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:34:14.510494+0000","last_undegraded":"2024-04-26T10:34:14.510494+0000","last_fullsized":"2024-04-26T10:34:14.510494+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:07.268421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498960+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:34:13.498960+0000","last_peered":"2024-04-26T10:34:13.498960+0000","last_clean":"2024-04-26T10:34:13.498960+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:34:13.498960+0000","last_undegraded":"2024-04-26T10:34:13.498960+0000","last_fullsized":"2024-04-26T10:34:13.498960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.489387+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:34:13.489387+0000","last_peered":"2024-04-26T10:34:13.489387+0000","last_clean":"2024-04-26T10:34:13.489387+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:34:13.489387+0000","last_undegraded":"2024-04-26T10:34:13.489387+0000","last_fullsized":"2024-04-26T10:34:13.489387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513255+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:34:14.513255+0000","last_peered":"2024-04-26T10:34:14.513255+0000","last_clean":"2024-04-26T10:34:14.513255+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:34:14.513255+0000","last_undegraded":"2024-04-26T10:34:14.513255+0000","last_fullsized":"2024-04-26T10:34:14.513255+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:03.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509249+0000","last_change":"2024-04-26T10:34:14.509249+0000","last_active":"2024-04-26T10:34:14.509249+0000","last_peered":"2024-04-26T10:34:14.509249+0000","last_clean":"2024-04-26T10:34:14.509249+0000","last_became_active":"2024-04-26T10:34:14.508371+0000","last_became_peered":"2024-04-26T10:34:14.508371+0000","last_unstale":"2024-04-26T10:34:14.509249+0000","last_undegraded":"2024-04-26T10:34:14.509249+0000","last_fullsized":"2024-04-26T10:34:14.509249+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:35.257141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.501880+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:34:13.501880+0000","last_peered":"2024-04-26T10:34:13.501880+0000","last_clean":"2024-04-26T10:34:13.501880+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:34:13.501880+0000","last_undegraded":"2024-04-26T10:34:13.501880+0000","last_fullsized":"2024-04-26T10:34:13.501880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494370+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:34:13.494370+0000","last_peered":"2024-04-26T10:34:13.494370+0000","last_clean":"2024-04-26T10:34:13.494370+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:34:13.494370+0000","last_undegraded":"2024-04-26T10:34:13.494370+0000","last_fullsized":"2024-04-26T10:34:13.494370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497329+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:34:13.497329+0000","last_peered":"2024-04-26T10:34:13.497329+0000","last_clean":"2024-04-26T10:34:13.497329+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:34:13.497329+0000","last_undegraded":"2024-04-26T10:34:13.497329+0000","last_fullsized":"2024-04-26T10:34:13.497329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510432+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:34:14.510432+0000","last_peered":"2024-04-26T10:34:14.510432+0000","last_clean":"2024-04-26T10:34:14.510432+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:34:14.510432+0000","last_undegraded":"2024-04-26T10:34:14.510432+0000","last_fullsized":"2024-04-26T10:34:14.510432+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.343269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494669+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:34:13.494669+0000","last_peered":"2024-04-26T10:34:13.494669+0000","last_clean":"2024-04-26T10:34:13.494669+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:34:13.494669+0000","last_undegraded":"2024-04-26T10:34:13.494669+0000","last_fullsized":"2024-04-26T10:34:13.494669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498977+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:34:13.498977+0000","last_peered":"2024-04-26T10:34:13.498977+0000","last_clean":"2024-04-26T10:34:13.498977+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:34:13.498977+0000","last_undegraded":"2024-04-26T10:34:13.498977+0000","last_fullsized":"2024-04-26T10:34:13.498977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498830+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:34:13.498830+0000","last_peered":"2024-04-26T10:34:13.498830+0000","last_clean":"2024-04-26T10:34:13.498830+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:34:13.498830+0000","last_undegraded":"2024-04-26T10:34:13.498830+0000","last_fullsized":"2024-04-26T10:34:13.498830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488236+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:34:13.488236+0000","last_peered":"2024-04-26T10:34:13.488236+0000","last_clean":"2024-04-26T10:34:13.488236+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:34:13.488236+0000","last_undegraded":"2024-04-26T10:34:13.488236+0000","last_fullsized":"2024-04-26T10:34:13.488236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500095+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:34:13.500095+0000","last_peered":"2024-04-26T10:34:13.500095+0000","last_clean":"2024-04-26T10:34:13.500095+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:34:13.500095+0000","last_undegraded":"2024-04-26T10:34:13.500095+0000","last_fullsized":"2024-04-26T10:34:13.500095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.492271+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:34:13.492271+0000","last_peered":"2024-04-26T10:34:13.492271+0000","last_clean":"2024-04-26T10:34:13.492271+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:34:13.492271+0000","last_undegraded":"2024-04-26T10:34:13.492271+0000","last_fullsized":"2024-04-26T10:34:13.492271+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.516602+0000","last_change":"2024-04-26T10:34:14.511829+0000","last_active":"2024-04-26T10:34:14.516602+0000","last_peered":"2024-04-26T10:34:14.516602+0000","last_clean":"2024-04-26T10:34:14.516602+0000","last_became_active":"2024-04-26T10:34:14.511584+0000","last_became_peered":"2024-04-26T10:34:14.511584+0000","last_unstale":"2024-04-26T10:34:14.516602+0000","last_undegraded":"2024-04-26T10:34:14.516602+0000","last_fullsized":"2024-04-26T10:34:14.516602+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:30.166797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497341+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:34:13.497341+0000","last_peered":"2024-04-26T10:34:13.497341+0000","last_clean":"2024-04-26T10:34:13.497341+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:34:13.497341+0000","last_undegraded":"2024-04-26T10:34:13.497341+0000","last_fullsized":"2024-04-26T10:34:13.497341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499319+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:34:13.499319+0000","last_peered":"2024-04-26T10:34:13.499319+0000","last_clean":"2024-04-26T10:34:13.499319+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:34:13.499319+0000","last_undegraded":"2024-04-26T10:34:13.499319+0000","last_fullsized":"2024-04-26T10:34:13.499319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488262+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:34:13.488262+0000","last_peered":"2024-04-26T10:34:13.488262+0000","last_clean":"2024-04-26T10:34:13.488262+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:34:13.488262+0000","last_undegraded":"2024-04-26T10:34:13.488262+0000","last_fullsized":"2024-04-26T10:34:13.488262+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.489169+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:34:13.489169+0000","last_peered":"2024-04-26T10:34:13.489169+0000","last_clean":"2024-04-26T10:34:13.489169+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:34:13.489169+0000","last_undegraded":"2024-04-26T10:34:13.489169+0000","last_fullsized":"2024-04-26T10:34:13.489169+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500180+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:34:13.500180+0000","last_peered":"2024-04-26T10:34:13.500180+0000","last_clean":"2024-04-26T10:34:13.500180+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:34:13.500180+0000","last_undegraded":"2024-04-26T10:34:13.500180+0000","last_fullsized":"2024-04-26T10:34:13.500180+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497506+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:34:13.497506+0000","last_peered":"2024-04-26T10:34:13.497506+0000","last_clean":"2024-04-26T10:34:13.497506+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:34:13.497506+0000","last_undegraded":"2024-04-26T10:34:13.497506+0000","last_fullsized":"2024-04-26T10:34:13.497506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":54,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511168+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:34:14.511168+0000","last_peered":"2024-04-26T10:34:14.511168+0000","last_clean":"2024-04-26T10:34:14.511168+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:34:14.511168+0000","last_undegraded":"2024-04-26T10:34:14.511168+0000","last_fullsized":"2024-04-26T10:34:14.511168+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:19.856062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488984+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:34:13.488984+0000","last_peered":"2024-04-26T10:34:13.488984+0000","last_clean":"2024-04-26T10:34:13.488984+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:34:13.488984+0000","last_undegraded":"2024-04-26T10:34:13.488984+0000","last_fullsized":"2024-04-26T10:34:13.488984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498920+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:34:13.498920+0000","last_peered":"2024-04-26T10:34:13.498920+0000","last_clean":"2024-04-26T10:34:13.498920+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:34:13.498920+0000","last_undegraded":"2024-04-26T10:34:13.498920+0000","last_fullsized":"2024-04-26T10:34:13.498920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511362+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:34:14.511362+0000","last_peered":"2024-04-26T10:34:14.511362+0000","last_clean":"2024-04-26T10:34:14.511362+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:34:14.511362+0000","last_undegraded":"2024-04-26T10:34:14.511362+0000","last_fullsized":"2024-04-26T10:34:14.511362+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:04.852453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494871+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:34:13.494871+0000","last_peered":"2024-04-26T10:34:13.494871+0000","last_clean":"2024-04-26T10:34:13.494871+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:34:13.494871+0000","last_undegraded":"2024-04-26T10:34:13.494871+0000","last_fullsized":"2024-04-26T10:34:13.494871+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500325+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:34:13.500325+0000","last_peered":"2024-04-26T10:34:13.500325+0000","last_clean":"2024-04-26T10:34:13.500325+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:34:13.500325+0000","last_undegraded":"2024-04-26T10:34:13.500325+0000","last_fullsized":"2024-04-26T10:34:13.500325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.523338+0000","last_change":"2024-04-26T10:34:14.518131+0000","last_active":"2024-04-26T10:34:14.523338+0000","last_peered":"2024-04-26T10:34:14.523338+0000","last_clean":"2024-04-26T10:34:14.523338+0000","last_became_active":"2024-04-26T10:34:14.506010+0000","last_became_peered":"2024-04-26T10:34:14.506010+0000","last_unstale":"2024-04-26T10:34:14.523338+0000","last_undegraded":"2024-04-26T10:34:14.523338+0000","last_fullsized":"2024-04-26T10:34:14.523338+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:51.842115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509381+0000","last_change":"2024-04-26T10:34:14.509381+0000","last_active":"2024-04-26T10:34:14.509381+0000","last_peered":"2024-04-26T10:34:14.509381+0000","last_clean":"2024-04-26T10:34:14.509381+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:34:14.509381+0000","last_undegraded":"2024-04-26T10:34:14.509381+0000","last_fullsized":"2024-04-26T10:34:14.509381+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:05.841519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":80,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.548596+0000","last_change":"2024-04-26T10:34:14.548596+0000","last_active":"2024-04-26T10:34:14.548596+0000","last_peered":"2024-04-26T10:34:14.548596+0000","last_clean":"2024-04-26T10:34:14.548596+0000","last_became_active":"2024-04-26T10:34:14.512027+0000","last_became_peered":"2024-04-26T10:34:14.512027+0000","last_unstale":"2024-04-26T10:34:14.548596+0000","last_undegraded":"2024-04-26T10:34:14.548596+0000","last_fullsized":"2024-04-26T10:34:14.548596+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:39.957573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513656+0000","last_change":"2024-04-26T10:34:14.513656+0000","last_active":"2024-04-26T10:34:14.513656+0000","last_peered":"2024-04-26T10:34:14.513656+0000","last_clean":"2024-04-26T10:34:14.513656+0000","last_became_active":"2024-04-26T10:34:14.513402+0000","last_became_peered":"2024-04-26T10:34:14.513402+0000","last_unstale":"2024-04-26T10:34:14.513656+0000","last_undegraded":"2024-04-26T10:34:14.513656+0000","last_fullsized":"2024-04-26T10:34:14.513656+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:22.053611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500059+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:34:13.500059+0000","last_peered":"2024-04-26T10:34:13.500059+0000","last_clean":"2024-04-26T10:34:13.500059+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:34:13.500059+0000","last_undegraded":"2024-04-26T10:34:13.500059+0000","last_fullsized":"2024-04-26T10:34:13.500059+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510736+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:34:14.510736+0000","last_peered":"2024-04-26T10:34:14.510736+0000","last_clean":"2024-04-26T10:34:14.510736+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:34:14.510736+0000","last_undegraded":"2024-04-26T10:34:14.510736+0000","last_fullsized":"2024-04-26T10:34:14.510736+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:02.872251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.496178+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:34:13.496178+0000","last_peered":"2024-04-26T10:34:13.496178+0000","last_clean":"2024-04-26T10:34:13.496178+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:34:13.496178+0000","last_undegraded":"2024-04-26T10:34:13.496178+0000","last_fullsized":"2024-04-26T10:34:13.496178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511581+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:34:14.511581+0000","last_peered":"2024-04-26T10:34:14.511581+0000","last_clean":"2024-04-26T10:34:14.511581+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:34:14.511581+0000","last_undegraded":"2024-04-26T10:34:14.511581+0000","last_fullsized":"2024-04-26T10:34:14.511581+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:43.500342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510605+0000","last_change":"2024-04-26T10:34:14.509818+0000","last_active":"2024-04-26T10:34:14.510605+0000","last_peered":"2024-04-26T10:34:14.510605+0000","last_clean":"2024-04-26T10:34:14.510605+0000","last_became_active":"2024-04-26T10:34:14.509270+0000","last_became_peered":"2024-04-26T10:34:14.509270+0000","last_unstale":"2024-04-26T10:34:14.510605+0000","last_undegraded":"2024-04-26T10:34:14.510605+0000","last_fullsized":"2024-04-26T10:34:14.510605+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:45.412620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498283+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:34:13.498283+0000","last_peered":"2024-04-26T10:34:13.498283+0000","last_clean":"2024-04-26T10:34:13.498283+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:34:13.498283+0000","last_undegraded":"2024-04-26T10:34:13.498283+0000","last_fullsized":"2024-04-26T10:34:13.498283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":82,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.531646+0000","last_change":"2024-04-26T10:34:14.531646+0000","last_active":"2024-04-26T10:34:14.531646+0000","last_peered":"2024-04-26T10:34:14.531646+0000","last_clean":"2024-04-26T10:34:14.531646+0000","last_became_active":"2024-04-26T10:34:14.511911+0000","last_became_peered":"2024-04-26T10:34:14.511911+0000","last_unstale":"2024-04-26T10:34:14.531646+0000","last_undegraded":"2024-04-26T10:34:14.531646+0000","last_fullsized":"2024-04-26T10:34:14.531646+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:39.588939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499927+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:34:13.499927+0000","last_peered":"2024-04-26T10:34:13.499927+0000","last_clean":"2024-04-26T10:34:13.499927+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:34:13.499927+0000","last_undegraded":"2024-04-26T10:34:13.499927+0000","last_fullsized":"2024-04-26T10:34:13.499927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"42'8158","reported_seq":11257,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.549415+0000","last_change":"2024-04-26T10:34:14.549017+0000","last_active":"2024-04-26T10:34:14.549415+0000","last_peered":"2024-04-26T10:34:14.549415+0000","last_clean":"2024-04-26T10:34:14.549415+0000","last_became_active":"2024-04-26T10:34:14.518037+0000","last_became_peered":"2024-04-26T10:34:14.518037+0000","last_unstale":"2024-04-26T10:34:14.549415+0000","last_undegraded":"2024-04-26T10:34:14.549415+0000","last_fullsized":"2024-04-26T10:34:14.549415+0000","mapping_epoch":41,"log_start":"29'5291","ondisk_log_start":"29'5291","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2867,"log_dups_size":1542,"ondisk_log_size":2867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:21.571693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":534642688,"num_objects":8158,"num_object_clones":0,"num_object_copies":16316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8158,"num_write_kb":522112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1524,"num_bytes_recovered":99876864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":63,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.536943+0000","last_change":"2024-04-26T10:34:14.536943+0000","last_active":"2024-04-26T10:34:14.536943+0000","last_peered":"2024-04-26T10:34:14.536943+0000","last_clean":"2024-04-26T10:34:14.536943+0000","last_became_active":"2024-04-26T10:34:14.511960+0000","last_became_peered":"2024-04-26T10:34:14.511960+0000","last_unstale":"2024-04-26T10:34:14.536943+0000","last_undegraded":"2024-04-26T10:34:14.536943+0000","last_fullsized":"2024-04-26T10:34:14.536943+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.329973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.492102+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:34:13.492102+0000","last_peered":"2024-04-26T10:34:13.492102+0000","last_clean":"2024-04-26T10:34:13.492102+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:34:13.492102+0000","last_undegraded":"2024-04-26T10:34:13.492102+0000","last_fullsized":"2024-04-26T10:34:13.492102+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"42'8366","reported_seq":8400,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.563489+0000","last_change":"2024-04-26T10:33:16.346351+0000","last_active":"2024-04-26T10:34:14.563489+0000","last_peered":"2024-04-26T10:34:14.563489+0000","last_clean":"2024-04-26T10:34:14.563489+0000","last_became_active":"2024-04-26T10:33:16.346122+0000","last_became_peered":"2024-04-26T10:33:16.346122+0000","last_unstale":"2024-04-26T10:34:14.563489+0000","last_undegraded":"2024-04-26T10:34:14.563489+0000","last_fullsized":"2024-04-26T10:34:14.563489+0000","mapping_epoch":16,"log_start":"26'4364","ondisk_log_start":"26'4364","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":4002,"log_dups_size":0,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:13.714464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":548274176,"num_objects":8366,"num_object_clones":0,"num_object_copies":16732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8366,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":535424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488538+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:34:13.488538+0000","last_peered":"2024-04-26T10:34:13.488538+0000","last_clean":"2024-04-26T10:34:13.488538+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:34:13.488538+0000","last_undegraded":"2024-04-26T10:34:13.488538+0000","last_fullsized":"2024-04-26T10:34:13.488538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510461+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:34:14.510461+0000","last_peered":"2024-04-26T10:34:14.510461+0000","last_clean":"2024-04-26T10:34:14.510461+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:34:14.510461+0000","last_undegraded":"2024-04-26T10:34:14.510461+0000","last_fullsized":"2024-04-26T10:34:14.510461+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:12.954308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"40'8199","reported_seq":11536,"reported_epoch":40,"state":"peering","last_fresh":"2024-04-26T10:34:13.471961+0000","last_change":"2024-04-26T10:34:14.500388+0000","last_active":"2024-04-26T10:34:14.500388+0000","last_peered":"2024-04-26T10:34:13.471961+0000","last_clean":"2024-04-26T10:34:00.443121+0000","last_became_active":"2024-04-26T10:34:02.510251+0000","last_became_peered":"2024-04-26T10:34:02.510251+0000","last_unstale":"2024-04-26T10:34:13.471961+0000","last_undegraded":"2024-04-26T10:34:13.471961+0000","last_fullsized":"2024-04-26T10:34:13.471961+0000","mapping_epoch":42,"log_start":"29'5264","ondisk_log_start":"29'5264","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2935,"log_dups_size":1442,"ondisk_log_size":2935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:40.416790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537329664,"num_objects":8199,"num_object_clones":0,"num_object_copies":16398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":524736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1649,"num_bytes_recovered":108068864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500554+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:34:13.500554+0000","last_peered":"2024-04-26T10:34:13.500554+0000","last_clean":"2024-04-26T10:34:13.500554+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:34:13.500554+0000","last_undegraded":"2024-04-26T10:34:13.500554+0000","last_fullsized":"2024-04-26T10:34:13.500554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.495036+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:34:13.495036+0000","last_peered":"2024-04-26T10:34:13.495036+0000","last_clean":"2024-04-26T10:34:13.495036+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:34:13.495036+0000","last_undegraded":"2024-04-26T10:34:13.495036+0000","last_fullsized":"2024-04-26T10:34:13.495036+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"42'8232","reported_seq":8266,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.539351+0000","last_change":"2024-04-26T10:33:16.346212+0000","last_active":"2024-04-26T10:34:14.539351+0000","last_peered":"2024-04-26T10:34:14.539351+0000","last_clean":"2024-04-26T10:34:14.539351+0000","last_became_active":"2024-04-26T10:33:16.346004+0000","last_became_peered":"2024-04-26T10:33:16.346004+0000","last_unstale":"2024-04-26T10:34:14.539351+0000","last_undegraded":"2024-04-26T10:34:14.539351+0000","last_fullsized":"2024-04-26T10:34:14.539351+0000","mapping_epoch":16,"log_start":"29'5354","ondisk_log_start":"29'5354","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2878,"log_dups_size":1542,"ondisk_log_size":2878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:27.495754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539492352,"num_objects":8232,"num_object_clones":0,"num_object_copies":16464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8232,"num_write_kb":526848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.495715+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:34:13.495715+0000","last_peered":"2024-04-26T10:34:13.495715+0000","last_clean":"2024-04-26T10:34:13.495715+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:34:13.495715+0000","last_undegraded":"2024-04-26T10:34:13.495715+0000","last_fullsized":"2024-04-26T10:34:13.495715+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500549+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:34:13.500549+0000","last_peered":"2024-04-26T10:34:13.500549+0000","last_clean":"2024-04-26T10:34:13.500549+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:34:13.500549+0000","last_undegraded":"2024-04-26T10:34:13.500549+0000","last_fullsized":"2024-04-26T10:34:13.500549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"40'8104","reported_seq":8142,"reported_epoch":40,"state":"peering","last_fresh":"2024-04-26T10:34:13.471569+0000","last_change":"2024-04-26T10:34:14.501539+0000","last_active":"2024-04-26T10:34:14.501539+0000","last_peered":"2024-04-26T10:34:13.471569+0000","last_clean":"2024-04-26T10:34:00.445985+0000","last_became_active":"2024-04-26T10:34:02.502550+0000","last_became_peered":"2024-04-26T10:34:02.502550+0000","last_unstale":"2024-04-26T10:34:13.471569+0000","last_undegraded":"2024-04-26T10:34:13.471569+0000","last_fullsized":"2024-04-26T10:34:13.471569+0000","mapping_epoch":42,"log_start":"29'5172","ondisk_log_start":"29'5172","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":1442,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:03.212384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531103744,"num_objects":8104,"num_object_clones":0,"num_object_copies":16208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8104,"num_write_kb":518656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500740+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:34:13.500740+0000","last_peered":"2024-04-26T10:34:13.500740+0000","last_clean":"2024-04-26T10:34:13.500740+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:34:13.500740+0000","last_undegraded":"2024-04-26T10:34:13.500740+0000","last_fullsized":"2024-04-26T10:34:13.500740+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.495797+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:34:13.495797+0000","last_peered":"2024-04-26T10:34:13.495797+0000","last_clean":"2024-04-26T10:34:13.495797+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:34:13.495797+0000","last_undegraded":"2024-04-26T10:34:13.495797+0000","last_fullsized":"2024-04-26T10:34:13.495797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"42'8121","reported_seq":8155,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.539261+0000","last_change":"2024-04-26T10:33:16.349242+0000","last_active":"2024-04-26T10:34:14.539261+0000","last_peered":"2024-04-26T10:34:14.539261+0000","last_clean":"2024-04-26T10:34:14.539261+0000","last_became_active":"2024-04-26T10:33:16.349063+0000","last_became_peered":"2024-04-26T10:33:16.349063+0000","last_unstale":"2024-04-26T10:34:14.539261+0000","last_undegraded":"2024-04-26T10:34:14.539261+0000","last_fullsized":"2024-04-26T10:34:14.539261+0000","mapping_epoch":16,"log_start":"28'5162","ondisk_log_start":"28'5162","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2959,"log_dups_size":1442,"ondisk_log_size":2959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:09.297624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532217856,"num_objects":8121,"num_object_clones":0,"num_object_copies":16242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8121,"num_write_kb":519744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.493724+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:34:13.493724+0000","last_peered":"2024-04-26T10:34:13.493724+0000","last_clean":"2024-04-26T10:34:13.493724+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:34:13.493724+0000","last_undegraded":"2024-04-26T10:34:13.493724+0000","last_fullsized":"2024-04-26T10:34:13.493724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500444+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:34:13.500444+0000","last_peered":"2024-04-26T10:34:13.500444+0000","last_clean":"2024-04-26T10:34:13.500444+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:34:13.500444+0000","last_undegraded":"2024-04-26T10:34:13.500444+0000","last_fullsized":"2024-04-26T10:34:13.500444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"42'7888","reported_seq":7940,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.549556+0000","last_change":"2024-04-26T10:34:14.549556+0000","last_active":"2024-04-26T10:34:14.549556+0000","last_peered":"2024-04-26T10:34:14.549556+0000","last_clean":"2024-04-26T10:34:14.549556+0000","last_became_active":"2024-04-26T10:34:14.520855+0000","last_became_peered":"2024-04-26T10:34:14.520855+0000","last_unstale":"2024-04-26T10:34:14.549556+0000","last_undegraded":"2024-04-26T10:34:14.549556+0000","last_fullsized":"2024-04-26T10:34:14.549556+0000","mapping_epoch":41,"log_start":"28'5005","ondisk_log_start":"28'5005","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2883,"log_dups_size":1442,"ondisk_log_size":2883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:48.789996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516947968,"num_objects":7888,"num_object_clones":0,"num_object_copies":15776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7888,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7888,"num_write_kb":504832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488180+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:34:13.488180+0000","last_peered":"2024-04-26T10:34:13.488180+0000","last_clean":"2024-04-26T10:34:13.488180+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:34:13.488180+0000","last_undegraded":"2024-04-26T10:34:13.488180+0000","last_fullsized":"2024-04-26T10:34:13.488180+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509460+0000","last_change":"2024-04-26T10:34:14.509460+0000","last_active":"2024-04-26T10:34:14.509460+0000","last_peered":"2024-04-26T10:34:14.509460+0000","last_clean":"2024-04-26T10:34:14.509460+0000","last_became_active":"2024-04-26T10:34:14.509213+0000","last_became_peered":"2024-04-26T10:34:14.509213+0000","last_unstale":"2024-04-26T10:34:14.509460+0000","last_undegraded":"2024-04-26T10:34:14.509460+0000","last_fullsized":"2024-04-26T10:34:14.509460+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:15.816526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"42'8055","reported_seq":8089,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.498076+0000","last_change":"2024-04-26T10:33:16.344866+0000","last_active":"2024-04-26T10:34:14.498076+0000","last_peered":"2024-04-26T10:34:14.498076+0000","last_clean":"2024-04-26T10:34:14.498076+0000","last_became_active":"2024-04-26T10:33:16.344614+0000","last_became_peered":"2024-04-26T10:33:16.344614+0000","last_unstale":"2024-04-26T10:34:14.498076+0000","last_undegraded":"2024-04-26T10:34:14.498076+0000","last_fullsized":"2024-04-26T10:34:14.498076+0000","mapping_epoch":16,"log_start":"26'4054","ondisk_log_start":"26'4054","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":4001,"log_dups_size":0,"ondisk_log_size":4001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":527892480,"num_objects":8055,"num_object_clones":0,"num_object_copies":16110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8055,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8055,"num_write_kb":515520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510428+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:34:14.510428+0000","last_peered":"2024-04-26T10:34:14.510428+0000","last_clean":"2024-04-26T10:34:14.510428+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:34:14.510428+0000","last_undegraded":"2024-04-26T10:34:14.510428+0000","last_fullsized":"2024-04-26T10:34:14.510428+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:35.111495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498309+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:34:13.498309+0000","last_peered":"2024-04-26T10:34:13.498309+0000","last_clean":"2024-04-26T10:34:13.498309+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:34:13.498309+0000","last_undegraded":"2024-04-26T10:34:13.498309+0000","last_fullsized":"2024-04-26T10:34:13.498309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"42'8049","reported_seq":8083,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.542200+0000","last_change":"2024-04-26T10:33:16.349280+0000","last_active":"2024-04-26T10:34:14.542200+0000","last_peered":"2024-04-26T10:34:14.542200+0000","last_clean":"2024-04-26T10:34:14.542200+0000","last_became_active":"2024-04-26T10:33:16.349010+0000","last_became_peered":"2024-04-26T10:33:16.349010+0000","last_unstale":"2024-04-26T10:34:14.542200+0000","last_undegraded":"2024-04-26T10:34:14.542200+0000","last_fullsized":"2024-04-26T10:34:14.542200+0000","mapping_epoch":16,"log_start":"28'5171","ondisk_log_start":"28'5171","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2878,"log_dups_size":1442,"ondisk_log_size":2878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:08.933996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":527499264,"num_objects":8049,"num_object_clones":0,"num_object_copies":16098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8049,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8049,"num_write_kb":515136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511174+0000","last_change":"2024-04-26T10:34:14.511174+0000","last_active":"2024-04-26T10:34:14.511174+0000","last_peered":"2024-04-26T10:34:14.511174+0000","last_clean":"2024-04-26T10:34:14.511174+0000","last_became_active":"2024-04-26T10:34:14.510907+0000","last_became_peered":"2024-04-26T10:34:14.510907+0000","last_unstale":"2024-04-26T10:34:14.511174+0000","last_undegraded":"2024-04-26T10:34:14.511174+0000","last_fullsized":"2024-04-26T10:34:14.511174+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:34.574586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499450+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:34:13.499450+0000","last_peered":"2024-04-26T10:34:13.499450+0000","last_clean":"2024-04-26T10:34:13.499450+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:34:13.499450+0000","last_undegraded":"2024-04-26T10:34:13.499450+0000","last_fullsized":"2024-04-26T10:34:13.499450+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510449+0000","last_change":"2024-04-26T10:34:14.506552+0000","last_active":"2024-04-26T10:34:14.510449+0000","last_peered":"2024-04-26T10:34:14.510449+0000","last_clean":"2024-04-26T10:34:14.510449+0000","last_became_active":"2024-04-26T10:34:14.506008+0000","last_became_peered":"2024-04-26T10:34:14.506008+0000","last_unstale":"2024-04-26T10:34:14.510449+0000","last_undegraded":"2024-04-26T10:34:14.510449+0000","last_fullsized":"2024-04-26T10:34:14.510449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.031036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"42'8063","reported_seq":8097,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.503467+0000","last_change":"2024-04-26T10:33:16.349302+0000","last_active":"2024-04-26T10:34:14.503467+0000","last_peered":"2024-04-26T10:34:14.503467+0000","last_clean":"2024-04-26T10:34:14.503467+0000","last_became_active":"2024-04-26T10:33:16.348992+0000","last_became_peered":"2024-04-26T10:33:16.348992+0000","last_unstale":"2024-04-26T10:34:14.503467+0000","last_undegraded":"2024-04-26T10:34:14.503467+0000","last_fullsized":"2024-04-26T10:34:14.503467+0000","mapping_epoch":16,"log_start":"29'5157","ondisk_log_start":"29'5157","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":1442,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:15.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528416768,"num_objects":8063,"num_object_clones":0,"num_object_copies":16126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8063,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8063,"num_write_kb":516032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494391+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:34:13.494391+0000","last_peered":"2024-04-26T10:34:13.494391+0000","last_clean":"2024-04-26T10:34:13.494391+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:34:13.494391+0000","last_undegraded":"2024-04-26T10:34:13.494391+0000","last_fullsized":"2024-04-26T10:34:13.494391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499966+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:34:13.499966+0000","last_peered":"2024-04-26T10:34:13.499966+0000","last_clean":"2024-04-26T10:34:13.499966+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:34:13.499966+0000","last_undegraded":"2024-04-26T10:34:13.499966+0000","last_fullsized":"2024-04-26T10:34:13.499966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513348+0000","last_change":"2024-04-26T10:34:14.513348+0000","last_active":"2024-04-26T10:34:14.513348+0000","last_peered":"2024-04-26T10:34:14.513348+0000","last_clean":"2024-04-26T10:34:14.513348+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:34:14.513348+0000","last_undegraded":"2024-04-26T10:34:14.513348+0000","last_fullsized":"2024-04-26T10:34:14.513348+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:21.161769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"41'8130","reported_seq":8164,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.516120+0000","last_change":"2024-04-26T10:33:16.349181+0000","last_active":"2024-04-26T10:34:13.516120+0000","last_peered":"2024-04-26T10:34:13.516120+0000","last_clean":"2024-04-26T10:34:13.516120+0000","last_became_active":"2024-04-26T10:33:16.348981+0000","last_became_peered":"2024-04-26T10:33:16.348981+0000","last_unstale":"2024-04-26T10:34:13.516120+0000","last_undegraded":"2024-04-26T10:34:13.516120+0000","last_fullsized":"2024-04-26T10:34:13.516120+0000","mapping_epoch":16,"log_start":"29'5184","ondisk_log_start":"29'5184","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":1442,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532807680,"num_objects":8130,"num_object_clones":0,"num_object_copies":16260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8130,"num_write_kb":520320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500009+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:34:13.500009+0000","last_peered":"2024-04-26T10:34:13.500009+0000","last_clean":"2024-04-26T10:34:13.500009+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:34:13.500009+0000","last_undegraded":"2024-04-26T10:34:13.500009+0000","last_fullsized":"2024-04-26T10:34:13.500009+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.492182+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:34:13.492182+0000","last_peered":"2024-04-26T10:34:13.492182+0000","last_clean":"2024-04-26T10:34:13.492182+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:34:13.492182+0000","last_undegraded":"2024-04-26T10:34:13.492182+0000","last_fullsized":"2024-04-26T10:34:13.492182+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511363+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:34:14.511363+0000","last_peered":"2024-04-26T10:34:14.511363+0000","last_clean":"2024-04-26T10:34:14.511363+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:34:14.511363+0000","last_undegraded":"2024-04-26T10:34:14.511363+0000","last_fullsized":"2024-04-26T10:34:14.511363+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:57.803542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"40'8122","reported_seq":8160,"reported_epoch":40,"state":"peering","last_fresh":"2024-04-26T10:34:13.469763+0000","last_change":"2024-04-26T10:34:14.500169+0000","last_active":"2024-04-26T10:34:14.500169+0000","last_peered":"2024-04-26T10:34:13.469763+0000","last_clean":"2024-04-26T10:34:00.447964+0000","last_became_active":"2024-04-26T10:34:02.523429+0000","last_became_peered":"2024-04-26T10:34:02.523429+0000","last_unstale":"2024-04-26T10:34:13.469763+0000","last_undegraded":"2024-04-26T10:34:13.469763+0000","last_fullsized":"2024-04-26T10:34:13.469763+0000","mapping_epoch":42,"log_start":"29'5257","ondisk_log_start":"29'5257","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2865,"log_dups_size":1542,"ondisk_log_size":2865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:23.452922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532283392,"num_objects":8122,"num_object_clones":0,"num_object_copies":16244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8122,"num_write_kb":519808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499450+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:34:13.499450+0000","last_peered":"2024-04-26T10:34:13.499450+0000","last_clean":"2024-04-26T10:34:13.499450+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:34:13.499450+0000","last_undegraded":"2024-04-26T10:34:13.499450+0000","last_fullsized":"2024-04-26T10:34:13.499450+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":260,"reported_epoch":42,"state":"remapped+peering","last_fresh":"2024-04-26T10:34:14.499234+0000","last_change":"2024-04-26T10:34:14.500746+0000","last_active":"2024-04-26T10:34:13.494830+0000","last_peered":"2024-04-26T10:34:12.484561+0000","last_clean":"2024-04-26T10:34:12.484561+0000","last_became_active":"2024-04-26T10:34:04.467654+0000","last_became_peered":"2024-04-26T10:34:04.467654+0000","last_unstale":"2024-04-26T10:34:14.499234+0000","last_undegraded":"2024-04-26T10:34:14.499234+0000","last_fullsized":"2024-04-26T10:34:14.499234+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:19.317224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.496016+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:34:13.496016+0000","last_peered":"2024-04-26T10:34:13.496016+0000","last_clean":"2024-04-26T10:34:13.496016+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:34:13.496016+0000","last_undegraded":"2024-04-26T10:34:13.496016+0000","last_fullsized":"2024-04-26T10:34:13.496016+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509642+0000","last_change":"2024-04-26T10:34:14.509642+0000","last_active":"2024-04-26T10:34:14.509642+0000","last_peered":"2024-04-26T10:34:14.509642+0000","last_clean":"2024-04-26T10:34:14.509642+0000","last_became_active":"2024-04-26T10:34:14.509329+0000","last_became_peered":"2024-04-26T10:34:14.509329+0000","last_unstale":"2024-04-26T10:34:14.509642+0000","last_undegraded":"2024-04-26T10:34:14.509642+0000","last_fullsized":"2024-04-26T10:34:14.509642+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:20.861292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"42'8068","reported_seq":8102,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.542842+0000","last_change":"2024-04-26T10:33:16.344693+0000","last_active":"2024-04-26T10:34:14.542842+0000","last_peered":"2024-04-26T10:34:14.542842+0000","last_clean":"2024-04-26T10:34:14.542842+0000","last_became_active":"2024-04-26T10:33:16.344478+0000","last_became_peered":"2024-04-26T10:33:16.344478+0000","last_unstale":"2024-04-26T10:34:14.542842+0000","last_undegraded":"2024-04-26T10:34:14.542842+0000","last_fullsized":"2024-04-26T10:34:14.542842+0000","mapping_epoch":16,"log_start":"29'5133","ondisk_log_start":"29'5133","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2935,"log_dups_size":1442,"ondisk_log_size":2935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:24.298876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528744448,"num_objects":8068,"num_object_clones":0,"num_object_copies":16136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8068,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8068,"num_write_kb":516352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509367+0000","last_change":"2024-04-26T10:34:14.509367+0000","last_active":"2024-04-26T10:34:14.509367+0000","last_peered":"2024-04-26T10:34:14.509367+0000","last_clean":"2024-04-26T10:34:14.509367+0000","last_became_active":"2024-04-26T10:34:14.508465+0000","last_became_peered":"2024-04-26T10:34:14.508465+0000","last_unstale":"2024-04-26T10:34:14.509367+0000","last_undegraded":"2024-04-26T10:34:14.509367+0000","last_fullsized":"2024-04-26T10:34:14.509367+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:31.790156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499920+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:34:13.499920+0000","last_peered":"2024-04-26T10:34:13.499920+0000","last_clean":"2024-04-26T10:34:13.499920+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:34:13.499920+0000","last_undegraded":"2024-04-26T10:34:13.499920+0000","last_fullsized":"2024-04-26T10:34:13.499920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488609+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:34:13.488609+0000","last_peered":"2024-04-26T10:34:13.488609+0000","last_clean":"2024-04-26T10:34:13.488609+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:34:13.488609+0000","last_undegraded":"2024-04-26T10:34:13.488609+0000","last_fullsized":"2024-04-26T10:34:13.488609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"42'8200","reported_seq":8234,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.538890+0000","last_change":"2024-04-26T10:33:16.344694+0000","last_active":"2024-04-26T10:34:14.538890+0000","last_peered":"2024-04-26T10:34:14.538890+0000","last_clean":"2024-04-26T10:34:14.538890+0000","last_became_active":"2024-04-26T10:33:16.344461+0000","last_became_peered":"2024-04-26T10:33:16.344461+0000","last_unstale":"2024-04-26T10:34:14.538890+0000","last_undegraded":"2024-04-26T10:34:14.538890+0000","last_fullsized":"2024-04-26T10:34:14.538890+0000","mapping_epoch":16,"log_start":"29'5284","ondisk_log_start":"29'5284","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":1442,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:29.374096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537395200,"num_objects":8200,"num_object_clones":0,"num_object_copies":16400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8200,"num_write_kb":524800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511624+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:34:14.511624+0000","last_peered":"2024-04-26T10:34:14.511624+0000","last_clean":"2024-04-26T10:34:14.511624+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:34:14.511624+0000","last_undegraded":"2024-04-26T10:34:14.511624+0000","last_fullsized":"2024-04-26T10:34:14.511624+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":54,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509602+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:34:14.509602+0000","last_peered":"2024-04-26T10:34:14.509602+0000","last_clean":"2024-04-26T10:34:14.509602+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:34:14.509602+0000","last_undegraded":"2024-04-26T10:34:14.509602+0000","last_fullsized":"2024-04-26T10:34:14.509602+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:21.048381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488843+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:34:13.488843+0000","last_peered":"2024-04-26T10:34:13.488843+0000","last_clean":"2024-04-26T10:34:13.488843+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:34:13.488843+0000","last_undegraded":"2024-04-26T10:34:13.488843+0000","last_fullsized":"2024-04-26T10:34:13.488843+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"42'8180","reported_seq":8214,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.542566+0000","last_change":"2024-04-26T10:33:16.344714+0000","last_active":"2024-04-26T10:34:14.542566+0000","last_peered":"2024-04-26T10:34:14.542566+0000","last_clean":"2024-04-26T10:34:14.542566+0000","last_became_active":"2024-04-26T10:33:16.344500+0000","last_became_peered":"2024-04-26T10:33:16.344500+0000","last_unstale":"2024-04-26T10:34:14.542566+0000","last_undegraded":"2024-04-26T10:34:14.542566+0000","last_fullsized":"2024-04-26T10:34:14.542566+0000","mapping_epoch":16,"log_start":"29'5235","ondisk_log_start":"29'5235","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2945,"log_dups_size":1442,"ondisk_log_size":2945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:19.056484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536084480,"num_objects":8180,"num_object_clones":0,"num_object_copies":16360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8180,"num_write_kb":523520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497426+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:34:13.497426+0000","last_peered":"2024-04-26T10:34:13.497426+0000","last_clean":"2024-04-26T10:34:13.497426+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:34:13.497426+0000","last_undegraded":"2024-04-26T10:34:13.497426+0000","last_fullsized":"2024-04-26T10:34:13.497426+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509515+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:34:14.509515+0000","last_peered":"2024-04-26T10:34:14.509515+0000","last_clean":"2024-04-26T10:34:14.509515+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:34:14.509515+0000","last_undegraded":"2024-04-26T10:34:14.509515+0000","last_fullsized":"2024-04-26T10:34:14.509515+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.172123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500430+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:34:13.500430+0000","last_peered":"2024-04-26T10:34:13.500430+0000","last_clean":"2024-04-26T10:34:13.500430+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:34:13.500430+0000","last_undegraded":"2024-04-26T10:34:13.500430+0000","last_fullsized":"2024-04-26T10:34:13.500430+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'8103","reported_seq":8139,"reported_epoch":40,"state":"peering","last_fresh":"2024-04-26T10:34:13.458972+0000","last_change":"2024-04-26T10:34:14.498783+0000","last_active":"2024-04-26T10:34:14.498783+0000","last_peered":"2024-04-26T10:34:13.458972+0000","last_clean":"2024-04-26T10:34:00.424582+0000","last_became_active":"2024-04-26T10:34:02.519692+0000","last_became_peered":"2024-04-26T10:34:02.519692+0000","last_unstale":"2024-04-26T10:34:13.458972+0000","last_undegraded":"2024-04-26T10:34:13.458972+0000","last_fullsized":"2024-04-26T10:34:13.458972+0000","mapping_epoch":42,"log_start":"28'5188","ondisk_log_start":"28'5188","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2915,"log_dups_size":1442,"ondisk_log_size":2915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:12.143408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531038208,"num_objects":8103,"num_object_clones":0,"num_object_copies":16206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8103,"num_write_kb":518592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.512226+0000","last_change":"2024-04-26T10:34:14.512226+0000","last_active":"2024-04-26T10:34:14.512226+0000","last_peered":"2024-04-26T10:34:14.512226+0000","last_clean":"2024-04-26T10:34:14.512226+0000","last_became_active":"2024-04-26T10:34:14.511888+0000","last_became_peered":"2024-04-26T10:34:14.511888+0000","last_unstale":"2024-04-26T10:34:14.512226+0000","last_undegraded":"2024-04-26T10:34:14.512226+0000","last_fullsized":"2024-04-26T10:34:14.512226+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:58.832869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497421+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:34:13.497421+0000","last_peered":"2024-04-26T10:34:13.497421+0000","last_clean":"2024-04-26T10:34:13.497421+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:34:13.497421+0000","last_undegraded":"2024-04-26T10:34:13.497421+0000","last_fullsized":"2024-04-26T10:34:13.497421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510695+0000","last_change":"2024-04-26T10:34:14.510158+0000","last_active":"2024-04-26T10:34:14.510695+0000","last_peered":"2024-04-26T10:34:14.510695+0000","last_clean":"2024-04-26T10:34:14.510695+0000","last_became_active":"2024-04-26T10:34:14.509584+0000","last_became_peered":"2024-04-26T10:34:14.509584+0000","last_unstale":"2024-04-26T10:34:14.510695+0000","last_undegraded":"2024-04-26T10:34:14.510695+0000","last_fullsized":"2024-04-26T10:34:14.510695+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:39.230972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513307+0000","last_change":"2024-04-26T10:34:14.508334+0000","last_active":"2024-04-26T10:34:14.513307+0000","last_peered":"2024-04-26T10:34:14.513307+0000","last_clean":"2024-04-26T10:34:14.513307+0000","last_became_active":"2024-04-26T10:34:14.507205+0000","last_became_peered":"2024-04-26T10:34:14.507205+0000","last_unstale":"2024-04-26T10:34:14.513307+0000","last_undegraded":"2024-04-26T10:34:14.513307+0000","last_fullsized":"2024-04-26T10:34:14.513307+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:20.747187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.489460+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:34:13.489460+0000","last_peered":"2024-04-26T10:34:13.489460+0000","last_clean":"2024-04-26T10:34:13.489460+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:34:13.489460+0000","last_undegraded":"2024-04-26T10:34:13.489460+0000","last_fullsized":"2024-04-26T10:34:13.489460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497414+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:34:13.497414+0000","last_peered":"2024-04-26T10:34:13.497414+0000","last_clean":"2024-04-26T10:34:13.497414+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:34:13.497414+0000","last_undegraded":"2024-04-26T10:34:13.497414+0000","last_fullsized":"2024-04-26T10:34:13.497414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499249+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:34:13.499249+0000","last_peered":"2024-04-26T10:34:13.499249+0000","last_clean":"2024-04-26T10:34:13.499249+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:34:13.499249+0000","last_undegraded":"2024-04-26T10:34:13.499249+0000","last_fullsized":"2024-04-26T10:34:13.499249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488589+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:34:13.488589+0000","last_peered":"2024-04-26T10:34:13.488589+0000","last_clean":"2024-04-26T10:34:13.488589+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:34:13.488589+0000","last_undegraded":"2024-04-26T10:34:13.488589+0000","last_fullsized":"2024-04-26T10:34:13.488589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494252+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:34:13.494252+0000","last_peered":"2024-04-26T10:34:13.494252+0000","last_clean":"2024-04-26T10:34:13.494252+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:34:13.494252+0000","last_undegraded":"2024-04-26T10:34:13.494252+0000","last_fullsized":"2024-04-26T10:34:13.494252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498954+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:34:13.498954+0000","last_peered":"2024-04-26T10:34:13.498954+0000","last_clean":"2024-04-26T10:34:13.498954+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:34:13.498954+0000","last_undegraded":"2024-04-26T10:34:13.498954+0000","last_fullsized":"2024-04-26T10:34:13.498954+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510537+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:34:14.510537+0000","last_peered":"2024-04-26T10:34:14.510537+0000","last_clean":"2024-04-26T10:34:14.510537+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:34:14.510537+0000","last_undegraded":"2024-04-26T10:34:14.510537+0000","last_fullsized":"2024-04-26T10:34:14.510537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497515+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:34:13.497515+0000","last_peered":"2024-04-26T10:34:13.497515+0000","last_clean":"2024-04-26T10:34:13.497515+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:34:13.497515+0000","last_undegraded":"2024-04-26T10:34:13.497515+0000","last_fullsized":"2024-04-26T10:34:13.497515+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497531+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:34:13.497531+0000","last_peered":"2024-04-26T10:34:13.497531+0000","last_clean":"2024-04-26T10:34:13.497531+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:34:13.497531+0000","last_undegraded":"2024-04-26T10:34:13.497531+0000","last_fullsized":"2024-04-26T10:34:13.497531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.496002+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:34:13.496002+0000","last_peered":"2024-04-26T10:34:13.496002+0000","last_clean":"2024-04-26T10:34:13.496002+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:34:13.496002+0000","last_undegraded":"2024-04-26T10:34:13.496002+0000","last_fullsized":"2024-04-26T10:34:13.496002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513276+0000","last_change":"2024-04-26T10:34:14.513276+0000","last_active":"2024-04-26T10:34:14.513276+0000","last_peered":"2024-04-26T10:34:14.513276+0000","last_clean":"2024-04-26T10:34:14.513276+0000","last_became_active":"2024-04-26T10:34:14.512930+0000","last_became_peered":"2024-04-26T10:34:14.512930+0000","last_unstale":"2024-04-26T10:34:14.513276+0000","last_undegraded":"2024-04-26T10:34:14.513276+0000","last_fullsized":"2024-04-26T10:34:14.513276+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:37.809739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488354+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:34:13.488354+0000","last_peered":"2024-04-26T10:34:13.488354+0000","last_clean":"2024-04-26T10:34:13.488354+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:34:13.488354+0000","last_undegraded":"2024-04-26T10:34:13.488354+0000","last_fullsized":"2024-04-26T10:34:13.488354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.516166+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:34:14.516166+0000","last_peered":"2024-04-26T10:34:14.516166+0000","last_clean":"2024-04-26T10:34:14.516166+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:34:14.516166+0000","last_undegraded":"2024-04-26T10:34:14.516166+0000","last_fullsized":"2024-04-26T10:34:14.516166+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.021846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510697+0000","last_change":"2024-04-26T10:34:14.507476+0000","last_active":"2024-04-26T10:34:14.510697+0000","last_peered":"2024-04-26T10:34:14.510697+0000","last_clean":"2024-04-26T10:34:14.510697+0000","last_became_active":"2024-04-26T10:34:14.507171+0000","last_became_peered":"2024-04-26T10:34:14.507171+0000","last_unstale":"2024-04-26T10:34:14.510697+0000","last_undegraded":"2024-04-26T10:34:14.510697+0000","last_fullsized":"2024-04-26T10:34:14.510697+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:32.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8522170368,"num_objects":130038,"num_object_clones":0,"num_object_copies":260076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130038,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130038,"num_write_kb":8322432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3174,"num_bytes_recovered":208011264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17163419648,"data_stored":17163419648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48763,"ondisk_log_size":48763,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":1,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738389,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6989468,"kb_used_data":6777872,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":87382372,"statfs":{"total":96636764160,"available":89479548928,"internally_reserved":0,"allocated":6940540928,"data_stored":6940241247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216660422},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.312}]},{"osd":1,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.39300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738388,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5459308,"kb_used_data":5297756,"kb_used_omap":1,"kb_used_meta":161534,"kb_avail":88912532,"statfs":{"total":96636764160,"available":91046432768,"internally_reserved":0,"allocated":5424902144,"data_stored":5424587178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":165411270},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.23699999999999999}]},{"osd":2,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.69599999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738388,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4807692,"kb_used_data":4686332,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":89564148,"statfs":{"total":96636764160,"available":91713687552,"internally_reserved":0,"allocated":4798803968,"data_stored":4798518934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.14999999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.19400000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.184},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.22700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5424939008,"data_stored":5424939008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4799004672,"data_stored":4799004672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6939475968,"data_stored":6939475968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:34:16.193 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:16.191+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:16.294 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:16.292+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:16.302 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:16.303 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:16.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:16.303 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:16.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.303 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:16.303 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:16.303 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.499578272000001, 2024-04-26T10:34:16.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:16.303 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.303 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.303 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.303 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.303 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:16.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:16.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.498750192000003, 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:16.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:16.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:16.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.497821129000002, 2024-04-26T10:34:16.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:16.315 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.315 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.315 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.315 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.315 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.315 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:16.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.315 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.315 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:16.315 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:16.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:16.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:16.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:16.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:16.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:16.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:16.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:16.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.320 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:16.321 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:16.321 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.497135688, 2024-04-26T10:34:16.321 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:16.321 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.321 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.321 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.321 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.321 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.321 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:16.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.321 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.322 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.322 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:16.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.322 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.322 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:16.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:16.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:16.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:16.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:16.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:16.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:16.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.326 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:16.326 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:16.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.326 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.326 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:16.326 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:16.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.326 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.326 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:16.326 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:16.326 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103337 5.d 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 18.111477014999998, 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.058853520999999999, 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.327 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103337 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188132+0000", 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6197000000000003e-05 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188144+0000", 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2001000000000001e-05 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188152+0000", 2024-04-26T10:34:16.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9349999999999994e-06 2024-04-26T10:34:16.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188185+0000", 2024-04-26T10:34:16.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3436000000000003e-05 2024-04-26T10:34:16.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188275+0000", 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9995999999999997e-05 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188365+0000", 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0254999999999996e-05 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.194973+0000", 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066073490000000002 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246781+0000", 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.051808372999999998 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246865+0000", 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3498999999999995e-05 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246920+0000", 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5208999999999999e-05 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.332 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.920845245999999, 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:16.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:16.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:16.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:16.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:16.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:16.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:16.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:16.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:16.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:16.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.338 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.338 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:16.338 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:16.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.338 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.338 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:16.338 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:16.338 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.338 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.338 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.920625942000001, 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.339 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:16.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:16.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.342 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:16.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:16.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.342 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:16.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:16.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:16.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.344 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.920546136999999, 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:16.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.346 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:16.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.346 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:16.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.347 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.347 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:16.347 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:16.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.347 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.347 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.347 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:16.347 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:16.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.347 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.347 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.347 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:16.347 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:16.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.348 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.348 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.348 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:16.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:16.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.348 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.348 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.348 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:16.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:16.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.349 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:16.349 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:16.349 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:16.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.349 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.349 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:16.349 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:16.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.349 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:16.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:16.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:16.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:16.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:16.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.919182107000001, 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.351 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:16.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.352 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.352 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.352 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:16.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.352 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.352 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:16.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:16.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.354 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.354 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.354 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:16.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:16.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.354 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.354 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.354 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:16.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:16.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.354 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.354 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.354 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.355 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.356 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.918587769999998, 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.357 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.358 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.358 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.358 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:16.358 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.358 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.358 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.358 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.358 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:16.358 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.358 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.358 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.358 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.358 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.359 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.360 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.361 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.362 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.362 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:16.362 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:16.362 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.362 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.362 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.362 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:16.362 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:16.362 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.362 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.362 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.362 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.362 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.363 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:16.363 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:16.363 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.917827414000001, 2024-04-26T10:34:16.363 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:16.363 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.363 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.363 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.363 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.363 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.363 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:16.363 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.363 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:16.364 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:16.365 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.365 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.365 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.365 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:16.365 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:16.365 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.365 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.365 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.365 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:16.365 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:16.366 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.366 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.366 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.366 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:16.366 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:16.366 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.366 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.367 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.367 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:16.367 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:16.367 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.367 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.367 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.367 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:16.367 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:16.368 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.368 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.368 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:16.368 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:16.368 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:16.368 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.369 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.369 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.369 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:16.369 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:16.369 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.369 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.370 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.370 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:16.370 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:16.370 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.370 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.370 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.370 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:16.371 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:16.371 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.371 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.371 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.371 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:16.371 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:16.371 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.371 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.372 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.372 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.372 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.372 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:16.372 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:16.372 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.917209954, 2024-04-26T10:34:16.372 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:16.372 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.373 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.373 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.373 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.373 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.373 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:16.373 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.374 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.374 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.374 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.374 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:16.374 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.374 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.375 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.375 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.375 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:16.375 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.375 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.375 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.375 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.375 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.376 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.377 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:16.377 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:16.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.377 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.377 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.377 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:16.377 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:16.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.377 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.377 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.377 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:16.377 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:16.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.378 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.378 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:16.378 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:16.378 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:16.378 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.378 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.378 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.378 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:16.378 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:16.378 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.378 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:16.379 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.916644950999999, 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.380 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.381 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:16.382 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:16.382 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.382 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.382 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.382 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:16.382 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:16.382 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.382 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.382 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.382 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:16.382 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:16.382 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.382 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.383 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.383 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:16.383 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:16.383 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.383 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.383 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.383 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:16.383 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:16.383 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.383 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.384 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.384 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:16.384 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:16.384 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.384 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.384 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.384 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:16.384 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:16.384 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.916101639000001, 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:16.385 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.386 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.386 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.386 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.386 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:16.386 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.386 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.386 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.386 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.386 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:16.386 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.386 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.387 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.387 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.387 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:16.387 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.387 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.387 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.387 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.387 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:16.387 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:16.388 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.388 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.388 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.388 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:16.388 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:16.388 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.388 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.388 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.388 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:16.388 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:16.388 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:16.389 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:16.390 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.390 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.390 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.390 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:16.390 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:16.390 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.390 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.390 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.390 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:16.390 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:16.390 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.390 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.390 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:16.391 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.914629639000001, 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:16.392 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.393 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:16.394 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:16.394 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.394 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.394 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.394 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:16.394 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:16.394 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.394 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.394 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.394 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:16.394 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:16.394 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.394 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:16.395 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:16.396 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.914064219, 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.397 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.398 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.398 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.398 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.398 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:16.398 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.398 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.398 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.398 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.398 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:16.398 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.398 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.398 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.398 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.399 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:16.400 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.401 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.913999368999999, 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.402 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:16.403 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.403 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.403 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.403 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.403 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:16.403 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.403 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.403 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.403 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.403 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:16.403 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:16.403 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.403 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.404 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.404 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:16.404 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:16.404 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.404 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.404 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.404 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:16.404 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:16.404 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.405 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.405 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.405 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:16.405 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:16.405 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.405 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.405 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.405 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:16.406 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:16.406 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.406 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.406 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.406 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:16.406 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:16.406 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.406 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.407 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.407 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:16.407 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:16.407 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.407 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.407 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.407 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.407 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.408 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:16.408 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:16.408 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.913238389, 2024-04-26T10:34:16.408 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:16.408 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.408 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:16.408 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.408 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.408 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.409 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:16.409 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.409 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.409 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.409 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.409 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:16.409 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.409 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.410 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.410 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.410 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:16.410 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:16.410 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.410 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.410 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.410 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:16.411 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:16.411 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.411 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.411 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.411 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:16.411 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:16.411 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.411 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.411 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.412 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:16.412 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:16.412 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.412 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.412 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.412 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:16.412 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:16.412 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.413 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.413 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.413 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:16.413 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:16.413 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.413 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.413 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.413 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:16.413 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:16.414 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.414 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.414 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.414 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.414 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.414 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:16.414 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:16.415 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.912216960999999, 2024-04-26T10:34:16.415 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:16.415 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.415 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:16.415 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.415 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.415 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.415 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:16.415 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.416 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.416 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.416 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.416 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:16.416 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.416 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.416 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.416 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.416 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:16.417 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.417 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.417 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.417 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.417 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:16.417 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:16.417 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.417 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.417 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.418 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:16.418 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:16.418 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.418 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.418 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.418 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:16.418 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:16.418 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.418 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.418 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.418 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:16.419 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:16.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.419 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.419 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.419 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:16.419 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:16.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.419 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.419 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:16.419 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:16.419 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:16.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103647 5.b e32/16 ondisk, result = 0)", 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.912198262, 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060768513000000003, 2024-04-26T10:34:16.420 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:16.421 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387344+0000", 2024-04-26T10:34:16.422 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.422 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.422 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.422 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:16.422 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387350+0000", 2024-04-26T10:34:16.422 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.22e-06 2024-04-26T10:34:16.422 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.422 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.422 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:16.422 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447917+0000", 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060567523999999998 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447925+0000", 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7689999999999996e-06 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448004+0000", 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9246000000000007e-05 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:16.423 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448012+0000", 2024-04-26T10:34:16.424 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3490000000000003e-06 2024-04-26T10:34:16.424 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:16.424 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:16.424 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:16.424 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448114+0000", 2024-04-26T10:34:16.424 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010205299999999999 2024-04-26T10:34:16.424 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.424 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.424 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.424 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:16.424 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:16.424 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:16.425 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 59 16 132326 132310 140.147 142.062 0.00828157 0.00713269 2024-04-26T10:34:16.426 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:16.427 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:16.424+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:16.527 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:16.526+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:16.620 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:16.620 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:16.620 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.620 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:132751 5.e e44/16 5:773ac6f0:::benchmark_data_smithi043_45180_object132750:head v 44'8241, mlcod=44'8237)", 2024-04-26T10:34:16.620 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:16.609769+0000", 2024-04-26T10:34:16.620 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0062474990000000001, 2024-04-26T10:34:16.620 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062765490000000002, 2024-04-26T10:34:16.620 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:16.620 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:16.620 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.609769+0000", 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.609769+0000", 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.609768+0000", 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:16.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.611150+0000", 2024-04-26T10:34:16.622 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001382012 2024-04-26T10:34:16.622 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:16.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.611158+0000", 2024-04-26T10:34:16.622 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0029999999999994e-06 2024-04-26T10:34:16.622 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.611163+0000", 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2560000000000002e-06 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.611862+0000", 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00069812800000000001 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.611895+0000", 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3453e-05 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:16.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:132761 5.e e44/16 5:705fe765:::benchmark_data_smithi043_45180_object132760:head v 44'8242, mlcod=44'8238)", 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:16.615008+0000", 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0010084, 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001087136, 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615008+0000", 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.624 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615008+0000", 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615007+0000", 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615110+0000", 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010252 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.625 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615116+0000", 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4989999999999999e-06 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615122+0000", 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.429e-06 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615158+0000", 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5981e-05 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615176+0000", 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8374000000000001e-05 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:132760 5.7 e44/16 5:eabecaa5:::benchmark_data_smithi043_45180_object132759:head v 44'8244, mlcod=44'8242)", 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:16.615031+0000", 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00098537499999999992, 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011061370000000001, 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:16.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615031+0000", 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615031+0000", 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615030+0000", 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615140+0000", 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109917 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615149+0000", 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7239999999999998e-06 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615155+0000", 2024-04-26T10:34:16.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5679999999999996e-06 2024-04-26T10:34:16.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.631 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:16.631 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615192+0000", 2024-04-26T10:34:16.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6260999999999997e-05 2024-04-26T10:34:16.631 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:16.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615213+0000", 2024-04-26T10:34:16.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.092e-05 2024-04-26T10:34:16.632 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:16.632 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:16.632 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:16.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.633 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:132762 5.3 5:ccc7a744:::benchmark_data_smithi043_45180_object132761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:34:16.633 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:16.615309+0000", 2024-04-26T10:34:16.633 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00070731600000000004, 2024-04-26T10:34:16.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086776900000000001, 2024-04-26T10:34:16.634 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:16.634 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:16.635 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:16.635 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:16.635 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.635 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 132762 2024-04-26T10:34:16.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.636 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:16.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:16.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615309+0000", 2024-04-26T10:34:16.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:16.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:16.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615309+0000", 2024-04-26T10:34:16.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:16.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:16.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615308+0000", 2024-04-26T10:34:16.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:16.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:16.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615438+0000", 2024-04-26T10:34:16.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013004100000000001 2024-04-26T10:34:16.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:16.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615445+0000", 2024-04-26T10:34:16.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2110000000000001e-06 2024-04-26T10:34:16.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615450+0000", 2024-04-26T10:34:16.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1959999999999999e-06 2024-04-26T10:34:16.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:16.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615483+0000", 2024-04-26T10:34:16.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2869e-05 2024-04-26T10:34:16.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:16.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615618+0000", 2024-04-26T10:34:16.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013477300000000001 2024-04-26T10:34:16.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:16.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615720+0000", 2024-04-26T10:34:16.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000102188 2024-04-26T10:34:16.643 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:16.644 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:16.644 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:16.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.644 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:132767 5.a 5:51e7d839:::benchmark_data_smithi043_45180_object132766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:34:16.644 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:16.615459+0000", 2024-04-26T10:34:16.645 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00055694800000000004, 2024-04-26T10:34:16.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00078604, 2024-04-26T10:34:16.645 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:16.645 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:16.645 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:16.646 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:16.646 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:16.646 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 132767 2024-04-26T10:34:16.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.646 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:16.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:16.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615459+0000", 2024-04-26T10:34:16.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:16.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:16.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615459+0000", 2024-04-26T10:34:16.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:16.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:16.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615459+0000", 2024-04-26T10:34:16.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:16.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:16.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615592+0000", 2024-04-26T10:34:16.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000133211 2024-04-26T10:34:16.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:16.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615604+0000", 2024-04-26T10:34:16.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2384999999999999e-05 2024-04-26T10:34:16.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:16.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615611+0000", 2024-04-26T10:34:16.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0160000000000003e-06 2024-04-26T10:34:16.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:16.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615688+0000", 2024-04-26T10:34:16.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6448999999999999e-05 2024-04-26T10:34:16.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:16.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615811+0000", 2024-04-26T10:34:16.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000123108 2024-04-26T10:34:16.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:16.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:16.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:16.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:16.615937+0000", 2024-04-26T10:34:16.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012605599999999999 2024-04-26T10:34:16.654 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:16.654 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:16.654 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:16.655 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:16.655 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:34:16.655 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 5 2024-04-26T10:34:16.655 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:16.657 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:16.656+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:16.658 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:16.757 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:16.756+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:16.846 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:16.846 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:16.846 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:34:16.846 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:34:16.847 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:16.858 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:16.857+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:16.863 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:16.959 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:16.958+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:17.053 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:17.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.249414792000003, 2024-04-26T10:34:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:17.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:17.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:17.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.249413807000003, 2024-04-26T10:34:17.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:17.063 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.249345183999999, 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:17.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.066 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.067 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.068 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.249293403999999, 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.069 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:17.071 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:17.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:17.073 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.249233554, 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.247520850000001, 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.080 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:17.085 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.247405782999998, 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:17.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:17.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.089 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.247312643000001, 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:17.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:17.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:17.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:17.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:17.095 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.097 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.247118483000001, 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:17.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:17.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:17.101 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.245911114999998, 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:17.102 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:17.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:17.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.105 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.245102207000002, 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:17.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:17.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.244998668999997, 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.111 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:17.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.244921796, 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:17.116 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.121 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.244806412000003, 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:17.125 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.868162358999999, 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:17.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:17.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:17.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:17.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:17.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.866132511, 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.131 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.865656707999999, 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.863689654000002, 2024-04-26T10:34:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103336 5.6 5:6c0cef20:::benchmark_data_smithi043_45180_object103335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.861580349, 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064107786, 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103336 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188502+0000", 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188540+0000", 2024-04-26T10:34:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8445000000000002e-05 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188553+0000", 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2768e-05 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188563+0000", 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9760000000000007e-06 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191877+0000", 2024-04-26T10:34:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003313908 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192004+0000", 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012663 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192143+0000", 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013964199999999999 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.196467+0000", 2024-04-26T10:34:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043232230000000002 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252539+0000", 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056072085000000001 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252577+0000", 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8730999999999999e-05 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252611+0000", 2024-04-26T10:34:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3769000000000001e-05 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 18.861021915999999, 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:17.158 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:17.160 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:17.157+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:17.160 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:17.175 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:34:17.260 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:17.259+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:17.326 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:17.333 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:17.333 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:17.347 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:17.348 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:17.361 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:17.359+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:17.368 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:17.369 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:17.370 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:17.370 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:17.422 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:2024-04-26T10:34:17.422086+0000 min lat: 0.00116398 max lat: 2.08407 avg lat: 0.00712827 2024-04-26T10:34:17.422 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T10:34:17.422 INFO:tasks.radosbench.radosbench.0.smithi043.stdout: 60 1 134639 134638 140.236 145.5 0.00582308 0.00712827 2024-04-26T10:34:17.462 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:17.461+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:17.519 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:34:17.521 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:17.521 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:17.531 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:17.562 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:17.561+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:17.663 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:17.663+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:17.698 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:17.698 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:17.710 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:17.765 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:17.764+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:17.839 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:17.839 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:17.849 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:17.865 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:17.864+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:17.966 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:17.965+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:17.976 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:17.976 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:17.986 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:18.068 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:18.067+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:18.152 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:18.153 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:18.163 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:18.207 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:18.205+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:18.269 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:18.268+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:18.293 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:18.293 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:18.304 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:18.370 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:18.369+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:18.422 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Total time run: 60.0061 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Total writes made: 134639 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Write size: 65536 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Object size: 65536 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Bandwidth (MB/sec): 140.235 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Stddev Bandwidth: 53.3385 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Max bandwidth (MB/sec): 310.25 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Min bandwidth (MB/sec): 0 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Average IOPS: 2243 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Stddev IOPS: 853.417 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Max IOPS: 4964 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Min IOPS: 0 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Average Latency(s): 0.00712827 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Stddev Latency(s): 0.0300366 2024-04-26T10:34:18.423 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Max latency(s): 2.08407 2024-04-26T10:34:18.424 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Min latency(s): 0.00116398 2024-04-26T10:34:18.427 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Cleaning up (deleting benchmark objects) 2024-04-26T10:34:18.471 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:18.470+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:18.494 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:18.494 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:18.507 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:18.510 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-26T10:34:18.572 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:18.570+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:18.673 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:18.671+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:18.681 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:18.681 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:18.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:18.775 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:18.772+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:18.862 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:18.862 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:18.875 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:18.876 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:18.873+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:18.976 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:18.974+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:19.045 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:19.045 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:19.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:19.077 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:19.075+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:19.178 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:19.176+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:19.192 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:34:19.223 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:19.223 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:19.237 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:19.280 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:19.279+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:19.379 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:19.378+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:19.383 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:19.403 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:19.403 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:19.417 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:19.480 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:19.479+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:19.537 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:19.559 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:19.561 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:19.561 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:34:19.571 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-04-26T10:34:19.000221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8522763098,"num_objects":130062,"num_object_clones":0,"num_object_copies":260124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130062,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":130286,"num_write_kb":8325906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3198,"num_bytes_recovered":208604984,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48959,"ondisk_log_size":48959,"up":242,"acting":241,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":248,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":17256468,"kb_used_data":16761960,"kb_used_omap":4,"kb_used_meta":494459,"kb_avail":265859052,"statfs":{"total":289910292480,"available":272239669248,"internally_reserved":0,"allocated":17164247040,"data_stored":17163347359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":506326354},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":452788224,"num_objects":6909,"num_object_clones":0,"num_object_copies":13818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-43599,"num_objects_unfound":0,"num_objects_dirty":6909,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6909,"num_write_kb":442176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":991,"num_bytes_recovered":64226956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000573"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510347+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:34:14.510347+0000","last_peered":"2024-04-26T10:34:14.510347+0000","last_clean":"2024-04-26T10:34:14.510347+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:34:14.510347+0000","last_undegraded":"2024-04-26T10:34:14.510347+0000","last_fullsized":"2024-04-26T10:34:14.510347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:26.964955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488460+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:34:13.488460+0000","last_peered":"2024-04-26T10:34:13.488460+0000","last_clean":"2024-04-26T10:34:13.488460+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:34:13.488460+0000","last_undegraded":"2024-04-26T10:34:13.488460+0000","last_fullsized":"2024-04-26T10:34:13.488460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499377+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:34:13.499377+0000","last_peered":"2024-04-26T10:34:13.499377+0000","last_clean":"2024-04-26T10:34:13.499377+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:34:13.499377+0000","last_undegraded":"2024-04-26T10:34:13.499377+0000","last_fullsized":"2024-04-26T10:34:13.499377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499057+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:34:13.499057+0000","last_peered":"2024-04-26T10:34:13.499057+0000","last_clean":"2024-04-26T10:34:13.499057+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:34:13.499057+0000","last_undegraded":"2024-04-26T10:34:13.499057+0000","last_fullsized":"2024-04-26T10:34:13.499057+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513196+0000","last_change":"2024-04-26T10:34:14.507618+0000","last_active":"2024-04-26T10:34:14.513196+0000","last_peered":"2024-04-26T10:34:14.513196+0000","last_clean":"2024-04-26T10:34:14.513196+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:34:14.513196+0000","last_undegraded":"2024-04-26T10:34:14.513196+0000","last_fullsized":"2024-04-26T10:34:14.513196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:27.721106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.493676+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:34:13.493676+0000","last_peered":"2024-04-26T10:34:13.493676+0000","last_clean":"2024-04-26T10:34:13.493676+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:34:13.493676+0000","last_undegraded":"2024-04-26T10:34:13.493676+0000","last_fullsized":"2024-04-26T10:34:13.493676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.502929+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:34:13.502929+0000","last_peered":"2024-04-26T10:34:13.502929+0000","last_clean":"2024-04-26T10:34:13.502929+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:34:13.502929+0000","last_undegraded":"2024-04-26T10:34:13.502929+0000","last_fullsized":"2024-04-26T10:34:13.502929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.493758+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:34:13.493758+0000","last_peered":"2024-04-26T10:34:13.493758+0000","last_clean":"2024-04-26T10:34:13.493758+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:34:13.493758+0000","last_undegraded":"2024-04-26T10:34:13.493758+0000","last_fullsized":"2024-04-26T10:34:13.493758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497249+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:34:13.497249+0000","last_peered":"2024-04-26T10:34:13.497249+0000","last_clean":"2024-04-26T10:34:13.497249+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:34:13.497249+0000","last_undegraded":"2024-04-26T10:34:13.497249+0000","last_fullsized":"2024-04-26T10:34:13.497249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510494+0000","last_change":"2024-04-26T10:34:14.507265+0000","last_active":"2024-04-26T10:34:14.510494+0000","last_peered":"2024-04-26T10:34:14.510494+0000","last_clean":"2024-04-26T10:34:14.510494+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:34:14.510494+0000","last_undegraded":"2024-04-26T10:34:14.510494+0000","last_fullsized":"2024-04-26T10:34:14.510494+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:07.268421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498960+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:34:13.498960+0000","last_peered":"2024-04-26T10:34:13.498960+0000","last_clean":"2024-04-26T10:34:13.498960+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:34:13.498960+0000","last_undegraded":"2024-04-26T10:34:13.498960+0000","last_fullsized":"2024-04-26T10:34:13.498960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.489387+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:34:13.489387+0000","last_peered":"2024-04-26T10:34:13.489387+0000","last_clean":"2024-04-26T10:34:13.489387+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:34:13.489387+0000","last_undegraded":"2024-04-26T10:34:13.489387+0000","last_fullsized":"2024-04-26T10:34:13.489387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513255+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:34:14.513255+0000","last_peered":"2024-04-26T10:34:14.513255+0000","last_clean":"2024-04-26T10:34:14.513255+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:34:14.513255+0000","last_undegraded":"2024-04-26T10:34:14.513255+0000","last_fullsized":"2024-04-26T10:34:14.513255+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:03.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509249+0000","last_change":"2024-04-26T10:34:14.509249+0000","last_active":"2024-04-26T10:34:14.509249+0000","last_peered":"2024-04-26T10:34:14.509249+0000","last_clean":"2024-04-26T10:34:14.509249+0000","last_became_active":"2024-04-26T10:34:14.508371+0000","last_became_peered":"2024-04-26T10:34:14.508371+0000","last_unstale":"2024-04-26T10:34:14.509249+0000","last_undegraded":"2024-04-26T10:34:14.509249+0000","last_fullsized":"2024-04-26T10:34:14.509249+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:35.257141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.501880+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:34:13.501880+0000","last_peered":"2024-04-26T10:34:13.501880+0000","last_clean":"2024-04-26T10:34:13.501880+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:34:13.501880+0000","last_undegraded":"2024-04-26T10:34:13.501880+0000","last_fullsized":"2024-04-26T10:34:13.501880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494370+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:34:13.494370+0000","last_peered":"2024-04-26T10:34:13.494370+0000","last_clean":"2024-04-26T10:34:13.494370+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:34:13.494370+0000","last_undegraded":"2024-04-26T10:34:13.494370+0000","last_fullsized":"2024-04-26T10:34:13.494370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497329+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:34:13.497329+0000","last_peered":"2024-04-26T10:34:13.497329+0000","last_clean":"2024-04-26T10:34:13.497329+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:34:13.497329+0000","last_undegraded":"2024-04-26T10:34:13.497329+0000","last_fullsized":"2024-04-26T10:34:13.497329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510432+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:34:14.510432+0000","last_peered":"2024-04-26T10:34:14.510432+0000","last_clean":"2024-04-26T10:34:14.510432+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:34:14.510432+0000","last_undegraded":"2024-04-26T10:34:14.510432+0000","last_fullsized":"2024-04-26T10:34:14.510432+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.343269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494669+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:34:13.494669+0000","last_peered":"2024-04-26T10:34:13.494669+0000","last_clean":"2024-04-26T10:34:13.494669+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:34:13.494669+0000","last_undegraded":"2024-04-26T10:34:13.494669+0000","last_fullsized":"2024-04-26T10:34:13.494669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498977+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:34:13.498977+0000","last_peered":"2024-04-26T10:34:13.498977+0000","last_clean":"2024-04-26T10:34:13.498977+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:34:13.498977+0000","last_undegraded":"2024-04-26T10:34:13.498977+0000","last_fullsized":"2024-04-26T10:34:13.498977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498830+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:34:13.498830+0000","last_peered":"2024-04-26T10:34:13.498830+0000","last_clean":"2024-04-26T10:34:13.498830+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:34:13.498830+0000","last_undegraded":"2024-04-26T10:34:13.498830+0000","last_fullsized":"2024-04-26T10:34:13.498830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488236+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:34:13.488236+0000","last_peered":"2024-04-26T10:34:13.488236+0000","last_clean":"2024-04-26T10:34:13.488236+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:34:13.488236+0000","last_undegraded":"2024-04-26T10:34:13.488236+0000","last_fullsized":"2024-04-26T10:34:13.488236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500095+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:34:13.500095+0000","last_peered":"2024-04-26T10:34:13.500095+0000","last_clean":"2024-04-26T10:34:13.500095+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:34:13.500095+0000","last_undegraded":"2024-04-26T10:34:13.500095+0000","last_fullsized":"2024-04-26T10:34:13.500095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.492271+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:34:13.492271+0000","last_peered":"2024-04-26T10:34:13.492271+0000","last_clean":"2024-04-26T10:34:13.492271+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:34:13.492271+0000","last_undegraded":"2024-04-26T10:34:13.492271+0000","last_fullsized":"2024-04-26T10:34:13.492271+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.516602+0000","last_change":"2024-04-26T10:34:14.511829+0000","last_active":"2024-04-26T10:34:14.516602+0000","last_peered":"2024-04-26T10:34:14.516602+0000","last_clean":"2024-04-26T10:34:14.516602+0000","last_became_active":"2024-04-26T10:34:14.511584+0000","last_became_peered":"2024-04-26T10:34:14.511584+0000","last_unstale":"2024-04-26T10:34:14.516602+0000","last_undegraded":"2024-04-26T10:34:14.516602+0000","last_fullsized":"2024-04-26T10:34:14.516602+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:30.166797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497341+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:34:13.497341+0000","last_peered":"2024-04-26T10:34:13.497341+0000","last_clean":"2024-04-26T10:34:13.497341+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:34:13.497341+0000","last_undegraded":"2024-04-26T10:34:13.497341+0000","last_fullsized":"2024-04-26T10:34:13.497341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499319+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:34:13.499319+0000","last_peered":"2024-04-26T10:34:13.499319+0000","last_clean":"2024-04-26T10:34:13.499319+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:34:13.499319+0000","last_undegraded":"2024-04-26T10:34:13.499319+0000","last_fullsized":"2024-04-26T10:34:13.499319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488262+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:34:13.488262+0000","last_peered":"2024-04-26T10:34:13.488262+0000","last_clean":"2024-04-26T10:34:13.488262+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:34:13.488262+0000","last_undegraded":"2024-04-26T10:34:13.488262+0000","last_fullsized":"2024-04-26T10:34:13.488262+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.489169+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:34:13.489169+0000","last_peered":"2024-04-26T10:34:13.489169+0000","last_clean":"2024-04-26T10:34:13.489169+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:34:13.489169+0000","last_undegraded":"2024-04-26T10:34:13.489169+0000","last_fullsized":"2024-04-26T10:34:13.489169+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500180+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:34:13.500180+0000","last_peered":"2024-04-26T10:34:13.500180+0000","last_clean":"2024-04-26T10:34:13.500180+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:34:13.500180+0000","last_undegraded":"2024-04-26T10:34:13.500180+0000","last_fullsized":"2024-04-26T10:34:13.500180+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497506+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:34:13.497506+0000","last_peered":"2024-04-26T10:34:13.497506+0000","last_clean":"2024-04-26T10:34:13.497506+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:34:13.497506+0000","last_undegraded":"2024-04-26T10:34:13.497506+0000","last_fullsized":"2024-04-26T10:34:13.497506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":54,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511168+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:34:14.511168+0000","last_peered":"2024-04-26T10:34:14.511168+0000","last_clean":"2024-04-26T10:34:14.511168+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:34:14.511168+0000","last_undegraded":"2024-04-26T10:34:14.511168+0000","last_fullsized":"2024-04-26T10:34:14.511168+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:19.856062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488984+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:34:13.488984+0000","last_peered":"2024-04-26T10:34:13.488984+0000","last_clean":"2024-04-26T10:34:13.488984+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:34:13.488984+0000","last_undegraded":"2024-04-26T10:34:13.488984+0000","last_fullsized":"2024-04-26T10:34:13.488984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498920+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:34:13.498920+0000","last_peered":"2024-04-26T10:34:13.498920+0000","last_clean":"2024-04-26T10:34:13.498920+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:34:13.498920+0000","last_undegraded":"2024-04-26T10:34:13.498920+0000","last_fullsized":"2024-04-26T10:34:13.498920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511362+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:34:14.511362+0000","last_peered":"2024-04-26T10:34:14.511362+0000","last_clean":"2024-04-26T10:34:14.511362+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:34:14.511362+0000","last_undegraded":"2024-04-26T10:34:14.511362+0000","last_fullsized":"2024-04-26T10:34:14.511362+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:04.852453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494871+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:34:13.494871+0000","last_peered":"2024-04-26T10:34:13.494871+0000","last_clean":"2024-04-26T10:34:13.494871+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:34:13.494871+0000","last_undegraded":"2024-04-26T10:34:13.494871+0000","last_fullsized":"2024-04-26T10:34:13.494871+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500325+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:34:13.500325+0000","last_peered":"2024-04-26T10:34:13.500325+0000","last_clean":"2024-04-26T10:34:13.500325+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:34:13.500325+0000","last_undegraded":"2024-04-26T10:34:13.500325+0000","last_fullsized":"2024-04-26T10:34:13.500325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.523338+0000","last_change":"2024-04-26T10:34:14.518131+0000","last_active":"2024-04-26T10:34:14.523338+0000","last_peered":"2024-04-26T10:34:14.523338+0000","last_clean":"2024-04-26T10:34:14.523338+0000","last_became_active":"2024-04-26T10:34:14.506010+0000","last_became_peered":"2024-04-26T10:34:14.506010+0000","last_unstale":"2024-04-26T10:34:14.523338+0000","last_undegraded":"2024-04-26T10:34:14.523338+0000","last_fullsized":"2024-04-26T10:34:14.523338+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:51.842115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509381+0000","last_change":"2024-04-26T10:34:14.509381+0000","last_active":"2024-04-26T10:34:14.509381+0000","last_peered":"2024-04-26T10:34:14.509381+0000","last_clean":"2024-04-26T10:34:14.509381+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:34:14.509381+0000","last_undegraded":"2024-04-26T10:34:14.509381+0000","last_fullsized":"2024-04-26T10:34:14.509381+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:05.841519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":80,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.548596+0000","last_change":"2024-04-26T10:34:14.548596+0000","last_active":"2024-04-26T10:34:14.548596+0000","last_peered":"2024-04-26T10:34:14.548596+0000","last_clean":"2024-04-26T10:34:14.548596+0000","last_became_active":"2024-04-26T10:34:14.512027+0000","last_became_peered":"2024-04-26T10:34:14.512027+0000","last_unstale":"2024-04-26T10:34:14.548596+0000","last_undegraded":"2024-04-26T10:34:14.548596+0000","last_fullsized":"2024-04-26T10:34:14.548596+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:39.957573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513656+0000","last_change":"2024-04-26T10:34:14.513656+0000","last_active":"2024-04-26T10:34:14.513656+0000","last_peered":"2024-04-26T10:34:14.513656+0000","last_clean":"2024-04-26T10:34:14.513656+0000","last_became_active":"2024-04-26T10:34:14.513402+0000","last_became_peered":"2024-04-26T10:34:14.513402+0000","last_unstale":"2024-04-26T10:34:14.513656+0000","last_undegraded":"2024-04-26T10:34:14.513656+0000","last_fullsized":"2024-04-26T10:34:14.513656+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:22.053611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500059+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:34:13.500059+0000","last_peered":"2024-04-26T10:34:13.500059+0000","last_clean":"2024-04-26T10:34:13.500059+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:34:13.500059+0000","last_undegraded":"2024-04-26T10:34:13.500059+0000","last_fullsized":"2024-04-26T10:34:13.500059+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510736+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:34:14.510736+0000","last_peered":"2024-04-26T10:34:14.510736+0000","last_clean":"2024-04-26T10:34:14.510736+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:34:14.510736+0000","last_undegraded":"2024-04-26T10:34:14.510736+0000","last_fullsized":"2024-04-26T10:34:14.510736+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:02.872251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.496178+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:34:13.496178+0000","last_peered":"2024-04-26T10:34:13.496178+0000","last_clean":"2024-04-26T10:34:13.496178+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:34:13.496178+0000","last_undegraded":"2024-04-26T10:34:13.496178+0000","last_fullsized":"2024-04-26T10:34:13.496178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511581+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:34:14.511581+0000","last_peered":"2024-04-26T10:34:14.511581+0000","last_clean":"2024-04-26T10:34:14.511581+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:34:14.511581+0000","last_undegraded":"2024-04-26T10:34:14.511581+0000","last_fullsized":"2024-04-26T10:34:14.511581+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:43.500342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510605+0000","last_change":"2024-04-26T10:34:14.509818+0000","last_active":"2024-04-26T10:34:14.510605+0000","last_peered":"2024-04-26T10:34:14.510605+0000","last_clean":"2024-04-26T10:34:14.510605+0000","last_became_active":"2024-04-26T10:34:14.509270+0000","last_became_peered":"2024-04-26T10:34:14.509270+0000","last_unstale":"2024-04-26T10:34:14.510605+0000","last_undegraded":"2024-04-26T10:34:14.510605+0000","last_fullsized":"2024-04-26T10:34:14.510605+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:45.412620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498283+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:34:13.498283+0000","last_peered":"2024-04-26T10:34:13.498283+0000","last_clean":"2024-04-26T10:34:13.498283+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:34:13.498283+0000","last_undegraded":"2024-04-26T10:34:13.498283+0000","last_fullsized":"2024-04-26T10:34:13.498283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":82,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.531646+0000","last_change":"2024-04-26T10:34:14.531646+0000","last_active":"2024-04-26T10:34:14.531646+0000","last_peered":"2024-04-26T10:34:14.531646+0000","last_clean":"2024-04-26T10:34:14.531646+0000","last_became_active":"2024-04-26T10:34:14.511911+0000","last_became_peered":"2024-04-26T10:34:14.511911+0000","last_unstale":"2024-04-26T10:34:14.531646+0000","last_undegraded":"2024-04-26T10:34:14.531646+0000","last_fullsized":"2024-04-26T10:34:14.531646+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:39.588939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499927+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:34:13.499927+0000","last_peered":"2024-04-26T10:34:13.499927+0000","last_clean":"2024-04-26T10:34:13.499927+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:34:13.499927+0000","last_undegraded":"2024-04-26T10:34:13.499927+0000","last_fullsized":"2024-04-26T10:34:13.499927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"42'8158","reported_seq":11257,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.549415+0000","last_change":"2024-04-26T10:34:14.549017+0000","last_active":"2024-04-26T10:34:14.549415+0000","last_peered":"2024-04-26T10:34:14.549415+0000","last_clean":"2024-04-26T10:34:14.549415+0000","last_became_active":"2024-04-26T10:34:14.518037+0000","last_became_peered":"2024-04-26T10:34:14.518037+0000","last_unstale":"2024-04-26T10:34:14.549415+0000","last_undegraded":"2024-04-26T10:34:14.549415+0000","last_fullsized":"2024-04-26T10:34:14.549415+0000","mapping_epoch":41,"log_start":"29'5291","ondisk_log_start":"29'5291","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2867,"log_dups_size":1542,"ondisk_log_size":2867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:21.571693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":534642688,"num_objects":8158,"num_object_clones":0,"num_object_copies":16316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8158,"num_write_kb":522112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1524,"num_bytes_recovered":99876864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":63,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.536943+0000","last_change":"2024-04-26T10:34:14.536943+0000","last_active":"2024-04-26T10:34:14.536943+0000","last_peered":"2024-04-26T10:34:14.536943+0000","last_clean":"2024-04-26T10:34:14.536943+0000","last_became_active":"2024-04-26T10:34:14.511960+0000","last_became_peered":"2024-04-26T10:34:14.511960+0000","last_unstale":"2024-04-26T10:34:14.536943+0000","last_undegraded":"2024-04-26T10:34:14.536943+0000","last_fullsized":"2024-04-26T10:34:14.536943+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.329973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.492102+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:34:13.492102+0000","last_peered":"2024-04-26T10:34:13.492102+0000","last_clean":"2024-04-26T10:34:13.492102+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:34:13.492102+0000","last_undegraded":"2024-04-26T10:34:13.492102+0000","last_fullsized":"2024-04-26T10:34:13.492102+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"42'8366","reported_seq":8400,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.563489+0000","last_change":"2024-04-26T10:33:16.346351+0000","last_active":"2024-04-26T10:34:14.563489+0000","last_peered":"2024-04-26T10:34:14.563489+0000","last_clean":"2024-04-26T10:34:14.563489+0000","last_became_active":"2024-04-26T10:33:16.346122+0000","last_became_peered":"2024-04-26T10:33:16.346122+0000","last_unstale":"2024-04-26T10:34:14.563489+0000","last_undegraded":"2024-04-26T10:34:14.563489+0000","last_fullsized":"2024-04-26T10:34:14.563489+0000","mapping_epoch":16,"log_start":"26'4364","ondisk_log_start":"26'4364","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":4002,"log_dups_size":0,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:13.714464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":548274176,"num_objects":8366,"num_object_clones":0,"num_object_copies":16732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8366,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":535424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488538+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:34:13.488538+0000","last_peered":"2024-04-26T10:34:13.488538+0000","last_clean":"2024-04-26T10:34:13.488538+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:34:13.488538+0000","last_undegraded":"2024-04-26T10:34:13.488538+0000","last_fullsized":"2024-04-26T10:34:13.488538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510461+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:34:14.510461+0000","last_peered":"2024-04-26T10:34:14.510461+0000","last_clean":"2024-04-26T10:34:14.510461+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:34:14.510461+0000","last_undegraded":"2024-04-26T10:34:14.510461+0000","last_fullsized":"2024-04-26T10:34:14.510461+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:12.954308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"40'8199","reported_seq":11536,"reported_epoch":40,"state":"peering","last_fresh":"2024-04-26T10:34:13.471961+0000","last_change":"2024-04-26T10:34:14.500388+0000","last_active":"2024-04-26T10:34:14.500388+0000","last_peered":"2024-04-26T10:34:13.471961+0000","last_clean":"2024-04-26T10:34:00.443121+0000","last_became_active":"2024-04-26T10:34:02.510251+0000","last_became_peered":"2024-04-26T10:34:02.510251+0000","last_unstale":"2024-04-26T10:34:13.471961+0000","last_undegraded":"2024-04-26T10:34:13.471961+0000","last_fullsized":"2024-04-26T10:34:13.471961+0000","mapping_epoch":42,"log_start":"29'5264","ondisk_log_start":"29'5264","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2935,"log_dups_size":1442,"ondisk_log_size":2935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:40.416790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537329664,"num_objects":8199,"num_object_clones":0,"num_object_copies":16398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":524736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1649,"num_bytes_recovered":108068864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500554+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:34:13.500554+0000","last_peered":"2024-04-26T10:34:13.500554+0000","last_clean":"2024-04-26T10:34:13.500554+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:34:13.500554+0000","last_undegraded":"2024-04-26T10:34:13.500554+0000","last_fullsized":"2024-04-26T10:34:13.500554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.495036+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:34:13.495036+0000","last_peered":"2024-04-26T10:34:13.495036+0000","last_clean":"2024-04-26T10:34:13.495036+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:34:13.495036+0000","last_undegraded":"2024-04-26T10:34:13.495036+0000","last_fullsized":"2024-04-26T10:34:13.495036+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"42'8232","reported_seq":8266,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.539351+0000","last_change":"2024-04-26T10:33:16.346212+0000","last_active":"2024-04-26T10:34:14.539351+0000","last_peered":"2024-04-26T10:34:14.539351+0000","last_clean":"2024-04-26T10:34:14.539351+0000","last_became_active":"2024-04-26T10:33:16.346004+0000","last_became_peered":"2024-04-26T10:33:16.346004+0000","last_unstale":"2024-04-26T10:34:14.539351+0000","last_undegraded":"2024-04-26T10:34:14.539351+0000","last_fullsized":"2024-04-26T10:34:14.539351+0000","mapping_epoch":16,"log_start":"29'5354","ondisk_log_start":"29'5354","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2878,"log_dups_size":1542,"ondisk_log_size":2878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:27.495754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539492352,"num_objects":8232,"num_object_clones":0,"num_object_copies":16464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8232,"num_write_kb":526848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.495715+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:34:13.495715+0000","last_peered":"2024-04-26T10:34:13.495715+0000","last_clean":"2024-04-26T10:34:13.495715+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:34:13.495715+0000","last_undegraded":"2024-04-26T10:34:13.495715+0000","last_fullsized":"2024-04-26T10:34:13.495715+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500549+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:34:13.500549+0000","last_peered":"2024-04-26T10:34:13.500549+0000","last_clean":"2024-04-26T10:34:13.500549+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:34:13.500549+0000","last_undegraded":"2024-04-26T10:34:13.500549+0000","last_fullsized":"2024-04-26T10:34:13.500549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"40'8104","reported_seq":8142,"reported_epoch":40,"state":"peering","last_fresh":"2024-04-26T10:34:13.471569+0000","last_change":"2024-04-26T10:34:14.501539+0000","last_active":"2024-04-26T10:34:14.501539+0000","last_peered":"2024-04-26T10:34:13.471569+0000","last_clean":"2024-04-26T10:34:00.445985+0000","last_became_active":"2024-04-26T10:34:02.502550+0000","last_became_peered":"2024-04-26T10:34:02.502550+0000","last_unstale":"2024-04-26T10:34:13.471569+0000","last_undegraded":"2024-04-26T10:34:13.471569+0000","last_fullsized":"2024-04-26T10:34:13.471569+0000","mapping_epoch":42,"log_start":"29'5172","ondisk_log_start":"29'5172","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":1442,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:03.212384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531103744,"num_objects":8104,"num_object_clones":0,"num_object_copies":16208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8104,"num_write_kb":518656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500740+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:34:13.500740+0000","last_peered":"2024-04-26T10:34:13.500740+0000","last_clean":"2024-04-26T10:34:13.500740+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:34:13.500740+0000","last_undegraded":"2024-04-26T10:34:13.500740+0000","last_fullsized":"2024-04-26T10:34:13.500740+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.495797+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:34:13.495797+0000","last_peered":"2024-04-26T10:34:13.495797+0000","last_clean":"2024-04-26T10:34:13.495797+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:34:13.495797+0000","last_undegraded":"2024-04-26T10:34:13.495797+0000","last_fullsized":"2024-04-26T10:34:13.495797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"42'8121","reported_seq":8155,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.539261+0000","last_change":"2024-04-26T10:33:16.349242+0000","last_active":"2024-04-26T10:34:14.539261+0000","last_peered":"2024-04-26T10:34:14.539261+0000","last_clean":"2024-04-26T10:34:14.539261+0000","last_became_active":"2024-04-26T10:33:16.349063+0000","last_became_peered":"2024-04-26T10:33:16.349063+0000","last_unstale":"2024-04-26T10:34:14.539261+0000","last_undegraded":"2024-04-26T10:34:14.539261+0000","last_fullsized":"2024-04-26T10:34:14.539261+0000","mapping_epoch":16,"log_start":"28'5162","ondisk_log_start":"28'5162","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2959,"log_dups_size":1442,"ondisk_log_size":2959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:09.297624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532217856,"num_objects":8121,"num_object_clones":0,"num_object_copies":16242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8121,"num_write_kb":519744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.493724+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:34:13.493724+0000","last_peered":"2024-04-26T10:34:13.493724+0000","last_clean":"2024-04-26T10:34:13.493724+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:34:13.493724+0000","last_undegraded":"2024-04-26T10:34:13.493724+0000","last_fullsized":"2024-04-26T10:34:13.493724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500444+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:34:13.500444+0000","last_peered":"2024-04-26T10:34:13.500444+0000","last_clean":"2024-04-26T10:34:13.500444+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:34:13.500444+0000","last_undegraded":"2024-04-26T10:34:13.500444+0000","last_fullsized":"2024-04-26T10:34:13.500444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"42'7888","reported_seq":7940,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.549556+0000","last_change":"2024-04-26T10:34:14.549556+0000","last_active":"2024-04-26T10:34:14.549556+0000","last_peered":"2024-04-26T10:34:14.549556+0000","last_clean":"2024-04-26T10:34:14.549556+0000","last_became_active":"2024-04-26T10:34:14.520855+0000","last_became_peered":"2024-04-26T10:34:14.520855+0000","last_unstale":"2024-04-26T10:34:14.549556+0000","last_undegraded":"2024-04-26T10:34:14.549556+0000","last_fullsized":"2024-04-26T10:34:14.549556+0000","mapping_epoch":41,"log_start":"28'5005","ondisk_log_start":"28'5005","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2883,"log_dups_size":1442,"ondisk_log_size":2883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:48.789996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516947968,"num_objects":7888,"num_object_clones":0,"num_object_copies":15776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7888,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7888,"num_write_kb":504832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488180+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:34:13.488180+0000","last_peered":"2024-04-26T10:34:13.488180+0000","last_clean":"2024-04-26T10:34:13.488180+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:34:13.488180+0000","last_undegraded":"2024-04-26T10:34:13.488180+0000","last_fullsized":"2024-04-26T10:34:13.488180+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509460+0000","last_change":"2024-04-26T10:34:14.509460+0000","last_active":"2024-04-26T10:34:14.509460+0000","last_peered":"2024-04-26T10:34:14.509460+0000","last_clean":"2024-04-26T10:34:14.509460+0000","last_became_active":"2024-04-26T10:34:14.509213+0000","last_became_peered":"2024-04-26T10:34:14.509213+0000","last_unstale":"2024-04-26T10:34:14.509460+0000","last_undegraded":"2024-04-26T10:34:14.509460+0000","last_fullsized":"2024-04-26T10:34:14.509460+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:15.816526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"42'8055","reported_seq":8089,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.498076+0000","last_change":"2024-04-26T10:33:16.344866+0000","last_active":"2024-04-26T10:34:14.498076+0000","last_peered":"2024-04-26T10:34:14.498076+0000","last_clean":"2024-04-26T10:34:14.498076+0000","last_became_active":"2024-04-26T10:33:16.344614+0000","last_became_peered":"2024-04-26T10:33:16.344614+0000","last_unstale":"2024-04-26T10:34:14.498076+0000","last_undegraded":"2024-04-26T10:34:14.498076+0000","last_fullsized":"2024-04-26T10:34:14.498076+0000","mapping_epoch":16,"log_start":"26'4054","ondisk_log_start":"26'4054","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":4001,"log_dups_size":0,"ondisk_log_size":4001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":527892480,"num_objects":8055,"num_object_clones":0,"num_object_copies":16110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8055,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8055,"num_write_kb":515520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510428+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:34:14.510428+0000","last_peered":"2024-04-26T10:34:14.510428+0000","last_clean":"2024-04-26T10:34:14.510428+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:34:14.510428+0000","last_undegraded":"2024-04-26T10:34:14.510428+0000","last_fullsized":"2024-04-26T10:34:14.510428+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:35.111495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498309+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:34:13.498309+0000","last_peered":"2024-04-26T10:34:13.498309+0000","last_clean":"2024-04-26T10:34:13.498309+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:34:13.498309+0000","last_undegraded":"2024-04-26T10:34:13.498309+0000","last_fullsized":"2024-04-26T10:34:13.498309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"42'8049","reported_seq":8083,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.542200+0000","last_change":"2024-04-26T10:33:16.349280+0000","last_active":"2024-04-26T10:34:14.542200+0000","last_peered":"2024-04-26T10:34:14.542200+0000","last_clean":"2024-04-26T10:34:14.542200+0000","last_became_active":"2024-04-26T10:33:16.349010+0000","last_became_peered":"2024-04-26T10:33:16.349010+0000","last_unstale":"2024-04-26T10:34:14.542200+0000","last_undegraded":"2024-04-26T10:34:14.542200+0000","last_fullsized":"2024-04-26T10:34:14.542200+0000","mapping_epoch":16,"log_start":"28'5171","ondisk_log_start":"28'5171","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2878,"log_dups_size":1442,"ondisk_log_size":2878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:08.933996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":527499264,"num_objects":8049,"num_object_clones":0,"num_object_copies":16098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8049,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8049,"num_write_kb":515136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511174+0000","last_change":"2024-04-26T10:34:14.511174+0000","last_active":"2024-04-26T10:34:14.511174+0000","last_peered":"2024-04-26T10:34:14.511174+0000","last_clean":"2024-04-26T10:34:14.511174+0000","last_became_active":"2024-04-26T10:34:14.510907+0000","last_became_peered":"2024-04-26T10:34:14.510907+0000","last_unstale":"2024-04-26T10:34:14.511174+0000","last_undegraded":"2024-04-26T10:34:14.511174+0000","last_fullsized":"2024-04-26T10:34:14.511174+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:34.574586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499450+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:34:13.499450+0000","last_peered":"2024-04-26T10:34:13.499450+0000","last_clean":"2024-04-26T10:34:13.499450+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:34:13.499450+0000","last_undegraded":"2024-04-26T10:34:13.499450+0000","last_fullsized":"2024-04-26T10:34:13.499450+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510449+0000","last_change":"2024-04-26T10:34:14.506552+0000","last_active":"2024-04-26T10:34:14.510449+0000","last_peered":"2024-04-26T10:34:14.510449+0000","last_clean":"2024-04-26T10:34:14.510449+0000","last_became_active":"2024-04-26T10:34:14.506008+0000","last_became_peered":"2024-04-26T10:34:14.506008+0000","last_unstale":"2024-04-26T10:34:14.510449+0000","last_undegraded":"2024-04-26T10:34:14.510449+0000","last_fullsized":"2024-04-26T10:34:14.510449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.031036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"42'8063","reported_seq":8097,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.503467+0000","last_change":"2024-04-26T10:33:16.349302+0000","last_active":"2024-04-26T10:34:14.503467+0000","last_peered":"2024-04-26T10:34:14.503467+0000","last_clean":"2024-04-26T10:34:14.503467+0000","last_became_active":"2024-04-26T10:33:16.348992+0000","last_became_peered":"2024-04-26T10:33:16.348992+0000","last_unstale":"2024-04-26T10:34:14.503467+0000","last_undegraded":"2024-04-26T10:34:14.503467+0000","last_fullsized":"2024-04-26T10:34:14.503467+0000","mapping_epoch":16,"log_start":"29'5157","ondisk_log_start":"29'5157","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":1442,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:15.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528416768,"num_objects":8063,"num_object_clones":0,"num_object_copies":16126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8063,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8063,"num_write_kb":516032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494391+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:34:13.494391+0000","last_peered":"2024-04-26T10:34:13.494391+0000","last_clean":"2024-04-26T10:34:13.494391+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:34:13.494391+0000","last_undegraded":"2024-04-26T10:34:13.494391+0000","last_fullsized":"2024-04-26T10:34:13.494391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499966+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:34:13.499966+0000","last_peered":"2024-04-26T10:34:13.499966+0000","last_clean":"2024-04-26T10:34:13.499966+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:34:13.499966+0000","last_undegraded":"2024-04-26T10:34:13.499966+0000","last_fullsized":"2024-04-26T10:34:13.499966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513348+0000","last_change":"2024-04-26T10:34:14.513348+0000","last_active":"2024-04-26T10:34:14.513348+0000","last_peered":"2024-04-26T10:34:14.513348+0000","last_clean":"2024-04-26T10:34:14.513348+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:34:14.513348+0000","last_undegraded":"2024-04-26T10:34:14.513348+0000","last_fullsized":"2024-04-26T10:34:14.513348+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:21.161769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"41'8130","reported_seq":8164,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.516120+0000","last_change":"2024-04-26T10:33:16.349181+0000","last_active":"2024-04-26T10:34:13.516120+0000","last_peered":"2024-04-26T10:34:13.516120+0000","last_clean":"2024-04-26T10:34:13.516120+0000","last_became_active":"2024-04-26T10:33:16.348981+0000","last_became_peered":"2024-04-26T10:33:16.348981+0000","last_unstale":"2024-04-26T10:34:13.516120+0000","last_undegraded":"2024-04-26T10:34:13.516120+0000","last_fullsized":"2024-04-26T10:34:13.516120+0000","mapping_epoch":16,"log_start":"29'5184","ondisk_log_start":"29'5184","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":1442,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532807680,"num_objects":8130,"num_object_clones":0,"num_object_copies":16260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8130,"num_write_kb":520320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500009+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:34:13.500009+0000","last_peered":"2024-04-26T10:34:13.500009+0000","last_clean":"2024-04-26T10:34:13.500009+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:34:13.500009+0000","last_undegraded":"2024-04-26T10:34:13.500009+0000","last_fullsized":"2024-04-26T10:34:13.500009+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.492182+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:34:13.492182+0000","last_peered":"2024-04-26T10:34:13.492182+0000","last_clean":"2024-04-26T10:34:13.492182+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:34:13.492182+0000","last_undegraded":"2024-04-26T10:34:13.492182+0000","last_fullsized":"2024-04-26T10:34:13.492182+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511363+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:34:14.511363+0000","last_peered":"2024-04-26T10:34:14.511363+0000","last_clean":"2024-04-26T10:34:14.511363+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:34:14.511363+0000","last_undegraded":"2024-04-26T10:34:14.511363+0000","last_fullsized":"2024-04-26T10:34:14.511363+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:57.803542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"40'8122","reported_seq":8160,"reported_epoch":40,"state":"peering","last_fresh":"2024-04-26T10:34:13.469763+0000","last_change":"2024-04-26T10:34:14.500169+0000","last_active":"2024-04-26T10:34:14.500169+0000","last_peered":"2024-04-26T10:34:13.469763+0000","last_clean":"2024-04-26T10:34:00.447964+0000","last_became_active":"2024-04-26T10:34:02.523429+0000","last_became_peered":"2024-04-26T10:34:02.523429+0000","last_unstale":"2024-04-26T10:34:13.469763+0000","last_undegraded":"2024-04-26T10:34:13.469763+0000","last_fullsized":"2024-04-26T10:34:13.469763+0000","mapping_epoch":42,"log_start":"29'5257","ondisk_log_start":"29'5257","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2865,"log_dups_size":1542,"ondisk_log_size":2865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:23.452922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532283392,"num_objects":8122,"num_object_clones":0,"num_object_copies":16244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8122,"num_write_kb":519808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499450+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:34:13.499450+0000","last_peered":"2024-04-26T10:34:13.499450+0000","last_clean":"2024-04-26T10:34:13.499450+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:34:13.499450+0000","last_undegraded":"2024-04-26T10:34:13.499450+0000","last_fullsized":"2024-04-26T10:34:13.499450+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":260,"reported_epoch":42,"state":"remapped+peering","last_fresh":"2024-04-26T10:34:14.499234+0000","last_change":"2024-04-26T10:34:14.500746+0000","last_active":"2024-04-26T10:34:13.494830+0000","last_peered":"2024-04-26T10:34:12.484561+0000","last_clean":"2024-04-26T10:34:12.484561+0000","last_became_active":"2024-04-26T10:34:04.467654+0000","last_became_peered":"2024-04-26T10:34:04.467654+0000","last_unstale":"2024-04-26T10:34:14.499234+0000","last_undegraded":"2024-04-26T10:34:14.499234+0000","last_fullsized":"2024-04-26T10:34:14.499234+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:19.317224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.496016+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:34:13.496016+0000","last_peered":"2024-04-26T10:34:13.496016+0000","last_clean":"2024-04-26T10:34:13.496016+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:34:13.496016+0000","last_undegraded":"2024-04-26T10:34:13.496016+0000","last_fullsized":"2024-04-26T10:34:13.496016+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509642+0000","last_change":"2024-04-26T10:34:14.509642+0000","last_active":"2024-04-26T10:34:14.509642+0000","last_peered":"2024-04-26T10:34:14.509642+0000","last_clean":"2024-04-26T10:34:14.509642+0000","last_became_active":"2024-04-26T10:34:14.509329+0000","last_became_peered":"2024-04-26T10:34:14.509329+0000","last_unstale":"2024-04-26T10:34:14.509642+0000","last_undegraded":"2024-04-26T10:34:14.509642+0000","last_fullsized":"2024-04-26T10:34:14.509642+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:20.861292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"42'8068","reported_seq":8102,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.542842+0000","last_change":"2024-04-26T10:33:16.344693+0000","last_active":"2024-04-26T10:34:14.542842+0000","last_peered":"2024-04-26T10:34:14.542842+0000","last_clean":"2024-04-26T10:34:14.542842+0000","last_became_active":"2024-04-26T10:33:16.344478+0000","last_became_peered":"2024-04-26T10:33:16.344478+0000","last_unstale":"2024-04-26T10:34:14.542842+0000","last_undegraded":"2024-04-26T10:34:14.542842+0000","last_fullsized":"2024-04-26T10:34:14.542842+0000","mapping_epoch":16,"log_start":"29'5133","ondisk_log_start":"29'5133","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2935,"log_dups_size":1442,"ondisk_log_size":2935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:24.298876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528744448,"num_objects":8068,"num_object_clones":0,"num_object_copies":16136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8068,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8068,"num_write_kb":516352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509367+0000","last_change":"2024-04-26T10:34:14.509367+0000","last_active":"2024-04-26T10:34:14.509367+0000","last_peered":"2024-04-26T10:34:14.509367+0000","last_clean":"2024-04-26T10:34:14.509367+0000","last_became_active":"2024-04-26T10:34:14.508465+0000","last_became_peered":"2024-04-26T10:34:14.508465+0000","last_unstale":"2024-04-26T10:34:14.509367+0000","last_undegraded":"2024-04-26T10:34:14.509367+0000","last_fullsized":"2024-04-26T10:34:14.509367+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:31.790156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499920+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:34:13.499920+0000","last_peered":"2024-04-26T10:34:13.499920+0000","last_clean":"2024-04-26T10:34:13.499920+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:34:13.499920+0000","last_undegraded":"2024-04-26T10:34:13.499920+0000","last_fullsized":"2024-04-26T10:34:13.499920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488609+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:34:13.488609+0000","last_peered":"2024-04-26T10:34:13.488609+0000","last_clean":"2024-04-26T10:34:13.488609+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:34:13.488609+0000","last_undegraded":"2024-04-26T10:34:13.488609+0000","last_fullsized":"2024-04-26T10:34:13.488609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"42'8200","reported_seq":8234,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.538890+0000","last_change":"2024-04-26T10:33:16.344694+0000","last_active":"2024-04-26T10:34:14.538890+0000","last_peered":"2024-04-26T10:34:14.538890+0000","last_clean":"2024-04-26T10:34:14.538890+0000","last_became_active":"2024-04-26T10:33:16.344461+0000","last_became_peered":"2024-04-26T10:33:16.344461+0000","last_unstale":"2024-04-26T10:34:14.538890+0000","last_undegraded":"2024-04-26T10:34:14.538890+0000","last_fullsized":"2024-04-26T10:34:14.538890+0000","mapping_epoch":16,"log_start":"29'5284","ondisk_log_start":"29'5284","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":1442,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:29.374096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537395200,"num_objects":8200,"num_object_clones":0,"num_object_copies":16400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8200,"num_write_kb":524800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511624+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:34:14.511624+0000","last_peered":"2024-04-26T10:34:14.511624+0000","last_clean":"2024-04-26T10:34:14.511624+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:34:14.511624+0000","last_undegraded":"2024-04-26T10:34:14.511624+0000","last_fullsized":"2024-04-26T10:34:14.511624+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":54,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509602+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:34:14.509602+0000","last_peered":"2024-04-26T10:34:14.509602+0000","last_clean":"2024-04-26T10:34:14.509602+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:34:14.509602+0000","last_undegraded":"2024-04-26T10:34:14.509602+0000","last_fullsized":"2024-04-26T10:34:14.509602+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:21.048381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488843+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:34:13.488843+0000","last_peered":"2024-04-26T10:34:13.488843+0000","last_clean":"2024-04-26T10:34:13.488843+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:34:13.488843+0000","last_undegraded":"2024-04-26T10:34:13.488843+0000","last_fullsized":"2024-04-26T10:34:13.488843+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"42'8180","reported_seq":8214,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.542566+0000","last_change":"2024-04-26T10:33:16.344714+0000","last_active":"2024-04-26T10:34:14.542566+0000","last_peered":"2024-04-26T10:34:14.542566+0000","last_clean":"2024-04-26T10:34:14.542566+0000","last_became_active":"2024-04-26T10:33:16.344500+0000","last_became_peered":"2024-04-26T10:33:16.344500+0000","last_unstale":"2024-04-26T10:34:14.542566+0000","last_undegraded":"2024-04-26T10:34:14.542566+0000","last_fullsized":"2024-04-26T10:34:14.542566+0000","mapping_epoch":16,"log_start":"29'5235","ondisk_log_start":"29'5235","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2945,"log_dups_size":1442,"ondisk_log_size":2945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:19.056484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536084480,"num_objects":8180,"num_object_clones":0,"num_object_copies":16360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8180,"num_write_kb":523520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497426+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:34:13.497426+0000","last_peered":"2024-04-26T10:34:13.497426+0000","last_clean":"2024-04-26T10:34:13.497426+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:34:13.497426+0000","last_undegraded":"2024-04-26T10:34:13.497426+0000","last_fullsized":"2024-04-26T10:34:13.497426+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509515+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:34:14.509515+0000","last_peered":"2024-04-26T10:34:14.509515+0000","last_clean":"2024-04-26T10:34:14.509515+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:34:14.509515+0000","last_undegraded":"2024-04-26T10:34:14.509515+0000","last_fullsized":"2024-04-26T10:34:14.509515+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.172123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500430+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:34:13.500430+0000","last_peered":"2024-04-26T10:34:13.500430+0000","last_clean":"2024-04-26T10:34:13.500430+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:34:13.500430+0000","last_undegraded":"2024-04-26T10:34:13.500430+0000","last_fullsized":"2024-04-26T10:34:13.500430+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'8103","reported_seq":8139,"reported_epoch":40,"state":"peering","last_fresh":"2024-04-26T10:34:13.458972+0000","last_change":"2024-04-26T10:34:14.498783+0000","last_active":"2024-04-26T10:34:14.498783+0000","last_peered":"2024-04-26T10:34:13.458972+0000","last_clean":"2024-04-26T10:34:00.424582+0000","last_became_active":"2024-04-26T10:34:02.519692+0000","last_became_peered":"2024-04-26T10:34:02.519692+0000","last_unstale":"2024-04-26T10:34:13.458972+0000","last_undegraded":"2024-04-26T10:34:13.458972+0000","last_fullsized":"2024-04-26T10:34:13.458972+0000","mapping_epoch":42,"log_start":"28'5188","ondisk_log_start":"28'5188","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2915,"log_dups_size":1442,"ondisk_log_size":2915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:12.143408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531038208,"num_objects":8103,"num_object_clones":0,"num_object_copies":16206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8103,"num_write_kb":518592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.512226+0000","last_change":"2024-04-26T10:34:14.512226+0000","last_active":"2024-04-26T10:34:14.512226+0000","last_peered":"2024-04-26T10:34:14.512226+0000","last_clean":"2024-04-26T10:34:14.512226+0000","last_became_active":"2024-04-26T10:34:14.511888+0000","last_became_peered":"2024-04-26T10:34:14.511888+0000","last_unstale":"2024-04-26T10:34:14.512226+0000","last_undegraded":"2024-04-26T10:34:14.512226+0000","last_fullsized":"2024-04-26T10:34:14.512226+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:58.832869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497421+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:34:13.497421+0000","last_peered":"2024-04-26T10:34:13.497421+0000","last_clean":"2024-04-26T10:34:13.497421+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:34:13.497421+0000","last_undegraded":"2024-04-26T10:34:13.497421+0000","last_fullsized":"2024-04-26T10:34:13.497421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510695+0000","last_change":"2024-04-26T10:34:14.510158+0000","last_active":"2024-04-26T10:34:14.510695+0000","last_peered":"2024-04-26T10:34:14.510695+0000","last_clean":"2024-04-26T10:34:14.510695+0000","last_became_active":"2024-04-26T10:34:14.509584+0000","last_became_peered":"2024-04-26T10:34:14.509584+0000","last_unstale":"2024-04-26T10:34:14.510695+0000","last_undegraded":"2024-04-26T10:34:14.510695+0000","last_fullsized":"2024-04-26T10:34:14.510695+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:39.230972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513307+0000","last_change":"2024-04-26T10:34:14.508334+0000","last_active":"2024-04-26T10:34:14.513307+0000","last_peered":"2024-04-26T10:34:14.513307+0000","last_clean":"2024-04-26T10:34:14.513307+0000","last_became_active":"2024-04-26T10:34:14.507205+0000","last_became_peered":"2024-04-26T10:34:14.507205+0000","last_unstale":"2024-04-26T10:34:14.513307+0000","last_undegraded":"2024-04-26T10:34:14.513307+0000","last_fullsized":"2024-04-26T10:34:14.513307+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:20.747187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.489460+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:34:13.489460+0000","last_peered":"2024-04-26T10:34:13.489460+0000","last_clean":"2024-04-26T10:34:13.489460+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:34:13.489460+0000","last_undegraded":"2024-04-26T10:34:13.489460+0000","last_fullsized":"2024-04-26T10:34:13.489460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497414+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:34:13.497414+0000","last_peered":"2024-04-26T10:34:13.497414+0000","last_clean":"2024-04-26T10:34:13.497414+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:34:13.497414+0000","last_undegraded":"2024-04-26T10:34:13.497414+0000","last_fullsized":"2024-04-26T10:34:13.497414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499249+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:34:13.499249+0000","last_peered":"2024-04-26T10:34:13.499249+0000","last_clean":"2024-04-26T10:34:13.499249+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:34:13.499249+0000","last_undegraded":"2024-04-26T10:34:13.499249+0000","last_fullsized":"2024-04-26T10:34:13.499249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488589+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:34:13.488589+0000","last_peered":"2024-04-26T10:34:13.488589+0000","last_clean":"2024-04-26T10:34:13.488589+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:34:13.488589+0000","last_undegraded":"2024-04-26T10:34:13.488589+0000","last_fullsized":"2024-04-26T10:34:13.488589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494252+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:34:13.494252+0000","last_peered":"2024-04-26T10:34:13.494252+0000","last_clean":"2024-04-26T10:34:13.494252+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:34:13.494252+0000","last_undegraded":"2024-04-26T10:34:13.494252+0000","last_fullsized":"2024-04-26T10:34:13.494252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498954+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:34:13.498954+0000","last_peered":"2024-04-26T10:34:13.498954+0000","last_clean":"2024-04-26T10:34:13.498954+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:34:13.498954+0000","last_undegraded":"2024-04-26T10:34:13.498954+0000","last_fullsized":"2024-04-26T10:34:13.498954+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510537+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:34:14.510537+0000","last_peered":"2024-04-26T10:34:14.510537+0000","last_clean":"2024-04-26T10:34:14.510537+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:34:14.510537+0000","last_undegraded":"2024-04-26T10:34:14.510537+0000","last_fullsized":"2024-04-26T10:34:14.510537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497515+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:34:13.497515+0000","last_peered":"2024-04-26T10:34:13.497515+0000","last_clean":"2024-04-26T10:34:13.497515+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:34:13.497515+0000","last_undegraded":"2024-04-26T10:34:13.497515+0000","last_fullsized":"2024-04-26T10:34:13.497515+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497531+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:34:13.497531+0000","last_peered":"2024-04-26T10:34:13.497531+0000","last_clean":"2024-04-26T10:34:13.497531+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:34:13.497531+0000","last_undegraded":"2024-04-26T10:34:13.497531+0000","last_fullsized":"2024-04-26T10:34:13.497531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.496002+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:34:13.496002+0000","last_peered":"2024-04-26T10:34:13.496002+0000","last_clean":"2024-04-26T10:34:13.496002+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:34:13.496002+0000","last_undegraded":"2024-04-26T10:34:13.496002+0000","last_fullsized":"2024-04-26T10:34:13.496002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513276+0000","last_change":"2024-04-26T10:34:14.513276+0000","last_active":"2024-04-26T10:34:14.513276+0000","last_peered":"2024-04-26T10:34:14.513276+0000","last_clean":"2024-04-26T10:34:14.513276+0000","last_became_active":"2024-04-26T10:34:14.512930+0000","last_became_peered":"2024-04-26T10:34:14.512930+0000","last_unstale":"2024-04-26T10:34:14.513276+0000","last_undegraded":"2024-04-26T10:34:14.513276+0000","last_fullsized":"2024-04-26T10:34:14.513276+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:37.809739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488354+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:34:13.488354+0000","last_peered":"2024-04-26T10:34:13.488354+0000","last_clean":"2024-04-26T10:34:13.488354+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:34:13.488354+0000","last_undegraded":"2024-04-26T10:34:13.488354+0000","last_fullsized":"2024-04-26T10:34:13.488354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.516166+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:34:14.516166+0000","last_peered":"2024-04-26T10:34:14.516166+0000","last_clean":"2024-04-26T10:34:14.516166+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:34:14.516166+0000","last_undegraded":"2024-04-26T10:34:14.516166+0000","last_fullsized":"2024-04-26T10:34:14.516166+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.021846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510697+0000","last_change":"2024-04-26T10:34:14.507476+0000","last_active":"2024-04-26T10:34:14.510697+0000","last_peered":"2024-04-26T10:34:14.510697+0000","last_clean":"2024-04-26T10:34:14.510697+0000","last_became_active":"2024-04-26T10:34:14.507171+0000","last_became_peered":"2024-04-26T10:34:14.507171+0000","last_unstale":"2024-04-26T10:34:14.510697+0000","last_undegraded":"2024-04-26T10:34:14.510697+0000","last_fullsized":"2024-04-26T10:34:14.510697+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:32.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8522170368,"num_objects":130038,"num_object_clones":0,"num_object_copies":260076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130038,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130038,"num_write_kb":8322432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3174,"num_bytes_recovered":208011264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17163419648,"data_stored":17163419648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48763,"ondisk_log_size":48763,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":1,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738389,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6989468,"kb_used_data":6777872,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":87382372,"statfs":{"total":96636764160,"available":89479548928,"internally_reserved":0,"allocated":6940540928,"data_stored":6940241247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216660422},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.312}]},{"osd":1,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.39300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738388,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5459308,"kb_used_data":5297756,"kb_used_omap":1,"kb_used_meta":161534,"kb_avail":88912532,"statfs":{"total":96636764160,"available":91046432768,"internally_reserved":0,"allocated":5424902144,"data_stored":5424587178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":165411270},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.23699999999999999}]},{"osd":2,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.69599999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738388,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4807692,"kb_used_data":4686332,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":89564148,"statfs":{"total":96636764160,"available":91713687552,"internally_reserved":0,"allocated":4798803968,"data_stored":4798518934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.14999999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.19400000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.184},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.22700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5424939008,"data_stored":5424939008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4799004672,"data_stored":4799004672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6939475968,"data_stored":6939475968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:34:19.576 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T10:34:19.579 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:19.581 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:19.580+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:19.582 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:19.582 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:19.582 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:19.630 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:19.630 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:19.630 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:19.630 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:19.630 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:19.643 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:19.682 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:19.681+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:19.783 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:19.782+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:19.812 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:19.812 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:19.812 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:19.812 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:19.812 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.009682560999998, 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.813 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.814 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.815 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.816 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.817 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.818 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.818 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:19.818 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:19.818 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.818 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.818 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.818 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.818 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.818 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:19.818 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:19.818 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.008854481, 2024-04-26T10:34:19.818 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:19.818 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.819 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.820 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.821 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.822 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:19.823 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.007925417999999, 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.824 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:19.825 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.825 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.825 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.825 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.825 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:19.825 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.825 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.825 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.825 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.825 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:19.825 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.825 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:19.826 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:19.827 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.828 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.829 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.007239976999998, 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.830 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:19.831 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:19.832 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:19.833 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:19.834 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:19.834 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.834 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.834 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.834 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:19.834 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:19.834 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.834 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.834 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.834 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:19.834 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:19.834 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.835 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103337 5.d 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.621581303999999, 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.058853520999999999, 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103337 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.836 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.837 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188132+0000", 2024-04-26T10:34:19.838 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6197000000000003e-05 2024-04-26T10:34:19.838 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.838 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.838 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.838 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188144+0000", 2024-04-26T10:34:19.838 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2001000000000001e-05 2024-04-26T10:34:19.838 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.838 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.838 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.838 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188152+0000", 2024-04-26T10:34:19.838 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9349999999999994e-06 2024-04-26T10:34:19.838 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.838 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.839 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.839 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188185+0000", 2024-04-26T10:34:19.839 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3436000000000003e-05 2024-04-26T10:34:19.839 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.839 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.839 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.839 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188275+0000", 2024-04-26T10:34:19.839 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9995999999999997e-05 2024-04-26T10:34:19.839 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.839 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.839 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:19.839 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188365+0000", 2024-04-26T10:34:19.839 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0254999999999996e-05 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.194973+0000", 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066073490000000002 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246781+0000", 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.051808372999999998 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.840 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246865+0000", 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3498999999999995e-05 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246920+0000", 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5208999999999999e-05 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:19.841 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.430949535, 2024-04-26T10:34:19.842 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:19.842 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.842 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.842 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.842 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.842 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.842 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:19.842 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.842 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.842 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.842 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.842 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:19.842 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.843 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:19.844 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:19.844 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.844 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.844 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.844 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:19.844 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:19.844 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.844 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.844 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.844 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:19.844 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:19.844 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.844 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:19.845 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.846 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.846 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.846 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:19.846 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:19.846 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.846 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.846 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.846 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:19.846 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:19.846 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.846 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.846 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.846 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.430730230999998, 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:19.847 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.848 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.849 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.850 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.850 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:19.850 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:19.850 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.850 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.850 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.850 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:19.850 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:19.850 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.850 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.850 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.850 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.851 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.852 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.430650426, 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.853 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.854 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.854 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:19.854 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.854 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.854 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.854 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.854 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:19.854 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.854 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.854 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.854 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.854 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:19.854 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:19.855 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:19.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:19.858 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:19.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.858 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.858 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:19.858 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:19.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.858 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.858 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:19.858 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:19.858 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.858 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.429286395999998, 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.859 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.860 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.860 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.860 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:19.860 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.860 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.860 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.860 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:19.860 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.860 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.860 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.860 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:19.862 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.428692058999999, 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:19.864 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.865 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.866 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:19.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.866 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.866 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.866 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.866 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:19.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:19.866 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.866 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.866 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.866 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:19.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:19.867 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.869 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.870 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:19.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:19.870 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.870 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.870 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.870 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:19.870 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:19.870 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.427931702999999, 2024-04-26T10:34:19.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:19.870 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.870 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:19.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:19.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:19.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:19.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:19.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:19.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:19.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:19.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:19.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:19.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:19.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:19.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:19.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:19.876 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.876 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.876 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.876 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:19.876 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:19.876 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.427314243000001, 2024-04-26T10:34:19.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:19.876 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.877 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:19.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:19.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:19.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:19.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:19.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:19.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:19.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:19.881 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.426749239999999, 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:19.882 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:19.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.426205928000002, 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.886 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.887 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.888 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:19.888 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:19.888 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.888 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.888 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.888 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:19.888 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:19.888 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.888 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.888 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.888 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.889 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.890 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:19.891 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.424733927999998, 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.892 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.893 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:19.894 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.424168508000001, 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.900 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.901 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.901 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.901 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.901 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:19.901 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:19.901 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.424103658, 2024-04-26T10:34:19.901 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:19.901 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.901 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.901 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.901 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.901 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.901 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.904 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.423342678000001, 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.905 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.908 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.42232125, 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:19.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:19.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:19.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:19.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:19.912 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103647 5.b e32/16 ondisk, result = 0)", 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 21.422302551000001, 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060768513000000003, 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:19.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387344+0000", 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387350+0000", 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.22e-06 2024-04-26T10:34:19.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447917+0000", 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060567523999999998 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447925+0000", 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7689999999999996e-06 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448004+0000", 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9246000000000007e-05 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448012+0000", 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3490000000000003e-06 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448114+0000", 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010205299999999999 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:19.916 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:19.917 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:19.917+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:19.918 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:20.015 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:20.016 INFO:teuthology.orchestra.run.smithi043.stdout:{"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub,nodeep-scrub flag(s) set","count":20},"muted":false}},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":103,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":46,"num_osds":3,"num_up_osds":3,"osd_up_since":1714127564,"num_in_osds":3,"osd_in_since":1714127557,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":116},{"state_name":"peering","count":4},{"state_name":"remapped+peering","count":1}],"num_pgs":121,"num_pools":5,"num_objects":130062,"data_bytes":8522763098,"bytes_used":17670623232,"bytes_avail":272239669248,"bytes_total":289910292480,"inactive_pgs_ratio":0.041322313249111176,"recovering_objects_per_sec":247,"recovering_bytes_per_sec":16054437,"recovering_keys_per_sec":0,"num_objects_recovered":991,"num_bytes_recovered":64226956,"num_keys_recovered":0,"write_bytes_sec":113180830,"read_op_per_sec":0,"write_op_per_sec":1727},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4186}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-26T10:33:56.996864+0000","services":{}},"progress_events":{}} 2024-04-26T10:34:20.018 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:20.017+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:20.030 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T10:34:20.030 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:34:20.115 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:20.115 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:20.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.115 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:139346 5.2 e46/16 5:4ffdaf60:::benchmark_data_smithi043_45180_object4704:head v 46'8783, mlcod=46'8781)", 2024-04-26T10:34:20.116 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.108402+0000", 2024-04-26T10:34:20.116 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0047887750000000003, 2024-04-26T10:34:20.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0048104189999999998, 2024-04-26T10:34:20.116 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.116 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:20.116 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108402+0000", 2024-04-26T10:34:20.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108402+0000", 2024-04-26T10:34:20.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108402+0000", 2024-04-26T10:34:20.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967296 2024-04-26T10:34:20.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108404+0000", 2024-04-26T10:34:20.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1469999999999999e-06 2024-04-26T10:34:20.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108407+0000", 2024-04-26T10:34:20.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.994e-06 2024-04-26T10:34:20.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108410+0000", 2024-04-26T10:34:20.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3639999999999999e-06 2024-04-26T10:34:20.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.109691+0000", 2024-04-26T10:34:20.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001281091 2024-04-26T10:34:20.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.109710+0000", 2024-04-26T10:34:20.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9079000000000001e-05 2024-04-26T10:34:20.119 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.119 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.120 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.120 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:139349 5.3 5:cf4bb049:::benchmark_data_smithi043_45180_object4707:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.120 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.108708+0000", 2024-04-26T10:34:20.120 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0044827599999999997, 2024-04-26T10:34:20.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0045935919999999996, 2024-04-26T10:34:20.120 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.120 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:20.120 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.120 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.120 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.120 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 139349 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108708+0000", 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108708+0000", 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108708+0000", 2024-04-26T10:34:20.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108710+0000", 2024-04-26T10:34:20.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.238e-06 2024-04-26T10:34:20.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.122 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108715+0000", 2024-04-26T10:34:20.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6200000000000004e-06 2024-04-26T10:34:20.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108720+0000", 2024-04-26T10:34:20.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9230000000000001e-06 2024-04-26T10:34:20.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.109034+0000", 2024-04-26T10:34:20.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00031412900000000001 2024-04-26T10:34:20.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.109139+0000", 2024-04-26T10:34:20.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010484000000000001 2024-04-26T10:34:20.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.109223+0000", 2024-04-26T10:34:20.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3510000000000005e-05 2024-04-26T10:34:20.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111215+0000", 2024-04-26T10:34:20.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019919389999999999 2024-04-26T10:34:20.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113269+0000", 2024-04-26T10:34:20.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020542849999999999 2024-04-26T10:34:20.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113310+0000", 2024-04-26T10:34:20.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1136000000000001e-05 2024-04-26T10:34:20.125 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.125 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.125 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.126 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:139350 5.5 5:aeef4ffb:::benchmark_data_smithi043_45180_object4708:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.126 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.108728+0000", 2024-04-26T10:34:20.126 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0044623830000000003, 2024-04-26T10:34:20.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0046430719999999998, 2024-04-26T10:34:20.126 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.126 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:20.126 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.126 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.126 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.126 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 139350 2024-04-26T10:34:20.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.127 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108728+0000", 2024-04-26T10:34:20.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108728+0000", 2024-04-26T10:34:20.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108728+0000", 2024-04-26T10:34:20.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108731+0000", 2024-04-26T10:34:20.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8490000000000002e-06 2024-04-26T10:34:20.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108739+0000", 2024-04-26T10:34:20.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5990000000000002e-06 2024-04-26T10:34:20.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108745+0000", 2024-04-26T10:34:20.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0310000000000004e-06 2024-04-26T10:34:20.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108778+0000", 2024-04-26T10:34:20.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3052000000000001e-05 2024-04-26T10:34:20.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108879+0000", 2024-04-26T10:34:20.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000100851 2024-04-26T10:34:20.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108963+0000", 2024-04-26T10:34:20.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3615000000000005e-05 2024-04-26T10:34:20.131 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.131 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.131 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.131 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:139351 5.5 5:aa1ef70b:::benchmark_data_smithi043_45180_object4709:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.131 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.108754+0000", 2024-04-26T10:34:20.131 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0044369429999999996, 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004688032, 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 139351 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108754+0000", 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108754+0000", 2024-04-26T10:34:20.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108753+0000", 2024-04-26T10:34:20.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108756+0000", 2024-04-26T10:34:20.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5220000000000002e-06 2024-04-26T10:34:20.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108763+0000", 2024-04-26T10:34:20.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7499999999999997e-06 2024-04-26T10:34:20.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108768+0000", 2024-04-26T10:34:20.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4269999999999999e-06 2024-04-26T10:34:20.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.110668+0000", 2024-04-26T10:34:20.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001900241 2024-04-26T10:34:20.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.110807+0000", 2024-04-26T10:34:20.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000138851 2024-04-26T10:34:20.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.110903+0000", 2024-04-26T10:34:20.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5623000000000002e-05 2024-04-26T10:34:20.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.136 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.136 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.136 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:139353 5.a 5:55770e74:::benchmark_data_smithi043_45180_object4711:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.136 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.108792+0000", 2024-04-26T10:34:20.136 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00439873, 2024-04-26T10:34:20.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0047582249999999996, 2024-04-26T10:34:20.137 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.137 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:20.137 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.137 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.137 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.137 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 139353 2024-04-26T10:34:20.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.137 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108792+0000", 2024-04-26T10:34:20.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108792+0000", 2024-04-26T10:34:20.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108791+0000", 2024-04-26T10:34:20.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108794+0000", 2024-04-26T10:34:20.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0139999999999999e-06 2024-04-26T10:34:20.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108801+0000", 2024-04-26T10:34:20.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0509999999999999e-06 2024-04-26T10:34:20.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.108807+0000", 2024-04-26T10:34:20.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2340000000000002e-06 2024-04-26T10:34:20.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111369+0000", 2024-04-26T10:34:20.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025621189999999999 2024-04-26T10:34:20.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111492+0000", 2024-04-26T10:34:20.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012309899999999999 2024-04-26T10:34:20.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:20.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111593+0000", 2024-04-26T10:34:20.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000100975 2024-04-26T10:34:20.141 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.141 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.141 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.141 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:139355 5.c 5:32d05f7e:::benchmark_data_smithi043_45180_object4713:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.142 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.110693+0000", 2024-04-26T10:34:20.142 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0024980279999999998, 2024-04-26T10:34:20.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0029451730000000001, 2024-04-26T10:34:20.142 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.142 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:20.142 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.142 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.142 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.142 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 139355 2024-04-26T10:34:20.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.142 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.110693+0000", 2024-04-26T10:34:20.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.110693+0000", 2024-04-26T10:34:20.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.110692+0000", 2024-04-26T10:34:20.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:20.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.110697+0000", 2024-04-26T10:34:20.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:34:20.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.110709+0000", 2024-04-26T10:34:20.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1377e-05 2024-04-26T10:34:20.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.110717+0000", 2024-04-26T10:34:20.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5229999999999995e-06 2024-04-26T10:34:20.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111352+0000", 2024-04-26T10:34:20.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00063527899999999999 2024-04-26T10:34:20.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111465+0000", 2024-04-26T10:34:20.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000112413 2024-04-26T10:34:20.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111562+0000", 2024-04-26T10:34:20.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6800999999999997e-05 2024-04-26T10:34:20.146 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.146 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.146 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.146 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:139358 5.5 5:ae6f7d51:::benchmark_data_smithi043_45180_object4716:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.146 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.111151+0000", 2024-04-26T10:34:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0020401960000000002, 2024-04-26T10:34:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025774909999999999, 2024-04-26T10:34:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 139358 2024-04-26T10:34:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111151+0000", 2024-04-26T10:34:20.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111151+0000", 2024-04-26T10:34:20.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111150+0000", 2024-04-26T10:34:20.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:20.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111155+0000", 2024-04-26T10:34:20.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2140000000000004e-06 2024-04-26T10:34:20.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111164+0000", 2024-04-26T10:34:20.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7420000000000003e-06 2024-04-26T10:34:20.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111169+0000", 2024-04-26T10:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0429999999999998e-06 2024-04-26T10:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.112513+0000", 2024-04-26T10:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013446389999999999 2024-04-26T10:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.112682+0000", 2024-04-26T10:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016887400000000001 2024-04-26T10:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.112802+0000", 2024-04-26T10:34:20.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011967 2024-04-26T10:34:20.151 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.151 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.151 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.151 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:139359 5.5 5.8a79fac5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.151 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.111174+0000", 2024-04-26T10:34:20.151 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0020166149999999998, 2024-04-26T10:34:20.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026246949999999998, 2024-04-26T10:34:20.152 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.152 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:20.152 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.152 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.152 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.152 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 139359 2024-04-26T10:34:20.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.152 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111174+0000", 2024-04-26T10:34:20.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111174+0000", 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111174+0000", 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111176+0000", 2024-04-26T10:34:20.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.762e-06 2024-04-26T10:34:20.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111179+0000", 2024-04-26T10:34:20.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3469999999999999e-06 2024-04-26T10:34:20.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111182+0000", 2024-04-26T10:34:20.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.632e-06 2024-04-26T10:34:20.154 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.154 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.154 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.155 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:139344 5.7 e46/16 5:ee21e04a:::benchmark_data_smithi043_45180_object4702:head v 46'8609, mlcod=46'8605)", 2024-04-26T10:34:20.155 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.111201+0000", 2024-04-26T10:34:20.155 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0019901860000000001, 2024-04-26T10:34:20.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002631563, 2024-04-26T10:34:20.155 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.155 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:20.155 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111201+0000", 2024-04-26T10:34:20.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111201+0000", 2024-04-26T10:34:20.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111200+0000", 2024-04-26T10:34:20.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111208+0000", 2024-04-26T10:34:20.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1419999999999993e-06 2024-04-26T10:34:20.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111217+0000", 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8720000000000008e-06 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111223+0000", 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9490000000000001e-06 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111771+0000", 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00054771099999999999 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.111788+0000", 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7728e-05 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:139350 5.5 e46/16)", 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.113228+0000", 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9999633, 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00063831900000000004, 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:20.160 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113228+0000", 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113228+0000", 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113227+0000", 2024-04-26T10:34:20.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113231+0000", 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2440000000000002e-06 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113242+0000", 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1687e-05 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113248+0000", 2024-04-26T10:34:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7169999999999996e-06 2024-04-26T10:34:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:139351 5.5 e46/16)", 2024-04-26T10:34:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.113255+0000", 2024-04-26T10:34:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9999361, 2024-04-26T10:34:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00063727200000000003, 2024-04-26T10:34:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:20.163 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113255+0000", 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113255+0000", 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113254+0000", 2024-04-26T10:34:20.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113257+0000", 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2879999999999999e-06 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113262+0000", 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7209999999999999e-06 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113267+0000", 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2780000000000004e-06 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:139363 5.5 5.df015705 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.113443+0000", 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9997478, 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00047993299999999999, 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.166 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 139363 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113443+0000", 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113443+0000", 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113442+0000", 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113447+0000", 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.079e-06 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113456+0000", 2024-04-26T10:34:20.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3419999999999997e-06 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113462+0000", 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0889999999999996e-06 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:139364 5.5 5.98f38bf5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.113501+0000", 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9996896, 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000452755, 2024-04-26T10:34:20.169 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.170 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:20.170 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.170 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.170 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.170 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 139364 2024-04-26T10:34:20.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.170 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113501+0000", 2024-04-26T10:34:20.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113501+0000", 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113501+0000", 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113504+0000", 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3210000000000001e-06 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113510+0000", 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5599999999999999e-06 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113514+0000", 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0110000000000002e-06 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:139360 5.7 e46/16 5:e91f2b54:::benchmark_data_smithi043_45180_object4718:head v 46'8610, mlcod=46'8605)", 2024-04-26T10:34:20.172 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.113505+0000", 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9996862, 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00048281799999999998, 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113505+0000", 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113505+0000", 2024-04-26T10:34:20.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113504+0000", 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113509+0000", 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5389999999999998e-06 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113517+0000", 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3320000000000003e-06 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113523+0000", 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4699999999999999e-06 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113564+0000", 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0995000000000003e-05 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113584+0000", 2024-04-26T10:34:20.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0013e-05 2024-04-26T10:34:20.176 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.176 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.176 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.176 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:139365 5.5 5.9c1ecc35 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.176 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.113557+0000", 2024-04-26T10:34:20.176 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9996333, 2024-04-26T10:34:20.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00047162199999999999, 2024-04-26T10:34:20.176 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.176 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 139365 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113557+0000", 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113557+0000", 2024-04-26T10:34:20.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113557+0000", 2024-04-26T10:34:20.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113560+0000", 2024-04-26T10:34:20.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.275e-06 2024-04-26T10:34:20.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113567+0000", 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2540000000000003e-06 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113573+0000", 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6160000000000001e-06 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.179 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:139361 5.4 e46/42 5:25a2f874:::benchmark_data_smithi043_45180_object4719:head v 46'8743, mlcod=46'8741)", 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.113652+0000", 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9995384, 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00042026900000000002, 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113652+0000", 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113652+0000", 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113652+0000", 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113657+0000", 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7480000000000001e-06 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113664+0000", 2024-04-26T10:34:20.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1760000000000004e-06 2024-04-26T10:34:20.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113669+0000", 2024-04-26T10:34:20.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3870000000000003e-06 2024-04-26T10:34:20.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113704+0000", 2024-04-26T10:34:20.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4443000000000002e-05 2024-04-26T10:34:20.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113722+0000", 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8624e-05 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:139362 5.0 e46/42 5:04a9df13:::benchmark_data_smithi043_45180_object4720:head v 46'8683, mlcod=46'8681)", 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.113681+0000", 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9995093, 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00042569999999999999, 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:20.183 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113681+0000", 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113681+0000", 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113681+0000", 2024-04-26T10:34:20.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113685+0000", 2024-04-26T10:34:20.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7639999999999999e-06 2024-04-26T10:34:20.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113690+0000", 2024-04-26T10:34:20.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.604e-06 2024-04-26T10:34:20.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113695+0000", 2024-04-26T10:34:20.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3259999999999997e-06 2024-04-26T10:34:20.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113726+0000", 2024-04-26T10:34:20.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1451000000000001e-05 2024-04-26T10:34:20.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113743+0000", 2024-04-26T10:34:20.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7269e-05 2024-04-26T10:34:20.187 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.187 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.187 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.188 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:139366 5.a 5:5cbd2542:::benchmark_data_smithi043_45180_object4724:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.188 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:20.113718+0000", 2024-04-26T10:34:20.188 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9994731, 2024-04-26T10:34:20.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000433492, 2024-04-26T10:34:20.188 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.188 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:20.188 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.189 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.189 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.189 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 139366 2024-04-26T10:34:20.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.189 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113718+0000", 2024-04-26T10:34:20.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113718+0000", 2024-04-26T10:34:20.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113717+0000", 2024-04-26T10:34:20.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113720+0000", 2024-04-26T10:34:20.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8890000000000002e-06 2024-04-26T10:34:20.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113728+0000", 2024-04-26T10:34:20.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3690000000000007e-06 2024-04-26T10:34:20.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113734+0000", 2024-04-26T10:34:20.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9710000000000001e-06 2024-04-26T10:34:20.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113770+0000", 2024-04-26T10:34:20.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6052e-05 2024-04-26T10:34:20.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113884+0000", 2024-04-26T10:34:20.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114008 2024-04-26T10:34:20.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:20.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:20.113986+0000", 2024-04-26T10:34:20.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101341 2024-04-26T10:34:20.194 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.194 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.195 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.195 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.195 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:34:20.195 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 18 2024-04-26T10:34:20.195 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:20.197 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:20.195+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:20.198 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:20.297 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:20.296+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:20.386 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:20.388 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:34:20.389 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:34:20.390 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:34:20.390 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:20.397 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-04-26T10:34:19.000221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8522763098,"num_objects":130062,"num_object_clones":0,"num_object_copies":260124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130062,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":130286,"num_write_kb":8325906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3198,"num_bytes_recovered":208604984,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48959,"ondisk_log_size":48959,"up":242,"acting":241,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":248,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":17256468,"kb_used_data":16761960,"kb_used_omap":4,"kb_used_meta":494459,"kb_avail":265859052,"statfs":{"total":289910292480,"available":272239669248,"internally_reserved":0,"allocated":17164247040,"data_stored":17163347359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":506326354},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":452788224,"num_objects":6909,"num_object_clones":0,"num_object_copies":13818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-43599,"num_objects_unfound":0,"num_objects_dirty":6909,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6909,"num_write_kb":442176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":991,"num_bytes_recovered":64226956,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000573"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510347+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:34:14.510347+0000","last_peered":"2024-04-26T10:34:14.510347+0000","last_clean":"2024-04-26T10:34:14.510347+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:34:14.510347+0000","last_undegraded":"2024-04-26T10:34:14.510347+0000","last_fullsized":"2024-04-26T10:34:14.510347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:26.964955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488460+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:34:13.488460+0000","last_peered":"2024-04-26T10:34:13.488460+0000","last_clean":"2024-04-26T10:34:13.488460+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:34:13.488460+0000","last_undegraded":"2024-04-26T10:34:13.488460+0000","last_fullsized":"2024-04-26T10:34:13.488460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499377+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:34:13.499377+0000","last_peered":"2024-04-26T10:34:13.499377+0000","last_clean":"2024-04-26T10:34:13.499377+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:34:13.499377+0000","last_undegraded":"2024-04-26T10:34:13.499377+0000","last_fullsized":"2024-04-26T10:34:13.499377+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499057+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:34:13.499057+0000","last_peered":"2024-04-26T10:34:13.499057+0000","last_clean":"2024-04-26T10:34:13.499057+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:34:13.499057+0000","last_undegraded":"2024-04-26T10:34:13.499057+0000","last_fullsized":"2024-04-26T10:34:13.499057+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513196+0000","last_change":"2024-04-26T10:34:14.507618+0000","last_active":"2024-04-26T10:34:14.513196+0000","last_peered":"2024-04-26T10:34:14.513196+0000","last_clean":"2024-04-26T10:34:14.513196+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:34:14.513196+0000","last_undegraded":"2024-04-26T10:34:14.513196+0000","last_fullsized":"2024-04-26T10:34:14.513196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:27.721106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.493676+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:34:13.493676+0000","last_peered":"2024-04-26T10:34:13.493676+0000","last_clean":"2024-04-26T10:34:13.493676+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:34:13.493676+0000","last_undegraded":"2024-04-26T10:34:13.493676+0000","last_fullsized":"2024-04-26T10:34:13.493676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.502929+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:34:13.502929+0000","last_peered":"2024-04-26T10:34:13.502929+0000","last_clean":"2024-04-26T10:34:13.502929+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:34:13.502929+0000","last_undegraded":"2024-04-26T10:34:13.502929+0000","last_fullsized":"2024-04-26T10:34:13.502929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.493758+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:34:13.493758+0000","last_peered":"2024-04-26T10:34:13.493758+0000","last_clean":"2024-04-26T10:34:13.493758+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:34:13.493758+0000","last_undegraded":"2024-04-26T10:34:13.493758+0000","last_fullsized":"2024-04-26T10:34:13.493758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497249+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:34:13.497249+0000","last_peered":"2024-04-26T10:34:13.497249+0000","last_clean":"2024-04-26T10:34:13.497249+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:34:13.497249+0000","last_undegraded":"2024-04-26T10:34:13.497249+0000","last_fullsized":"2024-04-26T10:34:13.497249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510494+0000","last_change":"2024-04-26T10:34:14.507265+0000","last_active":"2024-04-26T10:34:14.510494+0000","last_peered":"2024-04-26T10:34:14.510494+0000","last_clean":"2024-04-26T10:34:14.510494+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:34:14.510494+0000","last_undegraded":"2024-04-26T10:34:14.510494+0000","last_fullsized":"2024-04-26T10:34:14.510494+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:07.268421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498960+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:34:13.498960+0000","last_peered":"2024-04-26T10:34:13.498960+0000","last_clean":"2024-04-26T10:34:13.498960+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:34:13.498960+0000","last_undegraded":"2024-04-26T10:34:13.498960+0000","last_fullsized":"2024-04-26T10:34:13.498960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.489387+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:34:13.489387+0000","last_peered":"2024-04-26T10:34:13.489387+0000","last_clean":"2024-04-26T10:34:13.489387+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:34:13.489387+0000","last_undegraded":"2024-04-26T10:34:13.489387+0000","last_fullsized":"2024-04-26T10:34:13.489387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513255+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:34:14.513255+0000","last_peered":"2024-04-26T10:34:14.513255+0000","last_clean":"2024-04-26T10:34:14.513255+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:34:14.513255+0000","last_undegraded":"2024-04-26T10:34:14.513255+0000","last_fullsized":"2024-04-26T10:34:14.513255+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:03.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509249+0000","last_change":"2024-04-26T10:34:14.509249+0000","last_active":"2024-04-26T10:34:14.509249+0000","last_peered":"2024-04-26T10:34:14.509249+0000","last_clean":"2024-04-26T10:34:14.509249+0000","last_became_active":"2024-04-26T10:34:14.508371+0000","last_became_peered":"2024-04-26T10:34:14.508371+0000","last_unstale":"2024-04-26T10:34:14.509249+0000","last_undegraded":"2024-04-26T10:34:14.509249+0000","last_fullsized":"2024-04-26T10:34:14.509249+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:35.257141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.501880+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:34:13.501880+0000","last_peered":"2024-04-26T10:34:13.501880+0000","last_clean":"2024-04-26T10:34:13.501880+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:34:13.501880+0000","last_undegraded":"2024-04-26T10:34:13.501880+0000","last_fullsized":"2024-04-26T10:34:13.501880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494370+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:34:13.494370+0000","last_peered":"2024-04-26T10:34:13.494370+0000","last_clean":"2024-04-26T10:34:13.494370+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:34:13.494370+0000","last_undegraded":"2024-04-26T10:34:13.494370+0000","last_fullsized":"2024-04-26T10:34:13.494370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497329+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:34:13.497329+0000","last_peered":"2024-04-26T10:34:13.497329+0000","last_clean":"2024-04-26T10:34:13.497329+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:34:13.497329+0000","last_undegraded":"2024-04-26T10:34:13.497329+0000","last_fullsized":"2024-04-26T10:34:13.497329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510432+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:34:14.510432+0000","last_peered":"2024-04-26T10:34:14.510432+0000","last_clean":"2024-04-26T10:34:14.510432+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:34:14.510432+0000","last_undegraded":"2024-04-26T10:34:14.510432+0000","last_fullsized":"2024-04-26T10:34:14.510432+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.343269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494669+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:34:13.494669+0000","last_peered":"2024-04-26T10:34:13.494669+0000","last_clean":"2024-04-26T10:34:13.494669+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:34:13.494669+0000","last_undegraded":"2024-04-26T10:34:13.494669+0000","last_fullsized":"2024-04-26T10:34:13.494669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498977+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:34:13.498977+0000","last_peered":"2024-04-26T10:34:13.498977+0000","last_clean":"2024-04-26T10:34:13.498977+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:34:13.498977+0000","last_undegraded":"2024-04-26T10:34:13.498977+0000","last_fullsized":"2024-04-26T10:34:13.498977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498830+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:34:13.498830+0000","last_peered":"2024-04-26T10:34:13.498830+0000","last_clean":"2024-04-26T10:34:13.498830+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:34:13.498830+0000","last_undegraded":"2024-04-26T10:34:13.498830+0000","last_fullsized":"2024-04-26T10:34:13.498830+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488236+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:34:13.488236+0000","last_peered":"2024-04-26T10:34:13.488236+0000","last_clean":"2024-04-26T10:34:13.488236+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:34:13.488236+0000","last_undegraded":"2024-04-26T10:34:13.488236+0000","last_fullsized":"2024-04-26T10:34:13.488236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500095+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:34:13.500095+0000","last_peered":"2024-04-26T10:34:13.500095+0000","last_clean":"2024-04-26T10:34:13.500095+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:34:13.500095+0000","last_undegraded":"2024-04-26T10:34:13.500095+0000","last_fullsized":"2024-04-26T10:34:13.500095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.492271+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:34:13.492271+0000","last_peered":"2024-04-26T10:34:13.492271+0000","last_clean":"2024-04-26T10:34:13.492271+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:34:13.492271+0000","last_undegraded":"2024-04-26T10:34:13.492271+0000","last_fullsized":"2024-04-26T10:34:13.492271+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.516602+0000","last_change":"2024-04-26T10:34:14.511829+0000","last_active":"2024-04-26T10:34:14.516602+0000","last_peered":"2024-04-26T10:34:14.516602+0000","last_clean":"2024-04-26T10:34:14.516602+0000","last_became_active":"2024-04-26T10:34:14.511584+0000","last_became_peered":"2024-04-26T10:34:14.511584+0000","last_unstale":"2024-04-26T10:34:14.516602+0000","last_undegraded":"2024-04-26T10:34:14.516602+0000","last_fullsized":"2024-04-26T10:34:14.516602+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:30.166797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497341+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:34:13.497341+0000","last_peered":"2024-04-26T10:34:13.497341+0000","last_clean":"2024-04-26T10:34:13.497341+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:34:13.497341+0000","last_undegraded":"2024-04-26T10:34:13.497341+0000","last_fullsized":"2024-04-26T10:34:13.497341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499319+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:34:13.499319+0000","last_peered":"2024-04-26T10:34:13.499319+0000","last_clean":"2024-04-26T10:34:13.499319+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:34:13.499319+0000","last_undegraded":"2024-04-26T10:34:13.499319+0000","last_fullsized":"2024-04-26T10:34:13.499319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488262+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:34:13.488262+0000","last_peered":"2024-04-26T10:34:13.488262+0000","last_clean":"2024-04-26T10:34:13.488262+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:34:13.488262+0000","last_undegraded":"2024-04-26T10:34:13.488262+0000","last_fullsized":"2024-04-26T10:34:13.488262+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.489169+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:34:13.489169+0000","last_peered":"2024-04-26T10:34:13.489169+0000","last_clean":"2024-04-26T10:34:13.489169+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:34:13.489169+0000","last_undegraded":"2024-04-26T10:34:13.489169+0000","last_fullsized":"2024-04-26T10:34:13.489169+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500180+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:34:13.500180+0000","last_peered":"2024-04-26T10:34:13.500180+0000","last_clean":"2024-04-26T10:34:13.500180+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:34:13.500180+0000","last_undegraded":"2024-04-26T10:34:13.500180+0000","last_fullsized":"2024-04-26T10:34:13.500180+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497506+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:34:13.497506+0000","last_peered":"2024-04-26T10:34:13.497506+0000","last_clean":"2024-04-26T10:34:13.497506+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:34:13.497506+0000","last_undegraded":"2024-04-26T10:34:13.497506+0000","last_fullsized":"2024-04-26T10:34:13.497506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":54,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511168+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:34:14.511168+0000","last_peered":"2024-04-26T10:34:14.511168+0000","last_clean":"2024-04-26T10:34:14.511168+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:34:14.511168+0000","last_undegraded":"2024-04-26T10:34:14.511168+0000","last_fullsized":"2024-04-26T10:34:14.511168+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:19.856062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488984+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:34:13.488984+0000","last_peered":"2024-04-26T10:34:13.488984+0000","last_clean":"2024-04-26T10:34:13.488984+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:34:13.488984+0000","last_undegraded":"2024-04-26T10:34:13.488984+0000","last_fullsized":"2024-04-26T10:34:13.488984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498920+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:34:13.498920+0000","last_peered":"2024-04-26T10:34:13.498920+0000","last_clean":"2024-04-26T10:34:13.498920+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:34:13.498920+0000","last_undegraded":"2024-04-26T10:34:13.498920+0000","last_fullsized":"2024-04-26T10:34:13.498920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511362+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:34:14.511362+0000","last_peered":"2024-04-26T10:34:14.511362+0000","last_clean":"2024-04-26T10:34:14.511362+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:34:14.511362+0000","last_undegraded":"2024-04-26T10:34:14.511362+0000","last_fullsized":"2024-04-26T10:34:14.511362+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:04.852453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494871+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:34:13.494871+0000","last_peered":"2024-04-26T10:34:13.494871+0000","last_clean":"2024-04-26T10:34:13.494871+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:34:13.494871+0000","last_undegraded":"2024-04-26T10:34:13.494871+0000","last_fullsized":"2024-04-26T10:34:13.494871+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500325+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:34:13.500325+0000","last_peered":"2024-04-26T10:34:13.500325+0000","last_clean":"2024-04-26T10:34:13.500325+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:34:13.500325+0000","last_undegraded":"2024-04-26T10:34:13.500325+0000","last_fullsized":"2024-04-26T10:34:13.500325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.523338+0000","last_change":"2024-04-26T10:34:14.518131+0000","last_active":"2024-04-26T10:34:14.523338+0000","last_peered":"2024-04-26T10:34:14.523338+0000","last_clean":"2024-04-26T10:34:14.523338+0000","last_became_active":"2024-04-26T10:34:14.506010+0000","last_became_peered":"2024-04-26T10:34:14.506010+0000","last_unstale":"2024-04-26T10:34:14.523338+0000","last_undegraded":"2024-04-26T10:34:14.523338+0000","last_fullsized":"2024-04-26T10:34:14.523338+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:51.842115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509381+0000","last_change":"2024-04-26T10:34:14.509381+0000","last_active":"2024-04-26T10:34:14.509381+0000","last_peered":"2024-04-26T10:34:14.509381+0000","last_clean":"2024-04-26T10:34:14.509381+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:34:14.509381+0000","last_undegraded":"2024-04-26T10:34:14.509381+0000","last_fullsized":"2024-04-26T10:34:14.509381+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:05.841519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":80,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.548596+0000","last_change":"2024-04-26T10:34:14.548596+0000","last_active":"2024-04-26T10:34:14.548596+0000","last_peered":"2024-04-26T10:34:14.548596+0000","last_clean":"2024-04-26T10:34:14.548596+0000","last_became_active":"2024-04-26T10:34:14.512027+0000","last_became_peered":"2024-04-26T10:34:14.512027+0000","last_unstale":"2024-04-26T10:34:14.548596+0000","last_undegraded":"2024-04-26T10:34:14.548596+0000","last_fullsized":"2024-04-26T10:34:14.548596+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:39.957573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513656+0000","last_change":"2024-04-26T10:34:14.513656+0000","last_active":"2024-04-26T10:34:14.513656+0000","last_peered":"2024-04-26T10:34:14.513656+0000","last_clean":"2024-04-26T10:34:14.513656+0000","last_became_active":"2024-04-26T10:34:14.513402+0000","last_became_peered":"2024-04-26T10:34:14.513402+0000","last_unstale":"2024-04-26T10:34:14.513656+0000","last_undegraded":"2024-04-26T10:34:14.513656+0000","last_fullsized":"2024-04-26T10:34:14.513656+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:22.053611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500059+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:34:13.500059+0000","last_peered":"2024-04-26T10:34:13.500059+0000","last_clean":"2024-04-26T10:34:13.500059+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:34:13.500059+0000","last_undegraded":"2024-04-26T10:34:13.500059+0000","last_fullsized":"2024-04-26T10:34:13.500059+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510736+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:34:14.510736+0000","last_peered":"2024-04-26T10:34:14.510736+0000","last_clean":"2024-04-26T10:34:14.510736+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:34:14.510736+0000","last_undegraded":"2024-04-26T10:34:14.510736+0000","last_fullsized":"2024-04-26T10:34:14.510736+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:02.872251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.496178+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:34:13.496178+0000","last_peered":"2024-04-26T10:34:13.496178+0000","last_clean":"2024-04-26T10:34:13.496178+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:34:13.496178+0000","last_undegraded":"2024-04-26T10:34:13.496178+0000","last_fullsized":"2024-04-26T10:34:13.496178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511581+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:34:14.511581+0000","last_peered":"2024-04-26T10:34:14.511581+0000","last_clean":"2024-04-26T10:34:14.511581+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:34:14.511581+0000","last_undegraded":"2024-04-26T10:34:14.511581+0000","last_fullsized":"2024-04-26T10:34:14.511581+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:43.500342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510605+0000","last_change":"2024-04-26T10:34:14.509818+0000","last_active":"2024-04-26T10:34:14.510605+0000","last_peered":"2024-04-26T10:34:14.510605+0000","last_clean":"2024-04-26T10:34:14.510605+0000","last_became_active":"2024-04-26T10:34:14.509270+0000","last_became_peered":"2024-04-26T10:34:14.509270+0000","last_unstale":"2024-04-26T10:34:14.510605+0000","last_undegraded":"2024-04-26T10:34:14.510605+0000","last_fullsized":"2024-04-26T10:34:14.510605+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:45.412620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498283+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:34:13.498283+0000","last_peered":"2024-04-26T10:34:13.498283+0000","last_clean":"2024-04-26T10:34:13.498283+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:34:13.498283+0000","last_undegraded":"2024-04-26T10:34:13.498283+0000","last_fullsized":"2024-04-26T10:34:13.498283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":82,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.531646+0000","last_change":"2024-04-26T10:34:14.531646+0000","last_active":"2024-04-26T10:34:14.531646+0000","last_peered":"2024-04-26T10:34:14.531646+0000","last_clean":"2024-04-26T10:34:14.531646+0000","last_became_active":"2024-04-26T10:34:14.511911+0000","last_became_peered":"2024-04-26T10:34:14.511911+0000","last_unstale":"2024-04-26T10:34:14.531646+0000","last_undegraded":"2024-04-26T10:34:14.531646+0000","last_fullsized":"2024-04-26T10:34:14.531646+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:39.588939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499927+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:34:13.499927+0000","last_peered":"2024-04-26T10:34:13.499927+0000","last_clean":"2024-04-26T10:34:13.499927+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:34:13.499927+0000","last_undegraded":"2024-04-26T10:34:13.499927+0000","last_fullsized":"2024-04-26T10:34:13.499927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"42'8158","reported_seq":11257,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.549415+0000","last_change":"2024-04-26T10:34:14.549017+0000","last_active":"2024-04-26T10:34:14.549415+0000","last_peered":"2024-04-26T10:34:14.549415+0000","last_clean":"2024-04-26T10:34:14.549415+0000","last_became_active":"2024-04-26T10:34:14.518037+0000","last_became_peered":"2024-04-26T10:34:14.518037+0000","last_unstale":"2024-04-26T10:34:14.549415+0000","last_undegraded":"2024-04-26T10:34:14.549415+0000","last_fullsized":"2024-04-26T10:34:14.549415+0000","mapping_epoch":41,"log_start":"29'5291","ondisk_log_start":"29'5291","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2867,"log_dups_size":1542,"ondisk_log_size":2867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:21.571693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":534642688,"num_objects":8158,"num_object_clones":0,"num_object_copies":16316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8158,"num_write_kb":522112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1524,"num_bytes_recovered":99876864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":63,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.536943+0000","last_change":"2024-04-26T10:34:14.536943+0000","last_active":"2024-04-26T10:34:14.536943+0000","last_peered":"2024-04-26T10:34:14.536943+0000","last_clean":"2024-04-26T10:34:14.536943+0000","last_became_active":"2024-04-26T10:34:14.511960+0000","last_became_peered":"2024-04-26T10:34:14.511960+0000","last_unstale":"2024-04-26T10:34:14.536943+0000","last_undegraded":"2024-04-26T10:34:14.536943+0000","last_fullsized":"2024-04-26T10:34:14.536943+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.329973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.492102+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:34:13.492102+0000","last_peered":"2024-04-26T10:34:13.492102+0000","last_clean":"2024-04-26T10:34:13.492102+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:34:13.492102+0000","last_undegraded":"2024-04-26T10:34:13.492102+0000","last_fullsized":"2024-04-26T10:34:13.492102+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"42'8366","reported_seq":8400,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.563489+0000","last_change":"2024-04-26T10:33:16.346351+0000","last_active":"2024-04-26T10:34:14.563489+0000","last_peered":"2024-04-26T10:34:14.563489+0000","last_clean":"2024-04-26T10:34:14.563489+0000","last_became_active":"2024-04-26T10:33:16.346122+0000","last_became_peered":"2024-04-26T10:33:16.346122+0000","last_unstale":"2024-04-26T10:34:14.563489+0000","last_undegraded":"2024-04-26T10:34:14.563489+0000","last_fullsized":"2024-04-26T10:34:14.563489+0000","mapping_epoch":16,"log_start":"26'4364","ondisk_log_start":"26'4364","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":4002,"log_dups_size":0,"ondisk_log_size":4002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:13.714464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":548274176,"num_objects":8366,"num_object_clones":0,"num_object_copies":16732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8366,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":535424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488538+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:34:13.488538+0000","last_peered":"2024-04-26T10:34:13.488538+0000","last_clean":"2024-04-26T10:34:13.488538+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:34:13.488538+0000","last_undegraded":"2024-04-26T10:34:13.488538+0000","last_fullsized":"2024-04-26T10:34:13.488538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510461+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:34:14.510461+0000","last_peered":"2024-04-26T10:34:14.510461+0000","last_clean":"2024-04-26T10:34:14.510461+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:34:14.510461+0000","last_undegraded":"2024-04-26T10:34:14.510461+0000","last_fullsized":"2024-04-26T10:34:14.510461+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:12.954308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"40'8199","reported_seq":11536,"reported_epoch":40,"state":"peering","last_fresh":"2024-04-26T10:34:13.471961+0000","last_change":"2024-04-26T10:34:14.500388+0000","last_active":"2024-04-26T10:34:14.500388+0000","last_peered":"2024-04-26T10:34:13.471961+0000","last_clean":"2024-04-26T10:34:00.443121+0000","last_became_active":"2024-04-26T10:34:02.510251+0000","last_became_peered":"2024-04-26T10:34:02.510251+0000","last_unstale":"2024-04-26T10:34:13.471961+0000","last_undegraded":"2024-04-26T10:34:13.471961+0000","last_fullsized":"2024-04-26T10:34:13.471961+0000","mapping_epoch":42,"log_start":"29'5264","ondisk_log_start":"29'5264","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2935,"log_dups_size":1442,"ondisk_log_size":2935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:40.416790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537329664,"num_objects":8199,"num_object_clones":0,"num_object_copies":16398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8199,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":524736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1649,"num_bytes_recovered":108068864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500554+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:34:13.500554+0000","last_peered":"2024-04-26T10:34:13.500554+0000","last_clean":"2024-04-26T10:34:13.500554+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:34:13.500554+0000","last_undegraded":"2024-04-26T10:34:13.500554+0000","last_fullsized":"2024-04-26T10:34:13.500554+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.495036+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:34:13.495036+0000","last_peered":"2024-04-26T10:34:13.495036+0000","last_clean":"2024-04-26T10:34:13.495036+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:34:13.495036+0000","last_undegraded":"2024-04-26T10:34:13.495036+0000","last_fullsized":"2024-04-26T10:34:13.495036+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"42'8232","reported_seq":8266,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.539351+0000","last_change":"2024-04-26T10:33:16.346212+0000","last_active":"2024-04-26T10:34:14.539351+0000","last_peered":"2024-04-26T10:34:14.539351+0000","last_clean":"2024-04-26T10:34:14.539351+0000","last_became_active":"2024-04-26T10:33:16.346004+0000","last_became_peered":"2024-04-26T10:33:16.346004+0000","last_unstale":"2024-04-26T10:34:14.539351+0000","last_undegraded":"2024-04-26T10:34:14.539351+0000","last_fullsized":"2024-04-26T10:34:14.539351+0000","mapping_epoch":16,"log_start":"29'5354","ondisk_log_start":"29'5354","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2878,"log_dups_size":1542,"ondisk_log_size":2878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:27.495754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539492352,"num_objects":8232,"num_object_clones":0,"num_object_copies":16464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8232,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8232,"num_write_kb":526848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.495715+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:34:13.495715+0000","last_peered":"2024-04-26T10:34:13.495715+0000","last_clean":"2024-04-26T10:34:13.495715+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:34:13.495715+0000","last_undegraded":"2024-04-26T10:34:13.495715+0000","last_fullsized":"2024-04-26T10:34:13.495715+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500549+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:34:13.500549+0000","last_peered":"2024-04-26T10:34:13.500549+0000","last_clean":"2024-04-26T10:34:13.500549+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:34:13.500549+0000","last_undegraded":"2024-04-26T10:34:13.500549+0000","last_fullsized":"2024-04-26T10:34:13.500549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"40'8104","reported_seq":8142,"reported_epoch":40,"state":"peering","last_fresh":"2024-04-26T10:34:13.471569+0000","last_change":"2024-04-26T10:34:14.501539+0000","last_active":"2024-04-26T10:34:14.501539+0000","last_peered":"2024-04-26T10:34:13.471569+0000","last_clean":"2024-04-26T10:34:00.445985+0000","last_became_active":"2024-04-26T10:34:02.502550+0000","last_became_peered":"2024-04-26T10:34:02.502550+0000","last_unstale":"2024-04-26T10:34:13.471569+0000","last_undegraded":"2024-04-26T10:34:13.471569+0000","last_fullsized":"2024-04-26T10:34:13.471569+0000","mapping_epoch":42,"log_start":"29'5172","ondisk_log_start":"29'5172","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2932,"log_dups_size":1442,"ondisk_log_size":2932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:03.212384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531103744,"num_objects":8104,"num_object_clones":0,"num_object_copies":16208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8104,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8104,"num_write_kb":518656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500740+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:34:13.500740+0000","last_peered":"2024-04-26T10:34:13.500740+0000","last_clean":"2024-04-26T10:34:13.500740+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:34:13.500740+0000","last_undegraded":"2024-04-26T10:34:13.500740+0000","last_fullsized":"2024-04-26T10:34:13.500740+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.495797+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:34:13.495797+0000","last_peered":"2024-04-26T10:34:13.495797+0000","last_clean":"2024-04-26T10:34:13.495797+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:34:13.495797+0000","last_undegraded":"2024-04-26T10:34:13.495797+0000","last_fullsized":"2024-04-26T10:34:13.495797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"42'8121","reported_seq":8155,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.539261+0000","last_change":"2024-04-26T10:33:16.349242+0000","last_active":"2024-04-26T10:34:14.539261+0000","last_peered":"2024-04-26T10:34:14.539261+0000","last_clean":"2024-04-26T10:34:14.539261+0000","last_became_active":"2024-04-26T10:33:16.349063+0000","last_became_peered":"2024-04-26T10:33:16.349063+0000","last_unstale":"2024-04-26T10:34:14.539261+0000","last_undegraded":"2024-04-26T10:34:14.539261+0000","last_fullsized":"2024-04-26T10:34:14.539261+0000","mapping_epoch":16,"log_start":"28'5162","ondisk_log_start":"28'5162","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2959,"log_dups_size":1442,"ondisk_log_size":2959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:09.297624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532217856,"num_objects":8121,"num_object_clones":0,"num_object_copies":16242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8121,"num_write_kb":519744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.493724+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:34:13.493724+0000","last_peered":"2024-04-26T10:34:13.493724+0000","last_clean":"2024-04-26T10:34:13.493724+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:34:13.493724+0000","last_undegraded":"2024-04-26T10:34:13.493724+0000","last_fullsized":"2024-04-26T10:34:13.493724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500444+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:34:13.500444+0000","last_peered":"2024-04-26T10:34:13.500444+0000","last_clean":"2024-04-26T10:34:13.500444+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:34:13.500444+0000","last_undegraded":"2024-04-26T10:34:13.500444+0000","last_fullsized":"2024-04-26T10:34:13.500444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"42'7888","reported_seq":7940,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.549556+0000","last_change":"2024-04-26T10:34:14.549556+0000","last_active":"2024-04-26T10:34:14.549556+0000","last_peered":"2024-04-26T10:34:14.549556+0000","last_clean":"2024-04-26T10:34:14.549556+0000","last_became_active":"2024-04-26T10:34:14.520855+0000","last_became_peered":"2024-04-26T10:34:14.520855+0000","last_unstale":"2024-04-26T10:34:14.549556+0000","last_undegraded":"2024-04-26T10:34:14.549556+0000","last_fullsized":"2024-04-26T10:34:14.549556+0000","mapping_epoch":41,"log_start":"28'5005","ondisk_log_start":"28'5005","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2883,"log_dups_size":1442,"ondisk_log_size":2883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:48.789996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516947968,"num_objects":7888,"num_object_clones":0,"num_object_copies":15776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7888,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7888,"num_write_kb":504832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488180+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:34:13.488180+0000","last_peered":"2024-04-26T10:34:13.488180+0000","last_clean":"2024-04-26T10:34:13.488180+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:34:13.488180+0000","last_undegraded":"2024-04-26T10:34:13.488180+0000","last_fullsized":"2024-04-26T10:34:13.488180+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509460+0000","last_change":"2024-04-26T10:34:14.509460+0000","last_active":"2024-04-26T10:34:14.509460+0000","last_peered":"2024-04-26T10:34:14.509460+0000","last_clean":"2024-04-26T10:34:14.509460+0000","last_became_active":"2024-04-26T10:34:14.509213+0000","last_became_peered":"2024-04-26T10:34:14.509213+0000","last_unstale":"2024-04-26T10:34:14.509460+0000","last_undegraded":"2024-04-26T10:34:14.509460+0000","last_fullsized":"2024-04-26T10:34:14.509460+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:15.816526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"42'8055","reported_seq":8089,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.498076+0000","last_change":"2024-04-26T10:33:16.344866+0000","last_active":"2024-04-26T10:34:14.498076+0000","last_peered":"2024-04-26T10:34:14.498076+0000","last_clean":"2024-04-26T10:34:14.498076+0000","last_became_active":"2024-04-26T10:33:16.344614+0000","last_became_peered":"2024-04-26T10:33:16.344614+0000","last_unstale":"2024-04-26T10:34:14.498076+0000","last_undegraded":"2024-04-26T10:34:14.498076+0000","last_fullsized":"2024-04-26T10:34:14.498076+0000","mapping_epoch":16,"log_start":"26'4054","ondisk_log_start":"26'4054","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":4001,"log_dups_size":0,"ondisk_log_size":4001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":527892480,"num_objects":8055,"num_object_clones":0,"num_object_copies":16110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8055,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8055,"num_write_kb":515520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510428+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:34:14.510428+0000","last_peered":"2024-04-26T10:34:14.510428+0000","last_clean":"2024-04-26T10:34:14.510428+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:34:14.510428+0000","last_undegraded":"2024-04-26T10:34:14.510428+0000","last_fullsized":"2024-04-26T10:34:14.510428+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:35.111495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498309+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:34:13.498309+0000","last_peered":"2024-04-26T10:34:13.498309+0000","last_clean":"2024-04-26T10:34:13.498309+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:34:13.498309+0000","last_undegraded":"2024-04-26T10:34:13.498309+0000","last_fullsized":"2024-04-26T10:34:13.498309+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"42'8049","reported_seq":8083,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.542200+0000","last_change":"2024-04-26T10:33:16.349280+0000","last_active":"2024-04-26T10:34:14.542200+0000","last_peered":"2024-04-26T10:34:14.542200+0000","last_clean":"2024-04-26T10:34:14.542200+0000","last_became_active":"2024-04-26T10:33:16.349010+0000","last_became_peered":"2024-04-26T10:33:16.349010+0000","last_unstale":"2024-04-26T10:34:14.542200+0000","last_undegraded":"2024-04-26T10:34:14.542200+0000","last_fullsized":"2024-04-26T10:34:14.542200+0000","mapping_epoch":16,"log_start":"28'5171","ondisk_log_start":"28'5171","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2878,"log_dups_size":1442,"ondisk_log_size":2878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:08.933996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":527499264,"num_objects":8049,"num_object_clones":0,"num_object_copies":16098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8049,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8049,"num_write_kb":515136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511174+0000","last_change":"2024-04-26T10:34:14.511174+0000","last_active":"2024-04-26T10:34:14.511174+0000","last_peered":"2024-04-26T10:34:14.511174+0000","last_clean":"2024-04-26T10:34:14.511174+0000","last_became_active":"2024-04-26T10:34:14.510907+0000","last_became_peered":"2024-04-26T10:34:14.510907+0000","last_unstale":"2024-04-26T10:34:14.511174+0000","last_undegraded":"2024-04-26T10:34:14.511174+0000","last_fullsized":"2024-04-26T10:34:14.511174+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:34.574586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499450+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:34:13.499450+0000","last_peered":"2024-04-26T10:34:13.499450+0000","last_clean":"2024-04-26T10:34:13.499450+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:34:13.499450+0000","last_undegraded":"2024-04-26T10:34:13.499450+0000","last_fullsized":"2024-04-26T10:34:13.499450+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510449+0000","last_change":"2024-04-26T10:34:14.506552+0000","last_active":"2024-04-26T10:34:14.510449+0000","last_peered":"2024-04-26T10:34:14.510449+0000","last_clean":"2024-04-26T10:34:14.510449+0000","last_became_active":"2024-04-26T10:34:14.506008+0000","last_became_peered":"2024-04-26T10:34:14.506008+0000","last_unstale":"2024-04-26T10:34:14.510449+0000","last_undegraded":"2024-04-26T10:34:14.510449+0000","last_fullsized":"2024-04-26T10:34:14.510449+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.031036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"42'8063","reported_seq":8097,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.503467+0000","last_change":"2024-04-26T10:33:16.349302+0000","last_active":"2024-04-26T10:34:14.503467+0000","last_peered":"2024-04-26T10:34:14.503467+0000","last_clean":"2024-04-26T10:34:14.503467+0000","last_became_active":"2024-04-26T10:33:16.348992+0000","last_became_peered":"2024-04-26T10:33:16.348992+0000","last_unstale":"2024-04-26T10:34:14.503467+0000","last_undegraded":"2024-04-26T10:34:14.503467+0000","last_fullsized":"2024-04-26T10:34:14.503467+0000","mapping_epoch":16,"log_start":"29'5157","ondisk_log_start":"29'5157","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2906,"log_dups_size":1442,"ondisk_log_size":2906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:15.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528416768,"num_objects":8063,"num_object_clones":0,"num_object_copies":16126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8063,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8063,"num_write_kb":516032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494391+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:34:13.494391+0000","last_peered":"2024-04-26T10:34:13.494391+0000","last_clean":"2024-04-26T10:34:13.494391+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:34:13.494391+0000","last_undegraded":"2024-04-26T10:34:13.494391+0000","last_fullsized":"2024-04-26T10:34:13.494391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499966+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:34:13.499966+0000","last_peered":"2024-04-26T10:34:13.499966+0000","last_clean":"2024-04-26T10:34:13.499966+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:34:13.499966+0000","last_undegraded":"2024-04-26T10:34:13.499966+0000","last_fullsized":"2024-04-26T10:34:13.499966+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513348+0000","last_change":"2024-04-26T10:34:14.513348+0000","last_active":"2024-04-26T10:34:14.513348+0000","last_peered":"2024-04-26T10:34:14.513348+0000","last_clean":"2024-04-26T10:34:14.513348+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:34:14.513348+0000","last_undegraded":"2024-04-26T10:34:14.513348+0000","last_fullsized":"2024-04-26T10:34:14.513348+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:21.161769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"41'8130","reported_seq":8164,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.516120+0000","last_change":"2024-04-26T10:33:16.349181+0000","last_active":"2024-04-26T10:34:13.516120+0000","last_peered":"2024-04-26T10:34:13.516120+0000","last_clean":"2024-04-26T10:34:13.516120+0000","last_became_active":"2024-04-26T10:33:16.348981+0000","last_became_peered":"2024-04-26T10:33:16.348981+0000","last_unstale":"2024-04-26T10:34:13.516120+0000","last_undegraded":"2024-04-26T10:34:13.516120+0000","last_fullsized":"2024-04-26T10:34:13.516120+0000","mapping_epoch":16,"log_start":"29'5184","ondisk_log_start":"29'5184","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2946,"log_dups_size":1442,"ondisk_log_size":2946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532807680,"num_objects":8130,"num_object_clones":0,"num_object_copies":16260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8130,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8130,"num_write_kb":520320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500009+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:34:13.500009+0000","last_peered":"2024-04-26T10:34:13.500009+0000","last_clean":"2024-04-26T10:34:13.500009+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:34:13.500009+0000","last_undegraded":"2024-04-26T10:34:13.500009+0000","last_fullsized":"2024-04-26T10:34:13.500009+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.492182+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:34:13.492182+0000","last_peered":"2024-04-26T10:34:13.492182+0000","last_clean":"2024-04-26T10:34:13.492182+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:34:13.492182+0000","last_undegraded":"2024-04-26T10:34:13.492182+0000","last_fullsized":"2024-04-26T10:34:13.492182+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511363+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:34:14.511363+0000","last_peered":"2024-04-26T10:34:14.511363+0000","last_clean":"2024-04-26T10:34:14.511363+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:34:14.511363+0000","last_undegraded":"2024-04-26T10:34:14.511363+0000","last_fullsized":"2024-04-26T10:34:14.511363+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:57.803542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"40'8122","reported_seq":8160,"reported_epoch":40,"state":"peering","last_fresh":"2024-04-26T10:34:13.469763+0000","last_change":"2024-04-26T10:34:14.500169+0000","last_active":"2024-04-26T10:34:14.500169+0000","last_peered":"2024-04-26T10:34:13.469763+0000","last_clean":"2024-04-26T10:34:00.447964+0000","last_became_active":"2024-04-26T10:34:02.523429+0000","last_became_peered":"2024-04-26T10:34:02.523429+0000","last_unstale":"2024-04-26T10:34:13.469763+0000","last_undegraded":"2024-04-26T10:34:13.469763+0000","last_fullsized":"2024-04-26T10:34:13.469763+0000","mapping_epoch":42,"log_start":"29'5257","ondisk_log_start":"29'5257","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2865,"log_dups_size":1542,"ondisk_log_size":2865,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:19:23.452922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532283392,"num_objects":8122,"num_object_clones":0,"num_object_copies":16244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8122,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8122,"num_write_kb":519808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499450+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:34:13.499450+0000","last_peered":"2024-04-26T10:34:13.499450+0000","last_clean":"2024-04-26T10:34:13.499450+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:34:13.499450+0000","last_undegraded":"2024-04-26T10:34:13.499450+0000","last_fullsized":"2024-04-26T10:34:13.499450+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":260,"reported_epoch":42,"state":"remapped+peering","last_fresh":"2024-04-26T10:34:14.499234+0000","last_change":"2024-04-26T10:34:14.500746+0000","last_active":"2024-04-26T10:34:13.494830+0000","last_peered":"2024-04-26T10:34:12.484561+0000","last_clean":"2024-04-26T10:34:12.484561+0000","last_became_active":"2024-04-26T10:34:04.467654+0000","last_became_peered":"2024-04-26T10:34:04.467654+0000","last_unstale":"2024-04-26T10:34:14.499234+0000","last_undegraded":"2024-04-26T10:34:14.499234+0000","last_fullsized":"2024-04-26T10:34:14.499234+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:19.317224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.496016+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:34:13.496016+0000","last_peered":"2024-04-26T10:34:13.496016+0000","last_clean":"2024-04-26T10:34:13.496016+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:34:13.496016+0000","last_undegraded":"2024-04-26T10:34:13.496016+0000","last_fullsized":"2024-04-26T10:34:13.496016+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509642+0000","last_change":"2024-04-26T10:34:14.509642+0000","last_active":"2024-04-26T10:34:14.509642+0000","last_peered":"2024-04-26T10:34:14.509642+0000","last_clean":"2024-04-26T10:34:14.509642+0000","last_became_active":"2024-04-26T10:34:14.509329+0000","last_became_peered":"2024-04-26T10:34:14.509329+0000","last_unstale":"2024-04-26T10:34:14.509642+0000","last_undegraded":"2024-04-26T10:34:14.509642+0000","last_fullsized":"2024-04-26T10:34:14.509642+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:20.861292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"42'8068","reported_seq":8102,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.542842+0000","last_change":"2024-04-26T10:33:16.344693+0000","last_active":"2024-04-26T10:34:14.542842+0000","last_peered":"2024-04-26T10:34:14.542842+0000","last_clean":"2024-04-26T10:34:14.542842+0000","last_became_active":"2024-04-26T10:33:16.344478+0000","last_became_peered":"2024-04-26T10:33:16.344478+0000","last_unstale":"2024-04-26T10:34:14.542842+0000","last_undegraded":"2024-04-26T10:34:14.542842+0000","last_fullsized":"2024-04-26T10:34:14.542842+0000","mapping_epoch":16,"log_start":"29'5133","ondisk_log_start":"29'5133","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2935,"log_dups_size":1442,"ondisk_log_size":2935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:24.298876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528744448,"num_objects":8068,"num_object_clones":0,"num_object_copies":16136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8068,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8068,"num_write_kb":516352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509367+0000","last_change":"2024-04-26T10:34:14.509367+0000","last_active":"2024-04-26T10:34:14.509367+0000","last_peered":"2024-04-26T10:34:14.509367+0000","last_clean":"2024-04-26T10:34:14.509367+0000","last_became_active":"2024-04-26T10:34:14.508465+0000","last_became_peered":"2024-04-26T10:34:14.508465+0000","last_unstale":"2024-04-26T10:34:14.509367+0000","last_undegraded":"2024-04-26T10:34:14.509367+0000","last_fullsized":"2024-04-26T10:34:14.509367+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:31.790156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499920+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:34:13.499920+0000","last_peered":"2024-04-26T10:34:13.499920+0000","last_clean":"2024-04-26T10:34:13.499920+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:34:13.499920+0000","last_undegraded":"2024-04-26T10:34:13.499920+0000","last_fullsized":"2024-04-26T10:34:13.499920+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488609+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:34:13.488609+0000","last_peered":"2024-04-26T10:34:13.488609+0000","last_clean":"2024-04-26T10:34:13.488609+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:34:13.488609+0000","last_undegraded":"2024-04-26T10:34:13.488609+0000","last_fullsized":"2024-04-26T10:34:13.488609+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"42'8200","reported_seq":8234,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.538890+0000","last_change":"2024-04-26T10:33:16.344694+0000","last_active":"2024-04-26T10:34:14.538890+0000","last_peered":"2024-04-26T10:34:14.538890+0000","last_clean":"2024-04-26T10:34:14.538890+0000","last_became_active":"2024-04-26T10:33:16.344461+0000","last_became_peered":"2024-04-26T10:33:16.344461+0000","last_unstale":"2024-04-26T10:34:14.538890+0000","last_undegraded":"2024-04-26T10:34:14.538890+0000","last_fullsized":"2024-04-26T10:34:14.538890+0000","mapping_epoch":16,"log_start":"29'5284","ondisk_log_start":"29'5284","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2916,"log_dups_size":1442,"ondisk_log_size":2916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:29.374096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537395200,"num_objects":8200,"num_object_clones":0,"num_object_copies":16400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8200,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8200,"num_write_kb":524800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.511624+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:34:14.511624+0000","last_peered":"2024-04-26T10:34:14.511624+0000","last_clean":"2024-04-26T10:34:14.511624+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:34:14.511624+0000","last_undegraded":"2024-04-26T10:34:14.511624+0000","last_fullsized":"2024-04-26T10:34:14.511624+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":54,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509602+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:34:14.509602+0000","last_peered":"2024-04-26T10:34:14.509602+0000","last_clean":"2024-04-26T10:34:14.509602+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:34:14.509602+0000","last_undegraded":"2024-04-26T10:34:14.509602+0000","last_fullsized":"2024-04-26T10:34:14.509602+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:21.048381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488843+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:34:13.488843+0000","last_peered":"2024-04-26T10:34:13.488843+0000","last_clean":"2024-04-26T10:34:13.488843+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:34:13.488843+0000","last_undegraded":"2024-04-26T10:34:13.488843+0000","last_fullsized":"2024-04-26T10:34:13.488843+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"42'8180","reported_seq":8214,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.542566+0000","last_change":"2024-04-26T10:33:16.344714+0000","last_active":"2024-04-26T10:34:14.542566+0000","last_peered":"2024-04-26T10:34:14.542566+0000","last_clean":"2024-04-26T10:34:14.542566+0000","last_became_active":"2024-04-26T10:33:16.344500+0000","last_became_peered":"2024-04-26T10:33:16.344500+0000","last_unstale":"2024-04-26T10:34:14.542566+0000","last_undegraded":"2024-04-26T10:34:14.542566+0000","last_fullsized":"2024-04-26T10:34:14.542566+0000","mapping_epoch":16,"log_start":"29'5235","ondisk_log_start":"29'5235","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2945,"log_dups_size":1442,"ondisk_log_size":2945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:19.056484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536084480,"num_objects":8180,"num_object_clones":0,"num_object_copies":16360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8180,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8180,"num_write_kb":523520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497426+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:34:13.497426+0000","last_peered":"2024-04-26T10:34:13.497426+0000","last_clean":"2024-04-26T10:34:13.497426+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:34:13.497426+0000","last_undegraded":"2024-04-26T10:34:13.497426+0000","last_fullsized":"2024-04-26T10:34:13.497426+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.509515+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:34:14.509515+0000","last_peered":"2024-04-26T10:34:14.509515+0000","last_clean":"2024-04-26T10:34:14.509515+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:34:14.509515+0000","last_undegraded":"2024-04-26T10:34:14.509515+0000","last_fullsized":"2024-04-26T10:34:14.509515+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.172123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.500430+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:34:13.500430+0000","last_peered":"2024-04-26T10:34:13.500430+0000","last_clean":"2024-04-26T10:34:13.500430+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:34:13.500430+0000","last_undegraded":"2024-04-26T10:34:13.500430+0000","last_fullsized":"2024-04-26T10:34:13.500430+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"40'8103","reported_seq":8139,"reported_epoch":40,"state":"peering","last_fresh":"2024-04-26T10:34:13.458972+0000","last_change":"2024-04-26T10:34:14.498783+0000","last_active":"2024-04-26T10:34:14.498783+0000","last_peered":"2024-04-26T10:34:13.458972+0000","last_clean":"2024-04-26T10:34:00.424582+0000","last_became_active":"2024-04-26T10:34:02.519692+0000","last_became_peered":"2024-04-26T10:34:02.519692+0000","last_unstale":"2024-04-26T10:34:13.458972+0000","last_undegraded":"2024-04-26T10:34:13.458972+0000","last_fullsized":"2024-04-26T10:34:13.458972+0000","mapping_epoch":42,"log_start":"28'5188","ondisk_log_start":"28'5188","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":2915,"log_dups_size":1442,"ondisk_log_size":2915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:12.143408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531038208,"num_objects":8103,"num_object_clones":0,"num_object_copies":16206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8103,"num_write_kb":518592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.512226+0000","last_change":"2024-04-26T10:34:14.512226+0000","last_active":"2024-04-26T10:34:14.512226+0000","last_peered":"2024-04-26T10:34:14.512226+0000","last_clean":"2024-04-26T10:34:14.512226+0000","last_became_active":"2024-04-26T10:34:14.511888+0000","last_became_peered":"2024-04-26T10:34:14.511888+0000","last_unstale":"2024-04-26T10:34:14.512226+0000","last_undegraded":"2024-04-26T10:34:14.512226+0000","last_fullsized":"2024-04-26T10:34:14.512226+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:58.832869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497421+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:34:13.497421+0000","last_peered":"2024-04-26T10:34:13.497421+0000","last_clean":"2024-04-26T10:34:13.497421+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:34:13.497421+0000","last_undegraded":"2024-04-26T10:34:13.497421+0000","last_fullsized":"2024-04-26T10:34:13.497421+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510695+0000","last_change":"2024-04-26T10:34:14.510158+0000","last_active":"2024-04-26T10:34:14.510695+0000","last_peered":"2024-04-26T10:34:14.510695+0000","last_clean":"2024-04-26T10:34:14.510695+0000","last_became_active":"2024-04-26T10:34:14.509584+0000","last_became_peered":"2024-04-26T10:34:14.509584+0000","last_unstale":"2024-04-26T10:34:14.510695+0000","last_undegraded":"2024-04-26T10:34:14.510695+0000","last_fullsized":"2024-04-26T10:34:14.510695+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:39.230972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513307+0000","last_change":"2024-04-26T10:34:14.508334+0000","last_active":"2024-04-26T10:34:14.513307+0000","last_peered":"2024-04-26T10:34:14.513307+0000","last_clean":"2024-04-26T10:34:14.513307+0000","last_became_active":"2024-04-26T10:34:14.507205+0000","last_became_peered":"2024-04-26T10:34:14.507205+0000","last_unstale":"2024-04-26T10:34:14.513307+0000","last_undegraded":"2024-04-26T10:34:14.513307+0000","last_fullsized":"2024-04-26T10:34:14.513307+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:20.747187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.489460+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:34:13.489460+0000","last_peered":"2024-04-26T10:34:13.489460+0000","last_clean":"2024-04-26T10:34:13.489460+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:34:13.489460+0000","last_undegraded":"2024-04-26T10:34:13.489460+0000","last_fullsized":"2024-04-26T10:34:13.489460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497414+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:34:13.497414+0000","last_peered":"2024-04-26T10:34:13.497414+0000","last_clean":"2024-04-26T10:34:13.497414+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:34:13.497414+0000","last_undegraded":"2024-04-26T10:34:13.497414+0000","last_fullsized":"2024-04-26T10:34:13.497414+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.499249+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:34:13.499249+0000","last_peered":"2024-04-26T10:34:13.499249+0000","last_clean":"2024-04-26T10:34:13.499249+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:34:13.499249+0000","last_undegraded":"2024-04-26T10:34:13.499249+0000","last_fullsized":"2024-04-26T10:34:13.499249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488589+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:34:13.488589+0000","last_peered":"2024-04-26T10:34:13.488589+0000","last_clean":"2024-04-26T10:34:13.488589+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:34:13.488589+0000","last_undegraded":"2024-04-26T10:34:13.488589+0000","last_fullsized":"2024-04-26T10:34:13.488589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.494252+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:34:13.494252+0000","last_peered":"2024-04-26T10:34:13.494252+0000","last_clean":"2024-04-26T10:34:13.494252+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:34:13.494252+0000","last_undegraded":"2024-04-26T10:34:13.494252+0000","last_fullsized":"2024-04-26T10:34:13.494252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.498954+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:34:13.498954+0000","last_peered":"2024-04-26T10:34:13.498954+0000","last_clean":"2024-04-26T10:34:13.498954+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:34:13.498954+0000","last_undegraded":"2024-04-26T10:34:13.498954+0000","last_fullsized":"2024-04-26T10:34:13.498954+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510537+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:34:14.510537+0000","last_peered":"2024-04-26T10:34:14.510537+0000","last_clean":"2024-04-26T10:34:14.510537+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:34:14.510537+0000","last_undegraded":"2024-04-26T10:34:14.510537+0000","last_fullsized":"2024-04-26T10:34:14.510537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497515+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:34:13.497515+0000","last_peered":"2024-04-26T10:34:13.497515+0000","last_clean":"2024-04-26T10:34:13.497515+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:34:13.497515+0000","last_undegraded":"2024-04-26T10:34:13.497515+0000","last_fullsized":"2024-04-26T10:34:13.497515+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.497531+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:34:13.497531+0000","last_peered":"2024-04-26T10:34:13.497531+0000","last_clean":"2024-04-26T10:34:13.497531+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:34:13.497531+0000","last_undegraded":"2024-04-26T10:34:13.497531+0000","last_fullsized":"2024-04-26T10:34:13.497531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.496002+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:34:13.496002+0000","last_peered":"2024-04-26T10:34:13.496002+0000","last_clean":"2024-04-26T10:34:13.496002+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:34:13.496002+0000","last_undegraded":"2024-04-26T10:34:13.496002+0000","last_fullsized":"2024-04-26T10:34:13.496002+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.513276+0000","last_change":"2024-04-26T10:34:14.513276+0000","last_active":"2024-04-26T10:34:14.513276+0000","last_peered":"2024-04-26T10:34:14.513276+0000","last_clean":"2024-04-26T10:34:14.513276+0000","last_became_active":"2024-04-26T10:34:14.512930+0000","last_became_peered":"2024-04-26T10:34:14.512930+0000","last_unstale":"2024-04-26T10:34:14.513276+0000","last_undegraded":"2024-04-26T10:34:14.513276+0000","last_fullsized":"2024-04-26T10:34:14.513276+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:37.809739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T10:34:13.488354+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:34:13.488354+0000","last_peered":"2024-04-26T10:34:13.488354+0000","last_clean":"2024-04-26T10:34:13.488354+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:34:13.488354+0000","last_undegraded":"2024-04-26T10:34:13.488354+0000","last_fullsized":"2024-04-26T10:34:13.488354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.516166+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:34:14.516166+0000","last_peered":"2024-04-26T10:34:14.516166+0000","last_clean":"2024-04-26T10:34:14.516166+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:34:14.516166+0000","last_undegraded":"2024-04-26T10:34:14.516166+0000","last_fullsized":"2024-04-26T10:34:14.516166+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.021846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T10:34:14.510697+0000","last_change":"2024-04-26T10:34:14.507476+0000","last_active":"2024-04-26T10:34:14.510697+0000","last_peered":"2024-04-26T10:34:14.510697+0000","last_clean":"2024-04-26T10:34:14.510697+0000","last_became_active":"2024-04-26T10:34:14.507171+0000","last_became_peered":"2024-04-26T10:34:14.507171+0000","last_unstale":"2024-04-26T10:34:14.510697+0000","last_undegraded":"2024-04-26T10:34:14.510697+0000","last_fullsized":"2024-04-26T10:34:14.510697+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:32.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8522170368,"num_objects":130038,"num_object_clones":0,"num_object_copies":260076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130038,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130038,"num_write_kb":8322432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3174,"num_bytes_recovered":208011264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17163419648,"data_stored":17163419648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48763,"ondisk_log_size":48763,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":1,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738389,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6989468,"kb_used_data":6777872,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":87382372,"statfs":{"total":96636764160,"available":89479548928,"internally_reserved":0,"allocated":6940540928,"data_stored":6940241247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":216660422},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.312}]},{"osd":1,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.39300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738388,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5459308,"kb_used_data":5297756,"kb_used_omap":1,"kb_used_meta":161534,"kb_avail":88912532,"statfs":{"total":96636764160,"available":91046432768,"internally_reserved":0,"allocated":5424902144,"data_stored":5424587178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":165411270},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.23699999999999999}]},{"osd":2,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.69599999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738388,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4807692,"kb_used_data":4686332,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":89564148,"statfs":{"total":96636764160,"available":91713687552,"internally_reserved":0,"allocated":4798803968,"data_stored":4798518934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.14999999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.19400000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.184},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.22700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5424939008,"data_stored":5424939008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4799004672,"data_stored":4799004672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6939475968,"data_stored":6939475968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:34:20.403 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:20.404 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:20.402+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:20.505 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:20.504+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:20.525 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:34:20.593 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.789886047000003, 2024-04-26T10:34:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.594 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:20.599 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.789885062000003, 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:20.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:20.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:20.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.789816438999999, 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.606 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.789764658999999, 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.609 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:20.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:20.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:20.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.789704809, 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.615 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.616 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.617 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.618 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.619 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.787992105000001, 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.620 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:20.621 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.622 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.623 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.624 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.625 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.787877037999998, 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:20.626 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:20.627 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.628 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.787783898000001, 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.630 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:20.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:20.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.787589738000001, 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:20.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:20.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:20.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.786382369999998, 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.643 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.785573462000002, 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.644 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:20.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:20.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:20.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:20.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:20.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:20.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.785469923999997, 2024-04-26T10:34:20.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:20.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:20.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.785393051, 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.655 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:20.660 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 52.785277667000003, 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:20.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:20.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.408633613999999, 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:20.664 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:20.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:20.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.406603766, 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.670 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:20.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.406127962999999, 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.404160909000002, 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.681 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:20.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:20.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:20.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:20.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103336 5.6 5:6c0cef20:::benchmark_data_smithi043_45180_object103335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.402051604, 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064107786, 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103336 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188502+0000", 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188540+0000", 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8445000000000002e-05 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188553+0000", 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2768e-05 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188563+0000", 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9760000000000007e-06 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191877+0000", 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003313908 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192004+0000", 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012663 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192143+0000", 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013964199999999999 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.196467+0000", 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043232230000000002 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252539+0000", 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056072085000000001 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252577+0000", 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8730999999999999e-05 2024-04-26T10:34:20.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252611+0000", 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3769000000000001e-05 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 22.401493170999998, 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:20.692 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:20.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:20.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:20.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:20.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.697 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:20.698 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:20.698 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:20.699 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:20.697+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:20.699 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:20.800 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:20.799+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:20.877 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:141569 5.1 5:8981376b:::benchmark_data_smithi043_45180_object6927:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:20.872129+0000", 2024-04-26T10:34:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0047152820000000003, 2024-04-26T10:34:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004739633, 2024-04-26T10:34:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 141569 2024-04-26T10:34:20.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.872129+0000", 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.872129+0000", 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:20.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.872128+0000", 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.872133+0000", 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8239999999999999e-06 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.872144+0000", 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1306e-05 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.872153+0000", 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8419999999999994e-06 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873295+0000", 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001142007 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873371+0000", 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5532999999999997e-05 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873429+0000", 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7964999999999998e-05 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:141575 5.1 5:8599acd2:::benchmark_data_smithi043_45180_object6933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:20.873427+0000", 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0034175329999999999, 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035126459999999999, 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:20.882 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 141575 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873427+0000", 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873427+0000", 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:20.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873426+0000", 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873429+0000", 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6390000000000001e-06 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873435+0000", 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0619999999999997e-06 2024-04-26T10:34:20.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873439+0000", 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4769999999999997e-06 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.874848+0000", 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001408117 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.874934+0000", 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6891999999999994e-05 2024-04-26T10:34:20.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.875035+0000", 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100278 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:141578 5.1 5:8842f8f3:::benchmark_data_smithi043_45180_object6936:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:20.873581+0000", 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0032632109999999998, 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003416821, 2024-04-26T10:34:20.886 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 141578 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873581+0000", 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:20.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873581+0000", 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873580+0000", 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873584+0000", 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.377e-06 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:20.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873592+0000", 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9500000000000001e-06 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873599+0000", 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.323e-06 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.876416+0000", 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002817005 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:20.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.876552+0000", 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013568799999999999 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.876640+0000", 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7954000000000005e-05 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:141579 5.7 5:e8b235c5:::benchmark_data_smithi043_45180_object6937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:20.874899+0000", 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0019452670000000001, 2024-04-26T10:34:20.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002140234, 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 141579 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.874899+0000", 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.874899+0000", 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.874898+0000", 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.874903+0000", 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3179999999999997e-06 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.874911+0000", 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5989999999999996e-06 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.874918+0000", 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.64e-06 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.874956+0000", 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8504999999999998e-05 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.875067+0000", 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110529 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.875164+0000", 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7499999999999998e-05 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.876961+0000", 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017969699999999999 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:20.894 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:141558 5.7 5:e9036ae1:::benchmark_data_smithi043_45180_object6916:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:20.867672+0000", 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0091726419999999999, 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0094127059999999999, 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 141558 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.895 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.867672+0000", 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.867672+0000", 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.867671+0000", 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:20.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.867674+0000", 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7259999999999998e-06 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.867682+0000", 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2949999999999994e-06 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.867695+0000", 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2727e-05 2024-04-26T10:34:20.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.871398+0000", 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003703511 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.871516+0000", 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117287 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.871609+0000", 2024-04-26T10:34:20.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3141999999999997e-05 2024-04-26T10:34:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:20.873596+0000", 2024-04-26T10:34:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019869829999999999 2024-04-26T10:34:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:34:20.899 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 5 2024-04-26T10:34:20.899 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:20.900 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:20.901 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:20.899+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:21.001 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:21.000+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:21.080 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:21.080 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:34:21.080 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:34:21.080 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:34:21.080 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:21.097 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:21.102 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:21.101+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:21.206 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:21.205+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:21.277 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:34:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:34:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.473691604999999, 2024-04-26T10:34:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:34:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:95997 5.7 5:ef48f664:::benchmark_data_smithi043_45180_object95996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.688482124, 2024-04-26T10:34:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024010581999999999, 2024-04-26T10:34:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 95997 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585344+0000", 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4491e-05 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585350+0000", 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1099999999999999e-06 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585355+0000", 2024-04-26T10:34:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5430000000000004e-06 2024-04-26T10:34:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592076+0000", 2024-04-26T10:34:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067208470000000003 2024-04-26T10:34:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592209+0000", 2024-04-26T10:34:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013344400000000001 2024-04-26T10:34:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592320+0000", 2024-04-26T10:34:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011081700000000001 2024-04-26T10:34:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.594282+0000", 2024-04-26T10:34:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019622699999999999 2024-04-26T10:34:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609277+0000", 2024-04-26T10:34:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014995066 2024-04-26T10:34:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609308+0000", 2024-04-26T10:34:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1242999999999999e-05 2024-04-26T10:34:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609331+0000", 2024-04-26T10:34:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2150999999999998e-05 2024-04-26T10:34:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101455 5.f 5:fbcc5be4:::benchmark_data_smithi043_45180_object101454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.003820936, 2024-04-26T10:34:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02195165, 2024-04-26T10:34:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101455 2024-04-26T10:34:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270103+0000", 2024-04-26T10:34:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122309 2024-04-26T10:34:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270111+0000", 2024-04-26T10:34:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3999999999999992e-06 2024-04-26T10:34:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270118+0000", 2024-04-26T10:34:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9179999999999997e-06 2024-04-26T10:34:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272018+0000", 2024-04-26T10:34:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018998610000000001 2024-04-26T10:34:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272126+0000", 2024-04-26T10:34:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010844999999999999 2024-04-26T10:34:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272225+0000", 2024-04-26T10:34:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8381999999999994e-05 2024-04-26T10:34:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278402+0000", 2024-04-26T10:34:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061767009999999997 2024-04-26T10:34:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291830+0000", 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013428756 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291894+0000", 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3189999999999996e-05 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291933+0000", 2024-04-26T10:34:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9297e-05 2024-04-26T10:34:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101456 5.f 5:f61cae04:::benchmark_data_smithi043_45180_object101455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.003539753999998, 2024-04-26T10:34:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021829133000000001, 2024-04-26T10:34:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101456 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270361+0000", 2024-04-26T10:34:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9395999999999995e-05 2024-04-26T10:34:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270369+0000", 2024-04-26T10:34:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5490000000000001e-06 2024-04-26T10:34:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270374+0000", 2024-04-26T10:34:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5130000000000004e-06 2024-04-26T10:34:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273610+0000", 2024-04-26T10:34:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003235791 2024-04-26T10:34:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273723+0000", 2024-04-26T10:34:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112833 2024-04-26T10:34:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273861+0000", 2024-04-26T10:34:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013803 2024-04-26T10:34:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278411+0000", 2024-04-26T10:34:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045506380000000001 2024-04-26T10:34:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291986+0000", 2024-04-26T10:34:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013574409000000001 2024-04-26T10:34:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292037+0000", 2024-04-26T10:34:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1041000000000001e-05 2024-04-26T10:34:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292091+0000", 2024-04-26T10:34:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4617000000000002e-05 2024-04-26T10:34:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101459 5.f 5:f6287f2a:::benchmark_data_smithi043_45180_object101458:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.001626846000001, 2024-04-26T10:34:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022608105999999999, 2024-04-26T10:34:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101459 2024-04-26T10:34:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272227+0000", 2024-04-26T10:34:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2669e-05 2024-04-26T10:34:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272236+0000", 2024-04-26T10:34:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0210000000000005e-06 2024-04-26T10:34:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272243+0000", 2024-04-26T10:34:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7469999999999999e-06 2024-04-26T10:34:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276304+0000", 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040604789999999997 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276386+0000", 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2278000000000001e-05 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276477+0000", 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0713999999999999e-05 2024-04-26T10:34:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278905+0000", 2024-04-26T10:34:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024288249999999999 2024-04-26T10:34:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294715+0000", 2024-04-26T10:34:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015809976999999999 2024-04-26T10:34:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294747+0000", 2024-04-26T10:34:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1814999999999999e-05 2024-04-26T10:34:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294783+0000", 2024-04-26T10:34:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6180999999999998e-05 2024-04-26T10:34:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101461 5.f 5:fcae472f:::benchmark_data_smithi043_45180_object101460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.000833585999999, 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021972760000000001, 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101461 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272968+0000", 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273035+0000", 2024-04-26T10:34:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7477000000000005e-05 2024-04-26T10:34:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273043+0000", 2024-04-26T10:34:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4159999999999998e-06 2024-04-26T10:34:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273049+0000", 2024-04-26T10:34:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4509999999999997e-06 2024-04-26T10:34:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277407+0000", 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043580529999999998 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277489+0000", 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1333000000000002e-05 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277574+0000", 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5042000000000003e-05 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278908+0000", 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013341360000000001 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294832+0000", 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015924462 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294899+0000", 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6984999999999996e-05 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294941+0000", 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2113000000000002e-05 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:102382 5.2 5:4e9d92ee:::benchmark_data_smithi043_45180_object102381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.566534825000002, 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021126853000000001, 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 102382 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707330+0000", 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3274000000000004e-05 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707339+0000", 2024-04-26T10:34:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9700000000000005e-06 2024-04-26T10:34:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707346+0000", 2024-04-26T10:34:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:34:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709272+0000", 2024-04-26T10:34:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019264169999999999 2024-04-26T10:34:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709387+0000", 2024-04-26T10:34:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115333 2024-04-26T10:34:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709479+0000", 2024-04-26T10:34:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1555e-05 2024-04-26T10:34:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.712520+0000", 2024-04-26T10:34:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030408729999999999 2024-04-26T10:34:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728336+0000", 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015815929999999999 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728370+0000", 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4496999999999999e-05 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728394+0000", 2024-04-26T10:34:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3793000000000001e-05 2024-04-26T10:34:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103328 5.6 e32/16 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head v 32'6425, mlcod=32'6423)", 2024-04-26T10:34:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.089442296000001, 2024-04-26T10:34:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064716840999999997, 2024-04-26T10:34:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184359+0000", 2024-04-26T10:34:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184419+0000", 2024-04-26T10:34:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9345999999999997e-05 2024-04-26T10:34:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184425+0000", 2024-04-26T10:34:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1190000000000002e-06 2024-04-26T10:34:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184429+0000", 2024-04-26T10:34:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.296e-06 2024-04-26T10:34:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184461+0000", 2024-04-26T10:34:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2122999999999997e-05 2024-04-26T10:34:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184477+0000", 2024-04-26T10:34:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5877000000000001e-05 2024-04-26T10:34:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249048+0000", 2024-04-26T10:34:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064570494000000006 2024-04-26T10:34:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249077+0000", 2024-04-26T10:34:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9081000000000002e-05 2024-04-26T10:34:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103327 5.c e32/16 5:3133c183:::benchmark_data_smithi043_45180_object103326:head v 32'6430, mlcod=32'6425)", 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.089275698000002, 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064984741999999998, 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184592+0000", 2024-04-26T10:34:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6027999999999999e-05 2024-04-26T10:34:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184597+0000", 2024-04-26T10:34:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8570000000000003e-06 2024-04-26T10:34:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184600+0000", 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3390000000000001e-06 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184620+0000", 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9890000000000001e-05 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184631+0000", 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1073999999999999e-05 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249477+0000", 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064845485999999994 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249511+0000", 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4508000000000002e-05 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103329 5.6 e32/16 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head v 32'6426, mlcod=32'6423)", 2024-04-26T10:34:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.085441877000001, 2024-04-26T10:34:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063744996999999998, 2024-04-26T10:34:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188359+0000", 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188389+0000", 2024-04-26T10:34:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9416000000000001e-05 2024-04-26T10:34:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243409+0000", 2024-04-26T10:34:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.055020409999999999 2024-04-26T10:34:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243419+0000", 2024-04-26T10:34:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0071000000000001e-05 2024-04-26T10:34:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243465+0000", 2024-04-26T10:34:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5799e-05 2024-04-26T10:34:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243491+0000", 2024-04-26T10:34:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5619999999999999e-05 2024-04-26T10:34:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252067+0000", 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085763809999999992 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252105+0000", 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8040999999999997e-05 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103337 5.d e32/16 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head v 32'6429, mlcod=32'6427)", 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.085371500000001, 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.057982037, 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188430+0000", 2024-04-26T10:34:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188500+0000", 2024-04-26T10:34:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0062999999999996e-05 2024-04-26T10:34:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243434+0000", 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.054933760999999998 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243442+0000", 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243490+0000", 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8312000000000001e-05 2024-04-26T10:34:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243511+0000", 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0781999999999999e-05 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246370+0000", 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028590930000000001 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246413+0000", 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2413000000000002e-05 2024-04-26T10:34:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103660 5.9 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.891435855000001, 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.067661676000000004, 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103660 2024-04-26T10:34:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382365+0000", 2024-04-26T10:34:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382430+0000", 2024-04-26T10:34:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4850000000000004e-05 2024-04-26T10:34:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382439+0000", 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382445+0000", 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0229999999999998e-06 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382482+0000", 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6909000000000002e-05 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382613+0000", 2024-04-26T10:34:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013072600000000001 2024-04-26T10:34:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382756+0000", 2024-04-26T10:34:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000143306 2024-04-26T10:34:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385090+0000", 2024-04-26T10:34:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002333786 2024-04-26T10:34:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449925+0000", 2024-04-26T10:34:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064835173999999995 2024-04-26T10:34:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449985+0000", 2024-04-26T10:34:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0124999999999998e-05 2024-04-26T10:34:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450028+0000", 2024-04-26T10:34:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2457999999999999e-05 2024-04-26T10:34:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103662 5.f 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.888992044999998, 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.068705924000000002, 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103662 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384809+0000", 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384908+0000", 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9146000000000002e-05 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384921+0000", 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2622e-05 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384931+0000", 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0108e-05 2024-04-26T10:34:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384984+0000", 2024-04-26T10:34:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2849000000000002e-05 2024-04-26T10:34:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017266800000000001 2024-04-26T10:34:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385313+0000", 2024-04-26T10:34:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015649300000000001 2024-04-26T10:34:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388446+0000", 2024-04-26T10:34:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003133481 2024-04-26T10:34:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453401+0000", 2024-04-26T10:34:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064955075000000001 2024-04-26T10:34:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453462+0000", 2024-04-26T10:34:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1134000000000001e-05 2024-04-26T10:34:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453516+0000", 2024-04-26T10:34:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3477999999999999e-05 2024-04-26T10:34:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103664 5.9 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.888709361, 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.065076041000000001, 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103664 2024-04-26T10:34:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385092+0000", 2024-04-26T10:34:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385145+0000", 2024-04-26T10:34:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3143000000000003e-05 2024-04-26T10:34:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0473e-05 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385163+0000", 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385193+0000", 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0638e-05 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385284+0000", 2024-04-26T10:34:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599000000000005e-05 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385375+0000", 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0606999999999995e-05 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387556+0000", 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021809529999999998 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450072+0000", 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062516408999999995 2024-04-26T10:34:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450123+0000", 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1406000000000002e-05 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450169+0000", 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5380000000000003e-05 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103666 5.f 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.886945988000001, 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066830159, 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103666 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386855+0000", 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386928+0000", 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-04-26T10:34:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386937+0000", 2024-04-26T10:34:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1090000000000004e-06 2024-04-26T10:34:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386945+0000", 2024-04-26T10:34:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-04-26T10:34:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386981+0000", 2024-04-26T10:34:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5899999999999998e-05 2024-04-26T10:34:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387071+0000", 2024-04-26T10:34:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9954e-05 2024-04-26T10:34:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387161+0000", 2024-04-26T10:34:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0898999999999998e-05 2024-04-26T10:34:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390584+0000", 2024-04-26T10:34:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034229030000000001 2024-04-26T10:34:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453579+0000", 2024-04-26T10:34:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062994267000000007 2024-04-26T10:34:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453640+0000", 2024-04-26T10:34:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1162999999999997e-05 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453686+0000", 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6493999999999999e-05 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103667 5.f 5:f4dc36e8:::benchmark_data_smithi043_45180_object103666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.886084918000002, 2024-04-26T10:34:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066218387000000004, 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103667 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387783+0000", 2024-04-26T10:34:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5973e-05 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387791+0000", 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1850000000000004e-06 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387796+0000", 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388469+0000", 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0006734 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388547+0000", 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7188999999999996e-05 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388630+0000", 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3892000000000002e-05 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390598+0000", 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00196759 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453803+0000", 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063205069000000003 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453844+0000", 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1248999999999998e-05 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453936+0000", 2024-04-26T10:34:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1201999999999999e-05 2024-04-26T10:34:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:107998 5.9 5:9ce23eb0:::benchmark_data_smithi043_45180_object107997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.778166538000001, 2024-04-26T10:34:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025313064, 2024-04-26T10:34:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107998 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495634+0000", 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495754+0000", 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119893 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495769+0000", 2024-04-26T10:34:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4769999999999999e-05 2024-04-26T10:34:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495781+0000", 2024-04-26T10:34:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1858999999999999e-05 2024-04-26T10:34:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502521+0000", 2024-04-26T10:34:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067402410000000001 2024-04-26T10:34:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502675+0000", 2024-04-26T10:34:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015405099999999999 2024-04-26T10:34:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1,2", 2024-04-26T10:34:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502846+0000", 2024-04-26T10:34:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000171001 2024-04-26T10:34:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.505743+0000", 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028975490000000001 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.508006+0000", 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022627620000000002 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520788+0000", 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012782244 2024-04-26T10:34:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520846+0000", 2024-04-26T10:34:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7976999999999997e-05 2024-04-26T10:34:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520949+0000", 2024-04-26T10:34:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102267 2024-04-26T10:34:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:107974 5.b e35/34 5:daaeafb8:::benchmark_data_smithi043_45180_object107973:head v 35'6822, mlcod=0'0)", 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.759139715, 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020988144, 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514661+0000", 2024-04-26T10:34:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514668+0000", 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0249999999999997e-06 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514678+0000", 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7950000000000002e-06 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514686+0000", 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9049999999999997e-06 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514872+0000", 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018605499999999999 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514900+0000", 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7758000000000001e-05 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.535626+0000", 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020725958999999999 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.535651+0000", 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-05 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:108005 5.c e35/16 5:3b5c73fa:::benchmark_data_smithi043_45180_object108004:head v 35'6720, mlcod=33'6718)", 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 18.759078702, 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025223481999999998, 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514766+0000", 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2818999999999998e-05 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514773+0000", 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999996e-06 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514777+0000", 2024-04-26T10:34:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6199999999999998e-06 2024-04-26T10:34:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522074+0000", 2024-04-26T10:34:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072964029999999999 2024-04-26T10:34:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522096+0000", 2024-04-26T10:34:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2027000000000001e-05 2024-04-26T10:34:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539924+0000", 2024-04-26T10:34:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017827749 2024-04-26T10:34:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539947+0000", 2024-04-26T10:34:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3232999999999999e-05 2024-04-26T10:34:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "MOSDPGPushReply(5.9 38/34 [PushReplyOp(5:91d0b3ac:::benchmark_data_smithi043_45180_object10370:head)])", 2024-04-26T10:34:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.175125256999999, 2024-04-26T10:34:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022588196000000001, 2024-04-26T10:34:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-04-26T10:34:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:21.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:21.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:21.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:21.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:21.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:21.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:21.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:34:21.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:21.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098679+0000", 2024-04-26T10:34:21.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.295e-06 2024-04-26T10:34:21.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:21.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098683+0000", 2024-04-26T10:34:21.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8659999999999999e-06 2024-04-26T10:34:21.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098687+0000", 2024-04-26T10:34:21.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.67e-06 2024-04-26T10:34:21.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:21.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.121146+0000", 2024-04-26T10:34:21.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022459798 2024-04-26T10:34:21.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:21.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:21.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:21.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.121265+0000", 2024-04-26T10:34:21.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011866000000000001 2024-04-26T10:34:21.394 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.394 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.394 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.394 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:21.394 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:21.395 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:21.396 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:21.397 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:21.394+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:21.497 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:21.495+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:21.524 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-26T10:34:21.576 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:21.576 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:21.576 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.576 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:143680 5.e 5:7bddaea3:::benchmark_data_smithi043_45180_object9038:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:34:21.576 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:21.569006+0000", 2024-04-26T10:34:21.576 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0055669539999999998, 2024-04-26T10:34:21.577 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0055924879999999996, 2024-04-26T10:34:21.577 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:21.577 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:21.577 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:21.577 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:21.577 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.577 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 143680 2024-04-26T10:34:21.577 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.577 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:21.577 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.577 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:21.577 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.569006+0000", 2024-04-26T10:34:21.578 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.578 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.578 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.578 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:21.578 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.569006+0000", 2024-04-26T10:34:21.578 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.578 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.578 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.578 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:21.578 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.569005+0000", 2024-04-26T10:34:21.578 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.579 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.579 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.579 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:21.579 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.569008+0000", 2024-04-26T10:34:21.579 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7590000000000002e-06 2024-04-26T10:34:21.579 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.579 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.579 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:21.579 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.569015+0000", 2024-04-26T10:34:21.579 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3550000000000001e-06 2024-04-26T10:34:21.579 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.580 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.580 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.580 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.569020+0000", 2024-04-26T10:34:21.580 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.609e-06 2024-04-26T10:34:21.580 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.580 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.580 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:21.580 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.570510+0000", 2024-04-26T10:34:21.580 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001490339 2024-04-26T10:34:21.580 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.580 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.580 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:21.581 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.570591+0000", 2024-04-26T10:34:21.581 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0821000000000004e-05 2024-04-26T10:34:21.581 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.581 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.581 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:21.581 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.570654+0000", 2024-04-26T10:34:21.581 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2537000000000001e-05 2024-04-26T10:34:21.581 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.581 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.581 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:21.581 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574136+0000", 2024-04-26T10:34:21.582 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0034825680000000001 2024-04-26T10:34:21.582 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.582 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:21.582 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.582 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.582 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.582 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:143683 5.e 5:7ab7e445:::benchmark_data_smithi043_45180_object9041:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:34:21.582 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:21.569316+0000", 2024-04-26T10:34:21.582 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0052563990000000001, 2024-04-26T10:34:21.582 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0053689130000000003, 2024-04-26T10:34:21.582 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:21.583 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:21.583 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:21.583 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:21.583 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.583 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 143683 2024-04-26T10:34:21.583 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.583 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:21.583 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.583 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:21.583 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.569316+0000", 2024-04-26T10:34:21.583 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.583 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.584 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.584 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:21.584 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.569316+0000", 2024-04-26T10:34:21.584 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.584 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.584 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.584 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:21.584 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.569316+0000", 2024-04-26T10:34:21.584 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:21.584 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.584 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.584 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:21.584 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.569320+0000", 2024-04-26T10:34:21.585 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4839999999999998e-06 2024-04-26T10:34:21.585 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.585 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.585 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:21.585 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.569330+0000", 2024-04-26T10:34:21.585 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8870000000000004e-06 2024-04-26T10:34:21.585 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.585 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.585 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.585 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.569337+0000", 2024-04-26T10:34:21.585 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:21.585 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.585 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.586 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:21.586 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.572025+0000", 2024-04-26T10:34:21.586 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0026884029999999998 2024-04-26T10:34:21.586 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.586 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.586 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:21.586 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.572169+0000", 2024-04-26T10:34:21.586 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014433499999999999 2024-04-26T10:34:21.586 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.586 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.586 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:21.586 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.572310+0000", 2024-04-26T10:34:21.587 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014082 2024-04-26T10:34:21.587 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.587 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:21.587 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.587 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.587 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.587 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:143688 5.e 5:74955e73:::benchmark_data_smithi043_45180_object9046:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:34:21.587 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:21.570946+0000", 2024-04-26T10:34:21.587 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0036273130000000001, 2024-04-26T10:34:21.587 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0038153919999999999, 2024-04-26T10:34:21.587 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:21.588 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:21.588 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:21.588 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:21.588 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.588 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 143688 2024-04-26T10:34:21.588 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.588 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:21.588 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.588 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:21.588 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.570946+0000", 2024-04-26T10:34:21.588 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.588 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.588 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.589 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:21.589 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.570946+0000", 2024-04-26T10:34:21.589 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.589 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.589 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.589 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:21.589 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.570945+0000", 2024-04-26T10:34:21.589 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:21.589 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.589 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.589 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:21.589 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.570950+0000", 2024-04-26T10:34:21.589 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8380000000000001e-06 2024-04-26T10:34:21.590 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.590 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.590 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:21.590 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.570959+0000", 2024-04-26T10:34:21.590 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.1910000000000006e-06 2024-04-26T10:34:21.590 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.590 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.590 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.590 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.570966+0000", 2024-04-26T10:34:21.590 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:21.590 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.590 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.591 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:21.591 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574172+0000", 2024-04-26T10:34:21.591 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0032067350000000001 2024-04-26T10:34:21.591 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.591 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.591 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:21.591 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574311+0000", 2024-04-26T10:34:21.591 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000138947 2024-04-26T10:34:21.591 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.591 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.591 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:21.592 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574419+0000", 2024-04-26T10:34:21.592 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000107403 2024-04-26T10:34:21.592 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.592 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:21.592 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.592 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.592 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.592 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:143691 5.e 5.a294ccae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:34:21.592 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:21.571996+0000", 2024-04-26T10:34:21.592 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0025764479999999998, 2024-04-26T10:34:21.592 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0028359660000000001, 2024-04-26T10:34:21.593 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:21.593 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:21.593 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:21.593 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:21.593 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.593 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 143691 2024-04-26T10:34:21.593 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.593 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:21.593 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.593 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:21.593 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.571996+0000", 2024-04-26T10:34:21.593 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.594 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.594 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.594 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:21.594 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.571996+0000", 2024-04-26T10:34:21.594 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.594 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.594 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.594 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:21.594 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.571996+0000", 2024-04-26T10:34:21.594 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:21.594 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.594 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.595 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:21.595 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.571999+0000", 2024-04-26T10:34:21.595 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9040000000000002e-06 2024-04-26T10:34:21.595 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.595 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.595 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:21.595 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.572010+0000", 2024-04-26T10:34:21.596 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0359e-05 2024-04-26T10:34:21.596 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.596 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.596 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.596 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.572015+0000", 2024-04-26T10:34:21.596 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7700000000000001e-06 2024-04-26T10:34:21.596 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.596 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:21.596 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.597 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.597 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.597 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:143694 5.e 5.a7ab1a1e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:34:21.597 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:21.572858+0000", 2024-04-26T10:34:21.597 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0017147600000000001, 2024-04-26T10:34:21.597 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020265690000000002, 2024-04-26T10:34:21.597 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:21.597 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:21.597 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:21.597 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:21.597 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.597 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 143694 2024-04-26T10:34:21.598 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.598 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:21.598 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.598 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:21.598 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.572858+0000", 2024-04-26T10:34:21.598 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.598 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.598 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.598 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:21.598 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.572858+0000", 2024-04-26T10:34:21.599 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.599 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.599 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.599 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:21.599 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.572857+0000", 2024-04-26T10:34:21.599 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.599 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.599 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.599 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:21.599 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.572862+0000", 2024-04-26T10:34:21.599 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1540000000000004e-06 2024-04-26T10:34:21.600 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.600 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.600 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:21.600 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.572868+0000", 2024-04-26T10:34:21.600 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5860000000000001e-06 2024-04-26T10:34:21.600 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.600 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.600 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.600 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.572874+0000", 2024-04-26T10:34:21.600 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0140000000000004e-06 2024-04-26T10:34:21.600 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.600 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:21.600 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.601 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.601 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.601 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:143695 5.e 5.4c66ab6e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:34:21.601 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:21.573030+0000", 2024-04-26T10:34:21.601 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0015429599999999999, 2024-04-26T10:34:21.601 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019066809999999999, 2024-04-26T10:34:21.601 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:21.601 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:21.601 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:21.601 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:21.601 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.602 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 143695 2024-04-26T10:34:21.602 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.602 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:21.602 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.602 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:21.602 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573030+0000", 2024-04-26T10:34:21.602 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.602 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.602 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.602 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:21.602 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573030+0000", 2024-04-26T10:34:21.603 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.603 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.603 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.603 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:21.603 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573029+0000", 2024-04-26T10:34:21.603 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.603 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.603 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.603 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:21.603 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573032+0000", 2024-04-26T10:34:21.603 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6220000000000001e-06 2024-04-26T10:34:21.603 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.604 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.604 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:21.604 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573041+0000", 2024-04-26T10:34:21.604 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9979999999999992e-06 2024-04-26T10:34:21.604 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.604 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.604 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.604 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573046+0000", 2024-04-26T10:34:21.604 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0050000000000004e-06 2024-04-26T10:34:21.604 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.604 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:21.604 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.605 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.605 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.605 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:143692 5.a e47/16 5:58889886:::benchmark_data_smithi043_45180_object9050:head v 47'9127, mlcod=47'9125)", 2024-04-26T10:34:21.605 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:21.573232+0000", 2024-04-26T10:34:21.605 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001340754, 2024-04-26T10:34:21.605 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017509330000000001, 2024-04-26T10:34:21.605 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:21.605 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:21.605 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:21.605 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.605 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:21.605 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573232+0000", 2024-04-26T10:34:21.606 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.606 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.606 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.606 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:21.606 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573232+0000", 2024-04-26T10:34:21.606 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.606 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.606 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.606 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:21.606 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573232+0000", 2024-04-26T10:34:21.606 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.606 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.607 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.607 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:21.607 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573237+0000", 2024-04-26T10:34:21.607 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9520000000000002e-06 2024-04-26T10:34:21.607 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.607 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.607 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:21.607 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573242+0000", 2024-04-26T10:34:21.607 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7139999999999998e-06 2024-04-26T10:34:21.607 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.607 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.607 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.608 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573249+0000", 2024-04-26T10:34:21.608 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6270000000000002e-06 2024-04-26T10:34:21.608 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.608 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.608 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:21.608 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573283+0000", 2024-04-26T10:34:21.608 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3942000000000001e-05 2024-04-26T10:34:21.608 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.608 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.608 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:21.608 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573296+0000", 2024-04-26T10:34:21.608 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3023000000000001e-05 2024-04-26T10:34:21.609 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.609 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.609 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:21.609 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574955+0000", 2024-04-26T10:34:21.609 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016593529999999999 2024-04-26T10:34:21.609 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.609 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.609 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:21.609 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574983+0000", 2024-04-26T10:34:21.609 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7821e-05 2024-04-26T10:34:21.609 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.609 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:21.609 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.610 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.610 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.610 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:143696 5.f e47/41 5:f653fb55:::benchmark_data_smithi043_45180_object9054:head v 47'8713, mlcod=47'8711)", 2024-04-26T10:34:21.610 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:21.573570+0000", 2024-04-26T10:34:21.610 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0010027250000000001, 2024-04-26T10:34:21.610 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014963159999999999, 2024-04-26T10:34:21.610 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:21.610 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:21.610 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:21.610 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.610 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:21.611 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573570+0000", 2024-04-26T10:34:21.611 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.611 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.611 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.611 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:21.611 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573570+0000", 2024-04-26T10:34:21.611 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.611 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.611 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.611 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:21.611 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573569+0000", 2024-04-26T10:34:21.611 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:21.611 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.612 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.612 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:21.612 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573575+0000", 2024-04-26T10:34:21.612 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7599999999999999e-06 2024-04-26T10:34:21.612 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.612 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.612 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:21.612 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573585+0000", 2024-04-26T10:34:21.612 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7520000000000008e-06 2024-04-26T10:34:21.612 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.612 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.612 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.613 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573592+0000", 2024-04-26T10:34:21.613 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.041e-06 2024-04-26T10:34:21.613 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.613 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.613 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:21.613 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573839+0000", 2024-04-26T10:34:21.613 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00024690600000000002 2024-04-26T10:34:21.613 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.613 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.613 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:21.613 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.573855+0000", 2024-04-26T10:34:21.614 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6217000000000001e-05 2024-04-26T10:34:21.614 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.614 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:21.614 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.614 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.614 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.614 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:143699 5.8 5:16a8162f:::benchmark_data_smithi043_45180_object9057:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:34:21.614 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:21.574147+0000", 2024-04-26T10:34:21.614 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00042557899999999999, 2024-04-26T10:34:21.614 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00098282800000000004, 2024-04-26T10:34:21.614 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:21.618 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:21.618 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:21.618 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 143699 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574147+0000", 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574147+0000", 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:21.619 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574147+0000", 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574151+0000", 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6330000000000004e-06 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574161+0000", 2024-04-26T10:34:21.620 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0033e-05 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574168+0000", 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2509999999999997e-06 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574197+0000", 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8447000000000001e-05 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574275+0000", 2024-04-26T10:34:21.621 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8184999999999998e-05 2024-04-26T10:34:21.622 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:21.622 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:21.622 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:21.622 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:21.574335+0000", 2024-04-26T10:34:21.622 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0371999999999997e-05 2024-04-26T10:34:21.622 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.622 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:21.622 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.622 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:21.622 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:34:21.622 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 9 2024-04-26T10:34:21.622 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:21.623 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:34:21.624 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:21.623+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:21.625 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:21.726 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:21.724+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:21.776 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:21.797 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:21.803 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:21.803 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:21.817 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:21.818 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:21.823 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:21.823 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:21.823 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:21.826 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:21.825+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:21.927 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:21.926+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:22.002 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:22.002 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:22.017 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:22.060 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:22.058+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:22.130 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:22.129+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:22.205 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:22.206 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:22.221 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:22.265 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:22.261+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:22.333 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:22.332+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:22.436 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:22.434+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:22.453 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:22.454 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:22.469 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:22.554 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:22.552+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:22.639 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:22.637+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:22.713 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:22.713 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:22.727 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:22.739 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:22.738+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:22.843 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:22.839+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:22.902 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:22.902 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:22.918 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:22.941 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:22.940+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:23.042 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:23.040+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:23.098 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:23.098 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:23.114 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:23.143 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:23.142+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:23.244 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:23.243+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:23.289 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:23.289 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:23.305 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:23.345 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:23.343+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:23.403 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:34:23.446 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:23.445+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:23.484 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:23.484 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:23.501 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:23.536 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:34:23.546 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:23.545+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:23.648 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:23.646+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:23.685 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:23.685 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:23.699 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:23.749 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:23.748+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:23.772 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:23.774 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:34:23.784 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-04-26T10:34:23.001149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8525646706,"num_objects":130107,"num_object_clones":0,"num_object_copies":260214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130107,"num_whiteouts":0,"num_read":137,"num_read_kb":119,"num_write":139445,"num_write_kb":8620371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3200,"num_bytes_recovered":209195352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56918,"ondisk_log_size":56918,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":17359308,"kb_used_data":16804524,"kb_used_omap":4,"kb_used_meta":554363,"kb_avail":265756212,"statfs":{"total":289910292480,"available":272134361088,"internally_reserved":0,"allocated":17207832576,"data_stored":17206798559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":567668050},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2883608,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9159,"num_write_kb":294465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001225"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426482+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:34:17.426482+0000","last_peered":"2024-04-26T10:34:17.426482+0000","last_clean":"2024-04-26T10:34:17.426482+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:34:17.426482+0000","last_undegraded":"2024-04-26T10:34:17.426482+0000","last_fullsized":"2024-04-26T10:34:17.426482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:26.964955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426483+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:34:17.426483+0000","last_peered":"2024-04-26T10:34:17.426483+0000","last_clean":"2024-04-26T10:34:17.426483+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:34:17.426483+0000","last_undegraded":"2024-04-26T10:34:17.426483+0000","last_fullsized":"2024-04-26T10:34:17.426483+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426062+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:34:17.426062+0000","last_peered":"2024-04-26T10:34:17.426062+0000","last_clean":"2024-04-26T10:34:17.426062+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:34:17.426062+0000","last_undegraded":"2024-04-26T10:34:17.426062+0000","last_fullsized":"2024-04-26T10:34:17.426062+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426013+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:34:17.426013+0000","last_peered":"2024-04-26T10:34:17.426013+0000","last_clean":"2024-04-26T10:34:17.426013+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:34:17.426013+0000","last_undegraded":"2024-04-26T10:34:17.426013+0000","last_fullsized":"2024-04-26T10:34:17.426013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425885+0000","last_change":"2024-04-26T10:34:14.507618+0000","last_active":"2024-04-26T10:34:17.425885+0000","last_peered":"2024-04-26T10:34:17.425885+0000","last_clean":"2024-04-26T10:34:17.425885+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:34:17.425885+0000","last_undegraded":"2024-04-26T10:34:17.425885+0000","last_fullsized":"2024-04-26T10:34:17.425885+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:27.721106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425625+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:34:17.425625+0000","last_peered":"2024-04-26T10:34:17.425625+0000","last_clean":"2024-04-26T10:34:17.425625+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:34:17.425625+0000","last_undegraded":"2024-04-26T10:34:17.425625+0000","last_fullsized":"2024-04-26T10:34:17.425625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425652+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:34:17.425652+0000","last_peered":"2024-04-26T10:34:17.425652+0000","last_clean":"2024-04-26T10:34:17.425652+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:34:17.425652+0000","last_undegraded":"2024-04-26T10:34:17.425652+0000","last_fullsized":"2024-04-26T10:34:17.425652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425257+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:34:17.425257+0000","last_peered":"2024-04-26T10:34:17.425257+0000","last_clean":"2024-04-26T10:34:17.425257+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:34:17.425257+0000","last_undegraded":"2024-04-26T10:34:17.425257+0000","last_fullsized":"2024-04-26T10:34:17.425257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554186+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:34:17.554186+0000","last_peered":"2024-04-26T10:34:17.554186+0000","last_clean":"2024-04-26T10:34:17.554186+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:34:17.554186+0000","last_undegraded":"2024-04-26T10:34:17.554186+0000","last_fullsized":"2024-04-26T10:34:17.554186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426349+0000","last_change":"2024-04-26T10:34:14.507265+0000","last_active":"2024-04-26T10:34:17.426349+0000","last_peered":"2024-04-26T10:34:17.426349+0000","last_clean":"2024-04-26T10:34:17.426349+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:34:17.426349+0000","last_undegraded":"2024-04-26T10:34:17.426349+0000","last_fullsized":"2024-04-26T10:34:17.426349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:07.268421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425957+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:34:17.425957+0000","last_peered":"2024-04-26T10:34:17.425957+0000","last_clean":"2024-04-26T10:34:17.425957+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:34:17.425957+0000","last_undegraded":"2024-04-26T10:34:17.425957+0000","last_fullsized":"2024-04-26T10:34:17.425957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426074+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:34:17.426074+0000","last_peered":"2024-04-26T10:34:17.426074+0000","last_clean":"2024-04-26T10:34:17.426074+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:34:17.426074+0000","last_undegraded":"2024-04-26T10:34:17.426074+0000","last_fullsized":"2024-04-26T10:34:17.426074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425971+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:34:17.425971+0000","last_peered":"2024-04-26T10:34:17.425971+0000","last_clean":"2024-04-26T10:34:17.425971+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:34:17.425971+0000","last_undegraded":"2024-04-26T10:34:17.425971+0000","last_fullsized":"2024-04-26T10:34:17.425971+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:03.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426305+0000","last_change":"2024-04-26T10:34:14.509249+0000","last_active":"2024-04-26T10:34:17.426305+0000","last_peered":"2024-04-26T10:34:17.426305+0000","last_clean":"2024-04-26T10:34:17.426305+0000","last_became_active":"2024-04-26T10:34:14.508371+0000","last_became_peered":"2024-04-26T10:34:14.508371+0000","last_unstale":"2024-04-26T10:34:17.426305+0000","last_undegraded":"2024-04-26T10:34:17.426305+0000","last_fullsized":"2024-04-26T10:34:17.426305+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:35.257141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425465+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:34:17.425465+0000","last_peered":"2024-04-26T10:34:17.425465+0000","last_clean":"2024-04-26T10:34:17.425465+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:34:17.425465+0000","last_undegraded":"2024-04-26T10:34:17.425465+0000","last_fullsized":"2024-04-26T10:34:17.425465+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425318+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:34:17.425318+0000","last_peered":"2024-04-26T10:34:17.425318+0000","last_clean":"2024-04-26T10:34:17.425318+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:34:17.425318+0000","last_undegraded":"2024-04-26T10:34:17.425318+0000","last_fullsized":"2024-04-26T10:34:17.425318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554242+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:34:17.554242+0000","last_peered":"2024-04-26T10:34:17.554242+0000","last_clean":"2024-04-26T10:34:17.554242+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:34:17.554242+0000","last_undegraded":"2024-04-26T10:34:17.554242+0000","last_fullsized":"2024-04-26T10:34:17.554242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426338+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:34:17.426338+0000","last_peered":"2024-04-26T10:34:17.426338+0000","last_clean":"2024-04-26T10:34:17.426338+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:34:17.426338+0000","last_undegraded":"2024-04-26T10:34:17.426338+0000","last_fullsized":"2024-04-26T10:34:17.426338+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.343269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553884+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:34:17.553884+0000","last_peered":"2024-04-26T10:34:17.553884+0000","last_clean":"2024-04-26T10:34:17.553884+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:34:17.553884+0000","last_undegraded":"2024-04-26T10:34:17.553884+0000","last_fullsized":"2024-04-26T10:34:17.553884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426231+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:34:17.426231+0000","last_peered":"2024-04-26T10:34:17.426231+0000","last_clean":"2024-04-26T10:34:17.426231+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:34:17.426231+0000","last_undegraded":"2024-04-26T10:34:17.426231+0000","last_fullsized":"2024-04-26T10:34:17.426231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426223+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:34:17.426223+0000","last_peered":"2024-04-26T10:34:17.426223+0000","last_clean":"2024-04-26T10:34:17.426223+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:34:17.426223+0000","last_undegraded":"2024-04-26T10:34:17.426223+0000","last_fullsized":"2024-04-26T10:34:17.426223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425823+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:34:17.425823+0000","last_peered":"2024-04-26T10:34:17.425823+0000","last_clean":"2024-04-26T10:34:17.425823+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:34:17.425823+0000","last_undegraded":"2024-04-26T10:34:17.425823+0000","last_fullsized":"2024-04-26T10:34:17.425823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553534+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:34:17.553534+0000","last_peered":"2024-04-26T10:34:17.553534+0000","last_clean":"2024-04-26T10:34:17.553534+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:34:17.553534+0000","last_undegraded":"2024-04-26T10:34:17.553534+0000","last_fullsized":"2024-04-26T10:34:17.553534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425916+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:34:17.425916+0000","last_peered":"2024-04-26T10:34:17.425916+0000","last_clean":"2024-04-26T10:34:17.425916+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:34:17.425916+0000","last_undegraded":"2024-04-26T10:34:17.425916+0000","last_fullsized":"2024-04-26T10:34:17.425916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426472+0000","last_change":"2024-04-26T10:34:14.511829+0000","last_active":"2024-04-26T10:34:17.426472+0000","last_peered":"2024-04-26T10:34:17.426472+0000","last_clean":"2024-04-26T10:34:17.426472+0000","last_became_active":"2024-04-26T10:34:14.511584+0000","last_became_peered":"2024-04-26T10:34:14.511584+0000","last_unstale":"2024-04-26T10:34:17.426472+0000","last_undegraded":"2024-04-26T10:34:17.426472+0000","last_fullsized":"2024-04-26T10:34:17.426472+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:30.166797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554390+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:34:17.554390+0000","last_peered":"2024-04-26T10:34:17.554390+0000","last_clean":"2024-04-26T10:34:17.554390+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:34:17.554390+0000","last_undegraded":"2024-04-26T10:34:17.554390+0000","last_fullsized":"2024-04-26T10:34:17.554390+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426048+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:34:17.426048+0000","last_peered":"2024-04-26T10:34:17.426048+0000","last_clean":"2024-04-26T10:34:17.426048+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:34:17.426048+0000","last_undegraded":"2024-04-26T10:34:17.426048+0000","last_fullsized":"2024-04-26T10:34:17.426048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":43,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426146+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:34:17.426146+0000","last_peered":"2024-04-26T10:34:17.426146+0000","last_clean":"2024-04-26T10:34:17.426146+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:34:17.426146+0000","last_undegraded":"2024-04-26T10:34:17.426146+0000","last_fullsized":"2024-04-26T10:34:17.426146+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426241+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:34:17.426241+0000","last_peered":"2024-04-26T10:34:17.426241+0000","last_clean":"2024-04-26T10:34:17.426241+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:34:17.426241+0000","last_undegraded":"2024-04-26T10:34:17.426241+0000","last_fullsized":"2024-04-26T10:34:17.426241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553570+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:34:17.553570+0000","last_peered":"2024-04-26T10:34:17.553570+0000","last_clean":"2024-04-26T10:34:17.553570+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:34:17.553570+0000","last_undegraded":"2024-04-26T10:34:17.553570+0000","last_fullsized":"2024-04-26T10:34:17.553570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554491+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:34:17.554491+0000","last_peered":"2024-04-26T10:34:17.554491+0000","last_clean":"2024-04-26T10:34:17.554491+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:34:17.554491+0000","last_undegraded":"2024-04-26T10:34:17.554491+0000","last_fullsized":"2024-04-26T10:34:17.554491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":58,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553643+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:34:17.553643+0000","last_peered":"2024-04-26T10:34:17.553643+0000","last_clean":"2024-04-26T10:34:17.553643+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:34:17.553643+0000","last_undegraded":"2024-04-26T10:34:17.553643+0000","last_fullsized":"2024-04-26T10:34:17.553643+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:19.856062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426655+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:34:17.426655+0000","last_peered":"2024-04-26T10:34:17.426655+0000","last_clean":"2024-04-26T10:34:17.426655+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:34:17.426655+0000","last_undegraded":"2024-04-26T10:34:17.426655+0000","last_fullsized":"2024-04-26T10:34:17.426655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554331+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:34:17.554331+0000","last_peered":"2024-04-26T10:34:17.554331+0000","last_clean":"2024-04-26T10:34:17.554331+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:34:17.554331+0000","last_undegraded":"2024-04-26T10:34:17.554331+0000","last_fullsized":"2024-04-26T10:34:17.554331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553470+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:34:17.553470+0000","last_peered":"2024-04-26T10:34:17.553470+0000","last_clean":"2024-04-26T10:34:17.553470+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:34:17.553470+0000","last_undegraded":"2024-04-26T10:34:17.553470+0000","last_fullsized":"2024-04-26T10:34:17.553470+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:04.852453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426423+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:34:17.426423+0000","last_peered":"2024-04-26T10:34:17.426423+0000","last_clean":"2024-04-26T10:34:17.426423+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:34:17.426423+0000","last_undegraded":"2024-04-26T10:34:17.426423+0000","last_fullsized":"2024-04-26T10:34:17.426423+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553654+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:34:17.553654+0000","last_peered":"2024-04-26T10:34:17.553654+0000","last_clean":"2024-04-26T10:34:17.553654+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:34:17.553654+0000","last_undegraded":"2024-04-26T10:34:17.553654+0000","last_fullsized":"2024-04-26T10:34:17.553654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425808+0000","last_change":"2024-04-26T10:34:14.518131+0000","last_active":"2024-04-26T10:34:17.425808+0000","last_peered":"2024-04-26T10:34:17.425808+0000","last_clean":"2024-04-26T10:34:17.425808+0000","last_became_active":"2024-04-26T10:34:14.506010+0000","last_became_peered":"2024-04-26T10:34:14.506010+0000","last_unstale":"2024-04-26T10:34:17.425808+0000","last_undegraded":"2024-04-26T10:34:17.425808+0000","last_fullsized":"2024-04-26T10:34:17.425808+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:51.842115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553609+0000","last_change":"2024-04-26T10:34:14.509381+0000","last_active":"2024-04-26T10:34:17.553609+0000","last_peered":"2024-04-26T10:34:17.553609+0000","last_clean":"2024-04-26T10:34:17.553609+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:34:17.553609+0000","last_undegraded":"2024-04-26T10:34:17.553609+0000","last_fullsized":"2024-04-26T10:34:17.553609+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:05.841519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":84,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425937+0000","last_change":"2024-04-26T10:34:14.548596+0000","last_active":"2024-04-26T10:34:17.425937+0000","last_peered":"2024-04-26T10:34:17.425937+0000","last_clean":"2024-04-26T10:34:17.425937+0000","last_became_active":"2024-04-26T10:34:14.512027+0000","last_became_peered":"2024-04-26T10:34:14.512027+0000","last_unstale":"2024-04-26T10:34:17.425937+0000","last_undegraded":"2024-04-26T10:34:17.425937+0000","last_fullsized":"2024-04-26T10:34:17.425937+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:39.957573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426754+0000","last_change":"2024-04-26T10:34:14.513656+0000","last_active":"2024-04-26T10:34:17.426754+0000","last_peered":"2024-04-26T10:34:17.426754+0000","last_clean":"2024-04-26T10:34:17.426754+0000","last_became_active":"2024-04-26T10:34:14.513402+0000","last_became_peered":"2024-04-26T10:34:14.513402+0000","last_unstale":"2024-04-26T10:34:17.426754+0000","last_undegraded":"2024-04-26T10:34:17.426754+0000","last_fullsized":"2024-04-26T10:34:17.426754+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:22.053611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426615+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:34:17.426615+0000","last_peered":"2024-04-26T10:34:17.426615+0000","last_clean":"2024-04-26T10:34:17.426615+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:34:17.426615+0000","last_undegraded":"2024-04-26T10:34:17.426615+0000","last_fullsized":"2024-04-26T10:34:17.426615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425995+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:34:17.425995+0000","last_peered":"2024-04-26T10:34:17.425995+0000","last_clean":"2024-04-26T10:34:17.425995+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:34:17.425995+0000","last_undegraded":"2024-04-26T10:34:17.425995+0000","last_fullsized":"2024-04-26T10:34:17.425995+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:02.872251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553691+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:34:17.553691+0000","last_peered":"2024-04-26T10:34:17.553691+0000","last_clean":"2024-04-26T10:34:17.553691+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:34:17.553691+0000","last_undegraded":"2024-04-26T10:34:17.553691+0000","last_fullsized":"2024-04-26T10:34:17.553691+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425865+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:34:17.425865+0000","last_peered":"2024-04-26T10:34:17.425865+0000","last_clean":"2024-04-26T10:34:17.425865+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:34:17.425865+0000","last_undegraded":"2024-04-26T10:34:17.425865+0000","last_fullsized":"2024-04-26T10:34:17.425865+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:43.500342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425520+0000","last_change":"2024-04-26T10:34:14.509818+0000","last_active":"2024-04-26T10:34:17.425520+0000","last_peered":"2024-04-26T10:34:17.425520+0000","last_clean":"2024-04-26T10:34:17.425520+0000","last_became_active":"2024-04-26T10:34:14.509270+0000","last_became_peered":"2024-04-26T10:34:14.509270+0000","last_unstale":"2024-04-26T10:34:17.425520+0000","last_undegraded":"2024-04-26T10:34:17.425520+0000","last_fullsized":"2024-04-26T10:34:17.425520+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:45.412620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554529+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:34:17.554529+0000","last_peered":"2024-04-26T10:34:17.554529+0000","last_clean":"2024-04-26T10:34:17.554529+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:34:17.554529+0000","last_undegraded":"2024-04-26T10:34:17.554529+0000","last_fullsized":"2024-04-26T10:34:17.554529+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":86,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425572+0000","last_change":"2024-04-26T10:34:14.531646+0000","last_active":"2024-04-26T10:34:17.425572+0000","last_peered":"2024-04-26T10:34:17.425572+0000","last_clean":"2024-04-26T10:34:17.425572+0000","last_became_active":"2024-04-26T10:34:14.511911+0000","last_became_peered":"2024-04-26T10:34:14.511911+0000","last_unstale":"2024-04-26T10:34:17.425572+0000","last_undegraded":"2024-04-26T10:34:17.425572+0000","last_fullsized":"2024-04-26T10:34:17.425572+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:39.588939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554410+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:34:17.554410+0000","last_peered":"2024-04-26T10:34:17.554410+0000","last_clean":"2024-04-26T10:34:17.554410+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:34:17.554410+0000","last_undegraded":"2024-04-26T10:34:17.554410+0000","last_fullsized":"2024-04-26T10:34:17.554410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"46'8717","reported_seq":11819,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.043734+0000","last_change":"2024-04-26T10:34:14.549017+0000","last_active":"2024-04-26T10:34:20.043734+0000","last_peered":"2024-04-26T10:34:20.043734+0000","last_clean":"2024-04-26T10:34:20.043734+0000","last_became_active":"2024-04-26T10:34:14.518037+0000","last_became_peered":"2024-04-26T10:34:14.518037+0000","last_unstale":"2024-04-26T10:34:20.043734+0000","last_undegraded":"2024-04-26T10:34:20.043734+0000","last_fullsized":"2024-04-26T10:34:20.043734+0000","mapping_epoch":41,"log_start":"29'5291","ondisk_log_start":"29'5291","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":1542,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:21.571693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":534183936,"num_objects":8151,"num_object_clones":0,"num_object_copies":16302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8717,"num_write_kb":539776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1524,"num_bytes_recovered":99876864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":67,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426021+0000","last_change":"2024-04-26T10:34:14.536943+0000","last_active":"2024-04-26T10:34:17.426021+0000","last_peered":"2024-04-26T10:34:17.426021+0000","last_clean":"2024-04-26T10:34:17.426021+0000","last_became_active":"2024-04-26T10:34:14.511960+0000","last_became_peered":"2024-04-26T10:34:14.511960+0000","last_unstale":"2024-04-26T10:34:17.426021+0000","last_undegraded":"2024-04-26T10:34:17.426021+0000","last_fullsized":"2024-04-26T10:34:17.426021+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.329973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425670+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:34:17.425670+0000","last_peered":"2024-04-26T10:34:17.425670+0000","last_clean":"2024-04-26T10:34:17.425670+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:34:17.425670+0000","last_undegraded":"2024-04-26T10:34:17.425670+0000","last_fullsized":"2024-04-26T10:34:17.425670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"46'8926","reported_seq":8964,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.035074+0000","last_change":"2024-04-26T10:33:16.346351+0000","last_active":"2024-04-26T10:34:20.035074+0000","last_peered":"2024-04-26T10:34:20.035074+0000","last_clean":"2024-04-26T10:34:20.035074+0000","last_became_active":"2024-04-26T10:33:16.346122+0000","last_became_peered":"2024-04-26T10:33:16.346122+0000","last_unstale":"2024-04-26T10:34:20.035074+0000","last_undegraded":"2024-04-26T10:34:20.035074+0000","last_fullsized":"2024-04-26T10:34:20.035074+0000","mapping_epoch":16,"log_start":"28'4964","ondisk_log_start":"28'4964","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3962,"log_dups_size":0,"ondisk_log_size":3962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:13.714464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":546439168,"num_objects":8338,"num_object_clones":0,"num_object_copies":16676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8338,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8926,"num_write_kb":552448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426502+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:34:17.426502+0000","last_peered":"2024-04-26T10:34:17.426502+0000","last_clean":"2024-04-26T10:34:17.426502+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:34:17.426502+0000","last_undegraded":"2024-04-26T10:34:17.426502+0000","last_fullsized":"2024-04-26T10:34:17.426502+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425619+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:34:17.425619+0000","last_peered":"2024-04-26T10:34:17.425619+0000","last_clean":"2024-04-26T10:34:17.425619+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:34:17.425619+0000","last_undegraded":"2024-04-26T10:34:17.425619+0000","last_fullsized":"2024-04-26T10:34:17.425619+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:12.954308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"46'8798","reported_seq":12145,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.037419+0000","last_change":"2024-04-26T10:34:15.510456+0000","last_active":"2024-04-26T10:34:20.037419+0000","last_peered":"2024-04-26T10:34:20.037419+0000","last_clean":"2024-04-26T10:34:20.037419+0000","last_became_active":"2024-04-26T10:34:15.505397+0000","last_became_peered":"2024-04-26T10:34:15.505397+0000","last_unstale":"2024-04-26T10:34:20.037419+0000","last_undegraded":"2024-04-26T10:34:20.037419+0000","last_fullsized":"2024-04-26T10:34:20.037419+0000","mapping_epoch":42,"log_start":"29'5264","ondisk_log_start":"29'5264","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":1442,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:45.190570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538968064,"num_objects":8224,"num_object_clones":0,"num_object_copies":16448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8224,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8798,"num_write_kb":544704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1649,"num_bytes_recovered":108068864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":43,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426313+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:34:17.426313+0000","last_peered":"2024-04-26T10:34:17.426313+0000","last_clean":"2024-04-26T10:34:17.426313+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:34:17.426313+0000","last_undegraded":"2024-04-26T10:34:17.426313+0000","last_fullsized":"2024-04-26T10:34:17.426313+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425957+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:34:17.425957+0000","last_peered":"2024-04-26T10:34:17.425957+0000","last_clean":"2024-04-26T10:34:17.425957+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:34:17.425957+0000","last_undegraded":"2024-04-26T10:34:17.425957+0000","last_fullsized":"2024-04-26T10:34:17.425957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"46'8820","reported_seq":8858,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.053122+0000","last_change":"2024-04-26T10:33:16.346212+0000","last_active":"2024-04-26T10:34:20.053122+0000","last_peered":"2024-04-26T10:34:20.053122+0000","last_clean":"2024-04-26T10:34:20.053122+0000","last_became_active":"2024-04-26T10:33:16.346004+0000","last_became_peered":"2024-04-26T10:33:16.346004+0000","last_unstale":"2024-04-26T10:34:20.053122+0000","last_undegraded":"2024-04-26T10:34:20.053122+0000","last_fullsized":"2024-04-26T10:34:20.053122+0000","mapping_epoch":16,"log_start":"29'5354","ondisk_log_start":"29'5354","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3466,"log_dups_size":1542,"ondisk_log_size":3466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:27.495754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":534642688,"num_objects":8158,"num_object_clones":0,"num_object_copies":16316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8820,"num_write_kb":543296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425756+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:34:17.425756+0000","last_peered":"2024-04-26T10:34:17.425756+0000","last_clean":"2024-04-26T10:34:17.425756+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:34:17.425756+0000","last_undegraded":"2024-04-26T10:34:17.425756+0000","last_fullsized":"2024-04-26T10:34:17.425756+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554075+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:34:17.554075+0000","last_peered":"2024-04-26T10:34:17.554075+0000","last_clean":"2024-04-26T10:34:17.554075+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:34:17.554075+0000","last_undegraded":"2024-04-26T10:34:17.554075+0000","last_fullsized":"2024-04-26T10:34:17.554075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"46'8705","reported_seq":8755,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.037538+0000","last_change":"2024-04-26T10:34:15.511727+0000","last_active":"2024-04-26T10:34:20.037538+0000","last_peered":"2024-04-26T10:34:20.037538+0000","last_clean":"2024-04-26T10:34:20.037538+0000","last_became_active":"2024-04-26T10:34:15.508075+0000","last_became_peered":"2024-04-26T10:34:15.508075+0000","last_unstale":"2024-04-26T10:34:20.037538+0000","last_undegraded":"2024-04-26T10:34:20.037538+0000","last_fullsized":"2024-04-26T10:34:20.037538+0000","mapping_epoch":42,"log_start":"29'5172","ondisk_log_start":"29'5172","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3533,"log_dups_size":1442,"ondisk_log_size":3533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:13.011834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532545560,"num_objects":8127,"num_object_clones":0,"num_object_copies":16254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8127,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8705,"num_write_kb":538561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553922+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:34:17.553922+0000","last_peered":"2024-04-26T10:34:17.553922+0000","last_clean":"2024-04-26T10:34:17.553922+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:34:17.553922+0000","last_undegraded":"2024-04-26T10:34:17.553922+0000","last_fullsized":"2024-04-26T10:34:17.553922+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425846+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:34:17.425846+0000","last_peered":"2024-04-26T10:34:17.425846+0000","last_clean":"2024-04-26T10:34:17.425846+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:34:17.425846+0000","last_undegraded":"2024-04-26T10:34:17.425846+0000","last_fullsized":"2024-04-26T10:34:17.425846+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"46'8671","reported_seq":8709,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.063298+0000","last_change":"2024-04-26T10:33:16.349242+0000","last_active":"2024-04-26T10:34:20.063298+0000","last_peered":"2024-04-26T10:34:20.063298+0000","last_clean":"2024-04-26T10:34:20.063298+0000","last_became_active":"2024-04-26T10:33:16.349063+0000","last_became_peered":"2024-04-26T10:33:16.349063+0000","last_unstale":"2024-04-26T10:34:20.063298+0000","last_undegraded":"2024-04-26T10:34:20.063298+0000","last_fullsized":"2024-04-26T10:34:20.063298+0000","mapping_epoch":16,"log_start":"28'5162","ondisk_log_start":"28'5162","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3509,"log_dups_size":1442,"ondisk_log_size":3509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:09.297624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531300352,"num_objects":8107,"num_object_clones":0,"num_object_copies":16214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8671,"num_write_kb":536896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425704+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:34:17.425704+0000","last_peered":"2024-04-26T10:34:17.425704+0000","last_clean":"2024-04-26T10:34:17.425704+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:34:17.425704+0000","last_undegraded":"2024-04-26T10:34:17.425704+0000","last_fullsized":"2024-04-26T10:34:17.425704+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426234+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:34:17.426234+0000","last_peered":"2024-04-26T10:34:17.426234+0000","last_clean":"2024-04-26T10:34:17.426234+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:34:17.426234+0000","last_undegraded":"2024-04-26T10:34:17.426234+0000","last_fullsized":"2024-04-26T10:34:17.426234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"46'8453","reported_seq":8509,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.044203+0000","last_change":"2024-04-26T10:34:14.549556+0000","last_active":"2024-04-26T10:34:20.044203+0000","last_peered":"2024-04-26T10:34:20.044203+0000","last_clean":"2024-04-26T10:34:20.044203+0000","last_became_active":"2024-04-26T10:34:14.520855+0000","last_became_peered":"2024-04-26T10:34:14.520855+0000","last_unstale":"2024-04-26T10:34:20.044203+0000","last_undegraded":"2024-04-26T10:34:20.044203+0000","last_fullsized":"2024-04-26T10:34:20.044203+0000","mapping_epoch":41,"log_start":"28'5005","ondisk_log_start":"28'5005","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3448,"log_dups_size":1442,"ondisk_log_size":3448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:48.789996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519241728,"num_objects":7923,"num_object_clones":0,"num_object_copies":15846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7923,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8453,"num_write_kb":524032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425705+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:34:17.425705+0000","last_peered":"2024-04-26T10:34:17.425705+0000","last_clean":"2024-04-26T10:34:17.425705+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:34:17.425705+0000","last_undegraded":"2024-04-26T10:34:17.425705+0000","last_fullsized":"2024-04-26T10:34:17.425705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426427+0000","last_change":"2024-04-26T10:34:14.509460+0000","last_active":"2024-04-26T10:34:17.426427+0000","last_peered":"2024-04-26T10:34:17.426427+0000","last_clean":"2024-04-26T10:34:17.426427+0000","last_became_active":"2024-04-26T10:34:14.509213+0000","last_became_peered":"2024-04-26T10:34:14.509213+0000","last_unstale":"2024-04-26T10:34:17.426427+0000","last_undegraded":"2024-04-26T10:34:17.426427+0000","last_fullsized":"2024-04-26T10:34:17.426427+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:15.816526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"46'8617","reported_seq":8655,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.041649+0000","last_change":"2024-04-26T10:33:16.344866+0000","last_active":"2024-04-26T10:34:20.041649+0000","last_peered":"2024-04-26T10:34:20.041649+0000","last_clean":"2024-04-26T10:34:20.041649+0000","last_became_active":"2024-04-26T10:33:16.344614+0000","last_became_peered":"2024-04-26T10:33:16.344614+0000","last_unstale":"2024-04-26T10:34:20.041649+0000","last_undegraded":"2024-04-26T10:34:20.041649+0000","last_fullsized":"2024-04-26T10:34:20.041649+0000","mapping_epoch":16,"log_start":"27'4654","ondisk_log_start":"27'4654","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3963,"log_dups_size":0,"ondisk_log_size":3963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531955712,"num_objects":8117,"num_object_clones":0,"num_object_copies":16234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8617,"num_write_kb":535488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425573+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:34:17.425573+0000","last_peered":"2024-04-26T10:34:17.425573+0000","last_clean":"2024-04-26T10:34:17.425573+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:34:17.425573+0000","last_undegraded":"2024-04-26T10:34:17.425573+0000","last_fullsized":"2024-04-26T10:34:17.425573+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:35.111495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554287+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:34:17.554287+0000","last_peered":"2024-04-26T10:34:17.554287+0000","last_clean":"2024-04-26T10:34:17.554287+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:34:17.554287+0000","last_undegraded":"2024-04-26T10:34:17.554287+0000","last_fullsized":"2024-04-26T10:34:17.554287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"46'8653","reported_seq":8690,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.069823+0000","last_change":"2024-04-26T10:33:16.349280+0000","last_active":"2024-04-26T10:34:20.069823+0000","last_peered":"2024-04-26T10:34:20.069823+0000","last_clean":"2024-04-26T10:34:20.069823+0000","last_became_active":"2024-04-26T10:33:16.349010+0000","last_became_peered":"2024-04-26T10:33:16.349010+0000","last_unstale":"2024-04-26T10:34:20.069823+0000","last_undegraded":"2024-04-26T10:34:20.069823+0000","last_fullsized":"2024-04-26T10:34:20.069823+0000","mapping_epoch":16,"log_start":"28'5171","ondisk_log_start":"28'5171","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3482,"log_dups_size":1442,"ondisk_log_size":3482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:08.933996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525402112,"num_objects":8017,"num_object_clones":0,"num_object_copies":16034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8017,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8653,"num_write_kb":533440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554060+0000","last_change":"2024-04-26T10:34:14.511174+0000","last_active":"2024-04-26T10:34:17.554060+0000","last_peered":"2024-04-26T10:34:17.554060+0000","last_clean":"2024-04-26T10:34:17.554060+0000","last_became_active":"2024-04-26T10:34:14.510907+0000","last_became_peered":"2024-04-26T10:34:14.510907+0000","last_unstale":"2024-04-26T10:34:17.554060+0000","last_undegraded":"2024-04-26T10:34:17.554060+0000","last_fullsized":"2024-04-26T10:34:17.554060+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:34.574586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426341+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:34:17.426341+0000","last_peered":"2024-04-26T10:34:17.426341+0000","last_clean":"2024-04-26T10:34:17.426341+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:34:17.426341+0000","last_undegraded":"2024-04-26T10:34:17.426341+0000","last_fullsized":"2024-04-26T10:34:17.426341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425733+0000","last_change":"2024-04-26T10:34:14.506552+0000","last_active":"2024-04-26T10:34:17.425733+0000","last_peered":"2024-04-26T10:34:17.425733+0000","last_clean":"2024-04-26T10:34:17.425733+0000","last_became_active":"2024-04-26T10:34:14.506008+0000","last_became_peered":"2024-04-26T10:34:14.506008+0000","last_unstale":"2024-04-26T10:34:17.425733+0000","last_undegraded":"2024-04-26T10:34:17.425733+0000","last_fullsized":"2024-04-26T10:34:17.425733+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.031036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"46'8608","reported_seq":8646,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.061691+0000","last_change":"2024-04-26T10:33:16.349302+0000","last_active":"2024-04-26T10:34:20.061691+0000","last_peered":"2024-04-26T10:34:20.061691+0000","last_clean":"2024-04-26T10:34:20.061691+0000","last_became_active":"2024-04-26T10:33:16.348992+0000","last_became_peered":"2024-04-26T10:33:16.348992+0000","last_unstale":"2024-04-26T10:34:20.061691+0000","last_undegraded":"2024-04-26T10:34:20.061691+0000","last_fullsized":"2024-04-26T10:34:20.061691+0000","mapping_epoch":16,"log_start":"29'5157","ondisk_log_start":"29'5157","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3451,"log_dups_size":1442,"ondisk_log_size":3451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:15.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529793024,"num_objects":8084,"num_object_clones":0,"num_object_copies":16168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8084,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8608,"num_write_kb":534144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426228+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:34:17.426228+0000","last_peered":"2024-04-26T10:34:17.426228+0000","last_clean":"2024-04-26T10:34:17.426228+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:34:17.426228+0000","last_undegraded":"2024-04-26T10:34:17.426228+0000","last_fullsized":"2024-04-26T10:34:17.426228+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426429+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:34:17.426429+0000","last_peered":"2024-04-26T10:34:17.426429+0000","last_clean":"2024-04-26T10:34:17.426429+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:34:17.426429+0000","last_undegraded":"2024-04-26T10:34:17.426429+0000","last_fullsized":"2024-04-26T10:34:17.426429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553982+0000","last_change":"2024-04-26T10:34:14.513348+0000","last_active":"2024-04-26T10:34:17.553982+0000","last_peered":"2024-04-26T10:34:17.553982+0000","last_clean":"2024-04-26T10:34:17.553982+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:34:17.553982+0000","last_undegraded":"2024-04-26T10:34:17.553982+0000","last_fullsized":"2024-04-26T10:34:17.553982+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:21.161769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"46'8706","reported_seq":8744,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.065199+0000","last_change":"2024-04-26T10:33:16.349181+0000","last_active":"2024-04-26T10:34:20.065199+0000","last_peered":"2024-04-26T10:34:20.065199+0000","last_clean":"2024-04-26T10:34:20.065199+0000","last_became_active":"2024-04-26T10:33:16.348981+0000","last_became_peered":"2024-04-26T10:33:16.348981+0000","last_unstale":"2024-04-26T10:34:20.065199+0000","last_undegraded":"2024-04-26T10:34:20.065199+0000","last_fullsized":"2024-04-26T10:34:20.065199+0000","mapping_epoch":16,"log_start":"29'5184","ondisk_log_start":"29'5184","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3522,"log_dups_size":1442,"ondisk_log_size":3522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533987328,"num_objects":8148,"num_object_clones":0,"num_object_copies":16296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8706,"num_write_kb":539328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553485+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:34:17.553485+0000","last_peered":"2024-04-26T10:34:17.553485+0000","last_clean":"2024-04-26T10:34:17.553485+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:34:17.553485+0000","last_undegraded":"2024-04-26T10:34:17.553485+0000","last_fullsized":"2024-04-26T10:34:17.553485+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425825+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:34:17.425825+0000","last_peered":"2024-04-26T10:34:17.425825+0000","last_clean":"2024-04-26T10:34:17.425825+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:34:17.425825+0000","last_undegraded":"2024-04-26T10:34:17.425825+0000","last_fullsized":"2024-04-26T10:34:17.425825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554370+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:34:17.554370+0000","last_peered":"2024-04-26T10:34:17.554370+0000","last_clean":"2024-04-26T10:34:17.554370+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:34:17.554370+0000","last_undegraded":"2024-04-26T10:34:17.554370+0000","last_fullsized":"2024-04-26T10:34:17.554370+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:57.803542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"46'8730","reported_seq":8779,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.046340+0000","last_change":"2024-04-26T10:34:15.513418+0000","last_active":"2024-04-26T10:34:20.046340+0000","last_peered":"2024-04-26T10:34:20.046340+0000","last_clean":"2024-04-26T10:34:20.046340+0000","last_became_active":"2024-04-26T10:34:15.508062+0000","last_became_peered":"2024-04-26T10:34:15.508062+0000","last_unstale":"2024-04-26T10:34:20.046340+0000","last_undegraded":"2024-04-26T10:34:20.046340+0000","last_fullsized":"2024-04-26T10:34:20.046340+0000","mapping_epoch":42,"log_start":"29'5257","ondisk_log_start":"29'5257","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3473,"log_dups_size":1542,"ondisk_log_size":3473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:12.573855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533200896,"num_objects":8136,"num_object_clones":0,"num_object_copies":16272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8730,"num_write_kb":539712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426378+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:34:17.426378+0000","last_peered":"2024-04-26T10:34:17.426378+0000","last_clean":"2024-04-26T10:34:17.426378+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:34:17.426378+0000","last_undegraded":"2024-04-26T10:34:17.426378+0000","last_fullsized":"2024-04-26T10:34:17.426378+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":283,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.428075+0000","last_change":"2024-04-26T10:34:17.427146+0000","last_active":"2024-04-26T10:34:17.428075+0000","last_peered":"2024-04-26T10:34:17.428075+0000","last_clean":"2024-04-26T10:34:17.428075+0000","last_became_active":"2024-04-26T10:34:17.426852+0000","last_became_peered":"2024-04-26T10:34:17.426852+0000","last_unstale":"2024-04-26T10:34:17.428075+0000","last_undegraded":"2024-04-26T10:34:17.428075+0000","last_fullsized":"2024-04-26T10:34:17.428075+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:50.963578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553586+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:34:17.553586+0000","last_peered":"2024-04-26T10:34:17.553586+0000","last_clean":"2024-04-26T10:34:17.553586+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:34:17.553586+0000","last_undegraded":"2024-04-26T10:34:17.553586+0000","last_fullsized":"2024-04-26T10:34:17.553586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426154+0000","last_change":"2024-04-26T10:34:14.509642+0000","last_active":"2024-04-26T10:34:17.426154+0000","last_peered":"2024-04-26T10:34:17.426154+0000","last_clean":"2024-04-26T10:34:17.426154+0000","last_became_active":"2024-04-26T10:34:14.509329+0000","last_became_peered":"2024-04-26T10:34:14.509329+0000","last_unstale":"2024-04-26T10:34:17.426154+0000","last_undegraded":"2024-04-26T10:34:17.426154+0000","last_fullsized":"2024-04-26T10:34:17.426154+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:20.861292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"46'8598","reported_seq":8636,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.042036+0000","last_change":"2024-04-26T10:33:16.344693+0000","last_active":"2024-04-26T10:34:20.042036+0000","last_peered":"2024-04-26T10:34:20.042036+0000","last_clean":"2024-04-26T10:34:20.042036+0000","last_became_active":"2024-04-26T10:33:16.344478+0000","last_became_peered":"2024-04-26T10:33:16.344478+0000","last_unstale":"2024-04-26T10:34:20.042036+0000","last_undegraded":"2024-04-26T10:34:20.042036+0000","last_fullsized":"2024-04-26T10:34:20.042036+0000","mapping_epoch":16,"log_start":"29'5133","ondisk_log_start":"29'5133","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3465,"log_dups_size":1442,"ondisk_log_size":3465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:24.298876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529399808,"num_objects":8078,"num_object_clones":0,"num_object_copies":16156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8598,"num_write_kb":533632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425399+0000","last_change":"2024-04-26T10:34:14.509367+0000","last_active":"2024-04-26T10:34:17.425399+0000","last_peered":"2024-04-26T10:34:17.425399+0000","last_clean":"2024-04-26T10:34:17.425399+0000","last_became_active":"2024-04-26T10:34:14.508465+0000","last_became_peered":"2024-04-26T10:34:14.508465+0000","last_unstale":"2024-04-26T10:34:17.425399+0000","last_undegraded":"2024-04-26T10:34:17.425399+0000","last_fullsized":"2024-04-26T10:34:17.425399+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:31.790156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553400+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:34:17.553400+0000","last_peered":"2024-04-26T10:34:17.553400+0000","last_clean":"2024-04-26T10:34:17.553400+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:34:17.553400+0000","last_undegraded":"2024-04-26T10:34:17.553400+0000","last_fullsized":"2024-04-26T10:34:17.553400+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426535+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:34:17.426535+0000","last_peered":"2024-04-26T10:34:17.426535+0000","last_clean":"2024-04-26T10:34:17.426535+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:34:17.426535+0000","last_undegraded":"2024-04-26T10:34:17.426535+0000","last_fullsized":"2024-04-26T10:34:17.426535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"46'8776","reported_seq":8814,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.030704+0000","last_change":"2024-04-26T10:33:16.344694+0000","last_active":"2024-04-26T10:34:20.030704+0000","last_peered":"2024-04-26T10:34:20.030704+0000","last_clean":"2024-04-26T10:34:20.030704+0000","last_became_active":"2024-04-26T10:33:16.344461+0000","last_became_peered":"2024-04-26T10:33:16.344461+0000","last_unstale":"2024-04-26T10:34:20.030704+0000","last_undegraded":"2024-04-26T10:34:20.030704+0000","last_fullsized":"2024-04-26T10:34:20.030704+0000","mapping_epoch":16,"log_start":"29'5284","ondisk_log_start":"29'5284","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3492,"log_dups_size":1442,"ondisk_log_size":3492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:29.374096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537526272,"num_objects":8202,"num_object_clones":0,"num_object_copies":16404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8776,"num_write_kb":543296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425991+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:34:17.425991+0000","last_peered":"2024-04-26T10:34:17.425991+0000","last_clean":"2024-04-26T10:34:17.425991+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:34:17.425991+0000","last_undegraded":"2024-04-26T10:34:17.425991+0000","last_fullsized":"2024-04-26T10:34:17.425991+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":58,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554178+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:34:17.554178+0000","last_peered":"2024-04-26T10:34:17.554178+0000","last_clean":"2024-04-26T10:34:17.554178+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:34:17.554178+0000","last_undegraded":"2024-04-26T10:34:17.554178+0000","last_fullsized":"2024-04-26T10:34:17.554178+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:21.048381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426081+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:34:17.426081+0000","last_peered":"2024-04-26T10:34:17.426081+0000","last_clean":"2024-04-26T10:34:17.426081+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:34:17.426081+0000","last_undegraded":"2024-04-26T10:34:17.426081+0000","last_fullsized":"2024-04-26T10:34:17.426081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"46'8747","reported_seq":8785,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.034905+0000","last_change":"2024-04-26T10:33:16.344714+0000","last_active":"2024-04-26T10:34:20.034905+0000","last_peered":"2024-04-26T10:34:20.034905+0000","last_clean":"2024-04-26T10:34:20.034905+0000","last_became_active":"2024-04-26T10:33:16.344500+0000","last_became_peered":"2024-04-26T10:33:16.344500+0000","last_unstale":"2024-04-26T10:34:20.034905+0000","last_undegraded":"2024-04-26T10:34:20.034905+0000","last_fullsized":"2024-04-26T10:34:20.034905+0000","mapping_epoch":16,"log_start":"29'5235","ondisk_log_start":"29'5235","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3512,"log_dups_size":1442,"ondisk_log_size":3512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:19.056484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537591808,"num_objects":8203,"num_object_clones":0,"num_object_copies":16406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8203,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8747,"num_write_kb":542400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554266+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:34:17.554266+0000","last_peered":"2024-04-26T10:34:17.554266+0000","last_clean":"2024-04-26T10:34:17.554266+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:34:17.554266+0000","last_undegraded":"2024-04-26T10:34:17.554266+0000","last_fullsized":"2024-04-26T10:34:17.554266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554605+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:34:17.554605+0000","last_peered":"2024-04-26T10:34:17.554605+0000","last_clean":"2024-04-26T10:34:17.554605+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:34:17.554605+0000","last_undegraded":"2024-04-26T10:34:17.554605+0000","last_fullsized":"2024-04-26T10:34:17.554605+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.172123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553484+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:34:17.553484+0000","last_peered":"2024-04-26T10:34:17.553484+0000","last_clean":"2024-04-26T10:34:17.553484+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:34:17.553484+0000","last_undegraded":"2024-04-26T10:34:17.553484+0000","last_fullsized":"2024-04-26T10:34:17.553484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"46'8672","reported_seq":8717,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.044933+0000","last_change":"2024-04-26T10:34:15.510428+0000","last_active":"2024-04-26T10:34:20.044933+0000","last_peered":"2024-04-26T10:34:20.044933+0000","last_clean":"2024-04-26T10:34:20.044933+0000","last_became_active":"2024-04-26T10:34:15.505392+0000","last_became_peered":"2024-04-26T10:34:15.505392+0000","last_unstale":"2024-04-26T10:34:20.044933+0000","last_undegraded":"2024-04-26T10:34:20.044933+0000","last_fullsized":"2024-04-26T10:34:20.044933+0000","mapping_epoch":42,"log_start":"28'5188","ondisk_log_start":"28'5188","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":1442,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:56.871872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528875520,"num_objects":8070,"num_object_clones":0,"num_object_copies":16140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8672,"num_write_kb":535744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426082+0000","last_change":"2024-04-26T10:34:14.512226+0000","last_active":"2024-04-26T10:34:17.426082+0000","last_peered":"2024-04-26T10:34:17.426082+0000","last_clean":"2024-04-26T10:34:17.426082+0000","last_became_active":"2024-04-26T10:34:14.511888+0000","last_became_peered":"2024-04-26T10:34:14.511888+0000","last_unstale":"2024-04-26T10:34:17.426082+0000","last_undegraded":"2024-04-26T10:34:17.426082+0000","last_fullsized":"2024-04-26T10:34:17.426082+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:58.832869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":43,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554451+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:34:17.554451+0000","last_peered":"2024-04-26T10:34:17.554451+0000","last_clean":"2024-04-26T10:34:17.554451+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:34:17.554451+0000","last_undegraded":"2024-04-26T10:34:17.554451+0000","last_fullsized":"2024-04-26T10:34:17.554451+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425533+0000","last_change":"2024-04-26T10:34:14.510158+0000","last_active":"2024-04-26T10:34:17.425533+0000","last_peered":"2024-04-26T10:34:17.425533+0000","last_clean":"2024-04-26T10:34:17.425533+0000","last_became_active":"2024-04-26T10:34:14.509584+0000","last_became_peered":"2024-04-26T10:34:14.509584+0000","last_unstale":"2024-04-26T10:34:17.425533+0000","last_undegraded":"2024-04-26T10:34:17.425533+0000","last_fullsized":"2024-04-26T10:34:17.425533+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:39.230972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426056+0000","last_change":"2024-04-26T10:34:14.508334+0000","last_active":"2024-04-26T10:34:17.426056+0000","last_peered":"2024-04-26T10:34:17.426056+0000","last_clean":"2024-04-26T10:34:17.426056+0000","last_became_active":"2024-04-26T10:34:14.507205+0000","last_became_peered":"2024-04-26T10:34:14.507205+0000","last_unstale":"2024-04-26T10:34:17.426056+0000","last_undegraded":"2024-04-26T10:34:17.426056+0000","last_fullsized":"2024-04-26T10:34:17.426056+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:20.747187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426171+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:34:17.426171+0000","last_peered":"2024-04-26T10:34:17.426171+0000","last_clean":"2024-04-26T10:34:17.426171+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:34:17.426171+0000","last_undegraded":"2024-04-26T10:34:17.426171+0000","last_fullsized":"2024-04-26T10:34:17.426171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425911+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:34:17.425911+0000","last_peered":"2024-04-26T10:34:17.425911+0000","last_clean":"2024-04-26T10:34:17.425911+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:34:17.425911+0000","last_undegraded":"2024-04-26T10:34:17.425911+0000","last_fullsized":"2024-04-26T10:34:17.425911+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426306+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:34:17.426306+0000","last_peered":"2024-04-26T10:34:17.426306+0000","last_clean":"2024-04-26T10:34:17.426306+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:34:17.426306+0000","last_undegraded":"2024-04-26T10:34:17.426306+0000","last_fullsized":"2024-04-26T10:34:17.426306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426164+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:34:17.426164+0000","last_peered":"2024-04-26T10:34:17.426164+0000","last_clean":"2024-04-26T10:34:17.426164+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:34:17.426164+0000","last_undegraded":"2024-04-26T10:34:17.426164+0000","last_fullsized":"2024-04-26T10:34:17.426164+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425880+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:34:17.425880+0000","last_peered":"2024-04-26T10:34:17.425880+0000","last_clean":"2024-04-26T10:34:17.425880+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:34:17.425880+0000","last_undegraded":"2024-04-26T10:34:17.425880+0000","last_fullsized":"2024-04-26T10:34:17.425880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":43,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554568+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:34:17.554568+0000","last_peered":"2024-04-26T10:34:17.554568+0000","last_clean":"2024-04-26T10:34:17.554568+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:34:17.554568+0000","last_undegraded":"2024-04-26T10:34:17.554568+0000","last_fullsized":"2024-04-26T10:34:17.554568+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425802+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:34:17.425802+0000","last_peered":"2024-04-26T10:34:17.425802+0000","last_clean":"2024-04-26T10:34:17.425802+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:34:17.425802+0000","last_undegraded":"2024-04-26T10:34:17.425802+0000","last_fullsized":"2024-04-26T10:34:17.425802+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":46,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554350+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:34:17.554350+0000","last_peered":"2024-04-26T10:34:17.554350+0000","last_clean":"2024-04-26T10:34:17.554350+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:34:17.554350+0000","last_undegraded":"2024-04-26T10:34:17.554350+0000","last_fullsized":"2024-04-26T10:34:17.554350+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425879+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:34:17.425879+0000","last_peered":"2024-04-26T10:34:17.425879+0000","last_clean":"2024-04-26T10:34:17.425879+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:34:17.425879+0000","last_undegraded":"2024-04-26T10:34:17.425879+0000","last_fullsized":"2024-04-26T10:34:17.425879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425482+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:34:17.425482+0000","last_peered":"2024-04-26T10:34:17.425482+0000","last_clean":"2024-04-26T10:34:17.425482+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:34:17.425482+0000","last_undegraded":"2024-04-26T10:34:17.425482+0000","last_fullsized":"2024-04-26T10:34:17.425482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553446+0000","last_change":"2024-04-26T10:34:14.513276+0000","last_active":"2024-04-26T10:34:17.553446+0000","last_peered":"2024-04-26T10:34:17.553446+0000","last_clean":"2024-04-26T10:34:17.553446+0000","last_became_active":"2024-04-26T10:34:14.512930+0000","last_became_peered":"2024-04-26T10:34:14.512930+0000","last_unstale":"2024-04-26T10:34:17.553446+0000","last_undegraded":"2024-04-26T10:34:17.553446+0000","last_fullsized":"2024-04-26T10:34:17.553446+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:37.809739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425960+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:34:17.425960+0000","last_peered":"2024-04-26T10:34:17.425960+0000","last_clean":"2024-04-26T10:34:17.425960+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:34:17.425960+0000","last_undegraded":"2024-04-26T10:34:17.425960+0000","last_fullsized":"2024-04-26T10:34:17.425960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554310+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:34:17.554310+0000","last_peered":"2024-04-26T10:34:17.554310+0000","last_clean":"2024-04-26T10:34:17.554310+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:34:17.554310+0000","last_undegraded":"2024-04-26T10:34:17.554310+0000","last_fullsized":"2024-04-26T10:34:17.554310+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.021846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425961+0000","last_change":"2024-04-26T10:34:14.507476+0000","last_active":"2024-04-26T10:34:17.425961+0000","last_peered":"2024-04-26T10:34:17.425961+0000","last_clean":"2024-04-26T10:34:17.425961+0000","last_became_active":"2024-04-26T10:34:14.507171+0000","last_became_peered":"2024-04-26T10:34:14.507171+0000","last_unstale":"2024-04-26T10:34:17.425961+0000","last_undegraded":"2024-04-26T10:34:17.425961+0000","last_fullsized":"2024-04-26T10:34:17.425961+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:32.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8525053976,"num_objects":130083,"num_object_clones":0,"num_object_copies":260166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130083,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":139197,"num_write_kb":8616897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3174,"num_bytes_recovered":208011264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17047429120,"data_stored":17047420976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56722,"ondisk_log_size":56722,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738390,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7029188,"kb_used_data":6781308,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":87342652,"statfs":{"total":96636764160,"available":89438875648,"internally_reserved":0,"allocated":6944059392,"data_stored":6943732497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":253622726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.432}]}]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5451368,"kb_used_data":5279772,"kb_used_omap":1,"kb_used_meta":171390,"kb_avail":88920472,"statfs":{"total":96636764160,"available":91054563328,"internally_reserved":0,"allocated":5406486528,"data_stored":5406129179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":175503814},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.187},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.20999999999999999}]},{"osd":2,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":1.117},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.67400000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738389,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4878752,"kb_used_data":4743444,"kb_used_omap":1,"kb_used_meta":135294,"kb_avail":89493088,"statfs":{"total":96636764160,"available":91640922112,"internally_reserved":0,"allocated":4857286656,"data_stored":4856936883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138541510},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.438},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.46999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5312024576,"data_stored":5312020504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4799533056,"data_stored":4799528984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6935871488,"data_stored":6935871488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:34:23.789 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T10:34:23.789 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:34:23.789 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-26T10:34:23.789 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T10:34:23.831 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:23.851 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:23.849+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:23.916 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:23.916 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:23.931 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:23.951 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:23.950+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:24.025 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:24.046 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:24.052 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:24.050+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:24.072 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:24.073 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:24.073 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:24.073 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:24.126 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:24.126 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:24.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.126 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:151047 5.4 e47/42 5:2b645034:::benchmark_data_smithi043_45180_object16405:head v 47'9429, mlcod=47'9427)", 2024-04-26T10:34:24.126 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:24.119947+0000", 2024-04-26T10:34:24.126 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0013047950000000001, 2024-04-26T10:34:24.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001323336, 2024-04-26T10:34:24.126 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.127 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:24.127 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119947+0000", 2024-04-26T10:34:24.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119947+0000", 2024-04-26T10:34:24.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119946+0000", 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119951+0000", 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6020000000000002e-06 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119956+0000", 2024-04-26T10:34:24.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3879999999999999e-06 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119962+0000", 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9000000000000003e-06 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119993+0000", 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1084999999999998e-05 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.120011+0000", 2024-04-26T10:34:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7689e-05 2024-04-26T10:34:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:151050 5.0 e47/42 5:0ae367ae:::benchmark_data_smithi043_45180_object16408:head v 47'9413, mlcod=47'9410)", 2024-04-26T10:34:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:24.119971+0000", 2024-04-26T10:34:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0012807630000000001, 2024-04-26T10:34:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013493610000000001, 2024-04-26T10:34:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:24.130 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119971+0000", 2024-04-26T10:34:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119971+0000", 2024-04-26T10:34:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119970+0000", 2024-04-26T10:34:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119974+0000", 2024-04-26T10:34:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.478e-06 2024-04-26T10:34:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119981+0000", 2024-04-26T10:34:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9609999999999999e-06 2024-04-26T10:34:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119985+0000", 2024-04-26T10:34:24.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6199999999999998e-06 2024-04-26T10:34:24.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.120023+0000", 2024-04-26T10:34:24.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7561000000000002e-05 2024-04-26T10:34:24.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.120035+0000", 2024-04-26T10:34:24.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2557e-05 2024-04-26T10:34:24.134 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.134 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.134 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.134 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:151048 5.2 e47/16 5:4959552b:::benchmark_data_smithi043_45180_object16406:head v 47'9546, mlcod=47'9542)", 2024-04-26T10:34:24.134 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:24.120754+0000", 2024-04-26T10:34:24.134 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00049751699999999995, 2024-04-26T10:34:24.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00061299599999999998, 2024-04-26T10:34:24.134 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.134 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:24.134 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.120754+0000", 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.120754+0000", 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.120753+0000", 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.120761+0000", 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.191e-06 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.120773+0000", 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1299e-05 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.120779+0000", 2024-04-26T10:34:24.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.618e-06 2024-04-26T10:34:24.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.120812+0000", 2024-04-26T10:34:24.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.243e-05 2024-04-26T10:34:24.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.120828+0000", 2024-04-26T10:34:24.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6699000000000001e-05 2024-04-26T10:34:24.137 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.138 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.138 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.138 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:151055 5.c 5:3721eb48:::benchmark_data_smithi043_45180_object16413:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:34:24.138 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:24.121012+0000", 2024-04-26T10:34:24.138 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00023889700000000001, 2024-04-26T10:34:24.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00039724200000000002, 2024-04-26T10:34:24.138 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.138 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:24.138 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.138 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.138 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.139 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 151055 2024-04-26T10:34:24.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.139 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.121012+0000", 2024-04-26T10:34:24.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.121012+0000", 2024-04-26T10:34:24.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.121011+0000", 2024-04-26T10:34:24.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:24.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.121017+0000", 2024-04-26T10:34:24.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9859999999999999e-06 2024-04-26T10:34:24.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.121027+0000", 2024-04-26T10:34:24.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0258000000000001e-05 2024-04-26T10:34:24.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.121035+0000", 2024-04-26T10:34:24.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.515e-06 2024-04-26T10:34:24.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.121079+0000", 2024-04-26T10:34:24.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3667000000000001e-05 2024-04-26T10:34:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.121213+0000", 2024-04-26T10:34:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013395799999999999 2024-04-26T10:34:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.121295+0000", 2024-04-26T10:34:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2280000000000005e-05 2024-04-26T10:34:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:151033 5.c 5:3ed6464f:::benchmark_data_smithi043_45180_object16391:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:24.112377+0000", 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0088745660000000004, 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0090780789999999993, 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 151033 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.112377+0000", 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.112377+0000", 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.112376+0000", 2024-04-26T10:34:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.112379+0000", 2024-04-26T10:34:24.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3410000000000001e-06 2024-04-26T10:34:24.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.112384+0000", 2024-04-26T10:34:24.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5720000000000002e-06 2024-04-26T10:34:24.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.112389+0000", 2024-04-26T10:34:24.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8250000000000004e-06 2024-04-26T10:34:24.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.115794+0000", 2024-04-26T10:34:24.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0034052710000000001 2024-04-26T10:34:24.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.115905+0000", 2024-04-26T10:34:24.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011107000000000001 2024-04-26T10:34:24.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.116020+0000", 2024-04-26T10:34:24.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114413 2024-04-26T10:34:24.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119241+0000", 2024-04-26T10:34:24.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003221509 2024-04-26T10:34:24.147 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.147 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:151039 5.c 5:3494220a:::benchmark_data_smithi043_45180_object16397:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:24.116171+0000", 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0050800250000000002, 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0053271569999999999, 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 151039 2024-04-26T10:34:24.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.116171+0000", 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.116171+0000", 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.116170+0000", 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.116175+0000", 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8210000000000001e-06 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.116185+0000", 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0000000000000001e-05 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.116192+0000", 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1910000000000003e-06 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.117592+0000", 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001400098 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.117706+0000", 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000113915 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.117807+0000", 2024-04-26T10:34:24.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000100572 2024-04-26T10:34:24.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:24.119431+0000", 2024-04-26T10:34:24.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016238159999999999 2024-04-26T10:34:24.152 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.152 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.152 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.152 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.152 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:34:24.152 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 6 2024-04-26T10:34:24.153 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:24.154 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:24.155 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:24.153+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:24.180 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:24.180 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-26T10:34:24.180 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 47, 2024-04-26T10:34:24.180 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "6d35b773-83ef-4e54-be62-89cec0b09327", 2024-04-26T10:34:24.180 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-04-26T10:32:36.651799+0000", 2024-04-26T10:34:24.180 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-04-26T10:34:21.515101+0000", 2024-04-26T10:34:24.180 INFO:teuthology.orchestra.run.smithi043.stdout: "last_up_change": "2024-04-26T10:32:44.545583+0000", 2024-04-26T10:34:24.180 INFO:teuthology.orchestra.run.smithi043.stdout: "last_in_change": "2024-04-26T10:32:37.588200+0000", 2024-04-26T10:34:24.180 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T10:34:24.180 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_num": 5804032, 2024-04-26T10:34:24.180 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_set": [ 2024-04-26T10:34:24.181 INFO:teuthology.orchestra.run.smithi043.stdout: "nodeep-scrub", 2024-04-26T10:34:24.181 INFO:teuthology.orchestra.run.smithi043.stdout: "pglog_hardlimit", 2024-04-26T10:34:24.181 INFO:teuthology.orchestra.run.smithi043.stdout: "purged_snapdirs", 2024-04-26T10:34:24.181 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_deletes", 2024-04-26T10:34:24.181 INFO:teuthology.orchestra.run.smithi043.stdout: "sortbitwise" 2024-04-26T10:34:24.181 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:24.181 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_version": 4, 2024-04-26T10:34:24.181 INFO:teuthology.orchestra.run.smithi043.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T10:34:24.181 INFO:teuthology.orchestra.run.smithi043.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T10:34:24.181 INFO:teuthology.orchestra.run.smithi043.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T10:34:24.181 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_snapshot": "", 2024-04-26T10:34:24.181 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_max": 5, 2024-04-26T10:34:24.182 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd": 3, 2024-04-26T10:34:24.182 INFO:teuthology.orchestra.run.smithi043.stdout: "require_min_compat_client": "luminous", 2024-04-26T10:34:24.182 INFO:teuthology.orchestra.run.smithi043.stdout: "min_compat_client": "jewel", 2024-04-26T10:34:24.182 INFO:teuthology.orchestra.run.smithi043.stdout: "require_osd_release": "reef", 2024-04-26T10:34:24.182 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_crimson": false, 2024-04-26T10:34:24.182 INFO:teuthology.orchestra.run.smithi043.stdout: "pools": [ 2024-04-26T10:34:24.182 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.182 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 1, 2024-04-26T10:34:24.182 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": ".mgr", 2024-04-26T10:34:24.182 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.037545+0000", 2024-04-26T10:34:24.182 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:24.183 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:24.183 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:24.183 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:24.183 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:24.183 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:24.183 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:24.183 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:24.183 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:24.183 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:24.183 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:24.183 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:24.183 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 1, 2024-04-26T10:34:24.183 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 1, 2024-04-26T10:34:24.184 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 1, 2024-04-26T10:34:24.184 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 1, 2024-04-26T10:34:24.184 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 1, 2024-04-26T10:34:24.184 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:24.184 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:24.184 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:24.184 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:24.184 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:24.184 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:24.184 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:24.184 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.185 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:34:24.185 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:24.185 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:24.185 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:24.185 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:24.185 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:24.185 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:24.185 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:24.185 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:24.185 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:24.185 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:24.185 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:24.185 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:24.186 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:24.186 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:24.186 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:24.186 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:24.186 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:24.186 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:24.186 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:24.186 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:24.186 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:24.186 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:24.186 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:24.186 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:24.187 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:24.187 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:24.187 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.187 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:24.187 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:24.187 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:24.187 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:24.187 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:24.187 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:24.187 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:24.188 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:24.188 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:24.188 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:24.188 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:24.188 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:34:24.188 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_max": 32, 2024-04-26T10:34:24.188 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 1 2024-04-26T10:34:24.188 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.188 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": {} 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 2.9900000095367432, 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 2.9900000095367432, 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 2, 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 2, 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.189 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.190 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 2, 2024-04-26T10:34:24.190 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "rbd", 2024-04-26T10:34:24.190 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.393201+0000", 2024-04-26T10:34:24.190 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:24.190 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:24.190 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:24.190 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:24.190 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:24.190 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:24.190 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:24.190 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:24.191 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:24.191 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:24.191 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:24.191 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:24.191 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 8, 2024-04-26T10:34:24.191 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 8, 2024-04-26T10:34:24.191 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 8, 2024-04-26T10:34:24.191 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 8, 2024-04-26T10:34:24.191 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 8, 2024-04-26T10:34:24.191 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:24.191 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:24.191 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:24.191 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:24.192 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:24.192 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:24.192 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:24.192 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.192 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:34:24.192 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:24.192 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:24.192 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:24.192 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:24.192 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:24.192 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:24.192 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:24.193 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:24.193 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:24.193 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:24.193 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:24.193 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:24.193 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:24.193 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:24.193 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:24.193 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:24.193 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:24.193 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:24.193 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:24.194 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:24.194 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:24.194 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:24.194 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:24.194 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:24.194 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:24.194 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:24.194 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.194 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:24.194 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:24.194 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd": {} 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.5, 2024-04-26T10:34:24.195 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.5, 2024-04-26T10:34:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:34:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.5, 2024-04-26T10:34:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.5, 2024-04-26T10:34:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 3, 2024-04-26T10:34:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_metadata", 2024-04-26T10:34:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:49.859710+0000", 2024-04-26T10:34:24.196 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 32, 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 32, 2024-04-26T10:34:24.197 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 32, 2024-04-26T10:34:24.198 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 32, 2024-04-26T10:34:24.198 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 32, 2024-04-26T10:34:24.198 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:24.198 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:24.198 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:24.198 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:24.198 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:24.198 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:24.198 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:24.198 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.198 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "14", 2024-04-26T10:34:24.198 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:24.199 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:24.199 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:24.199 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:24.199 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:24.199 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:24.199 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:24.199 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:24.199 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:24.199 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:24.199 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:24.199 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:24.199 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:24.200 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:24.200 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:24.200 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:24.200 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:24.200 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:24.200 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:24.200 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:24.200 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:24.200 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:24.200 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:24.200 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:24.200 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:24.200 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:34:24.201 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_bias": 4, 2024-04-26T10:34:24.202 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 16, 2024-04-26T10:34:24.202 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_priority": 5 2024-04-26T10:34:24.202 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.202 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:24.202 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:34:24.202 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": "cephfs" 2024-04-26T10:34:24.202 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.202 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.202 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:24.202 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 4, 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_data", 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:50.968196+0000", 2024-04-26T10:34:24.203 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 64, 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 64, 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 64, 2024-04-26T10:34:24.204 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 64, 2024-04-26T10:34:24.205 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 64, 2024-04-26T10:34:24.205 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:24.205 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:24.205 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:24.205 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:24.205 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:24.205 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:24.205 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:24.205 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.205 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "15", 2024-04-26T10:34:24.205 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:24.205 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:24.206 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:24.206 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:24.206 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:24.206 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:24.206 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:24.206 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:24.206 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:24.206 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:24.206 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:24.206 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:24.206 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:24.206 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:24.206 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:24.207 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:24.207 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:24.207 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:24.207 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:24.207 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:24.207 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:24.207 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:24.207 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:24.207 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:24.207 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:24.207 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:24.207 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.207 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:24.208 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:24.208 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:24.208 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:24.208 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:24.208 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:24.208 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:24.208 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:24.208 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:24.208 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:24.208 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:24.208 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:34:24.208 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 64, 2024-04-26T10:34:24.208 INFO:teuthology.orchestra.run.smithi043.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T10:34:24.209 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.209 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:24.209 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:34:24.209 INFO:teuthology.orchestra.run.smithi043.stdout: "data": "cephfs" 2024-04-26T10:34:24.209 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.209 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.209 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:24.209 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:34:24.209 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:34:24.209 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:34:24.209 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:34:24.209 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:34:24.210 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:24.210 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:24.210 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:24.210 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.210 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.210 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.210 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 5, 2024-04-26T10:34:24.210 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "unique_pool_0", 2024-04-26T10:34:24.210 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:33:15.284422+0000", 2024-04-26T10:34:24.210 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:24.210 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 16, 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 16, 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 16, 2024-04-26T10:34:24.211 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 16, 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 16, 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "18", 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:24.212 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:24.213 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:24.213 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:24.213 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:24.213 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:24.213 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:24.213 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:24.213 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:24.213 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:24.213 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:24.213 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:24.213 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:24.213 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:24.214 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:24.214 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:24.214 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:24.214 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:24.214 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:24.214 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:24.214 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:24.214 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:24.214 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:24.214 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.214 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:24.214 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:24.214 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "rados": {} 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:34:24.215 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "32399f03-8160-43f7-a69f-1db73f105676", 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:34:24.216 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:34:24.217 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:34:24.217 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:34:24.217 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:34:24.217 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:34:24.217 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:34:24.217 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 44, 2024-04-26T10:34:24.217 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:34:24.217 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:34:24.217 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:34:24.217 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:24.217 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.217 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:24.217 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6800", 2024-04-26T10:34:24.218 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:24.218 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.218 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.218 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:24.218 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6801", 2024-04-26T10:34:24.218 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:24.218 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.218 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.218 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.218 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:34:24.218 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:24.218 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.218 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6802", 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6803", 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.219 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:24.220 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6806", 2024-04-26T10:34:24.220 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:24.220 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.220 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.220 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:24.220 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6807", 2024-04-26T10:34:24.220 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:24.220 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.220 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.220 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.220 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:34:24.221 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:24.221 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.221 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:24.222 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6804", 2024-04-26T10:34:24.222 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:24.222 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.222 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.222 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:24.222 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6805", 2024-04-26T10:34:24.222 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:24.222 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.222 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.222 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.222 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.112:6801/41771", 2024-04-26T10:34:24.222 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.112:6803/41771", 2024-04-26T10:34:24.222 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.112:6807/41771", 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.112:6805/41771", 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "89e46a83-bfff-458f-bbac-258edb6ddad2", 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:34:24.223 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 42, 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6800", 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:24.224 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6801", 2024-04-26T10:34:24.225 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:24.225 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.225 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.225 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.225 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:34:24.225 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:24.225 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.225 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:24.225 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6802", 2024-04-26T10:34:24.225 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:24.225 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.226 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.226 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:24.226 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6803", 2024-04-26T10:34:24.226 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:24.226 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.227 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.227 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.227 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:34:24.227 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:24.227 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.227 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:24.227 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6806", 2024-04-26T10:34:24.227 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:24.227 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.227 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.227 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6807", 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6804", 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.228 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:24.229 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6805", 2024-04-26T10:34:24.229 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:24.229 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.229 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.229 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.229 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.186:6801/41804", 2024-04-26T10:34:24.229 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.186:6803/41804", 2024-04-26T10:34:24.229 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.186:6807/41804", 2024-04-26T10:34:24.229 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.186:6805/41804", 2024-04-26T10:34:24.229 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:34:24.229 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:34:24.229 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:34:24.230 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.230 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.230 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.230 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:34:24.230 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "24c9e06d-1386-4075-b64e-d6c1d57c57bb", 2024-04-26T10:34:24.230 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:34:24.230 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:34:24.230 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:34:24.230 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:34:24.230 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:34:24.230 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:34:24.230 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:34:24.230 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 41, 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6800", 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6801", 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:24.231 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6802", 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6803", 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.232 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6806", 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6807", 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.233 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.234 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.234 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:34:24.234 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:24.234 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.234 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:24.234 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6804", 2024-04-26T10:34:24.234 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:24.234 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.234 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.234 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:24.234 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6805", 2024-04-26T10:34:24.235 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:24.236 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.236 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.236 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.236 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.187:6801/41919", 2024-04-26T10:34:24.236 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.187:6803/41919", 2024-04-26T10:34:24.236 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.187:6807/41919", 2024-04-26T10:34:24.236 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.187:6805/41919", 2024-04-26T10:34:24.236 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:34:24.236 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:34:24.236 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:34:24.236 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:24.236 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_xinfo": [ 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.579572+0000", 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:34:24.237 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:34:24.238 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:34:24.238 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:34:24.238 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:34:24.238 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:34:24.238 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.596783+0000", 2024-04-26T10:34:24.238 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:34:24.238 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.238 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:24.238 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:34:24.238 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:34:24.238 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:34:24.238 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:34:24.238 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.632883+0000", 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap": [], 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_items": [], 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_primaries": [], 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_temp": [], 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_temp": [], 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklist": {}, 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: "range_blocklist": {}, 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profiles": { 2024-04-26T10:34:24.239 INFO:teuthology.orchestra.run.smithi043.stdout: "default": { 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-failure-domain": "osd", 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: "k": "2", 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: "m": "1", 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin": "jerasure", 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: "technique": "reed_sol_van" 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps_queue": [], 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: "new_removed_snaps": [], 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: "new_purged_snaps": [], 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_node_flags": {}, 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: "device_class_flags": {}, 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": { 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_enabled": false, 2024-04-26T10:34:24.240 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_bucket_count": 0, 2024-04-26T10:34:24.241 INFO:teuthology.orchestra.run.smithi043.stdout: "degraded_stretch_mode": 0, 2024-04-26T10:34:24.241 INFO:teuthology.orchestra.run.smithi043.stdout: "recovering_stretch_mode": 0, 2024-04-26T10:34:24.241 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_bucket": 0 2024-04-26T10:34:24.241 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:24.241 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-26T10:34:24.243 INFO:tasks.thrashosds.thrasher:j is {'epoch': 47, 'fsid': '6d35b773-83ef-4e54-be62-89cec0b09327', 'created': '2024-04-26T10:32:36.651799+0000', 'modified': '2024-04-26T10:34:21.515101+0000', 'last_up_change': '2024-04-26T10:32:44.545583+0000', 'last_in_change': '2024-04-26T10:32:37.588200+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:32:45.037545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:32:45.393201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:32:49.859710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:32:50.968196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-26T10:33:15.284422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '32399f03-8160-43f7-a69f-1db73f105676', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 44, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 41771}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 41771}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 41771}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 41771}]}, 'public_addr': '172.21.15.112:6801/41771', 'cluster_addr': '172.21.15.112:6803/41771', 'heartbeat_back_addr': '172.21.15.112:6807/41771', 'heartbeat_front_addr': '172.21.15.112:6805/41771', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '89e46a83-bfff-458f-bbac-258edb6ddad2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6800', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6801', 'nonce': 41804}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6802', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6803', 'nonce': 41804}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6806', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6807', 'nonce': 41804}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6804', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6805', 'nonce': 41804}]}, 'public_addr': '172.21.15.186:6801/41804', 'cluster_addr': '172.21.15.186:6803/41804', 'heartbeat_back_addr': '172.21.15.186:6807/41804', 'heartbeat_front_addr': '172.21.15.186:6805/41804', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '24c9e06d-1386-4075-b64e-d6c1d57c57bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 41919}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 41919}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 41919}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 41919}]}, 'public_addr': '172.21.15.187:6801/41919', 'cluster_addr': '172.21.15.187:6803/41919', 'heartbeat_back_addr': '172.21.15.187:6807/41919', 'heartbeat_front_addr': '172.21.15.187:6805/41919', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.579572+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.596783+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.632883+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T10:34:24.243 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:34:24.286 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:24.284+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:24.356 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:24.354+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:24.431 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:24.431 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:24.432 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:34:24.432 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:34:24.432 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:24.446 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:24.487 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:24.485+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:24.529 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-26T10:34:24.557 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:24.556+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:24.598 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:24.601 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:34:24.610 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-26T10:34:24.524130+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8525646706,"num_objects":130107,"num_object_clones":0,"num_object_copies":260214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130107,"num_whiteouts":0,"num_read":137,"num_read_kb":119,"num_write":139445,"num_write_kb":8620371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3200,"num_bytes_recovered":209195352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56918,"ondisk_log_size":56918,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":17359308,"kb_used_data":16804524,"kb_used_omap":4,"kb_used_meta":554363,"kb_avail":265756212,"statfs":{"total":289910292480,"available":272134361088,"internally_reserved":0,"allocated":17207832576,"data_stored":17206798559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":567668050},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2883608,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9159,"num_write_kb":294465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.100376"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426482+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:34:17.426482+0000","last_peered":"2024-04-26T10:34:17.426482+0000","last_clean":"2024-04-26T10:34:17.426482+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:34:17.426482+0000","last_undegraded":"2024-04-26T10:34:17.426482+0000","last_fullsized":"2024-04-26T10:34:17.426482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:26.964955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426483+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:34:17.426483+0000","last_peered":"2024-04-26T10:34:17.426483+0000","last_clean":"2024-04-26T10:34:17.426483+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:34:17.426483+0000","last_undegraded":"2024-04-26T10:34:17.426483+0000","last_fullsized":"2024-04-26T10:34:17.426483+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426062+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:34:17.426062+0000","last_peered":"2024-04-26T10:34:17.426062+0000","last_clean":"2024-04-26T10:34:17.426062+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:34:17.426062+0000","last_undegraded":"2024-04-26T10:34:17.426062+0000","last_fullsized":"2024-04-26T10:34:17.426062+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426013+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:34:17.426013+0000","last_peered":"2024-04-26T10:34:17.426013+0000","last_clean":"2024-04-26T10:34:17.426013+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:34:17.426013+0000","last_undegraded":"2024-04-26T10:34:17.426013+0000","last_fullsized":"2024-04-26T10:34:17.426013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425885+0000","last_change":"2024-04-26T10:34:14.507618+0000","last_active":"2024-04-26T10:34:17.425885+0000","last_peered":"2024-04-26T10:34:17.425885+0000","last_clean":"2024-04-26T10:34:17.425885+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:34:17.425885+0000","last_undegraded":"2024-04-26T10:34:17.425885+0000","last_fullsized":"2024-04-26T10:34:17.425885+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:27.721106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425625+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:34:17.425625+0000","last_peered":"2024-04-26T10:34:17.425625+0000","last_clean":"2024-04-26T10:34:17.425625+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:34:17.425625+0000","last_undegraded":"2024-04-26T10:34:17.425625+0000","last_fullsized":"2024-04-26T10:34:17.425625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425652+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:34:17.425652+0000","last_peered":"2024-04-26T10:34:17.425652+0000","last_clean":"2024-04-26T10:34:17.425652+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:34:17.425652+0000","last_undegraded":"2024-04-26T10:34:17.425652+0000","last_fullsized":"2024-04-26T10:34:17.425652+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425257+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:34:17.425257+0000","last_peered":"2024-04-26T10:34:17.425257+0000","last_clean":"2024-04-26T10:34:17.425257+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:34:17.425257+0000","last_undegraded":"2024-04-26T10:34:17.425257+0000","last_fullsized":"2024-04-26T10:34:17.425257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554186+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:34:17.554186+0000","last_peered":"2024-04-26T10:34:17.554186+0000","last_clean":"2024-04-26T10:34:17.554186+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:34:17.554186+0000","last_undegraded":"2024-04-26T10:34:17.554186+0000","last_fullsized":"2024-04-26T10:34:17.554186+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426349+0000","last_change":"2024-04-26T10:34:14.507265+0000","last_active":"2024-04-26T10:34:17.426349+0000","last_peered":"2024-04-26T10:34:17.426349+0000","last_clean":"2024-04-26T10:34:17.426349+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:34:17.426349+0000","last_undegraded":"2024-04-26T10:34:17.426349+0000","last_fullsized":"2024-04-26T10:34:17.426349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:07.268421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425957+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:34:17.425957+0000","last_peered":"2024-04-26T10:34:17.425957+0000","last_clean":"2024-04-26T10:34:17.425957+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:34:17.425957+0000","last_undegraded":"2024-04-26T10:34:17.425957+0000","last_fullsized":"2024-04-26T10:34:17.425957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426074+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:34:17.426074+0000","last_peered":"2024-04-26T10:34:17.426074+0000","last_clean":"2024-04-26T10:34:17.426074+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:34:17.426074+0000","last_undegraded":"2024-04-26T10:34:17.426074+0000","last_fullsized":"2024-04-26T10:34:17.426074+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425971+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:34:17.425971+0000","last_peered":"2024-04-26T10:34:17.425971+0000","last_clean":"2024-04-26T10:34:17.425971+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:34:17.425971+0000","last_undegraded":"2024-04-26T10:34:17.425971+0000","last_fullsized":"2024-04-26T10:34:17.425971+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:03.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426305+0000","last_change":"2024-04-26T10:34:14.509249+0000","last_active":"2024-04-26T10:34:17.426305+0000","last_peered":"2024-04-26T10:34:17.426305+0000","last_clean":"2024-04-26T10:34:17.426305+0000","last_became_active":"2024-04-26T10:34:14.508371+0000","last_became_peered":"2024-04-26T10:34:14.508371+0000","last_unstale":"2024-04-26T10:34:17.426305+0000","last_undegraded":"2024-04-26T10:34:17.426305+0000","last_fullsized":"2024-04-26T10:34:17.426305+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:35.257141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425465+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:34:17.425465+0000","last_peered":"2024-04-26T10:34:17.425465+0000","last_clean":"2024-04-26T10:34:17.425465+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:34:17.425465+0000","last_undegraded":"2024-04-26T10:34:17.425465+0000","last_fullsized":"2024-04-26T10:34:17.425465+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425318+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:34:17.425318+0000","last_peered":"2024-04-26T10:34:17.425318+0000","last_clean":"2024-04-26T10:34:17.425318+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:34:17.425318+0000","last_undegraded":"2024-04-26T10:34:17.425318+0000","last_fullsized":"2024-04-26T10:34:17.425318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554242+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:34:17.554242+0000","last_peered":"2024-04-26T10:34:17.554242+0000","last_clean":"2024-04-26T10:34:17.554242+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:34:17.554242+0000","last_undegraded":"2024-04-26T10:34:17.554242+0000","last_fullsized":"2024-04-26T10:34:17.554242+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426338+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:34:17.426338+0000","last_peered":"2024-04-26T10:34:17.426338+0000","last_clean":"2024-04-26T10:34:17.426338+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:34:17.426338+0000","last_undegraded":"2024-04-26T10:34:17.426338+0000","last_fullsized":"2024-04-26T10:34:17.426338+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.343269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553884+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:34:17.553884+0000","last_peered":"2024-04-26T10:34:17.553884+0000","last_clean":"2024-04-26T10:34:17.553884+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:34:17.553884+0000","last_undegraded":"2024-04-26T10:34:17.553884+0000","last_fullsized":"2024-04-26T10:34:17.553884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426231+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:34:17.426231+0000","last_peered":"2024-04-26T10:34:17.426231+0000","last_clean":"2024-04-26T10:34:17.426231+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:34:17.426231+0000","last_undegraded":"2024-04-26T10:34:17.426231+0000","last_fullsized":"2024-04-26T10:34:17.426231+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426223+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:34:17.426223+0000","last_peered":"2024-04-26T10:34:17.426223+0000","last_clean":"2024-04-26T10:34:17.426223+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:34:17.426223+0000","last_undegraded":"2024-04-26T10:34:17.426223+0000","last_fullsized":"2024-04-26T10:34:17.426223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425823+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:34:17.425823+0000","last_peered":"2024-04-26T10:34:17.425823+0000","last_clean":"2024-04-26T10:34:17.425823+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:34:17.425823+0000","last_undegraded":"2024-04-26T10:34:17.425823+0000","last_fullsized":"2024-04-26T10:34:17.425823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553534+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:34:17.553534+0000","last_peered":"2024-04-26T10:34:17.553534+0000","last_clean":"2024-04-26T10:34:17.553534+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:34:17.553534+0000","last_undegraded":"2024-04-26T10:34:17.553534+0000","last_fullsized":"2024-04-26T10:34:17.553534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425916+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:34:17.425916+0000","last_peered":"2024-04-26T10:34:17.425916+0000","last_clean":"2024-04-26T10:34:17.425916+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:34:17.425916+0000","last_undegraded":"2024-04-26T10:34:17.425916+0000","last_fullsized":"2024-04-26T10:34:17.425916+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426472+0000","last_change":"2024-04-26T10:34:14.511829+0000","last_active":"2024-04-26T10:34:17.426472+0000","last_peered":"2024-04-26T10:34:17.426472+0000","last_clean":"2024-04-26T10:34:17.426472+0000","last_became_active":"2024-04-26T10:34:14.511584+0000","last_became_peered":"2024-04-26T10:34:14.511584+0000","last_unstale":"2024-04-26T10:34:17.426472+0000","last_undegraded":"2024-04-26T10:34:17.426472+0000","last_fullsized":"2024-04-26T10:34:17.426472+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:30.166797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554390+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:34:17.554390+0000","last_peered":"2024-04-26T10:34:17.554390+0000","last_clean":"2024-04-26T10:34:17.554390+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:34:17.554390+0000","last_undegraded":"2024-04-26T10:34:17.554390+0000","last_fullsized":"2024-04-26T10:34:17.554390+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426048+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:34:17.426048+0000","last_peered":"2024-04-26T10:34:17.426048+0000","last_clean":"2024-04-26T10:34:17.426048+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:34:17.426048+0000","last_undegraded":"2024-04-26T10:34:17.426048+0000","last_fullsized":"2024-04-26T10:34:17.426048+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":43,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426146+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:34:17.426146+0000","last_peered":"2024-04-26T10:34:17.426146+0000","last_clean":"2024-04-26T10:34:17.426146+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:34:17.426146+0000","last_undegraded":"2024-04-26T10:34:17.426146+0000","last_fullsized":"2024-04-26T10:34:17.426146+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426241+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:34:17.426241+0000","last_peered":"2024-04-26T10:34:17.426241+0000","last_clean":"2024-04-26T10:34:17.426241+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:34:17.426241+0000","last_undegraded":"2024-04-26T10:34:17.426241+0000","last_fullsized":"2024-04-26T10:34:17.426241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553570+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:34:17.553570+0000","last_peered":"2024-04-26T10:34:17.553570+0000","last_clean":"2024-04-26T10:34:17.553570+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:34:17.553570+0000","last_undegraded":"2024-04-26T10:34:17.553570+0000","last_fullsized":"2024-04-26T10:34:17.553570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554491+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:34:17.554491+0000","last_peered":"2024-04-26T10:34:17.554491+0000","last_clean":"2024-04-26T10:34:17.554491+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:34:17.554491+0000","last_undegraded":"2024-04-26T10:34:17.554491+0000","last_fullsized":"2024-04-26T10:34:17.554491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":58,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553643+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:34:17.553643+0000","last_peered":"2024-04-26T10:34:17.553643+0000","last_clean":"2024-04-26T10:34:17.553643+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:34:17.553643+0000","last_undegraded":"2024-04-26T10:34:17.553643+0000","last_fullsized":"2024-04-26T10:34:17.553643+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:19.856062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426655+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:34:17.426655+0000","last_peered":"2024-04-26T10:34:17.426655+0000","last_clean":"2024-04-26T10:34:17.426655+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:34:17.426655+0000","last_undegraded":"2024-04-26T10:34:17.426655+0000","last_fullsized":"2024-04-26T10:34:17.426655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554331+0000","last_change":"2024-04-26T10:32:51.589706+0000","last_active":"2024-04-26T10:34:17.554331+0000","last_peered":"2024-04-26T10:34:17.554331+0000","last_clean":"2024-04-26T10:34:17.554331+0000","last_became_active":"2024-04-26T10:32:51.589506+0000","last_became_peered":"2024-04-26T10:32:51.589506+0000","last_unstale":"2024-04-26T10:34:17.554331+0000","last_undegraded":"2024-04-26T10:34:17.554331+0000","last_fullsized":"2024-04-26T10:34:17.554331+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553470+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:34:17.553470+0000","last_peered":"2024-04-26T10:34:17.553470+0000","last_clean":"2024-04-26T10:34:17.553470+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:34:17.553470+0000","last_undegraded":"2024-04-26T10:34:17.553470+0000","last_fullsized":"2024-04-26T10:34:17.553470+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:04.852453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426423+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:34:17.426423+0000","last_peered":"2024-04-26T10:34:17.426423+0000","last_clean":"2024-04-26T10:34:17.426423+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:34:17.426423+0000","last_undegraded":"2024-04-26T10:34:17.426423+0000","last_fullsized":"2024-04-26T10:34:17.426423+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553654+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:34:17.553654+0000","last_peered":"2024-04-26T10:34:17.553654+0000","last_clean":"2024-04-26T10:34:17.553654+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:34:17.553654+0000","last_undegraded":"2024-04-26T10:34:17.553654+0000","last_fullsized":"2024-04-26T10:34:17.553654+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425808+0000","last_change":"2024-04-26T10:34:14.518131+0000","last_active":"2024-04-26T10:34:17.425808+0000","last_peered":"2024-04-26T10:34:17.425808+0000","last_clean":"2024-04-26T10:34:17.425808+0000","last_became_active":"2024-04-26T10:34:14.506010+0000","last_became_peered":"2024-04-26T10:34:14.506010+0000","last_unstale":"2024-04-26T10:34:17.425808+0000","last_undegraded":"2024-04-26T10:34:17.425808+0000","last_fullsized":"2024-04-26T10:34:17.425808+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:51.842115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553609+0000","last_change":"2024-04-26T10:34:14.509381+0000","last_active":"2024-04-26T10:34:17.553609+0000","last_peered":"2024-04-26T10:34:17.553609+0000","last_clean":"2024-04-26T10:34:17.553609+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:34:17.553609+0000","last_undegraded":"2024-04-26T10:34:17.553609+0000","last_fullsized":"2024-04-26T10:34:17.553609+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:05.841519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":84,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425937+0000","last_change":"2024-04-26T10:34:14.548596+0000","last_active":"2024-04-26T10:34:17.425937+0000","last_peered":"2024-04-26T10:34:17.425937+0000","last_clean":"2024-04-26T10:34:17.425937+0000","last_became_active":"2024-04-26T10:34:14.512027+0000","last_became_peered":"2024-04-26T10:34:14.512027+0000","last_unstale":"2024-04-26T10:34:17.425937+0000","last_undegraded":"2024-04-26T10:34:17.425937+0000","last_fullsized":"2024-04-26T10:34:17.425937+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:39.957573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426754+0000","last_change":"2024-04-26T10:34:14.513656+0000","last_active":"2024-04-26T10:34:17.426754+0000","last_peered":"2024-04-26T10:34:17.426754+0000","last_clean":"2024-04-26T10:34:17.426754+0000","last_became_active":"2024-04-26T10:34:14.513402+0000","last_became_peered":"2024-04-26T10:34:14.513402+0000","last_unstale":"2024-04-26T10:34:17.426754+0000","last_undegraded":"2024-04-26T10:34:17.426754+0000","last_fullsized":"2024-04-26T10:34:17.426754+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:22.053611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426615+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:34:17.426615+0000","last_peered":"2024-04-26T10:34:17.426615+0000","last_clean":"2024-04-26T10:34:17.426615+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:34:17.426615+0000","last_undegraded":"2024-04-26T10:34:17.426615+0000","last_fullsized":"2024-04-26T10:34:17.426615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425995+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:34:17.425995+0000","last_peered":"2024-04-26T10:34:17.425995+0000","last_clean":"2024-04-26T10:34:17.425995+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:34:17.425995+0000","last_undegraded":"2024-04-26T10:34:17.425995+0000","last_fullsized":"2024-04-26T10:34:17.425995+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:02.872251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553691+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:34:17.553691+0000","last_peered":"2024-04-26T10:34:17.553691+0000","last_clean":"2024-04-26T10:34:17.553691+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:34:17.553691+0000","last_undegraded":"2024-04-26T10:34:17.553691+0000","last_fullsized":"2024-04-26T10:34:17.553691+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425865+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:34:17.425865+0000","last_peered":"2024-04-26T10:34:17.425865+0000","last_clean":"2024-04-26T10:34:17.425865+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:34:17.425865+0000","last_undegraded":"2024-04-26T10:34:17.425865+0000","last_fullsized":"2024-04-26T10:34:17.425865+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:43.500342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425520+0000","last_change":"2024-04-26T10:34:14.509818+0000","last_active":"2024-04-26T10:34:17.425520+0000","last_peered":"2024-04-26T10:34:17.425520+0000","last_clean":"2024-04-26T10:34:17.425520+0000","last_became_active":"2024-04-26T10:34:14.509270+0000","last_became_peered":"2024-04-26T10:34:14.509270+0000","last_unstale":"2024-04-26T10:34:17.425520+0000","last_undegraded":"2024-04-26T10:34:17.425520+0000","last_fullsized":"2024-04-26T10:34:17.425520+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:45.412620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554529+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:34:17.554529+0000","last_peered":"2024-04-26T10:34:17.554529+0000","last_clean":"2024-04-26T10:34:17.554529+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:34:17.554529+0000","last_undegraded":"2024-04-26T10:34:17.554529+0000","last_fullsized":"2024-04-26T10:34:17.554529+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":86,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425572+0000","last_change":"2024-04-26T10:34:14.531646+0000","last_active":"2024-04-26T10:34:17.425572+0000","last_peered":"2024-04-26T10:34:17.425572+0000","last_clean":"2024-04-26T10:34:17.425572+0000","last_became_active":"2024-04-26T10:34:14.511911+0000","last_became_peered":"2024-04-26T10:34:14.511911+0000","last_unstale":"2024-04-26T10:34:17.425572+0000","last_undegraded":"2024-04-26T10:34:17.425572+0000","last_fullsized":"2024-04-26T10:34:17.425572+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:39.588939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554410+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:34:17.554410+0000","last_peered":"2024-04-26T10:34:17.554410+0000","last_clean":"2024-04-26T10:34:17.554410+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:34:17.554410+0000","last_undegraded":"2024-04-26T10:34:17.554410+0000","last_fullsized":"2024-04-26T10:34:17.554410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"46'8717","reported_seq":11819,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.043734+0000","last_change":"2024-04-26T10:34:14.549017+0000","last_active":"2024-04-26T10:34:20.043734+0000","last_peered":"2024-04-26T10:34:20.043734+0000","last_clean":"2024-04-26T10:34:20.043734+0000","last_became_active":"2024-04-26T10:34:14.518037+0000","last_became_peered":"2024-04-26T10:34:14.518037+0000","last_unstale":"2024-04-26T10:34:20.043734+0000","last_undegraded":"2024-04-26T10:34:20.043734+0000","last_fullsized":"2024-04-26T10:34:20.043734+0000","mapping_epoch":41,"log_start":"29'5291","ondisk_log_start":"29'5291","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3426,"log_dups_size":1542,"ondisk_log_size":3426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:21.571693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":534183936,"num_objects":8151,"num_object_clones":0,"num_object_copies":16302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8151,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8717,"num_write_kb":539776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1524,"num_bytes_recovered":99876864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":67,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426021+0000","last_change":"2024-04-26T10:34:14.536943+0000","last_active":"2024-04-26T10:34:17.426021+0000","last_peered":"2024-04-26T10:34:17.426021+0000","last_clean":"2024-04-26T10:34:17.426021+0000","last_became_active":"2024-04-26T10:34:14.511960+0000","last_became_peered":"2024-04-26T10:34:14.511960+0000","last_unstale":"2024-04-26T10:34:17.426021+0000","last_undegraded":"2024-04-26T10:34:17.426021+0000","last_fullsized":"2024-04-26T10:34:17.426021+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.329973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425670+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:34:17.425670+0000","last_peered":"2024-04-26T10:34:17.425670+0000","last_clean":"2024-04-26T10:34:17.425670+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:34:17.425670+0000","last_undegraded":"2024-04-26T10:34:17.425670+0000","last_fullsized":"2024-04-26T10:34:17.425670+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"46'8926","reported_seq":8964,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.035074+0000","last_change":"2024-04-26T10:33:16.346351+0000","last_active":"2024-04-26T10:34:20.035074+0000","last_peered":"2024-04-26T10:34:20.035074+0000","last_clean":"2024-04-26T10:34:20.035074+0000","last_became_active":"2024-04-26T10:33:16.346122+0000","last_became_peered":"2024-04-26T10:33:16.346122+0000","last_unstale":"2024-04-26T10:34:20.035074+0000","last_undegraded":"2024-04-26T10:34:20.035074+0000","last_fullsized":"2024-04-26T10:34:20.035074+0000","mapping_epoch":16,"log_start":"28'4964","ondisk_log_start":"28'4964","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3962,"log_dups_size":0,"ondisk_log_size":3962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:13.714464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":546439168,"num_objects":8338,"num_object_clones":0,"num_object_copies":16676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8338,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8926,"num_write_kb":552448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426502+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:34:17.426502+0000","last_peered":"2024-04-26T10:34:17.426502+0000","last_clean":"2024-04-26T10:34:17.426502+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:34:17.426502+0000","last_undegraded":"2024-04-26T10:34:17.426502+0000","last_fullsized":"2024-04-26T10:34:17.426502+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425619+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:34:17.425619+0000","last_peered":"2024-04-26T10:34:17.425619+0000","last_clean":"2024-04-26T10:34:17.425619+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:34:17.425619+0000","last_undegraded":"2024-04-26T10:34:17.425619+0000","last_fullsized":"2024-04-26T10:34:17.425619+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:12.954308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"46'8798","reported_seq":12145,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.037419+0000","last_change":"2024-04-26T10:34:15.510456+0000","last_active":"2024-04-26T10:34:20.037419+0000","last_peered":"2024-04-26T10:34:20.037419+0000","last_clean":"2024-04-26T10:34:20.037419+0000","last_became_active":"2024-04-26T10:34:15.505397+0000","last_became_peered":"2024-04-26T10:34:15.505397+0000","last_unstale":"2024-04-26T10:34:20.037419+0000","last_undegraded":"2024-04-26T10:34:20.037419+0000","last_fullsized":"2024-04-26T10:34:20.037419+0000","mapping_epoch":42,"log_start":"29'5264","ondisk_log_start":"29'5264","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3534,"log_dups_size":1442,"ondisk_log_size":3534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:45.190570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538968064,"num_objects":8224,"num_object_clones":0,"num_object_copies":16448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8224,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8798,"num_write_kb":544704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1649,"num_bytes_recovered":108068864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":43,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426313+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:34:17.426313+0000","last_peered":"2024-04-26T10:34:17.426313+0000","last_clean":"2024-04-26T10:34:17.426313+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:34:17.426313+0000","last_undegraded":"2024-04-26T10:34:17.426313+0000","last_fullsized":"2024-04-26T10:34:17.426313+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425957+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:34:17.425957+0000","last_peered":"2024-04-26T10:34:17.425957+0000","last_clean":"2024-04-26T10:34:17.425957+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:34:17.425957+0000","last_undegraded":"2024-04-26T10:34:17.425957+0000","last_fullsized":"2024-04-26T10:34:17.425957+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"46'8820","reported_seq":8858,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.053122+0000","last_change":"2024-04-26T10:33:16.346212+0000","last_active":"2024-04-26T10:34:20.053122+0000","last_peered":"2024-04-26T10:34:20.053122+0000","last_clean":"2024-04-26T10:34:20.053122+0000","last_became_active":"2024-04-26T10:33:16.346004+0000","last_became_peered":"2024-04-26T10:33:16.346004+0000","last_unstale":"2024-04-26T10:34:20.053122+0000","last_undegraded":"2024-04-26T10:34:20.053122+0000","last_fullsized":"2024-04-26T10:34:20.053122+0000","mapping_epoch":16,"log_start":"29'5354","ondisk_log_start":"29'5354","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3466,"log_dups_size":1542,"ondisk_log_size":3466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:27.495754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":534642688,"num_objects":8158,"num_object_clones":0,"num_object_copies":16316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8158,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8820,"num_write_kb":543296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425756+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:34:17.425756+0000","last_peered":"2024-04-26T10:34:17.425756+0000","last_clean":"2024-04-26T10:34:17.425756+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:34:17.425756+0000","last_undegraded":"2024-04-26T10:34:17.425756+0000","last_fullsized":"2024-04-26T10:34:17.425756+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554075+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:34:17.554075+0000","last_peered":"2024-04-26T10:34:17.554075+0000","last_clean":"2024-04-26T10:34:17.554075+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:34:17.554075+0000","last_undegraded":"2024-04-26T10:34:17.554075+0000","last_fullsized":"2024-04-26T10:34:17.554075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"46'8705","reported_seq":8755,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.037538+0000","last_change":"2024-04-26T10:34:15.511727+0000","last_active":"2024-04-26T10:34:20.037538+0000","last_peered":"2024-04-26T10:34:20.037538+0000","last_clean":"2024-04-26T10:34:20.037538+0000","last_became_active":"2024-04-26T10:34:15.508075+0000","last_became_peered":"2024-04-26T10:34:15.508075+0000","last_unstale":"2024-04-26T10:34:20.037538+0000","last_undegraded":"2024-04-26T10:34:20.037538+0000","last_fullsized":"2024-04-26T10:34:20.037538+0000","mapping_epoch":42,"log_start":"29'5172","ondisk_log_start":"29'5172","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3533,"log_dups_size":1442,"ondisk_log_size":3533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:13.011834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":532545560,"num_objects":8127,"num_object_clones":0,"num_object_copies":16254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8127,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":8705,"num_write_kb":538561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553922+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:34:17.553922+0000","last_peered":"2024-04-26T10:34:17.553922+0000","last_clean":"2024-04-26T10:34:17.553922+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:34:17.553922+0000","last_undegraded":"2024-04-26T10:34:17.553922+0000","last_fullsized":"2024-04-26T10:34:17.553922+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425846+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:34:17.425846+0000","last_peered":"2024-04-26T10:34:17.425846+0000","last_clean":"2024-04-26T10:34:17.425846+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:34:17.425846+0000","last_undegraded":"2024-04-26T10:34:17.425846+0000","last_fullsized":"2024-04-26T10:34:17.425846+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"46'8671","reported_seq":8709,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.063298+0000","last_change":"2024-04-26T10:33:16.349242+0000","last_active":"2024-04-26T10:34:20.063298+0000","last_peered":"2024-04-26T10:34:20.063298+0000","last_clean":"2024-04-26T10:34:20.063298+0000","last_became_active":"2024-04-26T10:33:16.349063+0000","last_became_peered":"2024-04-26T10:33:16.349063+0000","last_unstale":"2024-04-26T10:34:20.063298+0000","last_undegraded":"2024-04-26T10:34:20.063298+0000","last_fullsized":"2024-04-26T10:34:20.063298+0000","mapping_epoch":16,"log_start":"28'5162","ondisk_log_start":"28'5162","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3509,"log_dups_size":1442,"ondisk_log_size":3509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:09.297624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531300352,"num_objects":8107,"num_object_clones":0,"num_object_copies":16214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8107,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8671,"num_write_kb":536896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425704+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:34:17.425704+0000","last_peered":"2024-04-26T10:34:17.425704+0000","last_clean":"2024-04-26T10:34:17.425704+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:34:17.425704+0000","last_undegraded":"2024-04-26T10:34:17.425704+0000","last_fullsized":"2024-04-26T10:34:17.425704+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426234+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:34:17.426234+0000","last_peered":"2024-04-26T10:34:17.426234+0000","last_clean":"2024-04-26T10:34:17.426234+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:34:17.426234+0000","last_undegraded":"2024-04-26T10:34:17.426234+0000","last_fullsized":"2024-04-26T10:34:17.426234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"46'8453","reported_seq":8509,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.044203+0000","last_change":"2024-04-26T10:34:14.549556+0000","last_active":"2024-04-26T10:34:20.044203+0000","last_peered":"2024-04-26T10:34:20.044203+0000","last_clean":"2024-04-26T10:34:20.044203+0000","last_became_active":"2024-04-26T10:34:14.520855+0000","last_became_peered":"2024-04-26T10:34:14.520855+0000","last_unstale":"2024-04-26T10:34:20.044203+0000","last_undegraded":"2024-04-26T10:34:20.044203+0000","last_fullsized":"2024-04-26T10:34:20.044203+0000","mapping_epoch":41,"log_start":"28'5005","ondisk_log_start":"28'5005","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3448,"log_dups_size":1442,"ondisk_log_size":3448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:48.789996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":519241728,"num_objects":7923,"num_object_clones":0,"num_object_copies":15846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7923,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8453,"num_write_kb":524032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425705+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:34:17.425705+0000","last_peered":"2024-04-26T10:34:17.425705+0000","last_clean":"2024-04-26T10:34:17.425705+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:34:17.425705+0000","last_undegraded":"2024-04-26T10:34:17.425705+0000","last_fullsized":"2024-04-26T10:34:17.425705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426427+0000","last_change":"2024-04-26T10:34:14.509460+0000","last_active":"2024-04-26T10:34:17.426427+0000","last_peered":"2024-04-26T10:34:17.426427+0000","last_clean":"2024-04-26T10:34:17.426427+0000","last_became_active":"2024-04-26T10:34:14.509213+0000","last_became_peered":"2024-04-26T10:34:14.509213+0000","last_unstale":"2024-04-26T10:34:17.426427+0000","last_undegraded":"2024-04-26T10:34:17.426427+0000","last_fullsized":"2024-04-26T10:34:17.426427+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:15.816526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"46'8617","reported_seq":8655,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.041649+0000","last_change":"2024-04-26T10:33:16.344866+0000","last_active":"2024-04-26T10:34:20.041649+0000","last_peered":"2024-04-26T10:34:20.041649+0000","last_clean":"2024-04-26T10:34:20.041649+0000","last_became_active":"2024-04-26T10:33:16.344614+0000","last_became_peered":"2024-04-26T10:33:16.344614+0000","last_unstale":"2024-04-26T10:34:20.041649+0000","last_undegraded":"2024-04-26T10:34:20.041649+0000","last_fullsized":"2024-04-26T10:34:20.041649+0000","mapping_epoch":16,"log_start":"27'4654","ondisk_log_start":"27'4654","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3963,"log_dups_size":0,"ondisk_log_size":3963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":531955712,"num_objects":8117,"num_object_clones":0,"num_object_copies":16234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8117,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8617,"num_write_kb":535488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425573+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:34:17.425573+0000","last_peered":"2024-04-26T10:34:17.425573+0000","last_clean":"2024-04-26T10:34:17.425573+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:34:17.425573+0000","last_undegraded":"2024-04-26T10:34:17.425573+0000","last_fullsized":"2024-04-26T10:34:17.425573+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:35.111495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554287+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:34:17.554287+0000","last_peered":"2024-04-26T10:34:17.554287+0000","last_clean":"2024-04-26T10:34:17.554287+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:34:17.554287+0000","last_undegraded":"2024-04-26T10:34:17.554287+0000","last_fullsized":"2024-04-26T10:34:17.554287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"46'8653","reported_seq":8690,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.069823+0000","last_change":"2024-04-26T10:33:16.349280+0000","last_active":"2024-04-26T10:34:20.069823+0000","last_peered":"2024-04-26T10:34:20.069823+0000","last_clean":"2024-04-26T10:34:20.069823+0000","last_became_active":"2024-04-26T10:33:16.349010+0000","last_became_peered":"2024-04-26T10:33:16.349010+0000","last_unstale":"2024-04-26T10:34:20.069823+0000","last_undegraded":"2024-04-26T10:34:20.069823+0000","last_fullsized":"2024-04-26T10:34:20.069823+0000","mapping_epoch":16,"log_start":"28'5171","ondisk_log_start":"28'5171","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3482,"log_dups_size":1442,"ondisk_log_size":3482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:08.933996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525402112,"num_objects":8017,"num_object_clones":0,"num_object_copies":16034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8017,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8653,"num_write_kb":533440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554060+0000","last_change":"2024-04-26T10:34:14.511174+0000","last_active":"2024-04-26T10:34:17.554060+0000","last_peered":"2024-04-26T10:34:17.554060+0000","last_clean":"2024-04-26T10:34:17.554060+0000","last_became_active":"2024-04-26T10:34:14.510907+0000","last_became_peered":"2024-04-26T10:34:14.510907+0000","last_unstale":"2024-04-26T10:34:17.554060+0000","last_undegraded":"2024-04-26T10:34:17.554060+0000","last_fullsized":"2024-04-26T10:34:17.554060+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:34.574586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426341+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:34:17.426341+0000","last_peered":"2024-04-26T10:34:17.426341+0000","last_clean":"2024-04-26T10:34:17.426341+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:34:17.426341+0000","last_undegraded":"2024-04-26T10:34:17.426341+0000","last_fullsized":"2024-04-26T10:34:17.426341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425733+0000","last_change":"2024-04-26T10:34:14.506552+0000","last_active":"2024-04-26T10:34:17.425733+0000","last_peered":"2024-04-26T10:34:17.425733+0000","last_clean":"2024-04-26T10:34:17.425733+0000","last_became_active":"2024-04-26T10:34:14.506008+0000","last_became_peered":"2024-04-26T10:34:14.506008+0000","last_unstale":"2024-04-26T10:34:17.425733+0000","last_undegraded":"2024-04-26T10:34:17.425733+0000","last_fullsized":"2024-04-26T10:34:17.425733+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.031036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"46'8608","reported_seq":8646,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.061691+0000","last_change":"2024-04-26T10:33:16.349302+0000","last_active":"2024-04-26T10:34:20.061691+0000","last_peered":"2024-04-26T10:34:20.061691+0000","last_clean":"2024-04-26T10:34:20.061691+0000","last_became_active":"2024-04-26T10:33:16.348992+0000","last_became_peered":"2024-04-26T10:33:16.348992+0000","last_unstale":"2024-04-26T10:34:20.061691+0000","last_undegraded":"2024-04-26T10:34:20.061691+0000","last_fullsized":"2024-04-26T10:34:20.061691+0000","mapping_epoch":16,"log_start":"29'5157","ondisk_log_start":"29'5157","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3451,"log_dups_size":1442,"ondisk_log_size":3451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:15.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529793024,"num_objects":8084,"num_object_clones":0,"num_object_copies":16168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8084,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8608,"num_write_kb":534144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426228+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:34:17.426228+0000","last_peered":"2024-04-26T10:34:17.426228+0000","last_clean":"2024-04-26T10:34:17.426228+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:34:17.426228+0000","last_undegraded":"2024-04-26T10:34:17.426228+0000","last_fullsized":"2024-04-26T10:34:17.426228+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426429+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:34:17.426429+0000","last_peered":"2024-04-26T10:34:17.426429+0000","last_clean":"2024-04-26T10:34:17.426429+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:34:17.426429+0000","last_undegraded":"2024-04-26T10:34:17.426429+0000","last_fullsized":"2024-04-26T10:34:17.426429+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553982+0000","last_change":"2024-04-26T10:34:14.513348+0000","last_active":"2024-04-26T10:34:17.553982+0000","last_peered":"2024-04-26T10:34:17.553982+0000","last_clean":"2024-04-26T10:34:17.553982+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:34:17.553982+0000","last_undegraded":"2024-04-26T10:34:17.553982+0000","last_fullsized":"2024-04-26T10:34:17.553982+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:21.161769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"46'8706","reported_seq":8744,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.065199+0000","last_change":"2024-04-26T10:33:16.349181+0000","last_active":"2024-04-26T10:34:20.065199+0000","last_peered":"2024-04-26T10:34:20.065199+0000","last_clean":"2024-04-26T10:34:20.065199+0000","last_became_active":"2024-04-26T10:33:16.348981+0000","last_became_peered":"2024-04-26T10:33:16.348981+0000","last_unstale":"2024-04-26T10:34:20.065199+0000","last_undegraded":"2024-04-26T10:34:20.065199+0000","last_fullsized":"2024-04-26T10:34:20.065199+0000","mapping_epoch":16,"log_start":"29'5184","ondisk_log_start":"29'5184","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3522,"log_dups_size":1442,"ondisk_log_size":3522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533987328,"num_objects":8148,"num_object_clones":0,"num_object_copies":16296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8148,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8706,"num_write_kb":539328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553485+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:34:17.553485+0000","last_peered":"2024-04-26T10:34:17.553485+0000","last_clean":"2024-04-26T10:34:17.553485+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:34:17.553485+0000","last_undegraded":"2024-04-26T10:34:17.553485+0000","last_fullsized":"2024-04-26T10:34:17.553485+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425825+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:34:17.425825+0000","last_peered":"2024-04-26T10:34:17.425825+0000","last_clean":"2024-04-26T10:34:17.425825+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:34:17.425825+0000","last_undegraded":"2024-04-26T10:34:17.425825+0000","last_fullsized":"2024-04-26T10:34:17.425825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554370+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:34:17.554370+0000","last_peered":"2024-04-26T10:34:17.554370+0000","last_clean":"2024-04-26T10:34:17.554370+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:34:17.554370+0000","last_undegraded":"2024-04-26T10:34:17.554370+0000","last_fullsized":"2024-04-26T10:34:17.554370+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:57.803542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"46'8730","reported_seq":8779,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.046340+0000","last_change":"2024-04-26T10:34:15.513418+0000","last_active":"2024-04-26T10:34:20.046340+0000","last_peered":"2024-04-26T10:34:20.046340+0000","last_clean":"2024-04-26T10:34:20.046340+0000","last_became_active":"2024-04-26T10:34:15.508062+0000","last_became_peered":"2024-04-26T10:34:15.508062+0000","last_unstale":"2024-04-26T10:34:20.046340+0000","last_undegraded":"2024-04-26T10:34:20.046340+0000","last_fullsized":"2024-04-26T10:34:20.046340+0000","mapping_epoch":42,"log_start":"29'5257","ondisk_log_start":"29'5257","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3473,"log_dups_size":1542,"ondisk_log_size":3473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:12.573855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533200896,"num_objects":8136,"num_object_clones":0,"num_object_copies":16272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8136,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8730,"num_write_kb":539712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426378+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:34:17.426378+0000","last_peered":"2024-04-26T10:34:17.426378+0000","last_clean":"2024-04-26T10:34:17.426378+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:34:17.426378+0000","last_undegraded":"2024-04-26T10:34:17.426378+0000","last_fullsized":"2024-04-26T10:34:17.426378+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":283,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.428075+0000","last_change":"2024-04-26T10:34:17.427146+0000","last_active":"2024-04-26T10:34:17.428075+0000","last_peered":"2024-04-26T10:34:17.428075+0000","last_clean":"2024-04-26T10:34:17.428075+0000","last_became_active":"2024-04-26T10:34:17.426852+0000","last_became_peered":"2024-04-26T10:34:17.426852+0000","last_unstale":"2024-04-26T10:34:17.428075+0000","last_undegraded":"2024-04-26T10:34:17.428075+0000","last_fullsized":"2024-04-26T10:34:17.428075+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:50.963578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553586+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:34:17.553586+0000","last_peered":"2024-04-26T10:34:17.553586+0000","last_clean":"2024-04-26T10:34:17.553586+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:34:17.553586+0000","last_undegraded":"2024-04-26T10:34:17.553586+0000","last_fullsized":"2024-04-26T10:34:17.553586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426154+0000","last_change":"2024-04-26T10:34:14.509642+0000","last_active":"2024-04-26T10:34:17.426154+0000","last_peered":"2024-04-26T10:34:17.426154+0000","last_clean":"2024-04-26T10:34:17.426154+0000","last_became_active":"2024-04-26T10:34:14.509329+0000","last_became_peered":"2024-04-26T10:34:14.509329+0000","last_unstale":"2024-04-26T10:34:17.426154+0000","last_undegraded":"2024-04-26T10:34:17.426154+0000","last_fullsized":"2024-04-26T10:34:17.426154+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:20.861292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"46'8598","reported_seq":8636,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.042036+0000","last_change":"2024-04-26T10:33:16.344693+0000","last_active":"2024-04-26T10:34:20.042036+0000","last_peered":"2024-04-26T10:34:20.042036+0000","last_clean":"2024-04-26T10:34:20.042036+0000","last_became_active":"2024-04-26T10:33:16.344478+0000","last_became_peered":"2024-04-26T10:33:16.344478+0000","last_unstale":"2024-04-26T10:34:20.042036+0000","last_undegraded":"2024-04-26T10:34:20.042036+0000","last_fullsized":"2024-04-26T10:34:20.042036+0000","mapping_epoch":16,"log_start":"29'5133","ondisk_log_start":"29'5133","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3465,"log_dups_size":1442,"ondisk_log_size":3465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:24.298876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":529399808,"num_objects":8078,"num_object_clones":0,"num_object_copies":16156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8598,"num_write_kb":533632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425399+0000","last_change":"2024-04-26T10:34:14.509367+0000","last_active":"2024-04-26T10:34:17.425399+0000","last_peered":"2024-04-26T10:34:17.425399+0000","last_clean":"2024-04-26T10:34:17.425399+0000","last_became_active":"2024-04-26T10:34:14.508465+0000","last_became_peered":"2024-04-26T10:34:14.508465+0000","last_unstale":"2024-04-26T10:34:17.425399+0000","last_undegraded":"2024-04-26T10:34:17.425399+0000","last_fullsized":"2024-04-26T10:34:17.425399+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:31.790156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553400+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:34:17.553400+0000","last_peered":"2024-04-26T10:34:17.553400+0000","last_clean":"2024-04-26T10:34:17.553400+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:34:17.553400+0000","last_undegraded":"2024-04-26T10:34:17.553400+0000","last_fullsized":"2024-04-26T10:34:17.553400+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426535+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:34:17.426535+0000","last_peered":"2024-04-26T10:34:17.426535+0000","last_clean":"2024-04-26T10:34:17.426535+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:34:17.426535+0000","last_undegraded":"2024-04-26T10:34:17.426535+0000","last_fullsized":"2024-04-26T10:34:17.426535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"46'8776","reported_seq":8814,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.030704+0000","last_change":"2024-04-26T10:33:16.344694+0000","last_active":"2024-04-26T10:34:20.030704+0000","last_peered":"2024-04-26T10:34:20.030704+0000","last_clean":"2024-04-26T10:34:20.030704+0000","last_became_active":"2024-04-26T10:33:16.344461+0000","last_became_peered":"2024-04-26T10:33:16.344461+0000","last_unstale":"2024-04-26T10:34:20.030704+0000","last_undegraded":"2024-04-26T10:34:20.030704+0000","last_fullsized":"2024-04-26T10:34:20.030704+0000","mapping_epoch":16,"log_start":"29'5284","ondisk_log_start":"29'5284","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3492,"log_dups_size":1442,"ondisk_log_size":3492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:29.374096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537526272,"num_objects":8202,"num_object_clones":0,"num_object_copies":16404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8202,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8776,"num_write_kb":543296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425991+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:34:17.425991+0000","last_peered":"2024-04-26T10:34:17.425991+0000","last_clean":"2024-04-26T10:34:17.425991+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:34:17.425991+0000","last_undegraded":"2024-04-26T10:34:17.425991+0000","last_fullsized":"2024-04-26T10:34:17.425991+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":58,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554178+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:34:17.554178+0000","last_peered":"2024-04-26T10:34:17.554178+0000","last_clean":"2024-04-26T10:34:17.554178+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:34:17.554178+0000","last_undegraded":"2024-04-26T10:34:17.554178+0000","last_fullsized":"2024-04-26T10:34:17.554178+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:21.048381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426081+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:34:17.426081+0000","last_peered":"2024-04-26T10:34:17.426081+0000","last_clean":"2024-04-26T10:34:17.426081+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:34:17.426081+0000","last_undegraded":"2024-04-26T10:34:17.426081+0000","last_fullsized":"2024-04-26T10:34:17.426081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"46'8747","reported_seq":8785,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.034905+0000","last_change":"2024-04-26T10:33:16.344714+0000","last_active":"2024-04-26T10:34:20.034905+0000","last_peered":"2024-04-26T10:34:20.034905+0000","last_clean":"2024-04-26T10:34:20.034905+0000","last_became_active":"2024-04-26T10:33:16.344500+0000","last_became_peered":"2024-04-26T10:33:16.344500+0000","last_unstale":"2024-04-26T10:34:20.034905+0000","last_undegraded":"2024-04-26T10:34:20.034905+0000","last_fullsized":"2024-04-26T10:34:20.034905+0000","mapping_epoch":16,"log_start":"29'5235","ondisk_log_start":"29'5235","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3512,"log_dups_size":1442,"ondisk_log_size":3512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:19.056484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":537591808,"num_objects":8203,"num_object_clones":0,"num_object_copies":16406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8203,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8747,"num_write_kb":542400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554266+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:34:17.554266+0000","last_peered":"2024-04-26T10:34:17.554266+0000","last_clean":"2024-04-26T10:34:17.554266+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:34:17.554266+0000","last_undegraded":"2024-04-26T10:34:17.554266+0000","last_fullsized":"2024-04-26T10:34:17.554266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554605+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:34:17.554605+0000","last_peered":"2024-04-26T10:34:17.554605+0000","last_clean":"2024-04-26T10:34:17.554605+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:34:17.554605+0000","last_undegraded":"2024-04-26T10:34:17.554605+0000","last_fullsized":"2024-04-26T10:34:17.554605+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.172123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553484+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:34:17.553484+0000","last_peered":"2024-04-26T10:34:17.553484+0000","last_clean":"2024-04-26T10:34:17.553484+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:34:17.553484+0000","last_undegraded":"2024-04-26T10:34:17.553484+0000","last_fullsized":"2024-04-26T10:34:17.553484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"46'8672","reported_seq":8717,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T10:34:20.044933+0000","last_change":"2024-04-26T10:34:15.510428+0000","last_active":"2024-04-26T10:34:20.044933+0000","last_peered":"2024-04-26T10:34:20.044933+0000","last_clean":"2024-04-26T10:34:20.044933+0000","last_became_active":"2024-04-26T10:34:15.505392+0000","last_became_peered":"2024-04-26T10:34:15.505392+0000","last_unstale":"2024-04-26T10:34:20.044933+0000","last_undegraded":"2024-04-26T10:34:20.044933+0000","last_fullsized":"2024-04-26T10:34:20.044933+0000","mapping_epoch":42,"log_start":"28'5188","ondisk_log_start":"28'5188","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":1442,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:56.871872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":528875520,"num_objects":8070,"num_object_clones":0,"num_object_copies":16140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8070,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8672,"num_write_kb":535744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426082+0000","last_change":"2024-04-26T10:34:14.512226+0000","last_active":"2024-04-26T10:34:17.426082+0000","last_peered":"2024-04-26T10:34:17.426082+0000","last_clean":"2024-04-26T10:34:17.426082+0000","last_became_active":"2024-04-26T10:34:14.511888+0000","last_became_peered":"2024-04-26T10:34:14.511888+0000","last_unstale":"2024-04-26T10:34:17.426082+0000","last_undegraded":"2024-04-26T10:34:17.426082+0000","last_fullsized":"2024-04-26T10:34:17.426082+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:58.832869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":43,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554451+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:34:17.554451+0000","last_peered":"2024-04-26T10:34:17.554451+0000","last_clean":"2024-04-26T10:34:17.554451+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:34:17.554451+0000","last_undegraded":"2024-04-26T10:34:17.554451+0000","last_fullsized":"2024-04-26T10:34:17.554451+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425533+0000","last_change":"2024-04-26T10:34:14.510158+0000","last_active":"2024-04-26T10:34:17.425533+0000","last_peered":"2024-04-26T10:34:17.425533+0000","last_clean":"2024-04-26T10:34:17.425533+0000","last_became_active":"2024-04-26T10:34:14.509584+0000","last_became_peered":"2024-04-26T10:34:14.509584+0000","last_unstale":"2024-04-26T10:34:17.425533+0000","last_undegraded":"2024-04-26T10:34:17.425533+0000","last_fullsized":"2024-04-26T10:34:17.425533+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:39.230972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426056+0000","last_change":"2024-04-26T10:34:14.508334+0000","last_active":"2024-04-26T10:34:17.426056+0000","last_peered":"2024-04-26T10:34:17.426056+0000","last_clean":"2024-04-26T10:34:17.426056+0000","last_became_active":"2024-04-26T10:34:14.507205+0000","last_became_peered":"2024-04-26T10:34:14.507205+0000","last_unstale":"2024-04-26T10:34:17.426056+0000","last_undegraded":"2024-04-26T10:34:17.426056+0000","last_fullsized":"2024-04-26T10:34:17.426056+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:20.747187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426171+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:34:17.426171+0000","last_peered":"2024-04-26T10:34:17.426171+0000","last_clean":"2024-04-26T10:34:17.426171+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:34:17.426171+0000","last_undegraded":"2024-04-26T10:34:17.426171+0000","last_fullsized":"2024-04-26T10:34:17.426171+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425911+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:34:17.425911+0000","last_peered":"2024-04-26T10:34:17.425911+0000","last_clean":"2024-04-26T10:34:17.425911+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:34:17.425911+0000","last_undegraded":"2024-04-26T10:34:17.425911+0000","last_fullsized":"2024-04-26T10:34:17.425911+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426306+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:34:17.426306+0000","last_peered":"2024-04-26T10:34:17.426306+0000","last_clean":"2024-04-26T10:34:17.426306+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:34:17.426306+0000","last_undegraded":"2024-04-26T10:34:17.426306+0000","last_fullsized":"2024-04-26T10:34:17.426306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":44,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.426164+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:34:17.426164+0000","last_peered":"2024-04-26T10:34:17.426164+0000","last_clean":"2024-04-26T10:34:17.426164+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:34:17.426164+0000","last_undegraded":"2024-04-26T10:34:17.426164+0000","last_fullsized":"2024-04-26T10:34:17.426164+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425880+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:34:17.425880+0000","last_peered":"2024-04-26T10:34:17.425880+0000","last_clean":"2024-04-26T10:34:17.425880+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:34:17.425880+0000","last_undegraded":"2024-04-26T10:34:17.425880+0000","last_fullsized":"2024-04-26T10:34:17.425880+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":43,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554568+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:34:17.554568+0000","last_peered":"2024-04-26T10:34:17.554568+0000","last_clean":"2024-04-26T10:34:17.554568+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:34:17.554568+0000","last_undegraded":"2024-04-26T10:34:17.554568+0000","last_fullsized":"2024-04-26T10:34:17.554568+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425802+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:34:17.425802+0000","last_peered":"2024-04-26T10:34:17.425802+0000","last_clean":"2024-04-26T10:34:17.425802+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:34:17.425802+0000","last_undegraded":"2024-04-26T10:34:17.425802+0000","last_fullsized":"2024-04-26T10:34:17.425802+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":46,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554350+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:34:17.554350+0000","last_peered":"2024-04-26T10:34:17.554350+0000","last_clean":"2024-04-26T10:34:17.554350+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:34:17.554350+0000","last_undegraded":"2024-04-26T10:34:17.554350+0000","last_fullsized":"2024-04-26T10:34:17.554350+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425879+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:34:17.425879+0000","last_peered":"2024-04-26T10:34:17.425879+0000","last_clean":"2024-04-26T10:34:17.425879+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:34:17.425879+0000","last_undegraded":"2024-04-26T10:34:17.425879+0000","last_fullsized":"2024-04-26T10:34:17.425879+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425482+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:34:17.425482+0000","last_peered":"2024-04-26T10:34:17.425482+0000","last_clean":"2024-04-26T10:34:17.425482+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:34:17.425482+0000","last_undegraded":"2024-04-26T10:34:17.425482+0000","last_fullsized":"2024-04-26T10:34:17.425482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.553446+0000","last_change":"2024-04-26T10:34:14.513276+0000","last_active":"2024-04-26T10:34:17.553446+0000","last_peered":"2024-04-26T10:34:17.553446+0000","last_clean":"2024-04-26T10:34:17.553446+0000","last_became_active":"2024-04-26T10:34:14.512930+0000","last_became_peered":"2024-04-26T10:34:14.512930+0000","last_unstale":"2024-04-26T10:34:17.553446+0000","last_undegraded":"2024-04-26T10:34:17.553446+0000","last_fullsized":"2024-04-26T10:34:17.553446+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:37.809739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":41,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425960+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:34:17.425960+0000","last_peered":"2024-04-26T10:34:17.425960+0000","last_clean":"2024-04-26T10:34:17.425960+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:34:17.425960+0000","last_undegraded":"2024-04-26T10:34:17.425960+0000","last_fullsized":"2024-04-26T10:34:17.425960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":57,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.554310+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:34:17.554310+0000","last_peered":"2024-04-26T10:34:17.554310+0000","last_clean":"2024-04-26T10:34:17.554310+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:34:17.554310+0000","last_undegraded":"2024-04-26T10:34:17.554310+0000","last_fullsized":"2024-04-26T10:34:17.554310+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.021846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-26T10:34:17.425961+0000","last_change":"2024-04-26T10:34:14.507476+0000","last_active":"2024-04-26T10:34:17.425961+0000","last_peered":"2024-04-26T10:34:17.425961+0000","last_clean":"2024-04-26T10:34:17.425961+0000","last_became_active":"2024-04-26T10:34:14.507171+0000","last_became_peered":"2024-04-26T10:34:14.507171+0000","last_unstale":"2024-04-26T10:34:17.425961+0000","last_undegraded":"2024-04-26T10:34:17.425961+0000","last_fullsized":"2024-04-26T10:34:17.425961+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:32.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":8525053976,"num_objects":130083,"num_object_clones":0,"num_object_copies":260166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130083,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":139197,"num_write_kb":8616897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3174,"num_bytes_recovered":208011264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17047429120,"data_stored":17047420976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56722,"ondisk_log_size":56722,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738390,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7029188,"kb_used_data":6781308,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":87342652,"statfs":{"total":96636764160,"available":89438875648,"internally_reserved":0,"allocated":6944059392,"data_stored":6943732497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":253622726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.432}]}]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5451368,"kb_used_data":5279772,"kb_used_omap":1,"kb_used_meta":171390,"kb_avail":88920472,"statfs":{"total":96636764160,"available":91054563328,"internally_reserved":0,"allocated":5406486528,"data_stored":5406129179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":175503814},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.187},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.20999999999999999}]},{"osd":2,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":1.117},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.67400000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738389,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4878752,"kb_used_data":4743444,"kb_used_omap":1,"kb_used_meta":135294,"kb_avail":89493088,"statfs":{"total":96636764160,"available":91640922112,"internally_reserved":0,"allocated":4857286656,"data_stored":4856936883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138541510},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.438},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.46999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5312024576,"data_stored":5312020504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4799533056,"data_stored":4799528984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6935871488,"data_stored":6935871488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:34:24.619 INFO:tasks.thrashosds.thrasher:Setting 3.17 to [0, 2] 2024-04-26T10:34:24.619 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.17', '0', '2'] 2024-04-26T10:34:24.620 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.17 0 2 2024-04-26T10:34:24.659 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:24.656+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:24.688 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:24.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.882731495000002, 2024-04-26T10:34:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:24.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:24.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.882730510000002, 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:24.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:24.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:24.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:24.701 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.882661886999998, 2024-04-26T10:34:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:24.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:24.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:24.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:24.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:24.711 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.882610106999998, 2024-04-26T10:34:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.712 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:24.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:24.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:24.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.718 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.882550256999998, 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.880837552999999, 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.724 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:24.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.729 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.880722486000003, 2024-04-26T10:34:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:24.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:24.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.880629345999999, 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.734 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:24.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:24.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.880435186, 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.740 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:24.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:24.744 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.879227817999997, 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:24.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:24.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.878418910000001, 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:24.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.750 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:24.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:24.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:24.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:24.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.878315372000003, 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:24.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:24.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:24.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:24.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:24.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:24.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:24.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:24.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:24.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:24.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:24.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:24.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:24.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:24.761 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.761 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.762 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.762 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:24.762 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:24.762 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.878238498999998, 2024-04-26T10:34:24.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:24.763 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.763 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.763 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.763 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.764 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.764 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:24.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.764 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:24.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:24.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:24.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:24.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:24.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:24.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:24.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:24.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:24.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:24.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:24.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:24.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:24.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:24.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:24.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:24.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:24.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:24.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:24.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:24.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:24.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:24.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:24.776 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.776 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.776 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.776 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:24.776 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:24.776 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 56.878123115000001, 2024-04-26T10:34:24.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:24.776 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.776 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:24.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:24.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:24.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:24.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:24.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.501479062000001, 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.780 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:24.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.786 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:24.786 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:24.786 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.499449213999998, 2024-04-26T10:34:24.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:24.786 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.786 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.786 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.786 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.786 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.786 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:24.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.786 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:24.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:24.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:24.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:24.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:24.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:24.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:24.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:24.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:24.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:24.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:24.791 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.791 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.791 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.498973411000001, 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:24.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:24.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:24.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.497006357, 2024-04-26T10:34:24.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:24.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:24.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:24.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:24.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:24.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:24.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:24.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:24.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:24.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:24.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:24.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:24.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:24.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:24.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:24.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:24.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:24.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:24.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:24.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103336 5.6 5:6c0cef20:::benchmark_data_smithi043_45180_object103335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:24.804 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.494897051999999, 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064107786, 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103336 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:24.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:24.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188502+0000", 2024-04-26T10:34:24.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:24.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188540+0000", 2024-04-26T10:34:24.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8445000000000002e-05 2024-04-26T10:34:24.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188553+0000", 2024-04-26T10:34:24.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2768e-05 2024-04-26T10:34:24.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188563+0000", 2024-04-26T10:34:24.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9760000000000007e-06 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191877+0000", 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003313908 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192004+0000", 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012663 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192143+0000", 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013964199999999999 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.196467+0000", 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043232230000000002 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252539+0000", 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056072085000000001 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252577+0000", 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8730999999999999e-05 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252611+0000", 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3769000000000001e-05 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:24.810 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:24.811 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 26.494338619000001, 2024-04-26T10:34:24.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:24.811 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:24.811 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:24.811 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:24.811 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:24.811 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:24.811 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:24.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.811 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:24.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:24.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:24.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:24.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:24.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:24.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:24.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:24.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:24.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:24.816 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:24.817 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:24.818 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:24.817+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:24.819 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:24.919 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:24.918+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:25.000 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:25.000 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:25.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.000 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop_reply(client.4538.0:153510 5.2 e48/16)", 2024-04-26T10:34:25.000 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:24.998345+0000", 2024-04-26T10:34:25.001 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 2.3057999999999998e-05, 2024-04-26T10:34:25.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8967000000000001e-05, 2024-04-26T10:34:25.001 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.001 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:25.001 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998345+0000", 2024-04-26T10:34:25.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998345+0000", 2024-04-26T10:34:25.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998344+0000", 2024-04-26T10:34:25.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998348+0000", 2024-04-26T10:34:25.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3380000000000001e-06 2024-04-26T10:34:25.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998355+0000", 2024-04-26T10:34:25.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:34:25.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998360+0000", 2024-04-26T10:34:25.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4029999999999998e-06 2024-04-26T10:34:25.004 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.004 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.004 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop_reply(client.4538.0:153512 5.2 e48/16)", 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:24.998367+0000", 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 6.68e-07, 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3517999999999998e-05, 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998367+0000", 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998367+0000", 2024-04-26T10:34:25.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998367+0000", 2024-04-26T10:34:25.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:34:25.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998369+0000", 2024-04-26T10:34:25.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4100000000000001e-06 2024-04-26T10:34:25.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998372+0000", 2024-04-26T10:34:25.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0790000000000001e-06 2024-04-26T10:34:25.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998374+0000", 2024-04-26T10:34:25.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.587e-06 2024-04-26T10:34:25.007 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.008 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.008 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.008 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:153518 5.6 e48/16 5:663294e7:::benchmark_data_smithi043_45180_object18876:head v 48'9581, mlcod=48'9579)", 2024-04-26T10:34:25.008 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:24.998386+0000", 2024-04-26T10:34:25.008 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9999824, 2024-04-26T10:34:25.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112056, 2024-04-26T10:34:25.008 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.008 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:25.008 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998386+0000", 2024-04-26T10:34:25.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998386+0000", 2024-04-26T10:34:25.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998386+0000", 2024-04-26T10:34:25.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:34:25.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998388+0000", 2024-04-26T10:34:25.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7669999999999999e-06 2024-04-26T10:34:25.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998393+0000", 2024-04-26T10:34:25.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.262e-06 2024-04-26T10:34:25.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998395+0000", 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5399999999999998e-06 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998423+0000", 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7826000000000001e-05 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998443+0000", 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9953e-05 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.011 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.012 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.012 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:153520 5.c e48/16 5:37036d2d:::benchmark_data_smithi043_45180_object18878:head v 48'9558, mlcod=48'9556)", 2024-04-26T10:34:25.012 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:24.998400+0000", 2024-04-26T10:34:25.012 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9999676, 2024-04-26T10:34:25.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016501499999999999, 2024-04-26T10:34:25.012 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.012 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:25.012 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998400+0000", 2024-04-26T10:34:25.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998400+0000", 2024-04-26T10:34:25.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998400+0000", 2024-04-26T10:34:25.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:34:25.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998402+0000", 2024-04-26T10:34:25.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0540000000000002e-06 2024-04-26T10:34:25.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998405+0000", 2024-04-26T10:34:25.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.926e-06 2024-04-26T10:34:25.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998407+0000", 2024-04-26T10:34:25.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2350000000000002e-06 2024-04-26T10:34:25.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998435+0000", 2024-04-26T10:34:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7268e-05 2024-04-26T10:34:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998451+0000", 2024-04-26T10:34:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.666e-05 2024-04-26T10:34:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.019 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:153522 5.f 5:f3140184:::benchmark_data_smithi043_45180_object18880:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:34:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:24.998415+0000", 2024-04-26T10:34:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4294967295.9999528, 2024-04-26T10:34:25.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000187894, 2024-04-26T10:34:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.021 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 153522 2024-04-26T10:34:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998415+0000", 2024-04-26T10:34:25.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998415+0000", 2024-04-26T10:34:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998415+0000", 2024-04-26T10:34:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998417+0000", 2024-04-26T10:34:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0360000000000001e-06 2024-04-26T10:34:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998422+0000", 2024-04-26T10:34:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9949999999999996e-06 2024-04-26T10:34:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998426+0000", 2024-04-26T10:34:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6950000000000002e-06 2024-04-26T10:34:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998461+0000", 2024-04-26T10:34:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5228000000000002e-05 2024-04-26T10:34:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.998576+0000", 2024-04-26T10:34:25.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114753 2024-04-26T10:34:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:153514 5.1 5:803b012b:::benchmark_data_smithi043_45180_object18872:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:34:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:24.993946+0000", 2024-04-26T10:34:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0044218230000000001, 2024-04-26T10:34:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047019080000000003, 2024-04-26T10:34:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.030 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 153514 2024-04-26T10:34:25.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.993946+0000", 2024-04-26T10:34:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.993946+0000", 2024-04-26T10:34:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.993945+0000", 2024-04-26T10:34:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.993957+0000", 2024-04-26T10:34:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1995e-05 2024-04-26T10:34:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.993966+0000", 2024-04-26T10:34:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5799999999999992e-06 2024-04-26T10:34:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.993974+0000", 2024-04-26T10:34:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1899999999999995e-06 2024-04-26T10:34:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.994156+0000", 2024-04-26T10:34:25.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000182306 2024-04-26T10:34:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.995512+0000", 2024-04-26T10:34:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013557650000000001 2024-04-26T10:34:25.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.995626+0000", 2024-04-26T10:34:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011396 2024-04-26T10:34:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.997732+0000", 2024-04-26T10:34:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021055700000000002 2024-04-26T10:34:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.040 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.041 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.041 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:153515 5.5 e48/16 5:ab8a156f:::benchmark_data_smithi043_45180_object18873:head v 48'9556, mlcod=48'9554)", 2024-04-26T10:34:25.041 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:24.995375+0000", 2024-04-26T10:34:25.041 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0029926589999999999, 2024-04-26T10:34:25.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033593669999999998, 2024-04-26T10:34:25.042 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.042 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:25.042 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.995375+0000", 2024-04-26T10:34:25.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.995375+0000", 2024-04-26T10:34:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.995375+0000", 2024-04-26T10:34:25.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.995380+0000", 2024-04-26T10:34:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0499999999999999e-06 2024-04-26T10:34:25.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.995389+0000", 2024-04-26T10:34:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:34:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.995396+0000", 2024-04-26T10:34:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6220000000000003e-06 2024-04-26T10:34:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.995443+0000", 2024-04-26T10:34:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7136999999999999e-05 2024-04-26T10:34:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.995461+0000", 2024-04-26T10:34:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7740999999999998e-05 2024-04-26T10:34:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:153521 5.2 5:4b34cddc:::benchmark_data_smithi043_45180_object18879:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:34:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:24.996712+0000", 2024-04-26T10:34:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0016563070000000001, 2024-04-26T10:34:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020925259999999999, 2024-04-26T10:34:25.050 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 153521 2024-04-26T10:34:25.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.996712+0000", 2024-04-26T10:34:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.996712+0000", 2024-04-26T10:34:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.996711+0000", 2024-04-26T10:34:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.996714+0000", 2024-04-26T10:34:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.484e-06 2024-04-26T10:34:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.996723+0000", 2024-04-26T10:34:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3000000000000002e-06 2024-04-26T10:34:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.996728+0000", 2024-04-26T10:34:25.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6540000000000004e-06 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.996782+0000", 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3525e-05 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.996910+0000", 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012829700000000001 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:24.997019+0000", 2024-04-26T10:34:25.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108633 2024-04-26T10:34:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:34:25.057 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 8 2024-04-26T10:34:25.057 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:25.059 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:25.059 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:25.057+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:25.160 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:25.157+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:25.238 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:25.239 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:34:25.239 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:34:25.239 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:34:25.239 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:25.254 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:25.260 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:25.258+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:25.361 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:25.360+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:25.437 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:34:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:34:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 57.634038105000002, 2024-04-26T10:34:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:34:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:95997 5.7 5:ef48f664:::benchmark_data_smithi043_45180_object95996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.848828623999999, 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024010581999999999, 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 95997 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585320+0000", 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585344+0000", 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4491e-05 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585350+0000", 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1099999999999999e-06 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.585355+0000", 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5430000000000004e-06 2024-04-26T10:34:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592076+0000", 2024-04-26T10:34:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067208470000000003 2024-04-26T10:34:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592209+0000", 2024-04-26T10:34:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013344400000000001 2024-04-26T10:34:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.592320+0000", 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011081700000000001 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.594282+0000", 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019622699999999999 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609277+0000", 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014995066 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609308+0000", 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1242999999999999e-05 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:54.609331+0000", 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2150999999999998e-05 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101455 5.f 5:fbcc5be4:::benchmark_data_smithi043_45180_object101454:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.164167436, 2024-04-26T10:34:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02195165, 2024-04-26T10:34:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101455 2024-04-26T10:34:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.269981+0000", 2024-04-26T10:34:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270103+0000", 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122309 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270111+0000", 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3999999999999992e-06 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270118+0000", 2024-04-26T10:34:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9179999999999997e-06 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272018+0000", 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018998610000000001 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272126+0000", 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010844999999999999 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272225+0000", 2024-04-26T10:34:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8381999999999994e-05 2024-04-26T10:34:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278402+0000", 2024-04-26T10:34:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0061767009999999997 2024-04-26T10:34:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291830+0000", 2024-04-26T10:34:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013428756 2024-04-26T10:34:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291894+0000", 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3189999999999996e-05 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291933+0000", 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9297e-05 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101456 5.f 5:f61cae04:::benchmark_data_smithi043_45180_object101455:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.163886254000001, 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021829133000000001, 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101456 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270262+0000", 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270361+0000", 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9395999999999995e-05 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270369+0000", 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5490000000000001e-06 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.270374+0000", 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5130000000000004e-06 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273610+0000", 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003235791 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273723+0000", 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112833 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273861+0000", 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013803 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278411+0000", 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045506380000000001 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.291986+0000", 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013574409000000001 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292037+0000", 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1041000000000001e-05 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.292091+0000", 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4617000000000002e-05 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101459 5.f 5:f6287f2a:::benchmark_data_smithi043_45180_object101458:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.161973346, 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022608105999999999, 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101459 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272175+0000", 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272227+0000", 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2669e-05 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272236+0000", 2024-04-26T10:34:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0210000000000005e-06 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272243+0000", 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7469999999999999e-06 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276304+0000", 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040604789999999997 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276386+0000", 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2278000000000001e-05 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.276477+0000", 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0713999999999999e-05 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278905+0000", 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024288249999999999 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294715+0000", 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015809976999999999 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294747+0000", 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1814999999999999e-05 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294783+0000", 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6180999999999998e-05 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:101461 5.f 5:fcae472f:::benchmark_data_smithi043_45180_object101460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.161180086000002, 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021972760000000001, 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 101461 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272969+0000", 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.272968+0000", 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273035+0000", 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7477000000000005e-05 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273043+0000", 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4159999999999998e-06 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.273049+0000", 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4509999999999997e-06 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277407+0000", 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043580529999999998 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277489+0000", 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1333000000000002e-05 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.277574+0000", 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5042000000000003e-05 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.278908+0000", 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013341360000000001 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294832+0000", 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015924462 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294899+0000", 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6984999999999996e-05 2024-04-26T10:34:25.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.294941+0000", 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2113000000000002e-05 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:102382 5.2 5:4e9d92ee:::benchmark_data_smithi043_45180_object102381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.726881325000001, 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021126853000000001, 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.471 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 102382 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:25.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707267+0000", 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707330+0000", 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3274000000000004e-05 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707339+0000", 2024-04-26T10:34:25.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9700000000000005e-06 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.707346+0000", 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709272+0000", 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019264169999999999 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709387+0000", 2024-04-26T10:34:25.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000115333 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.709479+0000", 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1555e-05 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.712520+0000", 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030408729999999999 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728336+0000", 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015815929999999999 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728370+0000", 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4496999999999999e-05 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:57.728394+0000", 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3793000000000001e-05 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103328 5.6 e32/16 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head v 32'6425, mlcod=32'6423)", 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.249788796000001, 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064716840999999997, 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184359+0000", 2024-04-26T10:34:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184419+0000", 2024-04-26T10:34:25.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9345999999999997e-05 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184425+0000", 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1190000000000002e-06 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184429+0000", 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.296e-06 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184461+0000", 2024-04-26T10:34:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2122999999999997e-05 2024-04-26T10:34:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184477+0000", 2024-04-26T10:34:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5877000000000001e-05 2024-04-26T10:34:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249048+0000", 2024-04-26T10:34:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064570494000000006 2024-04-26T10:34:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249077+0000", 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9081000000000002e-05 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103327 5.c e32/16 5:3133c183:::benchmark_data_smithi043_45180_object103326:head v 32'6430, mlcod=32'6425)", 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.249622198000001, 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064984741999999998, 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.481 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184592+0000", 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6027999999999999e-05 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184597+0000", 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8570000000000003e-06 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184600+0000", 2024-04-26T10:34:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3390000000000001e-06 2024-04-26T10:34:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184620+0000", 2024-04-26T10:34:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9890000000000001e-05 2024-04-26T10:34:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184631+0000", 2024-04-26T10:34:25.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1073999999999999e-05 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249477+0000", 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064845485999999994 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249511+0000", 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4508000000000002e-05 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103329 5.6 e32/16 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head v 32'6426, mlcod=32'6423)", 2024-04-26T10:34:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.245788377, 2024-04-26T10:34:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063744996999999998, 2024-04-26T10:34:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188359+0000", 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188389+0000", 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9416000000000001e-05 2024-04-26T10:34:25.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243409+0000", 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.055020409999999999 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243419+0000", 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0071000000000001e-05 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243465+0000", 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5799e-05 2024-04-26T10:34:25.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243491+0000", 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5619999999999999e-05 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252067+0000", 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085763809999999992 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252105+0000", 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8040999999999997e-05 2024-04-26T10:34:25.489 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103337 5.d e32/16 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head v 32'6429, mlcod=32'6427)", 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.245718, 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.057982037, 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188430+0000", 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188500+0000", 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0062999999999996e-05 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243434+0000", 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.054933760999999998 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243442+0000", 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243490+0000", 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8312000000000001e-05 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243511+0000", 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0781999999999999e-05 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246370+0000", 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028590930000000001 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246413+0000", 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2413000000000002e-05 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103660 5.9 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.051782355, 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.067661676000000004, 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.494 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103660 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382365+0000", 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382430+0000", 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4850000000000004e-05 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382439+0000", 2024-04-26T10:34:25.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382445+0000", 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0229999999999998e-06 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382482+0000", 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6909000000000002e-05 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382613+0000", 2024-04-26T10:34:25.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013072600000000001 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382756+0000", 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000143306 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385090+0000", 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002333786 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449925+0000", 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064835173999999995 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449985+0000", 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0124999999999998e-05 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450028+0000", 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2457999999999999e-05 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103662 5.f 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.049338545000001, 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.068705924000000002, 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103662 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384809+0000", 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384908+0000", 2024-04-26T10:34:25.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9146000000000002e-05 2024-04-26T10:34:25.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384921+0000", 2024-04-26T10:34:25.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2622e-05 2024-04-26T10:34:25.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384931+0000", 2024-04-26T10:34:25.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0108e-05 2024-04-26T10:34:25.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384984+0000", 2024-04-26T10:34:25.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2849000000000002e-05 2024-04-26T10:34:25.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:25.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017266800000000001 2024-04-26T10:34:25.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:25.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385313+0000", 2024-04-26T10:34:25.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015649300000000001 2024-04-26T10:34:25.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388446+0000", 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003133481 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453401+0000", 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064955075000000001 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453462+0000", 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1134000000000001e-05 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453516+0000", 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3477999999999999e-05 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103664 5.9 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.049055860999999, 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.065076041000000001, 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.509 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103664 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385092+0000", 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385145+0000", 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3143000000000003e-05 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0473e-05 2024-04-26T10:34:25.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385163+0000", 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385193+0000", 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0638e-05 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385284+0000", 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599000000000005e-05 2024-04-26T10:34:25.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385375+0000", 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0606999999999995e-05 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387556+0000", 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021809529999999998 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450072+0000", 2024-04-26T10:34:25.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062516408999999995 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450123+0000", 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1406000000000002e-05 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450169+0000", 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5380000000000003e-05 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103666 5.f 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.047292488, 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066830159, 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103666 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386855+0000", 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386928+0000", 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386937+0000", 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1090000000000004e-06 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386945+0000", 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386981+0000", 2024-04-26T10:34:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5899999999999998e-05 2024-04-26T10:34:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387071+0000", 2024-04-26T10:34:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9954e-05 2024-04-26T10:34:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387161+0000", 2024-04-26T10:34:25.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0898999999999998e-05 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390584+0000", 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034229030000000001 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453579+0000", 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062994267000000007 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453640+0000", 2024-04-26T10:34:25.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1162999999999997e-05 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453686+0000", 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6493999999999999e-05 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103667 5.f 5:f4dc36e8:::benchmark_data_smithi043_45180_object103666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.046431418000001, 2024-04-26T10:34:25.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066218387000000004, 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103667 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387783+0000", 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5973e-05 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387791+0000", 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1850000000000004e-06 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387796+0000", 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388469+0000", 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0006734 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388547+0000", 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7188999999999996e-05 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388630+0000", 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3892000000000002e-05 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390598+0000", 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00196759 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453803+0000", 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063205069000000003 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453844+0000", 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1248999999999998e-05 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453936+0000", 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1201999999999999e-05 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.525 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:107998 5.9 5:9ce23eb0:::benchmark_data_smithi043_45180_object107997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.938513038, 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025313064, 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107998 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.526 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495634+0000", 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:25.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495754+0000", 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119893 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495769+0000", 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4769999999999999e-05 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495781+0000", 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1858999999999999e-05 2024-04-26T10:34:25.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502521+0000", 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067402410000000001 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502675+0000", 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015405099999999999 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1,2", 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502846+0000", 2024-04-26T10:34:25.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000171001 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.505743+0000", 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028975490000000001 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.508006+0000", 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022627620000000002 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520788+0000", 2024-04-26T10:34:25.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012782244 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520846+0000", 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7976999999999997e-05 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520949+0000", 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102267 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:107974 5.b e35/34 5:daaeafb8:::benchmark_data_smithi043_45180_object107973:head v 35'6822, mlcod=0'0)", 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.919486214999999, 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020988144, 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514662+0000", 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514661+0000", 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514668+0000", 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0249999999999997e-06 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514678+0000", 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7950000000000002e-06 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514686+0000", 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9049999999999997e-06 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514872+0000", 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018605499999999999 2024-04-26T10:34:25.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514900+0000", 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7758000000000001e-05 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.535626+0000", 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020725958999999999 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.535651+0000", 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-05 2024-04-26T10:34:25.535 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:108005 5.c e35/16 5:3b5c73fa:::benchmark_data_smithi043_45180_object108004:head v 35'6720, mlcod=33'6718)", 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 22.919425201999999, 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025223481999999998, 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514766+0000", 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2818999999999998e-05 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514773+0000", 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999996e-06 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514777+0000", 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6199999999999998e-06 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522074+0000", 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072964029999999999 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522096+0000", 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2027000000000001e-05 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539924+0000", 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017827749 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539947+0000", 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3232999999999999e-05 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "MOSDPGPushReply(5.9 38/34 [PushReplyOp(5:91d0b3ac:::benchmark_data_smithi043_45180_object10370:head)])", 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.335471757000001, 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022588196000000001, 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:25.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098677+0000", 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967296 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098679+0000", 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.295e-06 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098683+0000", 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8659999999999999e-06 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.098687+0000", 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.67e-06 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.121146+0000", 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022459798 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:08.121265+0000", 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011866000000000001 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:25.543 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:25.545 INFO:teuthology.orchestra.run.smithi043.stderr:set 3.17 pg_upmap mapping to [0,2] 2024-04-26T10:34:25.546 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:25.547 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:25.543+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:25.646 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:25.645+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:25.724 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:25.725 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:25.725 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.725 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:155636 5.b 5:d03bd0ad:::benchmark_data_smithi043_45180_object20994:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:34:25.725 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:25.715570+0000", 2024-04-26T10:34:25.725 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0075042329999999999, 2024-04-26T10:34:25.725 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0075470449999999996, 2024-04-26T10:34:25.725 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:25.725 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:25.725 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:25.725 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:25.725 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.725 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 155636 2024-04-26T10:34:25.725 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715570+0000", 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715570+0000", 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715569+0000", 2024-04-26T10:34:25.726 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715574+0000", 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4e-06 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715581+0000", 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5549999999999999e-06 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715586+0000", 2024-04-26T10:34:25.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7999999999999998e-06 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715617+0000", 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1575000000000002e-05 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715734+0000", 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000116752 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:25.728 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715820+0000", 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6243999999999996e-05 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.718447+0000", 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0026269549999999998 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:155640 5.b 5:df38ed46:::benchmark_data_smithi043_45180_object20998:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:25.715617+0000", 2024-04-26T10:34:25.729 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0074565509999999996, 2024-04-26T10:34:25.730 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0076048340000000004, 2024-04-26T10:34:25.730 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:25.730 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:25.730 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:25.730 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:25.730 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.730 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 155640 2024-04-26T10:34:25.730 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.730 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:25.730 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.730 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:25.730 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715617+0000", 2024-04-26T10:34:25.730 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715617+0000", 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715617+0000", 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:25.731 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715619+0000", 2024-04-26T10:34:25.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2280000000000001e-06 2024-04-26T10:34:25.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.732 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:25.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715625+0000", 2024-04-26T10:34:25.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9159999999999998e-06 2024-04-26T10:34:25.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.732 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.715631+0000", 2024-04-26T10:34:25.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3460000000000001e-06 2024-04-26T10:34:25.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.717174+0000", 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015433739999999999 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.717255+0000", 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1483000000000006e-05 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.717320+0000", 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4298e-05 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.718697+0000", 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013770309999999999 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:155647 5.b 5:d9e925dd:::benchmark_data_smithi043_45180_object21005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:25.719328+0000", 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0037455629999999999, 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0039835219999999998, 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:25.734 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 155647 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.719328+0000", 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.719328+0000", 2024-04-26T10:34:25.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.719328+0000", 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.719331+0000", 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3850000000000002e-06 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.719338+0000", 2024-04-26T10:34:25.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2599999999999999e-06 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.719343+0000", 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6129999999999997e-06 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.719367+0000", 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4063999999999999e-05 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.719440+0000", 2024-04-26T10:34:25.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2837999999999996e-05 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.719500+0000", 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0090999999999998e-05 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.720676+0000", 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0011761359999999999 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:155648 5.0 5:08fb88c6:::benchmark_data_smithi043_45180_object21006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:25.720069+0000", 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.003004872, 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0033311679999999998, 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 155648 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.720069+0000", 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.720069+0000", 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.720068+0000", 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.740 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.720073+0000", 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1899999999999997e-06 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.720081+0000", 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.242e-06 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.720091+0000", 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0121e-05 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.720117+0000", 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5777000000000001e-05 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.720198+0000", 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0871000000000005e-05 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.720260+0000", 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1991999999999999e-05 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.721984+0000", 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001723891 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723386+0000", 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001401979 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.743 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:155655 5.b 5:de38ba2d:::benchmark_data_smithi043_45180_object21013:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:25.722752+0000", 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.000321971, 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00072438899999999998, 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 155655 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.722752+0000", 2024-04-26T10:34:25.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.722752+0000", 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.722751+0000", 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.722757+0000", 2024-04-26T10:34:25.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3360000000000002e-06 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.722770+0000", 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3424999999999999e-05 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.722778+0000", 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6499999999999996e-06 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.722814+0000", 2024-04-26T10:34:25.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6884000000000001e-05 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.722897+0000", 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2198000000000001e-05 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.722963+0000", 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5959999999999999e-05 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:155656 5.a e49/16 5:595f06c9:::benchmark_data_smithi043_45180_object21014:head v 49'9859, mlcod=49'9857)", 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:25.723036+0000", 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 3.7988000000000003e-05, 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00048557400000000001, 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723036+0000", 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:25.748 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723036+0000", 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723036+0000", 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723040+0000", 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6800000000000001e-06 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:25.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723050+0000", 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6719999999999999e-06 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723055+0000", 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4299999999999997e-06 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723095+0000", 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9991999999999999e-05 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:25.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723110+0000", 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4919999999999999e-05 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:155636 5.b e49/42)", 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:25.723072+0000", 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 2.4049999999999998e-06, 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00048356799999999998, 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:25.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723072+0000", 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723072+0000", 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723071+0000", 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723074+0000", 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8789999999999999e-06 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723081+0000", 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6320000000000002e-06 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723089+0000", 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2230000000000007e-06 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.753 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:155640 5.b e49/42)", 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:25.723105+0000", 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4294967295.9999695, 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00047631000000000003, 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723105+0000", 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.754 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723105+0000", 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723104+0000", 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723106+0000", 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2170000000000001e-06 2024-04-26T10:34:25.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723112+0000", 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4e-06 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723115+0000", 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0199999999999999e-06 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:155658 5.f e49/41 5:f6dc87a3:::benchmark_data_smithi043_45180_object21016:head v 49'9491, mlcod=49'9489)", 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:25.723119+0000", 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4294967295.9999557, 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00049012199999999995, 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723119+0000", 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:25.757 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723119+0000", 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723118+0000", 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723124+0000", 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8420000000000001e-06 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:25.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723134+0000", 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0864e-05 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723141+0000", 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.224e-06 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723175+0000", 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4518999999999999e-05 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:25.759 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:25.760 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:25.723193+0000", 2024-04-26T10:34:25.760 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7566000000000001e-05 2024-04-26T10:34:25.760 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.760 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:25.760 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.760 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:25.760 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:34:25.760 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 9 2024-04-26T10:34:25.760 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:25.761 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:25.762 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:25.760+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:25.862 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:25.861+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:25.963 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:25.962+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:25.981 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:25.981 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:25.981 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:25.981 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:25.981 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:25.996 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:26.064 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:26.064+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:26.085 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:34:26.166 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:26.165+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:26.215 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:26.215 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:26.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:26.216 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:26.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.216 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:26.216 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:26.216 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.41214342, 2024-04-26T10:34:26.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:26.216 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.216 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.216 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.216 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:26.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:26.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:26.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.222 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:26.222 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:26.222 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.411315340000002, 2024-04-26T10:34:26.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:26.222 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.222 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.222 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.222 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.222 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.222 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:26.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.222 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:26.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:26.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:26.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:26.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:26.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:26.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:26.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:26.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:26.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:26.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:26.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:26.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:26.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:26.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.228 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:26.228 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:26.228 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.410386277000001, 2024-04-26T10:34:26.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:26.228 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.228 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.228 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.228 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.228 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.228 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:26.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.229 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:26.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:26.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:26.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:26.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.234 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:26.234 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:26.234 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.409700835999999, 2024-04-26T10:34:26.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:26.234 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.234 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.234 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.234 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.234 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.234 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:26.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.234 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:26.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:26.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:26.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:26.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:26.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:26.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:26.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:26.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:26.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:26.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:26.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:26.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:26.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:26.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:26.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:26.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:26.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:26.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:26.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:26.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:26.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:26.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:26.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:26.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:26.245 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.245 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.245 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.246 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103337 5.d 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:26.246 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:26.246 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 28.024042163000001, 2024-04-26T10:34:26.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.058853520999999999, 2024-04-26T10:34:26.246 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.247 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.247 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103337 2024-04-26T10:34:26.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.248 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:26.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:26.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:26.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:26.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188132+0000", 2024-04-26T10:34:26.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6197000000000003e-05 2024-04-26T10:34:26.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188144+0000", 2024-04-26T10:34:26.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2001000000000001e-05 2024-04-26T10:34:26.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188152+0000", 2024-04-26T10:34:26.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9349999999999994e-06 2024-04-26T10:34:26.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188185+0000", 2024-04-26T10:34:26.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3436000000000003e-05 2024-04-26T10:34:26.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188275+0000", 2024-04-26T10:34:26.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9995999999999997e-05 2024-04-26T10:34:26.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:26.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188365+0000", 2024-04-26T10:34:26.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0254999999999996e-05 2024-04-26T10:34:26.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.194973+0000", 2024-04-26T10:34:26.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066073490000000002 2024-04-26T10:34:26.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246781+0000", 2024-04-26T10:34:26.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.051808372999999998 2024-04-26T10:34:26.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246865+0000", 2024-04-26T10:34:26.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3498999999999995e-05 2024-04-26T10:34:26.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246920+0000", 2024-04-26T10:34:26.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5208999999999999e-05 2024-04-26T10:34:26.259 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.259 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.259 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.260 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:26.260 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:26.260 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.833410394000001, 2024-04-26T10:34:26.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:26.261 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.261 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.261 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.261 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.261 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.261 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:26.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.262 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:26.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:26.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.264 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.264 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:26.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:26.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:26.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:26.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:26.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:26.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:26.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:26.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:26.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:26.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:26.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:26.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:26.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:26.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:26.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:26.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:26.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:26.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:26.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:26.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:26.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:26.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:26.272 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.273 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.273 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.273 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:26.273 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:26.273 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.83319109, 2024-04-26T10:34:26.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:26.273 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.274 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.274 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.274 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.274 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.274 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:26.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.274 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:26.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:26.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:26.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:26.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:26.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:26.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:26.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:26.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:26.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:26.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:26.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:26.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.278 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.278 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:26.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:26.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:26.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:26.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:26.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:26.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:26.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.280 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:26.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:26.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:26.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:26.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:26.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:26.281 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.281 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.282 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.282 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:26.282 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:26.282 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.833111285000001, 2024-04-26T10:34:26.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:26.282 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.282 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.282 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.283 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.283 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.283 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:26.283 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.283 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:26.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:26.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:26.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:26.286 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.286 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:26.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:26.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:26.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:26.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:26.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:26.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.289 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.289 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:26.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:26.289 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.289 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.289 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.289 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:26.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:26.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:26.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:26.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:26.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:26.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:26.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:26.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:26.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:26.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:26.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:26.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:26.294 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.294 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.294 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.295 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:26.295 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:26.295 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.831747255, 2024-04-26T10:34:26.295 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:26.295 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.295 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.296 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.296 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.296 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.296 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:26.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.297 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.297 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:26.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:26.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:26.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:26.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:26.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:26.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:26.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:26.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:26.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:26.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.302 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:26.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:26.302 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:26.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:26.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:26.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:26.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:26.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:26.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:26.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:26.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:26.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:26.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:26.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:26.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:26.307 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.307 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.307 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.307 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:26.307 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:26.307 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.831152918000001, 2024-04-26T10:34:26.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:26.308 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.308 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.308 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.308 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.308 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.308 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:26.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.309 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:26.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:26.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:26.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:26.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:26.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:26.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:26.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:26.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:26.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:26.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:26.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:26.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:26.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:26.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:26.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.314 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.314 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:26.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:26.314 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.314 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.314 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:26.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:26.314 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.314 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.314 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.314 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.830392562, 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:26.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:26.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:26.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:26.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:26.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:26.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:26.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:26.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:26.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:26.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:26.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.321 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.321 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:26.321 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:26.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.321 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.321 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:26.321 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:26.321 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.321 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.321 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.322 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:26.322 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:26.322 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.829775101999999, 2024-04-26T10:34:26.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:26.322 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.322 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.322 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.322 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.323 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.323 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:26.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.323 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:26.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:26.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:26.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:26.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:26.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:26.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.326 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.326 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:26.326 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:26.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.326 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.327 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:26.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:26.327 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.327 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.328 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:26.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:26.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:26.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:26.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:26.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:26.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:26.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:26.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:26.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:26.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.829210099000001, 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.332 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.333 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:26.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.333 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.333 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.333 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:26.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.333 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.333 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.333 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:26.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:26.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:26.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:26.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:26.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:26.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:26.336 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.828666787, 2024-04-26T10:34:26.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:26.337 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.337 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.337 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.337 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.337 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.337 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:26.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.337 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:26.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.338 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.338 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:26.338 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.338 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.338 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:26.338 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:26.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.338 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:26.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.341 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:26.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:26.341 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.341 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:26.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:26.341 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.341 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:26.342 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.827194787, 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:26.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.347 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.826629366999999, 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.348 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:26.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:26.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:26.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:26.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:26.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:26.352 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.826564517000001, 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.354 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.355 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.356 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.825803536999999, 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.357 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.358 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:26.360 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.824782109000001, 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:26.362 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:26.363 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.364 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103647 5.b e32/16 ondisk, result = 0)", 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 27.824763409999999, 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060768513000000003, 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:26.365 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387344+0000", 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387350+0000", 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.22e-06 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.366 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447917+0000", 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060567523999999998 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447925+0000", 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7689999999999996e-06 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448004+0000", 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9246000000000007e-05 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.367 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:26.368 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448012+0000", 2024-04-26T10:34:26.368 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3490000000000003e-06 2024-04-26T10:34:26.368 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:26.368 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:26.368 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:26.368 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448114+0000", 2024-04-26T10:34:26.368 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010205299999999999 2024-04-26T10:34:26.368 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.368 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.368 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.368 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:26.368 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:26.368 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:26.370 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:26.370 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:26.370 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:26.371 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:26.371 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:26.368+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:26.372 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:26.372 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:26.372 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:26.470 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:26.469+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:26.542 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:34:26.566 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:26.566 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:26.571 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:26.570+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:26.582 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:26.672 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:26.671+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:26.773 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:26.772+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:26.779 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:26.779 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:26.795 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:26.874 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:26.872+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:26.983 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:26.978+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:26.994 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:26.994 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:27.010 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:27.075 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:27.074+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:27.177 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:27.175+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:27.191 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:27.192 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:27.205 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:27.278 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:27.276+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:27.379 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:27.377+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:27.380 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:27.380 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:27.392 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:27.479 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:27.478+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:27.540 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-26T10:34:27.571 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:27.571 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:27.581 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:27.580+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:27.584 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:27.681 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:27.680+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:27.760 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:27.760 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:27.774 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:27.815 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:27.814+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:27.883 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:27.883+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:27.984 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:27.985 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:27.985 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:27.983+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:27.998 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:28.086 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:28.084+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:28.180 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:28.180 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:28.186 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:28.185+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:28.192 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:28.288 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:28.287+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:28.373 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:28.381 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:28.382 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:28.389 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:28.388+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:28.397 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:28.490 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:28.489+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:28.527 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:28.548 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:28.572 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:28.573 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:28.573 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:28.573 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:28.591 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:28.590+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:28.633 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:28.633 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:28.633 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:34:28.634 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:34:28.634 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:28.646 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:28.693 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:28.693+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:28.794 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:28.793+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:28.838 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:28.838 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:28.838 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:28.838 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.034431261999998, 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.839 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:28.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:28.840 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.840 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.840 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.840 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.840 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:28.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:28.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:28.841 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:28.841 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.841 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.841 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.841 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:28.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:28.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:28.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:28.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.842 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.842 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:28.842 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:28.842 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.842 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:28.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:28.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:28.843 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:28.843 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:28.843 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.843 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.843 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:28.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:28.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:28.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:28.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.844 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.844 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.844 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:28.844 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:28.844 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.845 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.845 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:28.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:28.845 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.845 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.845 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.845 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.845 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.845 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:28.845 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:28.845 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.034430276999998, 2024-04-26T10:34:28.845 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.846 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:28.847 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:28.848 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.849 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.850 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:28.850 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:28.850 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.034361654000001, 2024-04-26T10:34:28.850 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:28.850 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.850 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.850 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.850 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.850 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.850 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:28.850 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.850 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.850 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:28.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.851 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.851 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:28.851 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.851 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.851 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:28.852 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:28.852 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.852 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.852 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.852 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.853 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:28.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:28.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:28.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:28.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.854 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.854 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:28.854 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:28.854 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:28.854 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:28.855 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.034309874000002, 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.856 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:28.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:28.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:28.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:28.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:28.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:28.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:28.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:28.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:28.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:28.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:28.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:28.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:28.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:28.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:28.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:28.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:28.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.862 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.862 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:28.863 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:28.863 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.034250024000002, 2024-04-26T10:34:28.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:28.863 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.863 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.863 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.863 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.863 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.864 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:28.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.864 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:28.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.864 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.864 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.864 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:28.864 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:28.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:28.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:28.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:28.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:28.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:28.868 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.869 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.869 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.869 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:28.869 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:28.870 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.032537320000003, 2024-04-26T10:34:28.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:28.870 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.870 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.870 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.870 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.871 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.871 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:28.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.871 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:28.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:28.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:28.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:28.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:28.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:28.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:28.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:28.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:28.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:28.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:28.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:28.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:28.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:28.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:28.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:28.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:28.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:28.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:28.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:28.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:28.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:28.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:28.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.881 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.881 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:28.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:28.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.882 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.882 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.882 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.882 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.882 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:28.883 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:28.883 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.032422253, 2024-04-26T10:34:28.883 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:28.883 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.883 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.883 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:28.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:28.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:28.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:28.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:28.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:28.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:28.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:28.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:28.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:28.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:28.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:28.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:28.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:28.890 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:28.891 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:28.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.891 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.891 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:28.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:28.892 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.892 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.892 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.892 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.892 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.893 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:28.893 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:28.893 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.032329113000003, 2024-04-26T10:34:28.893 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:28.893 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.893 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.894 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.894 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.894 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.894 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:28.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.895 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:28.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:28.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:28.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:28.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:28.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:28.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:28.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:28.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:28.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:28.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:28.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:28.899 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:28.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:28.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.900 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:28.900 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:28.900 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:28.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:28.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:28.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.901 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.901 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.901 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:28.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:28.901 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:28.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:28.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:28.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:28.902 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.902 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.903 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.903 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:28.903 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:28.903 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.032134953000003, 2024-04-26T10:34:28.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:28.903 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.903 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.903 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:28.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:28.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:28.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:28.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:28.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:28.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:28.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:28.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:28.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:28.907 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.030927585000001, 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:28.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:28.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:28.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:28.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:28.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:28.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.911 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.911 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:28.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:28.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:28.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:28.912 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.913 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.913 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.913 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:28.913 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:28.913 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.030118676999997, 2024-04-26T10:34:28.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:28.914 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.914 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.914 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.914 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.914 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.915 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:28.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.915 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:28.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:28.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:28.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:28.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:28.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:28.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:28.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:28.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:28.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:28.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:28.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:28.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:28.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:28.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:28.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:28.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:28.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:28.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:28.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:28.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:28.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:28.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:28.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:28.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.030015139, 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.925 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:28.930 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.029938266000002, 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:28.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:28.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:28.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 61.029822881999998, 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.938 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.939 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.653178829000002, 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.940 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:28.941 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.942 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:28.943 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.944 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:28.945 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.651148980999999, 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:28.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:28.948 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:28.949 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:28.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:28.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:28.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.950 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:28.950 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:28.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.950 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.950 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.650673178000002, 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.951 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:28.953 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.954 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.955 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.956 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.648706124, 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.957 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:28.958 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:28.959 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:28.960 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:28.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:28.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:28.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.961 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:28.961 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:28.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.961 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.961 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103336 5.6 5:6c0cef20:::benchmark_data_smithi043_45180_object103335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:28.962 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.646596818999999, 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064107786, 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103336 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188502+0000", 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188540+0000", 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8445000000000002e-05 2024-04-26T10:34:28.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188553+0000", 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2768e-05 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188563+0000", 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9760000000000007e-06 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191877+0000", 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003313908 2024-04-26T10:34:28.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192004+0000", 2024-04-26T10:34:28.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012663 2024-04-26T10:34:28.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:28.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192143+0000", 2024-04-26T10:34:28.966 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013964199999999999 2024-04-26T10:34:28.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.966 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.966 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.966 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.196467+0000", 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043232230000000002 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252539+0000", 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056072085000000001 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252577+0000", 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8730999999999999e-05 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.967 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252611+0000", 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3769000000000001e-05 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 30.646038386000001, 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:28.968 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:28.969 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:28.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.969 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:28.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:28.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:28.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.969 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.969 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.969 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:28.969 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:28.969 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:28.970 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.971 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.972 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.973 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.974 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:28.974 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:28.974 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:28.975 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:28.974+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:28.975 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:29.084 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:29.079+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:29.152 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:29.153 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:29.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.153 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:165344 5.f 5:f52bbc25:::benchmark_data_smithi043_45180_object30702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:29.153 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.150761+0000", 2024-04-26T10:34:29.153 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0013431420000000001, 2024-04-26T10:34:29.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013603580000000001, 2024-04-26T10:34:29.153 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.153 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:29.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:29.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:29.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.153 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 165344 2024-04-26T10:34:29.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.154 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.150761+0000", 2024-04-26T10:34:29.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.150761+0000", 2024-04-26T10:34:29.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.150760+0000", 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.150765+0000", 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.826e-06 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.150774+0000", 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3680000000000008e-06 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.150781+0000", 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9349999999999997e-06 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.150820+0000", 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8464999999999998e-05 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.150906+0000", 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6405999999999999e-05 2024-04-26T10:34:29.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.150971+0000", 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5108000000000001e-05 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:165321 5.6 e51/16 5:60df0b9e:::benchmark_data_smithi043_45180_object30679:head v 51'10320, mlcod=51'10316)", 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.151104+0000", 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00100041, 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010652260000000001, 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.157 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151104+0000", 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151104+0000", 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151103+0000", 2024-04-26T10:34:29.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151107+0000", 2024-04-26T10:34:29.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.636e-06 2024-04-26T10:34:29.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151113+0000", 2024-04-26T10:34:29.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5200000000000003e-06 2024-04-26T10:34:29.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151117+0000", 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7459999999999998e-06 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151153+0000", 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5633000000000003e-05 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151173+0000", 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0098e-05 2024-04-26T10:34:29.160 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:165347 5.5 e51/16 5:a248063d:::benchmark_data_smithi043_45180_object30705:head v 51'10277, mlcod=51'10275)", 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.151241+0000", 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00086277399999999996, 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00096194599999999998, 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151241+0000", 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151241+0000", 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151241+0000", 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151244+0000", 2024-04-26T10:34:29.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7520000000000001e-06 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151248+0000", 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9400000000000004e-06 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151251+0000", 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8650000000000001e-06 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151277+0000", 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6689000000000001e-05 2024-04-26T10:34:29.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.151290+0000", 2024-04-26T10:34:29.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2415000000000001e-05 2024-04-26T10:34:29.164 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.164 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.164 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.164 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.164 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:34:29.164 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 3 2024-04-26T10:34:29.164 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:29.167 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:29.176 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:29.176+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:29.277 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:29.276+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:29.345 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:34:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:34:29.346 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:34:29.346 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:29.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:29.378 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:29.377+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:29.479 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:29.477+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:29.530 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:34:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:34:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 61.727871864999997, 2024-04-26T10:34:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:34:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:34:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:34:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:34:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:34:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:34:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:34:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:34:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:34:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:34:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:34:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:34:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103328 5.6 e32/16 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head v 32'6425, mlcod=32'6423)", 2024-04-26T10:34:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.343622556, 2024-04-26T10:34:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064716840999999997, 2024-04-26T10:34:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184359+0000", 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184419+0000", 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9345999999999997e-05 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184425+0000", 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1190000000000002e-06 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184429+0000", 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.296e-06 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184461+0000", 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2122999999999997e-05 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184477+0000", 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5877000000000001e-05 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249048+0000", 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064570494000000006 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249077+0000", 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9081000000000002e-05 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103327 5.c e32/16 5:3133c183:::benchmark_data_smithi043_45180_object103326:head v 32'6430, mlcod=32'6425)", 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.343455958, 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064984741999999998, 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184592+0000", 2024-04-26T10:34:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6027999999999999e-05 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184597+0000", 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8570000000000003e-06 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184600+0000", 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3390000000000001e-06 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184620+0000", 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9890000000000001e-05 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184631+0000", 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1073999999999999e-05 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249477+0000", 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064845485999999994 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249511+0000", 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4508000000000002e-05 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103329 5.6 e32/16 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head v 32'6426, mlcod=32'6423)", 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.339622136999999, 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063744996999999998, 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.546 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188359+0000", 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188389+0000", 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9416000000000001e-05 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243409+0000", 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.055020409999999999 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243419+0000", 2024-04-26T10:34:29.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0071000000000001e-05 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243465+0000", 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5799e-05 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243491+0000", 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5619999999999999e-05 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252067+0000", 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085763809999999992 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252105+0000", 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8040999999999997e-05 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103337 5.d e32/16 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head v 32'6429, mlcod=32'6427)", 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:29.550 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.339551759999999, 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.057982037, 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188430+0000", 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188500+0000", 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0062999999999996e-05 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243434+0000", 2024-04-26T10:34:29.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.054933760999999998 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243442+0000", 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243490+0000", 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8312000000000001e-05 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243511+0000", 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0781999999999999e-05 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246370+0000", 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028590930000000001 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246413+0000", 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2413000000000002e-05 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103660 5.9 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.145616114999999, 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.067661676000000004, 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103660 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382365+0000", 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382430+0000", 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4850000000000004e-05 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382439+0000", 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382445+0000", 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0229999999999998e-06 2024-04-26T10:34:29.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382482+0000", 2024-04-26T10:34:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6909000000000002e-05 2024-04-26T10:34:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382613+0000", 2024-04-26T10:34:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013072600000000001 2024-04-26T10:34:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:29.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382756+0000", 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000143306 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385090+0000", 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002333786 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449925+0000", 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064835173999999995 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449985+0000", 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0124999999999998e-05 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450028+0000", 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2457999999999999e-05 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103662 5.f 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:29.560 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.143172305, 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.068705924000000002, 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103662 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384809+0000", 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384908+0000", 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9146000000000002e-05 2024-04-26T10:34:29.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384921+0000", 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2622e-05 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384931+0000", 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0108e-05 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384984+0000", 2024-04-26T10:34:29.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2849000000000002e-05 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017266800000000001 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385313+0000", 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015649300000000001 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388446+0000", 2024-04-26T10:34:29.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003133481 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453401+0000", 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064955075000000001 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453462+0000", 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1134000000000001e-05 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453516+0000", 2024-04-26T10:34:29.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3477999999999999e-05 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103664 5.9 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.142889620999998, 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.065076041000000001, 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:29.566 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103664 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385092+0000", 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385145+0000", 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3143000000000003e-05 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0473e-05 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385163+0000", 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385193+0000", 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0638e-05 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385284+0000", 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599000000000005e-05 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385375+0000", 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0606999999999995e-05 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387556+0000", 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021809529999999998 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450072+0000", 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062516408999999995 2024-04-26T10:34:29.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450123+0000", 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1406000000000002e-05 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450169+0000", 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5380000000000003e-05 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103666 5.f 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.141126247999999, 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066830159, 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103666 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386855+0000", 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386928+0000", 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386937+0000", 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1090000000000004e-06 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386945+0000", 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386981+0000", 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5899999999999998e-05 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387071+0000", 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9954e-05 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387161+0000", 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0898999999999998e-05 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390584+0000", 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034229030000000001 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453579+0000", 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062994267000000007 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453640+0000", 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1162999999999997e-05 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453686+0000", 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6493999999999999e-05 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103667 5.f 5:f4dc36e8:::benchmark_data_smithi043_45180_object103666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.140265178, 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066218387000000004, 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.577 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103667 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:29.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387783+0000", 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5973e-05 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387791+0000", 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1850000000000004e-06 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387796+0000", 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388469+0000", 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0006734 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388547+0000", 2024-04-26T10:34:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7188999999999996e-05 2024-04-26T10:34:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388630+0000", 2024-04-26T10:34:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3892000000000002e-05 2024-04-26T10:34:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390598+0000", 2024-04-26T10:34:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00196759 2024-04-26T10:34:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453803+0000", 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063205069000000003 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453844+0000", 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1248999999999998e-05 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453936+0000", 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1201999999999999e-05 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.582 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:107998 5.9 5:9ce23eb0:::benchmark_data_smithi043_45180_object107997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.032346797999999, 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025313064, 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107998 2024-04-26T10:34:29.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495634+0000", 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495754+0000", 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119893 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495769+0000", 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4769999999999999e-05 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495781+0000", 2024-04-26T10:34:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1858999999999999e-05 2024-04-26T10:34:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502521+0000", 2024-04-26T10:34:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067402410000000001 2024-04-26T10:34:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502675+0000", 2024-04-26T10:34:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015405099999999999 2024-04-26T10:34:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1,2", 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502846+0000", 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000171001 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.505743+0000", 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028975490000000001 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.508006+0000", 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022627620000000002 2024-04-26T10:34:29.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520788+0000", 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012782244 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520846+0000", 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7976999999999997e-05 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520949+0000", 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102267 2024-04-26T10:34:29.588 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:108005 5.c e35/16 5:3b5c73fa:::benchmark_data_smithi043_45180_object108004:head v 35'6720, mlcod=33'6718)", 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 27.013258961999998, 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025223481999999998, 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514766+0000", 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2818999999999998e-05 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514773+0000", 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999996e-06 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514777+0000", 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6199999999999998e-06 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522074+0000", 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072964029999999999 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522096+0000", 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2027000000000001e-05 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539924+0000", 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017827749 2024-04-26T10:34:29.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539947+0000", 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3232999999999999e-05 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:166165 5.7 5:ec907294:::benchmark_data_smithi043_45180_object31523:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.433361+0000", 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.094621407000000005, 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.03059839, 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.593 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 166165 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433361+0000", 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.594 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433361+0000", 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433360+0000", 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433365+0000", 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2349999999999999e-06 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433373+0000", 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9689999999999994e-06 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433380+0000", 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5000000000000002e-06 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.434799+0000", 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014180919999999999 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.434894+0000", 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5243999999999998e-05 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.434976+0000", 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2231000000000006e-05 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438020+0000", 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003043689 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439281+0000", 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001261302 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463901+0000", 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024619458 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463959+0000", 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8816000000000001e-05 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.598 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:166166 5.7 5:e25c7322:::benchmark_data_smithi043_45180_object31524:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.435038+0000", 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.092943856000000005, 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.031246537000000001, 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 166166 2024-04-26T10:34:29.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435038+0000", 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435038+0000", 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435038+0000", 2024-04-26T10:34:29.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435042+0000", 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3800000000000004e-06 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435053+0000", 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0676000000000001e-05 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435059+0000", 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0580000000000003e-06 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.436287+0000", 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001228593 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.436391+0000", 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104045 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.436494+0000", 2024-04-26T10:34:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010254799999999999 2024-04-26T10:34:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438209+0000", 2024-04-26T10:34:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001714564 2024-04-26T10:34:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464023+0000", 2024-04-26T10:34:29.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025814664000000001 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466246+0000", 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022227599999999998 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466285+0000", 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.909e-05 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:166169 5.c e51/16 5:3d9a2afe:::benchmark_data_smithi043_45180_object31527:head v 51'10313, mlcod=51'10309)", 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.437235+0000", 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.090747110000000006, 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026796387000000001, 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437235+0000", 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437235+0000", 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437234+0000", 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437242+0000", 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4410000000000004e-06 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437251+0000", 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1020000000000003e-06 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437258+0000", 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0090000000000001e-06 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437292+0000", 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4455999999999997e-05 2024-04-26T10:34:29.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437307+0000", 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4800999999999999e-05 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464004+0000", 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026697591 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464032+0000", 2024-04-26T10:34:29.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7144e-05 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:166175 5.3 e51/16 5:c0cd40ee:::benchmark_data_smithi043_45180_object31533:head v 51'10380, mlcod=51'10377)", 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.437538+0000", 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.090444754000000002, 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026367978, 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437538+0000", 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437538+0000", 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437537+0000", 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437542+0000", 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4410000000000003e-06 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437549+0000", 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6739999999999997e-06 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437555+0000", 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6119999999999998e-06 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437598+0000", 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3417000000000001e-05 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437616+0000", 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7651000000000001e-05 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439302+0000", 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016857809999999999 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463906+0000", 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024603861000000001 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:166176 5.c e51/16 5:3df338d2:::benchmark_data_smithi043_45180_object31534:head v 51'10314, mlcod=51'10310)", 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.438991+0000", 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.088991454999999997, 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025419694, 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.613 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438991+0000", 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438991+0000", 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438990+0000", 2024-04-26T10:34:29.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438995+0000", 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.921e-06 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439004+0000", 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.833e-06 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439009+0000", 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2209999999999996e-06 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439033+0000", 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4043999999999999e-05 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439049+0000", 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6082999999999998e-05 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464388+0000", 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025338270999999999 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464411+0000", 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2841e-05 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop_reply(client.4538.0:166166 5.7 e51/16 ondisk, result = 0)", 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.439292+0000", 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.088690709000000006, 2024-04-26T10:34:29.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026999493999999999, 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439292+0000", 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439292+0000", 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439291+0000", 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439294+0000", 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.852e-06 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439302+0000", 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8979999999999996e-06 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439308+0000", 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9410000000000004e-06 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464010+0000", 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02470224 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464017+0000", 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3420000000000002e-06 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466291+0000", 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002273635 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:166180 5.2 5:4fb08ef8:::benchmark_data_smithi043_45180_object31538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.439326+0000", 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.088656030999999996, 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027447910999999998, 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.621 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 166180 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439326+0000", 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439326+0000", 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439325+0000", 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439329+0000", 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.76e-06 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463882+0000", 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024552416000000001 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463895+0000", 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3286e-05 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463938+0000", 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2892999999999997e-05 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464092+0000", 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153731 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464233+0000", 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014117900000000001 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466687+0000", 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024545510000000001 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466695+0000", 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5959999999999998e-06 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466734+0000", 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8688e-05 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466774+0000", 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0661000000000003e-05 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.626 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:166190 5.d e51/42 5:b85cf01f:::benchmark_data_smithi043_45180_object31548:head v 51'10424, mlcod=51'10422)", 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.443282+0000", 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.084700395999999997, 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026511429999999999, 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.443282+0000", 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.443282+0000", 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.443281+0000", 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.443287+0000", 2024-04-26T10:34:29.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0850000000000002e-06 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463882+0000", 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020594057999999998 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463891+0000", 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8700000000000004e-06 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463998+0000", 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010639 2024-04-26T10:34:29.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464019+0000", 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0767e-05 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.469760+0000", 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057416230000000004 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.469793+0000", 2024-04-26T10:34:29.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3210000000000002e-05 2024-04-26T10:34:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:29.631 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:29.631 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:29.631 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:34:29.633 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:29.631+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:29.634 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:29.735 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:29.734+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:29.811 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:29.812 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:29.812 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.812 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:167193 5.4 5:2e0586f8:::benchmark_data_smithi043_45180_object32551:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:29.812 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:29.807933+0000", 2024-04-26T10:34:29.812 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0024935830000000002, 2024-04-26T10:34:29.812 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0025201619999999998, 2024-04-26T10:34:29.812 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:29.812 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:29.812 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:29.812 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:29.812 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.812 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 167193 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807933+0000", 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807933+0000", 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.813 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807933+0000", 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807936+0000", 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1410000000000001e-06 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807943+0000", 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3200000000000002e-06 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.814 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807949+0000", 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3700000000000003e-06 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.809548+0000", 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001599334 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.809644+0000", 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6636000000000001e-05 2024-04-26T10:34:29.815 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.816 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.816 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:29.816 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.809713+0000", 2024-04-26T10:34:29.816 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8176999999999995e-05 2024-04-26T10:34:29.816 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.816 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:29.816 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.816 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.816 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.816 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:167194 5.4 5.fd9b93d4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:29.816 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:29.808050+0000", 2024-04-26T10:34:29.817 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0023773090000000002, 2024-04-26T10:34:29.817 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0024905940000000001, 2024-04-26T10:34:29.817 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:29.817 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:29.817 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:29.817 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:29.817 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.817 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 167194 2024-04-26T10:34:29.817 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.817 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:29.818 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.818 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:29.818 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.808050+0000", 2024-04-26T10:34:29.818 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.819 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.819 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.819 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:29.819 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.808050+0000", 2024-04-26T10:34:29.819 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.819 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.819 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.819 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:29.819 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.808049+0000", 2024-04-26T10:34:29.819 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.820 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.820 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.820 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:29.820 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.808053+0000", 2024-04-26T10:34:29.820 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6940000000000001e-06 2024-04-26T10:34:29.820 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.820 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.820 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:29.820 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.808061+0000", 2024-04-26T10:34:29.820 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4330000000000004e-06 2024-04-26T10:34:29.820 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.820 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.821 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.822 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.808069+0000", 2024-04-26T10:34:29.822 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1580000000000005e-06 2024-04-26T10:34:29.822 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.822 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:29.822 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.822 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.822 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.822 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:167197 5.0 5:017708c0:::benchmark_data_smithi043_45180_object32555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:29.822 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:29.810199+0000", 2024-04-26T10:34:29.822 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00022835299999999999, 2024-04-26T10:34:29.822 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000402588, 2024-04-26T10:34:29.822 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 167197 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810199+0000", 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.823 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810199+0000", 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810198+0000", 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810203+0000", 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8559999999999998e-06 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.824 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810214+0000", 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0992000000000001e-05 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810222+0000", 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0730000000000005e-06 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810261+0000", 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.825 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810385+0000", 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012375999999999999 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810497+0000", 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000111396 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:167199 5.4 5.347edf14 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:29.826 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:29.810411+0000", 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 1.5733e-05, 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00026361899999999998, 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 167199 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810411+0000", 2024-04-26T10:34:29.827 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810411+0000", 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810411+0000", 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:29.828 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810414+0000", 2024-04-26T10:34:29.829 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2930000000000001e-06 2024-04-26T10:34:29.829 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.829 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.829 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:29.829 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810422+0000", 2024-04-26T10:34:29.829 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0790000000000001e-06 2024-04-26T10:34:29.829 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.829 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.829 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.829 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810427+0000", 2024-04-26T10:34:29.829 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2499999999999997e-06 2024-04-26T10:34:29.830 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.830 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:29.830 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.830 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.830 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.830 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:167187 5.e 5:72bf9986:::benchmark_data_smithi043_45180_object32545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:29.830 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:29.806591+0000", 2024-04-26T10:34:29.830 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0038359219999999999, 2024-04-26T10:34:29.830 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041424790000000001, 2024-04-26T10:34:29.830 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:29.830 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:29.830 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:29.830 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 167187 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.806591+0000", 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.806591+0000", 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.831 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.806590+0000", 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.806594+0000", 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0049999999999998e-06 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.806604+0000", 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8439999999999993e-06 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.832 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.806612+0000", 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8310000000000001e-06 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.806645+0000", 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3102999999999998e-05 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.806733+0000", 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7478999999999994e-05 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.833 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:29.834 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.806802+0000", 2024-04-26T10:34:29.834 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9461999999999993e-05 2024-04-26T10:34:29.834 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.834 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.834 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:29.834 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810488+0000", 2024-04-26T10:34:29.834 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0036863870000000002 2024-04-26T10:34:29.834 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.834 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:29.834 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.834 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.834 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.834 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:167190 5.4 5:2f29ab5b:::benchmark_data_smithi043_45180_object32548:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:29.807691+0000", 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0027354950000000001, 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0031210299999999999, 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 167190 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807691+0000", 2024-04-26T10:34:29.835 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807691+0000", 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807691+0000", 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:29.836 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807695+0000", 2024-04-26T10:34:29.837 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8579999999999999e-06 2024-04-26T10:34:29.837 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.837 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.837 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:29.837 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807707+0000", 2024-04-26T10:34:29.837 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1647e-05 2024-04-26T10:34:29.837 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.837 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.837 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.837 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807715+0000", 2024-04-26T10:34:29.837 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0700000000000007e-06 2024-04-26T10:34:29.837 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.837 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.838 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:29.838 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807744+0000", 2024-04-26T10:34:29.838 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8382999999999999e-05 2024-04-26T10:34:29.838 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.838 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.838 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:29.838 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807824+0000", 2024-04-26T10:34:29.838 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0679000000000005e-05 2024-04-26T10:34:29.838 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.838 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.838 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:29.838 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807885+0000", 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0940000000000003e-05 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:167192 5.e 5:72cdd6b3:::benchmark_data_smithi043_45180_object32550:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:29.807855+0000", 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0025719179999999999, 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0030304870000000001, 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:29.839 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 167192 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807855+0000", 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807855+0000", 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.840 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:29.841 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807854+0000", 2024-04-26T10:34:29.841 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:29.841 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.841 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.841 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:29.841 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807857+0000", 2024-04-26T10:34:29.841 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0149999999999999e-06 2024-04-26T10:34:29.841 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.841 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.841 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:29.841 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807865+0000", 2024-04-26T10:34:29.841 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0759999999999997e-06 2024-04-26T10:34:29.841 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.842 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.842 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:29.842 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.807870+0000", 2024-04-26T10:34:29.842 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.135e-06 2024-04-26T10:34:29.842 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.842 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.842 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:29.842 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.808467+0000", 2024-04-26T10:34:29.842 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00059703299999999996 2024-04-26T10:34:29.842 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.842 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.842 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:29.842 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.808603+0000", 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000136754 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.808726+0000", 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012255600000000001 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:29.810664+0000", 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001937561 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:29.843 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:34:29.844 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 7 2024-04-26T10:34:29.844 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:29.845 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:29.846 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:29.843+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:29.945 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:29.944+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:30.047 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:30.046+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:30.062 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:30.063 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:30.063 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:30.063 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:30.063 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:30.078 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:30.148 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:30.146+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:30.248 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:30.247+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:30.297 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:30.297 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:30.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:30.298 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:30.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.298 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:30.298 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:30.298 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.494830925999999, 2024-04-26T10:34:30.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:30.298 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.298 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.298 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.298 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.299 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.299 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:30.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.299 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:30.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:30.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:30.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:30.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:30.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:30.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:30.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:30.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:30.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:30.302 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.302 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:30.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:30.302 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.302 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:30.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:30.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:30.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:30.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:30.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:30.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:30.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:30.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:30.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:30.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:30.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:30.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:30.305 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.305 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.305 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.305 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:30.305 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:30.305 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.494002846000001, 2024-04-26T10:34:30.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:30.306 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.306 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.306 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.306 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.306 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.306 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:30.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.306 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:30.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:30.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:30.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.308 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.308 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:30.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:30.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.308 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.308 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:30.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:30.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:30.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:30.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:30.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:30.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:30.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:30.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:30.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:30.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:30.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:30.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:30.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:30.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:30.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:30.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:30.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:30.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:30.312 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.312 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.312 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.312 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:30.312 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:30.313 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.493073783, 2024-04-26T10:34:30.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:30.313 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.313 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.313 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.313 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.313 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.313 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:30.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.313 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:30.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.314 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.314 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.314 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:30.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.314 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.314 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.314 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:30.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.315 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:30.315 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:30.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.315 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:30.315 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:30.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:30.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:30.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:30.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:30.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:30.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:30.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:30.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:30.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:30.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:30.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:30.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:30.319 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.319 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.319 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.319 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:30.319 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:30.319 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.492388341999998, 2024-04-26T10:34:30.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:30.319 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.319 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.319 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:30.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.321 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:30.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:30.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.322 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.322 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:30.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:30.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.322 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.322 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:30.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:30.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:30.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:30.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:30.325 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.325 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.325 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.325 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103337 5.d 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:30.325 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:30.325 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 32.106729669000003, 2024-04-26T10:34:30.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.058853520999999999, 2024-04-26T10:34:30.325 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.325 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.325 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.326 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.326 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.326 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103337 2024-04-26T10:34:30.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.326 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.326 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.326 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:30.326 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.327 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.327 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:30.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.327 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.327 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.327 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.327 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:30.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:30.327 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.327 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.327 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.327 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188132+0000", 2024-04-26T10:34:30.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6197000000000003e-05 2024-04-26T10:34:30.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.328 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188144+0000", 2024-04-26T10:34:30.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2001000000000001e-05 2024-04-26T10:34:30.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.328 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188152+0000", 2024-04-26T10:34:30.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9349999999999994e-06 2024-04-26T10:34:30.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188185+0000", 2024-04-26T10:34:30.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3436000000000003e-05 2024-04-26T10:34:30.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188275+0000", 2024-04-26T10:34:30.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9995999999999997e-05 2024-04-26T10:34:30.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:30.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188365+0000", 2024-04-26T10:34:30.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0254999999999996e-05 2024-04-26T10:34:30.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.194973+0000", 2024-04-26T10:34:30.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066073490000000002 2024-04-26T10:34:30.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246781+0000", 2024-04-26T10:34:30.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.051808372999999998 2024-04-26T10:34:30.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246865+0000", 2024-04-26T10:34:30.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3498999999999995e-05 2024-04-26T10:34:30.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.332 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246920+0000", 2024-04-26T10:34:30.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5208999999999999e-05 2024-04-26T10:34:30.332 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.332 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.332 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.332 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:30.332 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:30.332 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.9160979, 2024-04-26T10:34:30.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:30.332 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.333 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.333 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.333 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.333 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.333 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:30.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.333 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.333 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.333 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.333 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:30.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:30.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:30.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:30.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:30.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:30.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:30.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:30.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:30.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:30.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:30.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:30.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:30.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:30.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:30.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:30.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:30.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:30.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:30.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.338 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.338 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:30.338 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:30.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.338 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.338 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:30.338 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:30.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.339 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.339 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:30.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:30.339 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.339 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.339 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.339 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:30.340 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:30.340 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.915878595999999, 2024-04-26T10:34:30.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:30.340 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.340 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.340 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.340 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.340 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.340 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:30.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.341 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.341 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:30.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.341 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.341 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:30.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.341 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.342 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:30.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.342 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:30.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:30.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.343 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.343 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:30.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:30.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.343 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.343 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.343 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:30.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:30.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.343 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.343 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.344 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:30.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:30.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.344 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.344 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:30.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:30.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.344 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:30.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:30.345 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:30.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:30.345 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:30.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:30.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:30.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.346 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:30.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:30.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.346 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:30.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:30.347 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.347 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.347 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.347 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.347 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:30.347 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:30.347 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.915798791, 2024-04-26T10:34:30.347 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:30.347 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.347 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.348 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.348 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.348 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.348 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:30.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.348 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.348 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.348 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.348 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:30.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.349 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.349 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:30.349 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.349 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.349 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:30.349 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:30.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:30.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:30.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:30.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:30.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:30.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:30.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:30.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:30.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:30.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.352 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:30.352 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:30.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:30.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.352 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.352 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:30.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:30.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.353 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.353 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:30.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:30.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.353 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.353 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:30.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:30.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.353 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.353 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:30.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:30.354 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.354 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.354 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.354 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.354 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:30.354 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:30.354 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.914434760999999, 2024-04-26T10:34:30.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:30.354 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.355 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.355 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.355 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.355 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.355 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:30.355 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.355 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.355 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.355 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.355 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:30.355 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.356 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:30.357 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:30.357 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.357 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.357 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.357 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:30.357 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:30.357 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.357 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.357 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.357 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:30.357 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:30.357 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.358 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.358 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.358 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:30.358 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:30.358 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.358 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.358 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.358 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:30.358 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:30.358 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.358 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:30.359 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:30.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:30.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.359 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.359 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:30.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:30.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.359 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.359 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:30.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:30.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.360 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.360 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.360 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:30.360 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:30.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.360 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.360 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.360 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:30.360 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:30.360 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.360 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.360 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.361 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.361 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:30.361 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:30.361 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.913840424, 2024-04-26T10:34:30.361 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:30.361 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.361 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.361 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.361 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.361 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.361 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:30.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.362 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.362 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.362 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.362 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:30.362 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.362 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.362 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.362 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.362 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:30.362 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.363 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.363 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.363 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.363 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:30.363 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.363 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.363 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.363 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.363 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:30.363 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:30.363 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.364 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.364 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.364 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:30.364 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:30.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.364 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.364 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.364 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:30.364 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:30.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.364 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.365 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.365 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:30.365 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:30.365 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.365 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.365 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.365 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:30.365 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:30.365 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.365 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.365 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:30.365 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:30.365 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:30.366 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.366 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.366 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.366 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:30.366 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:30.366 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.366 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.366 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.366 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.367 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.368 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.368 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.368 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:30.368 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:30.368 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.913080067999999, 2024-04-26T10:34:30.368 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:30.368 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.368 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.368 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.368 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.368 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.369 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:30.369 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.369 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.369 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.369 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.369 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:30.369 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.369 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.369 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.369 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.369 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:30.369 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.369 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.370 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.370 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.370 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:30.370 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:30.370 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.370 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.370 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.370 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:30.370 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:30.370 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.370 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.370 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.371 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:30.371 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:30.371 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.371 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.371 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.371 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:30.371 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:30.371 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.371 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.371 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.371 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:30.371 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:30.371 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.372 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.372 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.372 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:30.372 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:30.372 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.372 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.372 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:30.372 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:30.372 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:30.372 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.373 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.373 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.373 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:30.373 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:30.373 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.373 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.373 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.373 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:30.373 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:30.373 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.373 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.373 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.373 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:30.374 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:30.374 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.374 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.374 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.374 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:30.374 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:30.374 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.374 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.375 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.375 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.375 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.375 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:30.375 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:30.375 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.912462607999998, 2024-04-26T10:34:30.375 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:30.375 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.375 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.375 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.375 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.376 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.376 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:30.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.376 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.376 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.376 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.376 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:30.376 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.376 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.377 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.377 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:30.377 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.377 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.377 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.377 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:30.377 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:30.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.377 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.377 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.377 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:30.377 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:30.378 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.378 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.378 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.378 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:30.378 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:30.378 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.378 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.378 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.378 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:30.378 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:30.379 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.379 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.379 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.379 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:30.379 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:30.379 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.379 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.379 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.379 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:30.379 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:30.379 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.379 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.380 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:30.380 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:30.380 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:30.380 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.380 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.380 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.380 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:30.380 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:30.380 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.380 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.380 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.380 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:30.380 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:30.381 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.381 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.381 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.381 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:30.381 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:30.381 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.381 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.381 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.381 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:30.381 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:30.381 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.381 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.382 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.382 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.382 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.382 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:30.382 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:30.382 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.911897605, 2024-04-26T10:34:30.382 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:30.382 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.382 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.382 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.382 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.383 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.383 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:30.383 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.383 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.383 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.383 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.383 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:30.383 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.383 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.383 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.383 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.384 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:30.384 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.384 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.384 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.384 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.384 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:30.384 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:30.384 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.384 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.384 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.384 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:30.384 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:30.385 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.385 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.385 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.385 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:30.385 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:30.385 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.385 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.385 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.385 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:30.385 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:30.385 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.385 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.386 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.386 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:30.386 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:30.386 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.386 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.386 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.386 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:30.386 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:30.386 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.386 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.386 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.387 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:30.387 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:30.387 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.387 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.387 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.387 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.387 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.387 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:30.387 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:30.387 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.911354292999999, 2024-04-26T10:34:30.387 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:30.387 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.388 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.388 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.388 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.388 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.388 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:30.388 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.388 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.388 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.388 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.388 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:30.388 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.388 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.389 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.389 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.389 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:30.389 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.389 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.389 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.389 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.389 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:30.389 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.389 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.389 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.390 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.390 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:30.390 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:30.390 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.390 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.390 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.390 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:30.390 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:30.390 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.390 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.390 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.391 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:30.391 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:30.391 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.391 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.391 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.391 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:30.391 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:30.391 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.391 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.391 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.391 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:30.391 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:30.391 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.392 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.392 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:30.392 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:30.392 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:30.392 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.392 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.392 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.392 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:30.392 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:30.392 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.392 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.392 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.393 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:30.393 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:30.393 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.393 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.393 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.393 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:30.393 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:30.393 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.393 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.393 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.393 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:30.394 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:30.394 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.394 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.394 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.394 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.394 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.394 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:30.394 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:30.394 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.909882292999999, 2024-04-26T10:34:30.394 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:30.394 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.395 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.395 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:30.395 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:30.395 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.395 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:30.395 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.395 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.395 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.395 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.395 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:30.395 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.396 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:30.397 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:30.397 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.397 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.397 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.397 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:30.397 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:30.397 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.397 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.397 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.397 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:30.397 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:30.397 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.397 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.398 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.398 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:30.398 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:30.398 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.398 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.398 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.398 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:30.398 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:30.398 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.398 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.398 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:30.398 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:30.399 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:30.399 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.399 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.399 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:30.399 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:30.399 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:30.399 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.399 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.399 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:30.399 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:30.399 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:30.400 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.400 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.400 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.400 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:30.400 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:30.400 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.400 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.400 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.400 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:30.400 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:30.401 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.401 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.401 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.401 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.401 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.401 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:30.401 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:30.401 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.909316873000002, 2024-04-26T10:34:30.401 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:30.401 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.401 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.402 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.402 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.402 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.402 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:30.402 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.402 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.402 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.402 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.402 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:30.402 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.402 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.403 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.403 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.403 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:30.403 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.403 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.403 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.403 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.403 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:30.403 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:30.403 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.403 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.403 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.404 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:30.404 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:30.404 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.404 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.404 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.404 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:30.404 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:30.404 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.404 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.404 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.404 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:30.404 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:30.404 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.405 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.405 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.405 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:30.405 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:30.405 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.405 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.405 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.405 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:30.405 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:30.405 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.405 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.406 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.406 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:30.406 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:30.406 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.406 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.406 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.406 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.406 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.406 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:30.406 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:30.406 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.909252023000001, 2024-04-26T10:34:30.406 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:30.406 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.407 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.407 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.407 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.407 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.407 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:30.407 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.407 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.407 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.407 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.407 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:30.408 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.408 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.408 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.408 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.408 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:30.408 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.408 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.408 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.408 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.408 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:30.408 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:30.408 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.409 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.409 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.409 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:30.409 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:30.409 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.409 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.409 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.409 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:30.409 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:30.409 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.409 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.409 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.410 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:30.410 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:30.410 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.410 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.410 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.410 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:30.410 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:30.410 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.410 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.410 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.410 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:30.411 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.908491043000001, 2024-04-26T10:34:30.412 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:30.412 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.412 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:30.412 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.412 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.412 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.412 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:30.412 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.412 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.412 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.412 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.412 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:30.412 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.413 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:30.414 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:30.414 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.414 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.414 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.414 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:30.414 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:30.414 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.414 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.414 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.414 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:30.414 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:30.414 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.415 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.415 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.415 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:30.415 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:30.415 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.415 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.415 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.415 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:30.415 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:30.415 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.415 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.415 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.416 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.416 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.416 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:30.416 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:30.416 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.907469615, 2024-04-26T10:34:30.416 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:30.416 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.416 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:30.416 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.416 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.416 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.416 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:30.417 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.417 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.417 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.417 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.417 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:30.417 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.417 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.417 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.417 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.417 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:30.418 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.418 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.418 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.418 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.418 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:30.418 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:30.418 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.418 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.418 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.418 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:30.419 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:30.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.419 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.419 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.419 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:30.419 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:30.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.419 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.419 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.419 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:30.419 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:30.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.420 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.420 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.420 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:30.420 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:30.420 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.420 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.420 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:30.420 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:30.420 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:30.420 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.420 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.421 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.421 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:30.421 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:30.421 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.421 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.421 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.421 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.421 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.421 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103647 5.b e32/16 ondisk, result = 0)", 2024-04-26T10:34:30.421 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:30.421 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 31.907450915999998, 2024-04-26T10:34:30.422 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060768513000000003, 2024-04-26T10:34:30.422 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:30.422 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:30.422 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:30.422 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.422 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:30.422 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:30.422 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.422 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.422 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.422 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:30.423 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:30.423 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:30.423 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.423 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.423 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:30.423 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387344+0000", 2024-04-26T10:34:30.423 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.423 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.423 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387350+0000", 2024-04-26T10:34:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.22e-06 2024-04-26T10:34:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447917+0000", 2024-04-26T10:34:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060567523999999998 2024-04-26T10:34:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447925+0000", 2024-04-26T10:34:30.425 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7689999999999996e-06 2024-04-26T10:34:30.425 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.425 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.425 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:30.425 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448004+0000", 2024-04-26T10:34:30.425 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9246000000000007e-05 2024-04-26T10:34:30.425 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.425 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.425 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:30.425 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448012+0000", 2024-04-26T10:34:30.425 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3490000000000003e-06 2024-04-26T10:34:30.425 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:30.426 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:30.426 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:30.426 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448114+0000", 2024-04-26T10:34:30.426 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010205299999999999 2024-04-26T10:34:30.426 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.426 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.426 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.426 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:30.426 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:30.426 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:30.428 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:30.428 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:30.426+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:30.528 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:30.527+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:30.544 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-26T10:34:30.547 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:34:30.547 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T10:34:30.585 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:34:30.628 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:30.628 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:30.628 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.628 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:169524 5.c 5:35fedbfb:::benchmark_data_smithi043_45180_object34882:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:34:30.628 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:30.622127+0000", 2024-04-26T10:34:30.628 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0033625259999999998, 2024-04-26T10:34:30.628 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033829709999999998, 2024-04-26T10:34:30.628 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 169524 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622127+0000", 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.629 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622127+0000", 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622126+0000", 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622132+0000", 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4539999999999998e-06 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.630 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.631 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:30.631 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622141+0000", 2024-04-26T10:34:30.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7540000000000001e-06 2024-04-26T10:34:30.631 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.631 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.631 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622148+0000", 2024-04-26T10:34:30.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0319999999999998e-06 2024-04-26T10:34:30.631 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.631 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.631 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:30.631 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622186+0000", 2024-04-26T10:34:30.631 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8006999999999997e-05 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622333+0000", 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014655199999999999 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622448+0000", 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115209 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624402+0000", 2024-04-26T10:34:30.632 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019540600000000001 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:169519 5.e e52/16 5:751d56e5:::benchmark_data_smithi043_45180_object34877:head v 52'10492, mlcod=52'10488)", 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:30.622228+0000", 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0032612600000000002, 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033372789999999999, 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622228+0000", 2024-04-26T10:34:30.633 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:30.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622228+0000", 2024-04-26T10:34:30.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:30.634 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622228+0000", 2024-04-26T10:34:30.634 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.634 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.634 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.634 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622236+0000", 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9759999999999995e-06 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622243+0000", 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2309999999999999e-06 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622250+0000", 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3960000000000003e-06 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:30.635 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622511+0000", 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00026187299999999998 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622527+0000", 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5670000000000001e-05 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:169514 5.1 e52/16 5:8fd74b88:::benchmark_data_smithi043_45180_object34872:head v 52'10633, mlcod=52'10629)", 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:30.622877+0000", 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.002612985, 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002724265, 2024-04-26T10:34:30.636 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622877+0000", 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622877+0000", 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:30.637 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622876+0000", 2024-04-26T10:34:30.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:30.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622885+0000", 2024-04-26T10:34:30.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5580000000000001e-06 2024-04-26T10:34:30.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:30.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622893+0000", 2024-04-26T10:34:30.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5709999999999998e-06 2024-04-26T10:34:30.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622899+0000", 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6370000000000004e-06 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622926+0000", 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7322999999999999e-05 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.622942+0000", 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6140000000000001e-05 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.639 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:30.640 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.640 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:169525 5.0 e52/42 5:0b8eb496:::benchmark_data_smithi043_45180_object34883:head v 52'10576, mlcod=52'10574)", 2024-04-26T10:34:30.640 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:30.623010+0000", 2024-04-26T10:34:30.640 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0024796520000000002, 2024-04-26T10:34:30.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026242320000000002, 2024-04-26T10:34:30.640 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:30.640 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:30.640 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623010+0000", 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623010+0000", 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623010+0000", 2024-04-26T10:34:30.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:30.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623016+0000", 2024-04-26T10:34:30.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8240000000000002e-06 2024-04-26T10:34:30.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:30.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623024+0000", 2024-04-26T10:34:30.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3869999999999997e-06 2024-04-26T10:34:30.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623029+0000", 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2859999999999999e-06 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623924+0000", 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00089477800000000004 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623941+0000", 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6670000000000001e-05 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:30.643 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.644 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:169526 5.5 5:a353aadf:::benchmark_data_smithi043_45180_object34884:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:34:30.644 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:30.623943+0000", 2024-04-26T10:34:30.644 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001546296, 2024-04-26T10:34:30.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017562190000000001, 2024-04-26T10:34:30.645 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:30.645 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:30.645 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:30.645 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:30.645 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:30.645 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 169526 2024-04-26T10:34:30.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.645 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:30.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:30.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623943+0000", 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623943+0000", 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623943+0000", 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:30.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623947+0000", 2024-04-26T10:34:30.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8600000000000001e-06 2024-04-26T10:34:30.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:30.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623957+0000", 2024-04-26T10:34:30.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9459999999999993e-06 2024-04-26T10:34:30.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.647 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.647 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623963+0000", 2024-04-26T10:34:30.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3299999999999998e-06 2024-04-26T10:34:30.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:30.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.623992+0000", 2024-04-26T10:34:30.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9594000000000002e-05 2024-04-26T10:34:30.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624103+0000", 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110628 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624190+0000", 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7033999999999994e-05 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:169527 5.2 e52/16 5:41196afd:::benchmark_data_smithi043_45180_object34885:head v 52'10710, mlcod=52'10708)", 2024-04-26T10:34:30.649 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:30.624271+0000", 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0012192310000000001, 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015073619999999999, 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624271+0000", 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624271+0000", 2024-04-26T10:34:30.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624270+0000", 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624275+0000", 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3569999999999997e-06 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624286+0000", 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0353000000000001e-05 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624292+0000", 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2079999999999997e-06 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624322+0000", 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0334000000000001e-05 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624341+0000", 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9015999999999999e-05 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:30.652 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:169528 5.1 e52/16 5:864e8867:::benchmark_data_smithi043_45180_object34886:head v 52'10634, mlcod=52'10629)", 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:30.624555+0000", 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00093436500000000004, 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001264753, 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624555+0000", 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624555+0000", 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624555+0000", 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624560+0000", 2024-04-26T10:34:30.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8910000000000003e-06 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624568+0000", 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9400000000000002e-06 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624573+0000", 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5119999999999999e-06 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:30.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624776+0000", 2024-04-26T10:34:30.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020300299999999999 2024-04-26T10:34:30.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:30.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624792+0000", 2024-04-26T10:34:30.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5982999999999999e-05 2024-04-26T10:34:30.656 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.656 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:30.656 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.656 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:169532 5.e e52/16)", 2024-04-26T10:34:30.656 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:30.624992+0000", 2024-04-26T10:34:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00049775999999999998, 2024-04-26T10:34:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00086123899999999997, 2024-04-26T10:34:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624992+0000", 2024-04-26T10:34:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:30.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624992+0000", 2024-04-26T10:34:30.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:30.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.624991+0000", 2024-04-26T10:34:30.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:30.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625001+0000", 2024-04-26T10:34:30.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8190000000000003e-06 2024-04-26T10:34:30.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625011+0000", 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4909999999999994e-06 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625018+0000", 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1729999999999998e-06 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.659 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:169533 5.7 e52/16 5:e716044e:::benchmark_data_smithi043_45180_object34891:head v 52'10454, mlcod=52'10452)", 2024-04-26T10:34:30.660 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:30.625189+0000", 2024-04-26T10:34:30.660 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00030061900000000002, 2024-04-26T10:34:30.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000694058, 2024-04-26T10:34:30.660 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:30.660 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:30.660 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:30.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:30.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625189+0000", 2024-04-26T10:34:30.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625189+0000", 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625189+0000", 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625193+0000", 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6990000000000002e-06 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:30.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625201+0000", 2024-04-26T10:34:30.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4909999999999999e-06 2024-04-26T10:34:30.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625206+0000", 2024-04-26T10:34:30.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4670000000000003e-06 2024-04-26T10:34:30.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:30.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625240+0000", 2024-04-26T10:34:30.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3667000000000001e-05 2024-04-26T10:34:30.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:30.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625258+0000", 2024-04-26T10:34:30.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7592e-05 2024-04-26T10:34:30.663 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.663 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:30.663 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.663 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:169531 5.8 e52/16)", 2024-04-26T10:34:30.663 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:30.625913+0000", 2024-04-26T10:34:30.663 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9995761, 2024-04-26T10:34:30.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2128999999999997e-05, 2024-04-26T10:34:30.664 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:30.664 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:30.664 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:30.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:30.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625913+0000", 2024-04-26T10:34:30.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:30.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625913+0000", 2024-04-26T10:34:30.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:30.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:30.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625913+0000", 2024-04-26T10:34:30.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:30.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:30.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625922+0000", 2024-04-26T10:34:30.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9949999999999994e-06 2024-04-26T10:34:30.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:30.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625930+0000", 2024-04-26T10:34:30.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9929999999999995e-06 2024-04-26T10:34:30.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:30.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:30.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:30.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:30.625936+0000", 2024-04-26T10:34:30.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2720000000000003e-06 2024-04-26T10:34:30.666 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.667 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:30.667 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.667 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:30.667 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:34:30.667 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 10 2024-04-26T10:34:30.667 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:30.668 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:30.666+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:30.669 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:30.752 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:30.769 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:30.769+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:30.773 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:30.797 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:30.798 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:30.799 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:30.799 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:30.879 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:30.873+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:30.905 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:30.905 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:30.920 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:30.972 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:30.971+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:31.073 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:31.071+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:31.155 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:31.155 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:31.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:31.174 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:31.173+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:31.274 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:31.273+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:31.349 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:31.349 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:31.365 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:31.407 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:31.405+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:31.476 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:31.474+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:31.547 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T10:34:31.558 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T10:34:31.577 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:31.576+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:31.591 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:31.591 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:31.605 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:31.679 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:31.678+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:31.779 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:31.777+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:31.827 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:31.828 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:31.841 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:31.886 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:31.885+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:31.981 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:31.979+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:32.026 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:32.026 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:32.041 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:32.114 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:32.081+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:32.183 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:32.182+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:32.248 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:32.248 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:32.261 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:32.302 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:32.301+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:32.385 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:32.385+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:32.475 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:32.476 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:32.486 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:32.486+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:32.491 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:32.552 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T10:34:32.557 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:34:32.565 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T10:34:32.586 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:32.585+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:32.687 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:32.686+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:32.692 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:32.692 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:32.709 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:32.794 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:32.793+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:32.811 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:32.888 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:32.887+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:32.938 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:32.939 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:32.955 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:32.966 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:32.987 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:32.997 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:32.996+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:33.011 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:33.012 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:33.013 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:33.013 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:33.089 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:33.088+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:33.190 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:33.190+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:33.194 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:33.194 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:33.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:33.194 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:33.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.194 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:33.194 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.388595524999999, 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:33.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:33.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:33.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:33.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:33.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:33.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:33.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:33.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:33.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:33.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:33.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:33.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:33.200 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.38859454, 2024-04-26T10:34:33.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:33.201 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.201 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.201 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:33.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:33.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:33.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:33.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:33.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:33.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:33.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:33.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:33.205 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.388525916999996, 2024-04-26T10:34:33.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:33.206 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.206 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.206 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.206 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.206 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.206 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:33.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.206 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:33.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:33.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:33.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:33.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:33.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:33.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:33.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:33.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:33.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:33.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:33.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:33.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:33.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:33.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.213 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:33.213 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:33.213 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.388474137000003, 2024-04-26T10:34:33.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:33.213 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.213 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.213 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.214 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.214 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.214 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:33.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.214 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:33.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:33.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:33.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:33.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:33.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:33.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:33.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:33.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:33.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:33.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:33.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:33.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:33.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.388414287000003, 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:33.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:33.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:33.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:33.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:33.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:33.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:33.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:33.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:33.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:33.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:33.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:33.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:33.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:33.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:33.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:33.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:33.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:33.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:33.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.227 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.228 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:33.228 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:33.228 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.386701583000004, 2024-04-26T10:34:33.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:33.228 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.228 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.228 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.228 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.228 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.228 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:33.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.228 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:33.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:33.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:33.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:33.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:33.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:33.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:33.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:33.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:33.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:33.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:33.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.233 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.234 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:33.234 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:33.234 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.386586515999994, 2024-04-26T10:34:33.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:33.234 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.234 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.234 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:33.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:33.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:33.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:33.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:33.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.238 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.386493376000004, 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:33.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:33.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:33.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:33.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:33.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:33.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:33.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:33.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:33.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.386299215999998, 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.244 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.245 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:33.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:33.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:33.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:33.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:33.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:33.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:33.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:33.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:33.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.385091848000002, 2024-04-26T10:34:33.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:33.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:33.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:33.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:33.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:33.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:33.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:33.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:33.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:33.253 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.253 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.253 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.254 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:33.254 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:33.254 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.384282940000006, 2024-04-26T10:34:33.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:33.254 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.254 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.254 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.254 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.254 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.255 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:33.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.255 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:33.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:33.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:33.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:33.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:33.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:33.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:33.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:33.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:33.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:33.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:33.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:33.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:33.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:33.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:33.262 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.262 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.262 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.262 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:33.262 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:33.262 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.384179402000001, 2024-04-26T10:34:33.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:33.262 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.262 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.262 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.262 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.263 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.263 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:33.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.263 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:33.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:33.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:33.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:33.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:33.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:33.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:33.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:33.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:33.267 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:33.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:33.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:33.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:33.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:33.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:33.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.270 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:33.270 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:33.270 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.384102529000003, 2024-04-26T10:34:33.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:33.270 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.270 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.270 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.270 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.270 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.270 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:33.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:33.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:33.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:33.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:33.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:33.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:33.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:33.275 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 65.383987145000006, 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:33.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:33.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:33.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:33.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:33.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:33.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.007343091999999, 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.280 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:33.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:33.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:33.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:33.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:33.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:33.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:33.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:33.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:33.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:33.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:33.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:33.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:33.285 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.005313244, 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.286 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:33.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.287 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:33.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.287 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:33.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:33.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:33.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:33.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:33.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:33.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:33.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:33.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:33.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.004837440999999, 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.293 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:33.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:33.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:33.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:33.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:33.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:33.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:33.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.002870387000002, 2024-04-26T10:34:33.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:33.299 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.299 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.299 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.299 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.299 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.299 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:33.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.299 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:33.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:33.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:33.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:33.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:33.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:33.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:33.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:33.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:33.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:33.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.304 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.304 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:33.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:33.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:33.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:33.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:33.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:33.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:33.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:33.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:33.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:33.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:33.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:33.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:33.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:33.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:33.309 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.309 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.309 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.310 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103336 5.6 5:6c0cef20:::benchmark_data_smithi043_45180_object103335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:33.310 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:33.310 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.000761081999997, 2024-04-26T10:34:33.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064107786, 2024-04-26T10:34:33.311 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.311 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.311 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.311 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.311 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.311 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103336 2024-04-26T10:34:33.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.311 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188502+0000", 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188540+0000", 2024-04-26T10:34:33.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8445000000000002e-05 2024-04-26T10:34:33.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188553+0000", 2024-04-26T10:34:33.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2768e-05 2024-04-26T10:34:33.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188563+0000", 2024-04-26T10:34:33.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9760000000000007e-06 2024-04-26T10:34:33.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191877+0000", 2024-04-26T10:34:33.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003313908 2024-04-26T10:34:33.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192004+0000", 2024-04-26T10:34:33.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012663 2024-04-26T10:34:33.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192143+0000", 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013964199999999999 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.196467+0000", 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043232230000000002 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252539+0000", 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056072085000000001 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.315 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252577+0000", 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8730999999999999e-05 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252611+0000", 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3769000000000001e-05 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 35.000202649000002, 2024-04-26T10:34:33.316 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.317 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:33.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:33.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:33.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:33.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:33.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.318 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.318 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:33.318 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:33.318 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:33.318 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:33.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:33.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:33.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:33.319 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:33.319 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.319 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.319 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:33.319 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:33.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:33.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:33.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:33.320 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:33.320 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.320 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.320 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:33.320 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:33.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:33.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.321 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:33.321 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:33.321 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:33.321 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.321 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:33.322 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:33.323 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.323 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.323 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.323 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:33.323 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:33.323 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:33.324 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:33.322+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:33.325 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:33.426 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:33.424+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:33.502 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:33.502 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:177475 5.2 5:4ec032c7:::benchmark_data_smithi043_45180_object42833:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:33.494674+0000", 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0071209610000000003, 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071385889999999999, 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 177475 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:33.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.494674+0000", 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.494674+0000", 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.494673+0000", 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:33.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.494678+0000", 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0719999999999999e-06 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.494688+0000", 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0406e-05 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.494695+0000", 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2450000000000001e-06 2024-04-26T10:34:33.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.494758+0000", 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2424999999999999e-05 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.494870+0000", 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011203499999999999 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.494971+0000", 2024-04-26T10:34:33.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100852 2024-04-26T10:34:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.497071+0000", 2024-04-26T10:34:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021003939999999998 2024-04-26T10:34:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:177478 5.2 5:42fb779c:::benchmark_data_smithi043_45180_object42836:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:34:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:33.497904+0000", 2024-04-26T10:34:33.507 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0038904550000000001, 2024-04-26T10:34:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039606620000000002, 2024-04-26T10:34:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 177478 2024-04-26T10:34:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.497904+0000", 2024-04-26T10:34:33.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.497904+0000", 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.497903+0000", 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:33.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.497907+0000", 2024-04-26T10:34:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6100000000000002e-06 2024-04-26T10:34:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.497915+0000", 2024-04-26T10:34:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8909999999999995e-06 2024-04-26T10:34:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.497922+0000", 2024-04-26T10:34:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:34:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.497974+0000", 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2515000000000001e-05 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.498088+0000", 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000113872 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.498206+0000", 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118387 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.499983+0000", 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001776775 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:177484 5.3 e54/16 5:ccc046d4:::benchmark_data_smithi043_45180_object42842:head v 54'11066, mlcod=54'11064)", 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:33.500492+0000", 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0013021720000000001, 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014179310000000001, 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:33.512 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500492+0000", 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500492+0000", 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500492+0000", 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500497+0000", 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2390000000000002e-06 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500507+0000", 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0183999999999999e-05 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500513+0000", 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2890000000000003e-06 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500568+0000", 2024-04-26T10:34:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4168e-05 2024-04-26T10:34:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500587+0000", 2024-04-26T10:34:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9623000000000002e-05 2024-04-26T10:34:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:177483 5.6 e54/16 5:64633e1b:::benchmark_data_smithi043_45180_object42841:head v 54'11090, mlcod=54'11088)", 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:33.500528+0000", 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.001266842, 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014163909999999999, 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500528+0000", 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500528+0000", 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500527+0000", 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500531+0000", 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-06 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500537+0000", 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0140000000000004e-06 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500542+0000", 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1139999999999997e-06 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500568+0000", 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6169e-05 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:33.500590+0000", 2024-04-26T10:34:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1691999999999998e-05 2024-04-26T10:34:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:34:33.519 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 4 2024-04-26T10:34:33.519 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:33.520 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:33.559 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T10:34:33.559 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-26T10:34:33.561 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:33.560+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:33.576 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T10:34:33.576 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:34:33.627 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:33.625+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:33.727 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:33.727+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:33.738 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:33.738 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:34:33.738 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:34:33.738 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:34:33.738 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:33.752 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:33.841 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:33.840+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:33.933 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:33.935 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:34:33.935 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:33.928+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:33.944 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-04-26T10:34:33.552470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6641290098,"num_objects":101354,"num_object_clones":0,"num_object_copies":202708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101354,"num_whiteouts":0,"num_read":137,"num_read_kb":119,"num_write":168198,"num_write_kb":8620371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3200,"num_bytes_recovered":209195352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60871,"ondisk_log_size":60871,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":13705216,"kb_used_data":13115872,"kb_used_omap":4,"kb_used_meta":588795,"kb_avail":269410304,"statfs":{"total":289910292480,"available":275876151296,"internally_reserved":0,"allocated":13430652928,"data_stored":13429503618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":602926418},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,4],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-932315136,"num_objects":-14226,"num_object_clones":0,"num_object_copies":-28452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-14226,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.550394"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536768+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:34:26.536768+0000","last_peered":"2024-04-26T10:34:26.536768+0000","last_clean":"2024-04-26T10:34:26.536768+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:34:26.536768+0000","last_undegraded":"2024-04-26T10:34:26.536768+0000","last_fullsized":"2024-04-26T10:34:26.536768+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:26.964955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536821+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:34:26.536821+0000","last_peered":"2024-04-26T10:34:26.536821+0000","last_clean":"2024-04-26T10:34:26.536821+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:34:26.536821+0000","last_undegraded":"2024-04-26T10:34:26.536821+0000","last_fullsized":"2024-04-26T10:34:26.536821+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536684+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:34:26.536684+0000","last_peered":"2024-04-26T10:34:26.536684+0000","last_clean":"2024-04-26T10:34:26.536684+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:34:26.536684+0000","last_undegraded":"2024-04-26T10:34:26.536684+0000","last_fullsized":"2024-04-26T10:34:26.536684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536173+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:34:26.536173+0000","last_peered":"2024-04-26T10:34:26.536173+0000","last_clean":"2024-04-26T10:34:26.536173+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:34:26.536173+0000","last_undegraded":"2024-04-26T10:34:26.536173+0000","last_fullsized":"2024-04-26T10:34:26.536173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536296+0000","last_change":"2024-04-26T10:34:14.507618+0000","last_active":"2024-04-26T10:34:26.536296+0000","last_peered":"2024-04-26T10:34:26.536296+0000","last_clean":"2024-04-26T10:34:26.536296+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:34:26.536296+0000","last_undegraded":"2024-04-26T10:34:26.536296+0000","last_fullsized":"2024-04-26T10:34:26.536296+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:27.721106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535119+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:34:26.535119+0000","last_peered":"2024-04-26T10:34:26.535119+0000","last_clean":"2024-04-26T10:34:26.535119+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:34:26.535119+0000","last_undegraded":"2024-04-26T10:34:26.535119+0000","last_fullsized":"2024-04-26T10:34:26.535119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536212+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:34:26.536212+0000","last_peered":"2024-04-26T10:34:26.536212+0000","last_clean":"2024-04-26T10:34:26.536212+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:34:26.536212+0000","last_undegraded":"2024-04-26T10:34:26.536212+0000","last_fullsized":"2024-04-26T10:34:26.536212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.533781+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:34:26.533781+0000","last_peered":"2024-04-26T10:34:26.533781+0000","last_clean":"2024-04-26T10:34:26.533781+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:34:26.533781+0000","last_undegraded":"2024-04-26T10:34:26.533781+0000","last_fullsized":"2024-04-26T10:34:26.533781+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534982+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:34:26.534982+0000","last_peered":"2024-04-26T10:34:26.534982+0000","last_clean":"2024-04-26T10:34:26.534982+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:34:26.534982+0000","last_undegraded":"2024-04-26T10:34:26.534982+0000","last_fullsized":"2024-04-26T10:34:26.534982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536539+0000","last_change":"2024-04-26T10:34:14.507265+0000","last_active":"2024-04-26T10:34:26.536539+0000","last_peered":"2024-04-26T10:34:26.536539+0000","last_clean":"2024-04-26T10:34:26.536539+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:34:26.536539+0000","last_undegraded":"2024-04-26T10:34:26.536539+0000","last_fullsized":"2024-04-26T10:34:26.536539+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:07.268421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536534+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:34:26.536534+0000","last_peered":"2024-04-26T10:34:26.536534+0000","last_clean":"2024-04-26T10:34:26.536534+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:34:26.536534+0000","last_undegraded":"2024-04-26T10:34:26.536534+0000","last_fullsized":"2024-04-26T10:34:26.536534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536783+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:34:26.536783+0000","last_peered":"2024-04-26T10:34:26.536783+0000","last_clean":"2024-04-26T10:34:26.536783+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:34:26.536783+0000","last_undegraded":"2024-04-26T10:34:26.536783+0000","last_fullsized":"2024-04-26T10:34:26.536783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536299+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:34:26.536299+0000","last_peered":"2024-04-26T10:34:26.536299+0000","last_clean":"2024-04-26T10:34:26.536299+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:34:26.536299+0000","last_undegraded":"2024-04-26T10:34:26.536299+0000","last_fullsized":"2024-04-26T10:34:26.536299+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:03.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535431+0000","last_change":"2024-04-26T10:34:14.509249+0000","last_active":"2024-04-26T10:34:26.535431+0000","last_peered":"2024-04-26T10:34:26.535431+0000","last_clean":"2024-04-26T10:34:26.535431+0000","last_became_active":"2024-04-26T10:34:14.508371+0000","last_became_peered":"2024-04-26T10:34:14.508371+0000","last_unstale":"2024-04-26T10:34:26.535431+0000","last_undegraded":"2024-04-26T10:34:26.535431+0000","last_fullsized":"2024-04-26T10:34:26.535431+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:35.257141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536167+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:34:26.536167+0000","last_peered":"2024-04-26T10:34:26.536167+0000","last_clean":"2024-04-26T10:34:26.536167+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:34:26.536167+0000","last_undegraded":"2024-04-26T10:34:26.536167+0000","last_fullsized":"2024-04-26T10:34:26.536167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.533853+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:34:26.533853+0000","last_peered":"2024-04-26T10:34:26.533853+0000","last_clean":"2024-04-26T10:34:26.533853+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:34:26.533853+0000","last_undegraded":"2024-04-26T10:34:26.533853+0000","last_fullsized":"2024-04-26T10:34:26.533853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535057+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:34:26.535057+0000","last_peered":"2024-04-26T10:34:26.535057+0000","last_clean":"2024-04-26T10:34:26.535057+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:34:26.535057+0000","last_undegraded":"2024-04-26T10:34:26.535057+0000","last_fullsized":"2024-04-26T10:34:26.535057+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536508+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:34:26.536508+0000","last_peered":"2024-04-26T10:34:26.536508+0000","last_clean":"2024-04-26T10:34:26.536508+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:34:26.536508+0000","last_undegraded":"2024-04-26T10:34:26.536508+0000","last_fullsized":"2024-04-26T10:34:26.536508+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.343269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.537653+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:34:26.537653+0000","last_peered":"2024-04-26T10:34:26.537653+0000","last_clean":"2024-04-26T10:34:26.537653+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:34:26.537653+0000","last_undegraded":"2024-04-26T10:34:26.537653+0000","last_fullsized":"2024-04-26T10:34:26.537653+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535396+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:34:26.535396+0000","last_peered":"2024-04-26T10:34:26.535396+0000","last_clean":"2024-04-26T10:34:26.535396+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:34:26.535396+0000","last_undegraded":"2024-04-26T10:34:26.535396+0000","last_fullsized":"2024-04-26T10:34:26.535396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534874+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:34:26.534874+0000","last_peered":"2024-04-26T10:34:26.534874+0000","last_clean":"2024-04-26T10:34:26.534874+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:34:26.534874+0000","last_undegraded":"2024-04-26T10:34:26.534874+0000","last_fullsized":"2024-04-26T10:34:26.534874+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536718+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:34:26.536718+0000","last_peered":"2024-04-26T10:34:26.536718+0000","last_clean":"2024-04-26T10:34:26.536718+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:34:26.536718+0000","last_undegraded":"2024-04-26T10:34:26.536718+0000","last_fullsized":"2024-04-26T10:34:26.536718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534626+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:34:26.534626+0000","last_peered":"2024-04-26T10:34:26.534626+0000","last_clean":"2024-04-26T10:34:26.534626+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:34:26.534626+0000","last_undegraded":"2024-04-26T10:34:26.534626+0000","last_fullsized":"2024-04-26T10:34:26.534626+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536312+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:34:26.536312+0000","last_peered":"2024-04-26T10:34:26.536312+0000","last_clean":"2024-04-26T10:34:26.536312+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:34:26.536312+0000","last_undegraded":"2024-04-26T10:34:26.536312+0000","last_fullsized":"2024-04-26T10:34:26.536312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536885+0000","last_change":"2024-04-26T10:34:14.511829+0000","last_active":"2024-04-26T10:34:26.536885+0000","last_peered":"2024-04-26T10:34:26.536885+0000","last_clean":"2024-04-26T10:34:26.536885+0000","last_became_active":"2024-04-26T10:34:14.511584+0000","last_became_peered":"2024-04-26T10:34:14.511584+0000","last_unstale":"2024-04-26T10:34:26.536885+0000","last_undegraded":"2024-04-26T10:34:26.536885+0000","last_fullsized":"2024-04-26T10:34:26.536885+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:30.166797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535941+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:34:26.535941+0000","last_peered":"2024-04-26T10:34:26.535941+0000","last_clean":"2024-04-26T10:34:26.535941+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:34:26.535941+0000","last_undegraded":"2024-04-26T10:34:26.535941+0000","last_fullsized":"2024-04-26T10:34:26.535941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536544+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:34:26.536544+0000","last_peered":"2024-04-26T10:34:26.536544+0000","last_clean":"2024-04-26T10:34:26.536544+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:34:26.536544+0000","last_undegraded":"2024-04-26T10:34:26.536544+0000","last_fullsized":"2024-04-26T10:34:26.536544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536828+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:34:26.536828+0000","last_peered":"2024-04-26T10:34:26.536828+0000","last_clean":"2024-04-26T10:34:26.536828+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:34:26.536828+0000","last_undegraded":"2024-04-26T10:34:26.536828+0000","last_fullsized":"2024-04-26T10:34:26.536828+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.537013+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:34:26.537013+0000","last_peered":"2024-04-26T10:34:26.537013+0000","last_clean":"2024-04-26T10:34:26.537013+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:34:26.537013+0000","last_undegraded":"2024-04-26T10:34:26.537013+0000","last_fullsized":"2024-04-26T10:34:26.537013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534703+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:34:26.534703+0000","last_peered":"2024-04-26T10:34:26.534703+0000","last_clean":"2024-04-26T10:34:26.534703+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:34:26.534703+0000","last_undegraded":"2024-04-26T10:34:26.534703+0000","last_fullsized":"2024-04-26T10:34:26.534703+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536010+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:34:26.536010+0000","last_peered":"2024-04-26T10:34:26.536010+0000","last_clean":"2024-04-26T10:34:26.536010+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:34:26.536010+0000","last_undegraded":"2024-04-26T10:34:26.536010+0000","last_fullsized":"2024-04-26T10:34:26.536010+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":63,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.538111+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:34:26.538111+0000","last_peered":"2024-04-26T10:34:26.538111+0000","last_clean":"2024-04-26T10:34:26.538111+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:34:26.538111+0000","last_undegraded":"2024-04-26T10:34:26.538111+0000","last_fullsized":"2024-04-26T10:34:26.538111+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:19.856062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.537072+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:34:26.537072+0000","last_peered":"2024-04-26T10:34:26.537072+0000","last_clean":"2024-04-26T10:34:26.537072+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:34:26.537072+0000","last_undegraded":"2024-04-26T10:34:26.537072+0000","last_fullsized":"2024-04-26T10:34:26.537072+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:27.538545+0000","last_change":"2024-04-26T10:34:26.537188+0000","last_active":"2024-04-26T10:34:27.538545+0000","last_peered":"2024-04-26T10:34:27.538545+0000","last_clean":"2024-04-26T10:34:27.538545+0000","last_became_active":"2024-04-26T10:34:26.536934+0000","last_became_peered":"2024-04-26T10:34:26.536934+0000","last_unstale":"2024-04-26T10:34:27.538545+0000","last_undegraded":"2024-04-26T10:34:27.538545+0000","last_fullsized":"2024-04-26T10:34:27.538545+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:02.447434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.537935+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:34:26.537935+0000","last_peered":"2024-04-26T10:34:26.537935+0000","last_clean":"2024-04-26T10:34:26.537935+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:34:26.537935+0000","last_undegraded":"2024-04-26T10:34:26.537935+0000","last_fullsized":"2024-04-26T10:34:26.537935+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:04.852453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534826+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:34:26.534826+0000","last_peered":"2024-04-26T10:34:26.534826+0000","last_clean":"2024-04-26T10:34:26.534826+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:34:26.534826+0000","last_undegraded":"2024-04-26T10:34:26.534826+0000","last_fullsized":"2024-04-26T10:34:26.534826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534834+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:34:26.534834+0000","last_peered":"2024-04-26T10:34:26.534834+0000","last_clean":"2024-04-26T10:34:26.534834+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:34:26.534834+0000","last_undegraded":"2024-04-26T10:34:26.534834+0000","last_fullsized":"2024-04-26T10:34:26.534834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":25,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536383+0000","last_change":"2024-04-26T10:34:14.518131+0000","last_active":"2024-04-26T10:34:26.536383+0000","last_peered":"2024-04-26T10:34:26.536383+0000","last_clean":"2024-04-26T10:34:26.536383+0000","last_became_active":"2024-04-26T10:34:14.506010+0000","last_became_peered":"2024-04-26T10:34:14.506010+0000","last_unstale":"2024-04-26T10:34:26.536383+0000","last_undegraded":"2024-04-26T10:34:26.536383+0000","last_fullsized":"2024-04-26T10:34:26.536383+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:51.842115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536054+0000","last_change":"2024-04-26T10:34:14.509381+0000","last_active":"2024-04-26T10:34:26.536054+0000","last_peered":"2024-04-26T10:34:26.536054+0000","last_clean":"2024-04-26T10:34:26.536054+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:34:26.536054+0000","last_undegraded":"2024-04-26T10:34:26.536054+0000","last_fullsized":"2024-04-26T10:34:26.536054+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:05.841519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535429+0000","last_change":"2024-04-26T10:34:14.548596+0000","last_active":"2024-04-26T10:34:26.535429+0000","last_peered":"2024-04-26T10:34:26.535429+0000","last_clean":"2024-04-26T10:34:26.535429+0000","last_became_active":"2024-04-26T10:34:14.512027+0000","last_became_peered":"2024-04-26T10:34:14.512027+0000","last_unstale":"2024-04-26T10:34:26.535429+0000","last_undegraded":"2024-04-26T10:34:26.535429+0000","last_fullsized":"2024-04-26T10:34:26.535429+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:39.957573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535211+0000","last_change":"2024-04-26T10:34:14.513656+0000","last_active":"2024-04-26T10:34:26.535211+0000","last_peered":"2024-04-26T10:34:26.535211+0000","last_clean":"2024-04-26T10:34:26.535211+0000","last_became_active":"2024-04-26T10:34:14.513402+0000","last_became_peered":"2024-04-26T10:34:14.513402+0000","last_unstale":"2024-04-26T10:34:26.535211+0000","last_undegraded":"2024-04-26T10:34:26.535211+0000","last_fullsized":"2024-04-26T10:34:26.535211+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:22.053611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536031+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:34:26.536031+0000","last_peered":"2024-04-26T10:34:26.536031+0000","last_clean":"2024-04-26T10:34:26.536031+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:34:26.536031+0000","last_undegraded":"2024-04-26T10:34:26.536031+0000","last_fullsized":"2024-04-26T10:34:26.536031+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536612+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:34:26.536612+0000","last_peered":"2024-04-26T10:34:26.536612+0000","last_clean":"2024-04-26T10:34:26.536612+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:34:26.536612+0000","last_undegraded":"2024-04-26T10:34:26.536612+0000","last_fullsized":"2024-04-26T10:34:26.536612+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:02.872251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536167+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:34:26.536167+0000","last_peered":"2024-04-26T10:34:26.536167+0000","last_clean":"2024-04-26T10:34:26.536167+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:34:26.536167+0000","last_undegraded":"2024-04-26T10:34:26.536167+0000","last_fullsized":"2024-04-26T10:34:26.536167+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536450+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:34:26.536450+0000","last_peered":"2024-04-26T10:34:26.536450+0000","last_clean":"2024-04-26T10:34:26.536450+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:34:26.536450+0000","last_undegraded":"2024-04-26T10:34:26.536450+0000","last_fullsized":"2024-04-26T10:34:26.536450+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:43.500342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535986+0000","last_change":"2024-04-26T10:34:14.509818+0000","last_active":"2024-04-26T10:34:26.535986+0000","last_peered":"2024-04-26T10:34:26.535986+0000","last_clean":"2024-04-26T10:34:26.535986+0000","last_became_active":"2024-04-26T10:34:14.509270+0000","last_became_peered":"2024-04-26T10:34:14.509270+0000","last_unstale":"2024-04-26T10:34:26.535986+0000","last_undegraded":"2024-04-26T10:34:26.535986+0000","last_fullsized":"2024-04-26T10:34:26.535986+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:45.412620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536053+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:34:26.536053+0000","last_peered":"2024-04-26T10:34:26.536053+0000","last_clean":"2024-04-26T10:34:26.536053+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:34:26.536053+0000","last_undegraded":"2024-04-26T10:34:26.536053+0000","last_fullsized":"2024-04-26T10:34:26.536053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":91,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534107+0000","last_change":"2024-04-26T10:34:14.531646+0000","last_active":"2024-04-26T10:34:26.534107+0000","last_peered":"2024-04-26T10:34:26.534107+0000","last_clean":"2024-04-26T10:34:26.534107+0000","last_became_active":"2024-04-26T10:34:14.511911+0000","last_became_peered":"2024-04-26T10:34:14.511911+0000","last_unstale":"2024-04-26T10:34:26.534107+0000","last_undegraded":"2024-04-26T10:34:26.534107+0000","last_fullsized":"2024-04-26T10:34:26.534107+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:39.588939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535581+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:34:26.535581+0000","last_peered":"2024-04-26T10:34:26.535581+0000","last_clean":"2024-04-26T10:34:26.535581+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:34:26.535581+0000","last_undegraded":"2024-04-26T10:34:26.535581+0000","last_fullsized":"2024-04-26T10:34:26.535581+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"51'10561","reported_seq":13669,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.053043+0000","last_change":"2024-04-26T10:34:14.549017+0000","last_active":"2024-04-26T10:34:30.053043+0000","last_peered":"2024-04-26T10:34:30.053043+0000","last_clean":"2024-04-26T10:34:30.053043+0000","last_became_active":"2024-04-26T10:34:14.518037+0000","last_became_peered":"2024-04-26T10:34:14.518037+0000","last_unstale":"2024-04-26T10:34:30.053043+0000","last_undegraded":"2024-04-26T10:34:30.053043+0000","last_fullsized":"2024-04-26T10:34:30.053043+0000","mapping_epoch":41,"log_start":"35'6791","ondisk_log_start":"35'6791","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3770,"log_dups_size":1542,"ondisk_log_size":3770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:21.571693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413335552,"num_objects":6307,"num_object_clones":0,"num_object_copies":12614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10561,"num_write_kb":539776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1524,"num_bytes_recovered":99876864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":72,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535171+0000","last_change":"2024-04-26T10:34:14.536943+0000","last_active":"2024-04-26T10:34:26.535171+0000","last_peered":"2024-04-26T10:34:26.535171+0000","last_clean":"2024-04-26T10:34:26.535171+0000","last_became_active":"2024-04-26T10:34:14.511960+0000","last_became_peered":"2024-04-26T10:34:14.511960+0000","last_unstale":"2024-04-26T10:34:26.535171+0000","last_undegraded":"2024-04-26T10:34:26.535171+0000","last_fullsized":"2024-04-26T10:34:26.535171+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.329973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536125+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:34:26.536125+0000","last_peered":"2024-04-26T10:34:26.536125+0000","last_clean":"2024-04-26T10:34:26.536125+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:34:26.536125+0000","last_undegraded":"2024-04-26T10:34:26.536125+0000","last_fullsized":"2024-04-26T10:34:26.536125+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"51'10718","reported_seq":10760,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.059780+0000","last_change":"2024-04-26T10:33:16.346351+0000","last_active":"2024-04-26T10:34:30.059780+0000","last_peered":"2024-04-26T10:34:30.059780+0000","last_clean":"2024-04-26T10:34:30.059780+0000","last_became_active":"2024-04-26T10:33:16.346122+0000","last_became_peered":"2024-04-26T10:33:16.346122+0000","last_unstale":"2024-04-26T10:34:30.059780+0000","last_undegraded":"2024-04-26T10:34:30.059780+0000","last_fullsized":"2024-04-26T10:34:30.059780+0000","mapping_epoch":16,"log_start":"32'6764","ondisk_log_start":"32'6764","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3954,"log_dups_size":0,"ondisk_log_size":3954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:13.714464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428998656,"num_objects":6546,"num_object_clones":0,"num_object_copies":13092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6546,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10718,"num_write_kb":552448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536827+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:34:26.536827+0000","last_peered":"2024-04-26T10:34:26.536827+0000","last_clean":"2024-04-26T10:34:26.536827+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:34:26.536827+0000","last_undegraded":"2024-04-26T10:34:26.536827+0000","last_fullsized":"2024-04-26T10:34:26.536827+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536073+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:34:26.536073+0000","last_peered":"2024-04-26T10:34:26.536073+0000","last_clean":"2024-04-26T10:34:26.536073+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:34:26.536073+0000","last_undegraded":"2024-04-26T10:34:26.536073+0000","last_fullsized":"2024-04-26T10:34:26.536073+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:12.954308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"51'10626","reported_seq":13979,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.058149+0000","last_change":"2024-04-26T10:34:15.510456+0000","last_active":"2024-04-26T10:34:30.058149+0000","last_peered":"2024-04-26T10:34:30.058149+0000","last_clean":"2024-04-26T10:34:30.058149+0000","last_became_active":"2024-04-26T10:34:15.505397+0000","last_became_peered":"2024-04-26T10:34:15.505397+0000","last_unstale":"2024-04-26T10:34:30.058149+0000","last_undegraded":"2024-04-26T10:34:30.058149+0000","last_fullsized":"2024-04-26T10:34:30.058149+0000","mapping_epoch":42,"log_start":"32'6664","ondisk_log_start":"32'6664","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3962,"log_dups_size":1442,"ondisk_log_size":3962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:45.190570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419168256,"num_objects":6396,"num_object_clones":0,"num_object_copies":12792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10626,"num_write_kb":544704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1649,"num_bytes_recovered":108068864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536738+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:34:26.536738+0000","last_peered":"2024-04-26T10:34:26.536738+0000","last_clean":"2024-04-26T10:34:26.536738+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:34:26.536738+0000","last_undegraded":"2024-04-26T10:34:26.536738+0000","last_fullsized":"2024-04-26T10:34:26.536738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535340+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:34:26.535340+0000","last_peered":"2024-04-26T10:34:26.535340+0000","last_clean":"2024-04-26T10:34:26.535340+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:34:26.535340+0000","last_undegraded":"2024-04-26T10:34:26.535340+0000","last_fullsized":"2024-04-26T10:34:26.535340+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"51'10621","reported_seq":10664,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.090487+0000","last_change":"2024-04-26T10:33:16.346212+0000","last_active":"2024-04-26T10:34:30.090487+0000","last_peered":"2024-04-26T10:34:30.090487+0000","last_clean":"2024-04-26T10:34:30.090487+0000","last_became_active":"2024-04-26T10:33:16.346004+0000","last_became_peered":"2024-04-26T10:33:16.346004+0000","last_unstale":"2024-04-26T10:34:30.090487+0000","last_undegraded":"2024-04-26T10:34:30.090487+0000","last_fullsized":"2024-04-26T10:34:30.090487+0000","mapping_epoch":16,"log_start":"36'7054","ondisk_log_start":"36'7054","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":1542,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:27.495754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416612352,"num_objects":6357,"num_object_clones":0,"num_object_copies":12714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6357,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10621,"num_write_kb":543296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535058+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:34:26.535058+0000","last_peered":"2024-04-26T10:34:26.535058+0000","last_clean":"2024-04-26T10:34:26.535058+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:34:26.535058+0000","last_undegraded":"2024-04-26T10:34:26.535058+0000","last_fullsized":"2024-04-26T10:34:26.535058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535189+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:34:26.535189+0000","last_peered":"2024-04-26T10:34:26.535189+0000","last_clean":"2024-04-26T10:34:26.535189+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:34:26.535189+0000","last_undegraded":"2024-04-26T10:34:26.535189+0000","last_fullsized":"2024-04-26T10:34:26.535189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"51'10532","reported_seq":10587,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.050573+0000","last_change":"2024-04-26T10:34:15.511727+0000","last_active":"2024-04-26T10:34:30.050573+0000","last_peered":"2024-04-26T10:34:30.050573+0000","last_clean":"2024-04-26T10:34:30.050573+0000","last_became_active":"2024-04-26T10:34:15.508075+0000","last_became_peered":"2024-04-26T10:34:15.508075+0000","last_unstale":"2024-04-26T10:34:30.050573+0000","last_undegraded":"2024-04-26T10:34:30.050573+0000","last_fullsized":"2024-04-26T10:34:30.050573+0000","mapping_epoch":42,"log_start":"32'6572","ondisk_log_start":"32'6572","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3960,"log_dups_size":1442,"ondisk_log_size":3960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:13.011834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412811288,"num_objects":6300,"num_object_clones":0,"num_object_copies":12600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6300,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10532,"num_write_kb":538561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535068+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:34:26.535068+0000","last_peered":"2024-04-26T10:34:26.535068+0000","last_clean":"2024-04-26T10:34:26.535068+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:34:26.535068+0000","last_undegraded":"2024-04-26T10:34:26.535068+0000","last_fullsized":"2024-04-26T10:34:26.535068+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535148+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:34:26.535148+0000","last_peered":"2024-04-26T10:34:26.535148+0000","last_clean":"2024-04-26T10:34:26.535148+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:34:26.535148+0000","last_undegraded":"2024-04-26T10:34:26.535148+0000","last_fullsized":"2024-04-26T10:34:26.535148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"51'10407","reported_seq":10450,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.086724+0000","last_change":"2024-04-26T10:33:16.349242+0000","last_active":"2024-04-26T10:34:30.086724+0000","last_peered":"2024-04-26T10:34:30.086724+0000","last_clean":"2024-04-26T10:34:30.086724+0000","last_became_active":"2024-04-26T10:33:16.349063+0000","last_became_peered":"2024-04-26T10:33:16.349063+0000","last_unstale":"2024-04-26T10:34:30.086724+0000","last_undegraded":"2024-04-26T10:34:30.086724+0000","last_fullsized":"2024-04-26T10:34:30.086724+0000","mapping_epoch":16,"log_start":"36'6862","ondisk_log_start":"36'6862","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":1442,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:09.297624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417529856,"num_objects":6371,"num_object_clones":0,"num_object_copies":12742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10407,"num_write_kb":536896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535177+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:34:26.535177+0000","last_peered":"2024-04-26T10:34:26.535177+0000","last_clean":"2024-04-26T10:34:26.535177+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:34:26.535177+0000","last_undegraded":"2024-04-26T10:34:26.535177+0000","last_fullsized":"2024-04-26T10:34:26.535177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536730+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:34:26.536730+0000","last_peered":"2024-04-26T10:34:26.536730+0000","last_clean":"2024-04-26T10:34:26.536730+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:34:26.536730+0000","last_undegraded":"2024-04-26T10:34:26.536730+0000","last_fullsized":"2024-04-26T10:34:26.536730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"51'10255","reported_seq":10316,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.047939+0000","last_change":"2024-04-26T10:34:14.549556+0000","last_active":"2024-04-26T10:34:30.047939+0000","last_peered":"2024-04-26T10:34:30.047939+0000","last_clean":"2024-04-26T10:34:30.047939+0000","last_became_active":"2024-04-26T10:34:14.520855+0000","last_became_peered":"2024-04-26T10:34:14.520855+0000","last_unstale":"2024-04-26T10:34:30.047939+0000","last_undegraded":"2024-04-26T10:34:30.047939+0000","last_fullsized":"2024-04-26T10:34:30.047939+0000","mapping_epoch":41,"log_start":"32'6505","ondisk_log_start":"32'6505","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3750,"log_dups_size":1442,"ondisk_log_size":3750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:48.789996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401145856,"num_objects":6121,"num_object_clones":0,"num_object_copies":12242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10255,"num_write_kb":524032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536146+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:34:26.536146+0000","last_peered":"2024-04-26T10:34:26.536146+0000","last_clean":"2024-04-26T10:34:26.536146+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:34:26.536146+0000","last_undegraded":"2024-04-26T10:34:26.536146+0000","last_fullsized":"2024-04-26T10:34:26.536146+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534881+0000","last_change":"2024-04-26T10:34:14.509460+0000","last_active":"2024-04-26T10:34:26.534881+0000","last_peered":"2024-04-26T10:34:26.534881+0000","last_clean":"2024-04-26T10:34:26.534881+0000","last_became_active":"2024-04-26T10:34:14.509213+0000","last_became_peered":"2024-04-26T10:34:14.509213+0000","last_unstale":"2024-04-26T10:34:26.534881+0000","last_undegraded":"2024-04-26T10:34:26.534881+0000","last_fullsized":"2024-04-26T10:34:26.534881+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:15.816526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"51'10401","reported_seq":10443,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.063808+0000","last_change":"2024-04-26T10:33:16.344866+0000","last_active":"2024-04-26T10:34:30.063808+0000","last_peered":"2024-04-26T10:34:30.063808+0000","last_clean":"2024-04-26T10:34:30.063808+0000","last_became_active":"2024-04-26T10:33:16.344614+0000","last_became_peered":"2024-04-26T10:33:16.344614+0000","last_unstale":"2024-04-26T10:34:30.063808+0000","last_undegraded":"2024-04-26T10:34:30.063808+0000","last_fullsized":"2024-04-26T10:34:30.063808+0000","mapping_epoch":16,"log_start":"32'6354","ondisk_log_start":"32'6354","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415039488,"num_objects":6333,"num_object_clones":0,"num_object_copies":12666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10401,"num_write_kb":535488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536000+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:34:26.536000+0000","last_peered":"2024-04-26T10:34:26.536000+0000","last_clean":"2024-04-26T10:34:26.536000+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:34:26.536000+0000","last_undegraded":"2024-04-26T10:34:26.536000+0000","last_fullsized":"2024-04-26T10:34:26.536000+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:35.111495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535220+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:34:26.535220+0000","last_peered":"2024-04-26T10:34:26.535220+0000","last_clean":"2024-04-26T10:34:26.535220+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:34:26.535220+0000","last_undegraded":"2024-04-26T10:34:26.535220+0000","last_fullsized":"2024-04-26T10:34:26.535220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"51'10476","reported_seq":10519,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.073597+0000","last_change":"2024-04-26T10:33:16.349280+0000","last_active":"2024-04-26T10:34:30.073597+0000","last_peered":"2024-04-26T10:34:30.073597+0000","last_clean":"2024-04-26T10:34:30.073597+0000","last_became_active":"2024-04-26T10:33:16.349010+0000","last_became_peered":"2024-04-26T10:33:16.349010+0000","last_unstale":"2024-04-26T10:34:30.073597+0000","last_undegraded":"2024-04-26T10:34:30.073597+0000","last_fullsized":"2024-04-26T10:34:30.073597+0000","mapping_epoch":16,"log_start":"36'6871","ondisk_log_start":"36'6871","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3605,"log_dups_size":1442,"ondisk_log_size":3605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:08.933996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405929984,"num_objects":6194,"num_object_clones":0,"num_object_copies":12388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10476,"num_write_kb":533440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535309+0000","last_change":"2024-04-26T10:34:14.511174+0000","last_active":"2024-04-26T10:34:26.535309+0000","last_peered":"2024-04-26T10:34:26.535309+0000","last_clean":"2024-04-26T10:34:26.535309+0000","last_became_active":"2024-04-26T10:34:14.510907+0000","last_became_peered":"2024-04-26T10:34:14.510907+0000","last_unstale":"2024-04-26T10:34:26.535309+0000","last_undegraded":"2024-04-26T10:34:26.535309+0000","last_fullsized":"2024-04-26T10:34:26.535309+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:34.574586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536624+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:34:26.536624+0000","last_peered":"2024-04-26T10:34:26.536624+0000","last_clean":"2024-04-26T10:34:26.536624+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:34:26.536624+0000","last_undegraded":"2024-04-26T10:34:26.536624+0000","last_fullsized":"2024-04-26T10:34:26.536624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536438+0000","last_change":"2024-04-26T10:34:14.506552+0000","last_active":"2024-04-26T10:34:26.536438+0000","last_peered":"2024-04-26T10:34:26.536438+0000","last_clean":"2024-04-26T10:34:26.536438+0000","last_became_active":"2024-04-26T10:34:14.506008+0000","last_became_peered":"2024-04-26T10:34:14.506008+0000","last_unstale":"2024-04-26T10:34:26.536438+0000","last_undegraded":"2024-04-26T10:34:26.536438+0000","last_fullsized":"2024-04-26T10:34:26.536438+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.031036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"51'10440","reported_seq":10483,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.087683+0000","last_change":"2024-04-26T10:33:16.349302+0000","last_active":"2024-04-26T10:34:30.087683+0000","last_peered":"2024-04-26T10:34:30.087683+0000","last_clean":"2024-04-26T10:34:30.087683+0000","last_became_active":"2024-04-26T10:33:16.348992+0000","last_became_peered":"2024-04-26T10:33:16.348992+0000","last_unstale":"2024-04-26T10:34:30.087683+0000","last_undegraded":"2024-04-26T10:34:30.087683+0000","last_fullsized":"2024-04-26T10:34:30.087683+0000","mapping_epoch":16,"log_start":"36'6857","ondisk_log_start":"36'6857","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3583,"log_dups_size":1442,"ondisk_log_size":3583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:15.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409731072,"num_objects":6252,"num_object_clones":0,"num_object_copies":12504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10440,"num_write_kb":534144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536210+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:34:26.536210+0000","last_peered":"2024-04-26T10:34:26.536210+0000","last_clean":"2024-04-26T10:34:26.536210+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:34:26.536210+0000","last_undegraded":"2024-04-26T10:34:26.536210+0000","last_fullsized":"2024-04-26T10:34:26.536210+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535065+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:34:26.535065+0000","last_peered":"2024-04-26T10:34:26.535065+0000","last_clean":"2024-04-26T10:34:26.535065+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:34:26.535065+0000","last_undegraded":"2024-04-26T10:34:26.535065+0000","last_fullsized":"2024-04-26T10:34:26.535065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535197+0000","last_change":"2024-04-26T10:34:14.513348+0000","last_active":"2024-04-26T10:34:26.535197+0000","last_peered":"2024-04-26T10:34:26.535197+0000","last_clean":"2024-04-26T10:34:26.535197+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:34:26.535197+0000","last_undegraded":"2024-04-26T10:34:26.535197+0000","last_fullsized":"2024-04-26T10:34:26.535197+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:21.161769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"51'10503","reported_seq":10546,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.092083+0000","last_change":"2024-04-26T10:33:16.349181+0000","last_active":"2024-04-26T10:34:30.092083+0000","last_peered":"2024-04-26T10:34:30.092083+0000","last_clean":"2024-04-26T10:34:30.092083+0000","last_became_active":"2024-04-26T10:33:16.348981+0000","last_became_peered":"2024-04-26T10:33:16.348981+0000","last_unstale":"2024-04-26T10:34:30.092083+0000","last_undegraded":"2024-04-26T10:34:30.092083+0000","last_fullsized":"2024-04-26T10:34:30.092083+0000","mapping_epoch":16,"log_start":"36'6884","ondisk_log_start":"36'6884","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3619,"log_dups_size":1442,"ondisk_log_size":3619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416219136,"num_objects":6351,"num_object_clones":0,"num_object_copies":12702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10503,"num_write_kb":539328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534551+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:34:26.534551+0000","last_peered":"2024-04-26T10:34:26.534551+0000","last_clean":"2024-04-26T10:34:26.534551+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:34:26.534551+0000","last_undegraded":"2024-04-26T10:34:26.534551+0000","last_fullsized":"2024-04-26T10:34:26.534551+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536206+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:34:26.536206+0000","last_peered":"2024-04-26T10:34:26.536206+0000","last_clean":"2024-04-26T10:34:26.536206+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:34:26.536206+0000","last_undegraded":"2024-04-26T10:34:26.536206+0000","last_fullsized":"2024-04-26T10:34:26.536206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535497+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:34:26.535497+0000","last_peered":"2024-04-26T10:34:26.535497+0000","last_clean":"2024-04-26T10:34:26.535497+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:34:26.535497+0000","last_undegraded":"2024-04-26T10:34:26.535497+0000","last_fullsized":"2024-04-26T10:34:26.535497+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:57.803542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"51'10494","reported_seq":10548,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.057918+0000","last_change":"2024-04-26T10:34:15.513418+0000","last_active":"2024-04-26T10:34:30.057918+0000","last_peered":"2024-04-26T10:34:30.057918+0000","last_clean":"2024-04-26T10:34:30.057918+0000","last_became_active":"2024-04-26T10:34:15.508062+0000","last_became_peered":"2024-04-26T10:34:15.508062+0000","last_unstale":"2024-04-26T10:34:30.057918+0000","last_undegraded":"2024-04-26T10:34:30.057918+0000","last_fullsized":"2024-04-26T10:34:30.057918+0000","mapping_epoch":42,"log_start":"32'6457","ondisk_log_start":"32'6457","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":4037,"log_dups_size":1542,"ondisk_log_size":4037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:12.573855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417595392,"num_objects":6372,"num_object_clones":0,"num_object_copies":12744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6372,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10494,"num_write_kb":539712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535030+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:34:26.535030+0000","last_peered":"2024-04-26T10:34:26.535030+0000","last_clean":"2024-04-26T10:34:26.535030+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:34:26.535030+0000","last_undegraded":"2024-04-26T10:34:26.535030+0000","last_fullsized":"2024-04-26T10:34:26.535030+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":288,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.533926+0000","last_change":"2024-04-26T10:34:17.427146+0000","last_active":"2024-04-26T10:34:26.533926+0000","last_peered":"2024-04-26T10:34:26.533926+0000","last_clean":"2024-04-26T10:34:26.533926+0000","last_became_active":"2024-04-26T10:34:17.426852+0000","last_became_peered":"2024-04-26T10:34:17.426852+0000","last_unstale":"2024-04-26T10:34:26.533926+0000","last_undegraded":"2024-04-26T10:34:26.533926+0000","last_fullsized":"2024-04-26T10:34:26.533926+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:50.963578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535985+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:34:26.535985+0000","last_peered":"2024-04-26T10:34:26.535985+0000","last_clean":"2024-04-26T10:34:26.535985+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:34:26.535985+0000","last_undegraded":"2024-04-26T10:34:26.535985+0000","last_fullsized":"2024-04-26T10:34:26.535985+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536692+0000","last_change":"2024-04-26T10:34:14.509642+0000","last_active":"2024-04-26T10:34:26.536692+0000","last_peered":"2024-04-26T10:34:26.536692+0000","last_clean":"2024-04-26T10:34:26.536692+0000","last_became_active":"2024-04-26T10:34:14.509329+0000","last_became_peered":"2024-04-26T10:34:14.509329+0000","last_unstale":"2024-04-26T10:34:26.536692+0000","last_undegraded":"2024-04-26T10:34:26.536692+0000","last_fullsized":"2024-04-26T10:34:26.536692+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:20.861292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"51'10331","reported_seq":10374,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.032729+0000","last_change":"2024-04-26T10:33:16.344693+0000","last_active":"2024-04-26T10:34:30.032729+0000","last_peered":"2024-04-26T10:34:30.032729+0000","last_clean":"2024-04-26T10:34:30.032729+0000","last_became_active":"2024-04-26T10:33:16.344478+0000","last_became_peered":"2024-04-26T10:33:16.344478+0000","last_unstale":"2024-04-26T10:34:30.032729+0000","last_undegraded":"2024-04-26T10:34:30.032729+0000","last_fullsized":"2024-04-26T10:34:30.032729+0000","mapping_epoch":16,"log_start":"32'6533","ondisk_log_start":"32'6533","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3798,"log_dups_size":1442,"ondisk_log_size":3798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:24.298876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415825920,"num_objects":6345,"num_object_clones":0,"num_object_copies":12690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6345,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10331,"num_write_kb":533632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534006+0000","last_change":"2024-04-26T10:34:14.509367+0000","last_active":"2024-04-26T10:34:26.534006+0000","last_peered":"2024-04-26T10:34:26.534006+0000","last_clean":"2024-04-26T10:34:26.534006+0000","last_became_active":"2024-04-26T10:34:14.508465+0000","last_became_peered":"2024-04-26T10:34:14.508465+0000","last_unstale":"2024-04-26T10:34:26.534006+0000","last_undegraded":"2024-04-26T10:34:26.534006+0000","last_fullsized":"2024-04-26T10:34:26.534006+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:31.790156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534411+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:34:26.534411+0000","last_peered":"2024-04-26T10:34:26.534411+0000","last_clean":"2024-04-26T10:34:26.534411+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:34:26.534411+0000","last_undegraded":"2024-04-26T10:34:26.534411+0000","last_fullsized":"2024-04-26T10:34:26.534411+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536911+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:34:26.536911+0000","last_peered":"2024-04-26T10:34:26.536911+0000","last_clean":"2024-04-26T10:34:26.536911+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:34:26.536911+0000","last_undegraded":"2024-04-26T10:34:26.536911+0000","last_fullsized":"2024-04-26T10:34:26.536911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"51'10603","reported_seq":10646,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.050932+0000","last_change":"2024-04-26T10:33:16.344694+0000","last_active":"2024-04-26T10:34:30.050932+0000","last_peered":"2024-04-26T10:34:30.050932+0000","last_clean":"2024-04-26T10:34:30.050932+0000","last_became_active":"2024-04-26T10:33:16.344461+0000","last_became_peered":"2024-04-26T10:33:16.344461+0000","last_unstale":"2024-04-26T10:34:30.050932+0000","last_undegraded":"2024-04-26T10:34:30.050932+0000","last_fullsized":"2024-04-26T10:34:30.050932+0000","mapping_epoch":16,"log_start":"35'6884","ondisk_log_start":"35'6884","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":1442,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:29.374096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417792000,"num_objects":6375,"num_object_clones":0,"num_object_copies":12750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6375,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10603,"num_write_kb":543296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536704+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:34:26.536704+0000","last_peered":"2024-04-26T10:34:26.536704+0000","last_clean":"2024-04-26T10:34:26.536704+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:34:26.536704+0000","last_undegraded":"2024-04-26T10:34:26.536704+0000","last_fullsized":"2024-04-26T10:34:26.536704+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":63,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535422+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:34:26.535422+0000","last_peered":"2024-04-26T10:34:26.535422+0000","last_clean":"2024-04-26T10:34:26.535422+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:34:26.535422+0000","last_undegraded":"2024-04-26T10:34:26.535422+0000","last_fullsized":"2024-04-26T10:34:26.535422+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:21.048381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536625+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:34:26.536625+0000","last_peered":"2024-04-26T10:34:26.536625+0000","last_clean":"2024-04-26T10:34:26.536625+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:34:26.536625+0000","last_undegraded":"2024-04-26T10:34:26.536625+0000","last_fullsized":"2024-04-26T10:34:26.536625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"51'10508","reported_seq":10551,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.044288+0000","last_change":"2024-04-26T10:33:16.344714+0000","last_active":"2024-04-26T10:34:30.044288+0000","last_peered":"2024-04-26T10:34:30.044288+0000","last_clean":"2024-04-26T10:34:30.044288+0000","last_became_active":"2024-04-26T10:33:16.344500+0000","last_became_peered":"2024-04-26T10:33:16.344500+0000","last_unstale":"2024-04-26T10:34:30.044288+0000","last_undegraded":"2024-04-26T10:34:30.044288+0000","last_fullsized":"2024-04-26T10:34:30.044288+0000","mapping_epoch":16,"log_start":"32'6735","ondisk_log_start":"32'6735","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3773,"log_dups_size":1442,"ondisk_log_size":3773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:19.056484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422182912,"num_objects":6442,"num_object_clones":0,"num_object_copies":12884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10508,"num_write_kb":542400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535139+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:34:26.535139+0000","last_peered":"2024-04-26T10:34:26.535139+0000","last_clean":"2024-04-26T10:34:26.535139+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:34:26.535139+0000","last_undegraded":"2024-04-26T10:34:26.535139+0000","last_fullsized":"2024-04-26T10:34:26.535139+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536125+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:34:26.536125+0000","last_peered":"2024-04-26T10:34:26.536125+0000","last_clean":"2024-04-26T10:34:26.536125+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:34:26.536125+0000","last_undegraded":"2024-04-26T10:34:26.536125+0000","last_fullsized":"2024-04-26T10:34:26.536125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.172123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.537862+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:34:26.537862+0000","last_peered":"2024-04-26T10:34:26.537862+0000","last_clean":"2024-04-26T10:34:26.537862+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:34:26.537862+0000","last_undegraded":"2024-04-26T10:34:26.537862+0000","last_fullsized":"2024-04-26T10:34:26.537862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"51'10474","reported_seq":10526,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.057720+0000","last_change":"2024-04-26T10:34:15.510428+0000","last_active":"2024-04-26T10:34:30.057720+0000","last_peered":"2024-04-26T10:34:30.057720+0000","last_clean":"2024-04-26T10:34:30.057720+0000","last_became_active":"2024-04-26T10:34:15.505392+0000","last_became_peered":"2024-04-26T10:34:15.505392+0000","last_unstale":"2024-04-26T10:34:30.057720+0000","last_undegraded":"2024-04-26T10:34:30.057720+0000","last_fullsized":"2024-04-26T10:34:30.057720+0000","mapping_epoch":42,"log_start":"32'6488","ondisk_log_start":"32'6488","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3986,"log_dups_size":1442,"ondisk_log_size":3986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:56.871872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410779648,"num_objects":6268,"num_object_clones":0,"num_object_copies":12536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6268,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10474,"num_write_kb":535744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535311+0000","last_change":"2024-04-26T10:34:14.512226+0000","last_active":"2024-04-26T10:34:26.535311+0000","last_peered":"2024-04-26T10:34:26.535311+0000","last_clean":"2024-04-26T10:34:26.535311+0000","last_became_active":"2024-04-26T10:34:14.511888+0000","last_became_peered":"2024-04-26T10:34:14.511888+0000","last_unstale":"2024-04-26T10:34:26.535311+0000","last_undegraded":"2024-04-26T10:34:26.535311+0000","last_fullsized":"2024-04-26T10:34:26.535311+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:58.832869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535979+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:34:26.535979+0000","last_peered":"2024-04-26T10:34:26.535979+0000","last_clean":"2024-04-26T10:34:26.535979+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:34:26.535979+0000","last_undegraded":"2024-04-26T10:34:26.535979+0000","last_fullsized":"2024-04-26T10:34:26.535979+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535992+0000","last_change":"2024-04-26T10:34:14.510158+0000","last_active":"2024-04-26T10:34:26.535992+0000","last_peered":"2024-04-26T10:34:26.535992+0000","last_clean":"2024-04-26T10:34:26.535992+0000","last_became_active":"2024-04-26T10:34:14.509584+0000","last_became_peered":"2024-04-26T10:34:14.509584+0000","last_unstale":"2024-04-26T10:34:26.535992+0000","last_undegraded":"2024-04-26T10:34:26.535992+0000","last_fullsized":"2024-04-26T10:34:26.535992+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:39.230972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536579+0000","last_change":"2024-04-26T10:34:14.508334+0000","last_active":"2024-04-26T10:34:26.536579+0000","last_peered":"2024-04-26T10:34:26.536579+0000","last_clean":"2024-04-26T10:34:26.536579+0000","last_became_active":"2024-04-26T10:34:14.507205+0000","last_became_peered":"2024-04-26T10:34:14.507205+0000","last_unstale":"2024-04-26T10:34:26.536579+0000","last_undegraded":"2024-04-26T10:34:26.536579+0000","last_fullsized":"2024-04-26T10:34:26.536579+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:20.747187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536911+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:34:26.536911+0000","last_peered":"2024-04-26T10:34:26.536911+0000","last_clean":"2024-04-26T10:34:26.536911+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:34:26.536911+0000","last_undegraded":"2024-04-26T10:34:26.536911+0000","last_fullsized":"2024-04-26T10:34:26.536911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535313+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:34:26.535313+0000","last_peered":"2024-04-26T10:34:26.535313+0000","last_clean":"2024-04-26T10:34:26.535313+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:34:26.535313+0000","last_undegraded":"2024-04-26T10:34:26.535313+0000","last_fullsized":"2024-04-26T10:34:26.535313+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534978+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:34:26.534978+0000","last_peered":"2024-04-26T10:34:26.534978+0000","last_clean":"2024-04-26T10:34:26.534978+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:34:26.534978+0000","last_undegraded":"2024-04-26T10:34:26.534978+0000","last_fullsized":"2024-04-26T10:34:26.534978+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536926+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:34:26.536926+0000","last_peered":"2024-04-26T10:34:26.536926+0000","last_clean":"2024-04-26T10:34:26.536926+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:34:26.536926+0000","last_undegraded":"2024-04-26T10:34:26.536926+0000","last_fullsized":"2024-04-26T10:34:26.536926+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535287+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:34:26.535287+0000","last_peered":"2024-04-26T10:34:26.535287+0000","last_clean":"2024-04-26T10:34:26.535287+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:34:26.535287+0000","last_undegraded":"2024-04-26T10:34:26.535287+0000","last_fullsized":"2024-04-26T10:34:26.535287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536090+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:34:26.536090+0000","last_peered":"2024-04-26T10:34:26.536090+0000","last_clean":"2024-04-26T10:34:26.536090+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:34:26.536090+0000","last_undegraded":"2024-04-26T10:34:26.536090+0000","last_fullsized":"2024-04-26T10:34:26.536090+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536238+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:34:26.536238+0000","last_peered":"2024-04-26T10:34:26.536238+0000","last_clean":"2024-04-26T10:34:26.536238+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:34:26.536238+0000","last_undegraded":"2024-04-26T10:34:26.536238+0000","last_fullsized":"2024-04-26T10:34:26.536238+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":51,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535301+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:34:26.535301+0000","last_peered":"2024-04-26T10:34:26.535301+0000","last_clean":"2024-04-26T10:34:26.535301+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:34:26.535301+0000","last_undegraded":"2024-04-26T10:34:26.535301+0000","last_fullsized":"2024-04-26T10:34:26.535301+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534903+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:34:26.534903+0000","last_peered":"2024-04-26T10:34:26.534903+0000","last_clean":"2024-04-26T10:34:26.534903+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:34:26.534903+0000","last_undegraded":"2024-04-26T10:34:26.534903+0000","last_fullsized":"2024-04-26T10:34:26.534903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534005+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:34:26.534005+0000","last_peered":"2024-04-26T10:34:26.534005+0000","last_clean":"2024-04-26T10:34:26.534005+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:34:26.534005+0000","last_undegraded":"2024-04-26T10:34:26.534005+0000","last_fullsized":"2024-04-26T10:34:26.534005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534485+0000","last_change":"2024-04-26T10:34:14.513276+0000","last_active":"2024-04-26T10:34:26.534485+0000","last_peered":"2024-04-26T10:34:26.534485+0000","last_clean":"2024-04-26T10:34:26.534485+0000","last_became_active":"2024-04-26T10:34:14.512930+0000","last_became_peered":"2024-04-26T10:34:14.512930+0000","last_unstale":"2024-04-26T10:34:26.534485+0000","last_undegraded":"2024-04-26T10:34:26.534485+0000","last_fullsized":"2024-04-26T10:34:26.534485+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:37.809739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536814+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:34:26.536814+0000","last_peered":"2024-04-26T10:34:26.536814+0000","last_clean":"2024-04-26T10:34:26.536814+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:34:26.536814+0000","last_undegraded":"2024-04-26T10:34:26.536814+0000","last_fullsized":"2024-04-26T10:34:26.536814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535370+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:34:26.535370+0000","last_peered":"2024-04-26T10:34:26.535370+0000","last_clean":"2024-04-26T10:34:26.535370+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:34:26.535370+0000","last_undegraded":"2024-04-26T10:34:26.535370+0000","last_fullsized":"2024-04-26T10:34:26.535370+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.021846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536530+0000","last_change":"2024-04-26T10:34:14.507476+0000","last_active":"2024-04-26T10:34:26.536530+0000","last_peered":"2024-04-26T10:34:26.536530+0000","last_clean":"2024-04-26T10:34:26.536530+0000","last_became_active":"2024-04-26T10:34:14.507171+0000","last_became_peered":"2024-04-26T10:34:14.507171+0000","last_unstale":"2024-04-26T10:34:26.536530+0000","last_undegraded":"2024-04-26T10:34:26.536530+0000","last_fullsized":"2024-04-26T10:34:26.536530+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:32.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":6640697368,"num_objects":101330,"num_object_clones":0,"num_object_copies":202660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101330,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":167950,"num_write_kb":8616897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3174,"num_bytes_recovered":208011264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13278060544,"data_stored":13278052400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60675,"ondisk_log_size":60675,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738392,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5544448,"kb_used_data":5300600,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":88827392,"statfs":{"total":96636764160,"available":90959249408,"internally_reserved":0,"allocated":5427814400,"data_stored":5427449074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249428422},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":1.681},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":1.982}]},{"osd":1,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":1.6439999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4311204,"kb_used_data":4109272,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":90060636,"statfs":{"total":96636764160,"available":92222091264,"internally_reserved":0,"allocated":4207894528,"data_stored":4207498748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":1.4019999999999999}]},{"osd":2,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.53700000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738391,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3849564,"kb_used_data":3706000,"kb_used_omap":1,"kb_used_meta":143486,"kb_avail":90522276,"statfs":{"total":96636764160,"available":92694810624,"internally_reserved":0,"allocated":3794944000,"data_stored":3794555796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146930118},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.182},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.25900000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.214},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.23499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4133883904,"data_stored":4133879832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3735490560,"data_stored":3735486488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5408686080,"data_stored":5408686080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:34:33.949 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:34:33.979 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:34:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:34:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.979 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.169472651999996, 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:33.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:34:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:34:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:34:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:34:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:34:33.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:34:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:34:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:34:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:34:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:34:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:34:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:34:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:34:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:34:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103328 5.6 e32/16 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head v 32'6425, mlcod=32'6423)", 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.785223342999998, 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064716840999999997, 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184359+0000", 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184419+0000", 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9345999999999997e-05 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184425+0000", 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1190000000000002e-06 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184429+0000", 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.296e-06 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184461+0000", 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2122999999999997e-05 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:33.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184477+0000", 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5877000000000001e-05 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249048+0000", 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064570494000000006 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249077+0000", 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9081000000000002e-05 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.989 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103327 5.c e32/16 5:3133c183:::benchmark_data_smithi043_45180_object103326:head v 32'6430, mlcod=32'6425)", 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.785056744999999, 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064984741999999998, 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:33.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184592+0000", 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6027999999999999e-05 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184597+0000", 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8570000000000003e-06 2024-04-26T10:34:33.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184600+0000", 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3390000000000001e-06 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184620+0000", 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9890000000000001e-05 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184631+0000", 2024-04-26T10:34:33.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1073999999999999e-05 2024-04-26T10:34:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249477+0000", 2024-04-26T10:34:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064845485999999994 2024-04-26T10:34:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249511+0000", 2024-04-26T10:34:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4508000000000002e-05 2024-04-26T10:34:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:33.993 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103329 5.6 e32/16 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head v 32'6426, mlcod=32'6423)", 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.781222923999998, 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063744996999999998, 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188359+0000", 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188389+0000", 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9416000000000001e-05 2024-04-26T10:34:33.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243409+0000", 2024-04-26T10:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.055020409999999999 2024-04-26T10:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243419+0000", 2024-04-26T10:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0071000000000001e-05 2024-04-26T10:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:33.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243465+0000", 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5799e-05 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243491+0000", 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5619999999999999e-05 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252067+0000", 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085763809999999992 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252105+0000", 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8040999999999997e-05 2024-04-26T10:34:33.997 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103337 5.d e32/16 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head v 32'6429, mlcod=32'6427)", 2024-04-26T10:34:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.781152546999998, 2024-04-26T10:34:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.057982037, 2024-04-26T10:34:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:33.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188430+0000", 2024-04-26T10:34:33.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188500+0000", 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0062999999999996e-05 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243434+0000", 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.054933760999999998 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243442+0000", 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243490+0000", 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8312000000000001e-05 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243511+0000", 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0781999999999999e-05 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246370+0000", 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028590930000000001 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246413+0000", 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2413000000000002e-05 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103660 5.9 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:34.002 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.587216902000002, 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.067661676000000004, 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103660 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382365+0000", 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382430+0000", 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4850000000000004e-05 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382439+0000", 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382445+0000", 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0229999999999998e-06 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382482+0000", 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6909000000000002e-05 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382613+0000", 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013072600000000001 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382756+0000", 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000143306 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385090+0000", 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002333786 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449925+0000", 2024-04-26T10:34:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064835173999999995 2024-04-26T10:34:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449985+0000", 2024-04-26T10:34:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0124999999999998e-05 2024-04-26T10:34:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450028+0000", 2024-04-26T10:34:34.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2457999999999999e-05 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103662 5.f 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.584773091999999, 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.068705924000000002, 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:34.008 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103662 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384809+0000", 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384908+0000", 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9146000000000002e-05 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384921+0000", 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2622e-05 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384931+0000", 2024-04-26T10:34:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0108e-05 2024-04-26T10:34:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384984+0000", 2024-04-26T10:34:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2849000000000002e-05 2024-04-26T10:34:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017266800000000001 2024-04-26T10:34:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385313+0000", 2024-04-26T10:34:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015649300000000001 2024-04-26T10:34:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388446+0000", 2024-04-26T10:34:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003133481 2024-04-26T10:34:34.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453401+0000", 2024-04-26T10:34:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064955075000000001 2024-04-26T10:34:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453462+0000", 2024-04-26T10:34:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1134000000000001e-05 2024-04-26T10:34:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453516+0000", 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3477999999999999e-05 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103664 5.9 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.584490408000001, 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.065076041000000001, 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:34.014 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103664 2024-04-26T10:34:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385092+0000", 2024-04-26T10:34:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385145+0000", 2024-04-26T10:34:34.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3143000000000003e-05 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0473e-05 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385163+0000", 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385193+0000", 2024-04-26T10:34:34.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0638e-05 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385284+0000", 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599000000000005e-05 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385375+0000", 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0606999999999995e-05 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:34.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387556+0000", 2024-04-26T10:34:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021809529999999998 2024-04-26T10:34:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450072+0000", 2024-04-26T10:34:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062516408999999995 2024-04-26T10:34:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450123+0000", 2024-04-26T10:34:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1406000000000002e-05 2024-04-26T10:34:34.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450169+0000", 2024-04-26T10:34:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5380000000000003e-05 2024-04-26T10:34:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103666 5.f 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.582727034999998, 2024-04-26T10:34:34.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066830159, 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103666 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386855+0000", 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386928+0000", 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-04-26T10:34:34.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386937+0000", 2024-04-26T10:34:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1090000000000004e-06 2024-04-26T10:34:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386945+0000", 2024-04-26T10:34:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-04-26T10:34:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386981+0000", 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5899999999999998e-05 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387071+0000", 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9954e-05 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387161+0000", 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0898999999999998e-05 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:34.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390584+0000", 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034229030000000001 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453579+0000", 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062994267000000007 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453640+0000", 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1162999999999997e-05 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453686+0000", 2024-04-26T10:34:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6493999999999999e-05 2024-04-26T10:34:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103667 5.f 5:f4dc36e8:::benchmark_data_smithi043_45180_object103666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.581865964999999, 2024-04-26T10:34:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066218387000000004, 2024-04-26T10:34:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.026 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103667 2024-04-26T10:34:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387783+0000", 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5973e-05 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387791+0000", 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1850000000000004e-06 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387796+0000", 2024-04-26T10:34:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-04-26T10:34:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388469+0000", 2024-04-26T10:34:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0006734 2024-04-26T10:34:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388547+0000", 2024-04-26T10:34:34.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7188999999999996e-05 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388630+0000", 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3892000000000002e-05 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390598+0000", 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00196759 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453803+0000", 2024-04-26T10:34:34.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063205069000000003 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453844+0000", 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1248999999999998e-05 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453936+0000", 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1201999999999999e-05 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:107998 5.9 5:9ce23eb0:::benchmark_data_smithi043_45180_object107997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.473947585000001, 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025313064, 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107998 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495634+0000", 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495754+0000", 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119893 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495769+0000", 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4769999999999999e-05 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495781+0000", 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1858999999999999e-05 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502521+0000", 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067402410000000001 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502675+0000", 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015405099999999999 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1,2", 2024-04-26T10:34:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502846+0000", 2024-04-26T10:34:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000171001 2024-04-26T10:34:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.505743+0000", 2024-04-26T10:34:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028975490000000001 2024-04-26T10:34:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.508006+0000", 2024-04-26T10:34:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022627620000000002 2024-04-26T10:34:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520788+0000", 2024-04-26T10:34:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012782244 2024-04-26T10:34:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520846+0000", 2024-04-26T10:34:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7976999999999997e-05 2024-04-26T10:34:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520949+0000", 2024-04-26T10:34:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102267 2024-04-26T10:34:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:108005 5.c e35/16 5:3b5c73fa:::benchmark_data_smithi043_45180_object108004:head v 35'6720, mlcod=33'6718)", 2024-04-26T10:34:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.454859749000001, 2024-04-26T10:34:34.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025223481999999998, 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514766+0000", 2024-04-26T10:34:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2818999999999998e-05 2024-04-26T10:34:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514773+0000", 2024-04-26T10:34:34.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999996e-06 2024-04-26T10:34:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514777+0000", 2024-04-26T10:34:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6199999999999998e-06 2024-04-26T10:34:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522074+0000", 2024-04-26T10:34:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072964029999999999 2024-04-26T10:34:34.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522096+0000", 2024-04-26T10:34:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2027000000000001e-05 2024-04-26T10:34:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539924+0000", 2024-04-26T10:34:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017827749 2024-04-26T10:34:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539947+0000", 2024-04-26T10:34:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3232999999999999e-05 2024-04-26T10:34:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:166165 5.7 5:ec907294:::benchmark_data_smithi043_45180_object31523:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.433361+0000", 2024-04-26T10:34:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5362221940000005, 2024-04-26T10:34:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.03059839, 2024-04-26T10:34:34.044 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 166165 2024-04-26T10:34:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433361+0000", 2024-04-26T10:34:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433361+0000", 2024-04-26T10:34:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433360+0000", 2024-04-26T10:34:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433365+0000", 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2349999999999999e-06 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433373+0000", 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9689999999999994e-06 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433380+0000", 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5000000000000002e-06 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.434799+0000", 2024-04-26T10:34:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014180919999999999 2024-04-26T10:34:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.434894+0000", 2024-04-26T10:34:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5243999999999998e-05 2024-04-26T10:34:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.434976+0000", 2024-04-26T10:34:34.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2231000000000006e-05 2024-04-26T10:34:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438020+0000", 2024-04-26T10:34:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003043689 2024-04-26T10:34:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439281+0000", 2024-04-26T10:34:34.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001261302 2024-04-26T10:34:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463901+0000", 2024-04-26T10:34:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024619458 2024-04-26T10:34:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463959+0000", 2024-04-26T10:34:34.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8816000000000001e-05 2024-04-26T10:34:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:166166 5.7 5:e25c7322:::benchmark_data_smithi043_45180_object31524:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.435038+0000", 2024-04-26T10:34:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5345446430000003, 2024-04-26T10:34:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.031246537000000001, 2024-04-26T10:34:34.051 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 166166 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435038+0000", 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435038+0000", 2024-04-26T10:34:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435038+0000", 2024-04-26T10:34:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435042+0000", 2024-04-26T10:34:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3800000000000004e-06 2024-04-26T10:34:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435053+0000", 2024-04-26T10:34:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0676000000000001e-05 2024-04-26T10:34:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435059+0000", 2024-04-26T10:34:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0580000000000003e-06 2024-04-26T10:34:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.436287+0000", 2024-04-26T10:34:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001228593 2024-04-26T10:34:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.436391+0000", 2024-04-26T10:34:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104045 2024-04-26T10:34:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.436494+0000", 2024-04-26T10:34:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010254799999999999 2024-04-26T10:34:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438209+0000", 2024-04-26T10:34:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001714564 2024-04-26T10:34:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464023+0000", 2024-04-26T10:34:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025814664000000001 2024-04-26T10:34:34.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466246+0000", 2024-04-26T10:34:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022227599999999998 2024-04-26T10:34:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466285+0000", 2024-04-26T10:34:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.909e-05 2024-04-26T10:34:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:166169 5.c e51/16 5:3d9a2afe:::benchmark_data_smithi043_45180_object31527:head v 51'10313, mlcod=51'10309)", 2024-04-26T10:34:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.437235+0000", 2024-04-26T10:34:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5323478970000002, 2024-04-26T10:34:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026796387000000001, 2024-04-26T10:34:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437235+0000", 2024-04-26T10:34:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437235+0000", 2024-04-26T10:34:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437234+0000", 2024-04-26T10:34:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437242+0000", 2024-04-26T10:34:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4410000000000004e-06 2024-04-26T10:34:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437251+0000", 2024-04-26T10:34:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1020000000000003e-06 2024-04-26T10:34:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437258+0000", 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0090000000000001e-06 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437292+0000", 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4455999999999997e-05 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437307+0000", 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4800999999999999e-05 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464004+0000", 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026697591 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464032+0000", 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7144e-05 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:166175 5.3 e51/16 5:c0cd40ee:::benchmark_data_smithi043_45180_object31533:head v 51'10380, mlcod=51'10377)", 2024-04-26T10:34:34.062 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.437538+0000", 2024-04-26T10:34:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5320455410000005, 2024-04-26T10:34:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026367978, 2024-04-26T10:34:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437538+0000", 2024-04-26T10:34:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437538+0000", 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437537+0000", 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437542+0000", 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4410000000000003e-06 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437549+0000", 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6739999999999997e-06 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437555+0000", 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6119999999999998e-06 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437598+0000", 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3417000000000001e-05 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437616+0000", 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7651000000000001e-05 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439302+0000", 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016857809999999999 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463906+0000", 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024603861000000001 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.066 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:166176 5.c e51/16 5:3df338d2:::benchmark_data_smithi043_45180_object31534:head v 51'10314, mlcod=51'10310)", 2024-04-26T10:34:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.438991+0000", 2024-04-26T10:34:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.530592242, 2024-04-26T10:34:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025419694, 2024-04-26T10:34:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438991+0000", 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438991+0000", 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438990+0000", 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438995+0000", 2024-04-26T10:34:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.921e-06 2024-04-26T10:34:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439004+0000", 2024-04-26T10:34:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.833e-06 2024-04-26T10:34:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439009+0000", 2024-04-26T10:34:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2209999999999996e-06 2024-04-26T10:34:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439033+0000", 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4043999999999999e-05 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439049+0000", 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6082999999999998e-05 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464388+0000", 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025338270999999999 2024-04-26T10:34:34.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464411+0000", 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2841e-05 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop_reply(client.4538.0:166166 5.7 e51/16 ondisk, result = 0)", 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.439292+0000", 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5302914960000003, 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026999493999999999, 2024-04-26T10:34:34.071 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439292+0000", 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439292+0000", 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439291+0000", 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439294+0000", 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.852e-06 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439302+0000", 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8979999999999996e-06 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439308+0000", 2024-04-26T10:34:34.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9410000000000004e-06 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464010+0000", 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02470224 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464017+0000", 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3420000000000002e-06 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466291+0000", 2024-04-26T10:34:34.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002273635 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:166180 5.2 5:4fb08ef8:::benchmark_data_smithi043_45180_object31538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.439326+0000", 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5302568179999998, 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027447910999999998, 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:34.075 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 166180 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439326+0000", 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439326+0000", 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439325+0000", 2024-04-26T10:34:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439329+0000", 2024-04-26T10:34:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.76e-06 2024-04-26T10:34:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463882+0000", 2024-04-26T10:34:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024552416000000001 2024-04-26T10:34:34.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463895+0000", 2024-04-26T10:34:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3286e-05 2024-04-26T10:34:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463938+0000", 2024-04-26T10:34:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2892999999999997e-05 2024-04-26T10:34:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464092+0000", 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153731 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464233+0000", 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014117900000000001 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466687+0000", 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024545510000000001 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466695+0000", 2024-04-26T10:34:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5959999999999998e-06 2024-04-26T10:34:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466734+0000", 2024-04-26T10:34:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8688e-05 2024-04-26T10:34:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466774+0000", 2024-04-26T10:34:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0661000000000003e-05 2024-04-26T10:34:34.080 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:166190 5.d e51/42 5:b85cf01f:::benchmark_data_smithi043_45180_object31548:head v 51'10424, mlcod=51'10422)", 2024-04-26T10:34:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.443282+0000", 2024-04-26T10:34:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5263011830000002, 2024-04-26T10:34:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026511429999999999, 2024-04-26T10:34:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:34.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.443282+0000", 2024-04-26T10:34:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.443282+0000", 2024-04-26T10:34:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.443281+0000", 2024-04-26T10:34:34.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.443287+0000", 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0850000000000002e-06 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463882+0000", 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020594057999999998 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463891+0000", 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8700000000000004e-06 2024-04-26T10:34:34.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463998+0000", 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010639 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464019+0000", 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0767e-05 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.469760+0000", 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057416230000000004 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:34.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.469793+0000", 2024-04-26T10:34:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3210000000000002e-05 2024-04-26T10:34:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:34.085 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:34.085 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:34.087 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:34.085+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:34.087 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:34.187 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:34.187+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:34.268 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:34.268 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:34.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.268 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:179710 5.b 5:da94f8f4:::benchmark_data_smithi043_45180_object45068:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:34.261088+0000", 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0058423119999999997, 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058612239999999999, 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 179710 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261088+0000", 2024-04-26T10:34:34.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261088+0000", 2024-04-26T10:34:34.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.270 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261087+0000", 2024-04-26T10:34:34.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.270 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261090+0000", 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3170000000000002e-06 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261097+0000", 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1609999999999997e-06 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261103+0000", 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5969999999999999e-06 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261179+0000", 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5851000000000003e-05 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261287+0000", 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000107765 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261384+0000", 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7787000000000004e-05 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264529+0000", 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0031448679999999999 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:179712 5.b 5:deadffad:::benchmark_data_smithi043_45180_object45070:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:34.261420+0000", 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0055098339999999999, 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0055831789999999997, 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.273 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.274 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.274 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 179712 2024-04-26T10:34:34.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.274 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.274 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261420+0000", 2024-04-26T10:34:34.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.274 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261420+0000", 2024-04-26T10:34:34.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261419+0000", 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261424+0000", 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2189999999999998e-06 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261431+0000", 2024-04-26T10:34:34.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2790000000000001e-06 2024-04-26T10:34:34.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.261438+0000", 2024-04-26T10:34:34.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6279999999999999e-06 2024-04-26T10:34:34.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.263176+0000", 2024-04-26T10:34:34.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017379349999999999 2024-04-26T10:34:34.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.263253+0000", 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7818999999999995e-05 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.263316+0000", 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2946000000000003e-05 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264764+0000", 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001447727 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.277 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:179714 5.0 5:034ebaaf:::benchmark_data_smithi043_45180_object45072:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:34.264556+0000", 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.002373717, 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002493374, 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 179714 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.278 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264556+0000", 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264556+0000", 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264556+0000", 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264558+0000", 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.587e-06 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264565+0000", 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8639999999999998e-06 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264571+0000", 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.587e-06 2024-04-26T10:34:34.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264603+0000", 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1744e-05 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264717+0000", 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114545 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264807+0000", 2024-04-26T10:34:34.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9760999999999997e-05 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:179715 5.4 5:2abcea54:::benchmark_data_smithi043_45180_object45073:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:34.264579+0000", 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0023513990000000001, 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0025323580000000002, 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.282 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 179715 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264579+0000", 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264579+0000", 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.283 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264578+0000", 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264581+0000", 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5569999999999998e-06 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264587+0000", 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2099999999999998e-06 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264593+0000", 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2589999999999997e-06 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264621+0000", 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7572999999999998e-05 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264731+0000", 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000109658 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264815+0000", 2024-04-26T10:34:34.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4089000000000001e-05 2024-04-26T10:34:34.286 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.286 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.266321+0000", 2024-04-26T10:34:34.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001506301 2024-04-26T10:34:34.286 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.286 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.286 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.286 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:179718 5.8 5:1c100816:::benchmark_data_smithi043_45180_object45076:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:34.264603+0000", 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0023266620000000002, 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0025961019999999999, 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 179718 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264603+0000", 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264603+0000", 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264603+0000", 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264606+0000", 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.605e-06 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264611+0000", 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.84e-06 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264617+0000", 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3739999999999997e-06 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.289 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264651+0000", 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4375000000000002e-05 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264799+0000", 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014741900000000001 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264915+0000", 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000116527 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.290 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:179719 5.0 5:0b0071e2:::benchmark_data_smithi043_45180_object45077:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:34.264669+0000", 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0022605199999999998, 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0026162809999999998, 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 179719 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264669+0000", 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264669+0000", 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264669+0000", 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264672+0000", 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6459999999999999e-06 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264680+0000", 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4499999999999998e-06 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264687+0000", 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7039999999999997e-06 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.266279+0000", 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001591891 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.266373+0000", 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.4389999999999996e-05 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.266442+0000", 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8833999999999999e-05 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.294 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:179721 5.8 5:18c40963:::benchmark_data_smithi043_45180_object45079:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:34.264767+0000", 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0021631060000000001, 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002606045, 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 179721 2024-04-26T10:34:34.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264767+0000", 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264767+0000", 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264766+0000", 2024-04-26T10:34:34.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264770+0000", 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.569e-06 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264777+0000", 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1579999999999999e-06 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264783+0000", 2024-04-26T10:34:34.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.404e-06 2024-04-26T10:34:34.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.267176+0000", 2024-04-26T10:34:34.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00239303 2024-04-26T10:34:34.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.267248+0000", 2024-04-26T10:34:34.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1996999999999995e-05 2024-04-26T10:34:34.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.267311+0000", 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2030000000000001e-05 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:179725 5.8 5.a230cb58 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:34.264789+0000", 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0021413830000000002, 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0026620659999999998, 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.299 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 179725 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264789+0000", 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264789+0000", 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264788+0000", 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264791+0000", 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3819999999999998e-06 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264796+0000", 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6799999999999998e-06 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:34.264801+0000", 2024-04-26T10:34:34.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4989999999999996e-06 2024-04-26T10:34:34.302 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.302 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.302 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.302 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.302 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:34:34.302 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 8 2024-04-26T10:34:34.302 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:34.304 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:34.304 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:34.301+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:34.404 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:34.403+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:34.442 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:34.444 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:34:34.454 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-04-26T10:34:33.552470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6641290098,"num_objects":101354,"num_object_clones":0,"num_object_copies":202708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101354,"num_whiteouts":0,"num_read":137,"num_read_kb":119,"num_write":168198,"num_write_kb":8620371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3200,"num_bytes_recovered":209195352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60871,"ondisk_log_size":60871,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":13705216,"kb_used_data":13115872,"kb_used_omap":4,"kb_used_meta":588795,"kb_avail":269410304,"statfs":{"total":289910292480,"available":275876151296,"internally_reserved":0,"allocated":13430652928,"data_stored":13429503618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":602926418},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,4],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-932315136,"num_objects":-14226,"num_object_clones":0,"num_object_copies":-28452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-14226,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14226,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.550394"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536768+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:34:26.536768+0000","last_peered":"2024-04-26T10:34:26.536768+0000","last_clean":"2024-04-26T10:34:26.536768+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:34:26.536768+0000","last_undegraded":"2024-04-26T10:34:26.536768+0000","last_fullsized":"2024-04-26T10:34:26.536768+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:26.964955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536821+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:34:26.536821+0000","last_peered":"2024-04-26T10:34:26.536821+0000","last_clean":"2024-04-26T10:34:26.536821+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:34:26.536821+0000","last_undegraded":"2024-04-26T10:34:26.536821+0000","last_fullsized":"2024-04-26T10:34:26.536821+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536684+0000","last_change":"2024-04-26T10:32:52.007709+0000","last_active":"2024-04-26T10:34:26.536684+0000","last_peered":"2024-04-26T10:34:26.536684+0000","last_clean":"2024-04-26T10:34:26.536684+0000","last_became_active":"2024-04-26T10:32:52.005131+0000","last_became_peered":"2024-04-26T10:32:52.005131+0000","last_unstale":"2024-04-26T10:34:26.536684+0000","last_undegraded":"2024-04-26T10:34:26.536684+0000","last_fullsized":"2024-04-26T10:34:26.536684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:31:03.907281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536173+0000","last_change":"2024-04-26T10:32:52.000002+0000","last_active":"2024-04-26T10:34:26.536173+0000","last_peered":"2024-04-26T10:34:26.536173+0000","last_clean":"2024-04-26T10:34:26.536173+0000","last_became_active":"2024-04-26T10:32:51.999173+0000","last_became_peered":"2024-04-26T10:32:51.999173+0000","last_unstale":"2024-04-26T10:34:26.536173+0000","last_undegraded":"2024-04-26T10:34:26.536173+0000","last_fullsized":"2024-04-26T10:34:26.536173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536296+0000","last_change":"2024-04-26T10:34:14.507618+0000","last_active":"2024-04-26T10:34:26.536296+0000","last_peered":"2024-04-26T10:34:26.536296+0000","last_clean":"2024-04-26T10:34:26.536296+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:34:26.536296+0000","last_undegraded":"2024-04-26T10:34:26.536296+0000","last_fullsized":"2024-04-26T10:34:26.536296+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:27.721106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535119+0000","last_change":"2024-04-26T10:32:52.006791+0000","last_active":"2024-04-26T10:34:26.535119+0000","last_peered":"2024-04-26T10:34:26.535119+0000","last_clean":"2024-04-26T10:34:26.535119+0000","last_became_active":"2024-04-26T10:32:52.005709+0000","last_became_peered":"2024-04-26T10:32:52.005709+0000","last_unstale":"2024-04-26T10:34:26.535119+0000","last_undegraded":"2024-04-26T10:34:26.535119+0000","last_fullsized":"2024-04-26T10:34:26.535119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536212+0000","last_change":"2024-04-26T10:32:52.001166+0000","last_active":"2024-04-26T10:34:26.536212+0000","last_peered":"2024-04-26T10:34:26.536212+0000","last_clean":"2024-04-26T10:34:26.536212+0000","last_became_active":"2024-04-26T10:32:51.999721+0000","last_became_peered":"2024-04-26T10:32:51.999721+0000","last_unstale":"2024-04-26T10:34:26.536212+0000","last_undegraded":"2024-04-26T10:34:26.536212+0000","last_fullsized":"2024-04-26T10:34:26.536212+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.533781+0000","last_change":"2024-04-26T10:32:52.007881+0000","last_active":"2024-04-26T10:34:26.533781+0000","last_peered":"2024-04-26T10:34:26.533781+0000","last_clean":"2024-04-26T10:34:26.533781+0000","last_became_active":"2024-04-26T10:32:52.005720+0000","last_became_peered":"2024-04-26T10:32:52.005720+0000","last_unstale":"2024-04-26T10:34:26.533781+0000","last_undegraded":"2024-04-26T10:34:26.533781+0000","last_fullsized":"2024-04-26T10:34:26.533781+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:17.846332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534982+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:34:26.534982+0000","last_peered":"2024-04-26T10:34:26.534982+0000","last_clean":"2024-04-26T10:34:26.534982+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:34:26.534982+0000","last_undegraded":"2024-04-26T10:34:26.534982+0000","last_fullsized":"2024-04-26T10:34:26.534982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536539+0000","last_change":"2024-04-26T10:34:14.507265+0000","last_active":"2024-04-26T10:34:26.536539+0000","last_peered":"2024-04-26T10:34:26.536539+0000","last_clean":"2024-04-26T10:34:26.536539+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:34:26.536539+0000","last_undegraded":"2024-04-26T10:34:26.536539+0000","last_fullsized":"2024-04-26T10:34:26.536539+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:07.268421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536534+0000","last_change":"2024-04-26T10:32:52.008745+0000","last_active":"2024-04-26T10:34:26.536534+0000","last_peered":"2024-04-26T10:34:26.536534+0000","last_clean":"2024-04-26T10:34:26.536534+0000","last_became_active":"2024-04-26T10:32:52.008035+0000","last_became_peered":"2024-04-26T10:32:52.008035+0000","last_unstale":"2024-04-26T10:34:26.536534+0000","last_undegraded":"2024-04-26T10:34:26.536534+0000","last_fullsized":"2024-04-26T10:34:26.536534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536783+0000","last_change":"2024-04-26T10:32:52.009877+0000","last_active":"2024-04-26T10:34:26.536783+0000","last_peered":"2024-04-26T10:34:26.536783+0000","last_clean":"2024-04-26T10:34:26.536783+0000","last_became_active":"2024-04-26T10:32:52.008858+0000","last_became_peered":"2024-04-26T10:32:52.008858+0000","last_unstale":"2024-04-26T10:34:26.536783+0000","last_undegraded":"2024-04-26T10:34:26.536783+0000","last_fullsized":"2024-04-26T10:34:26.536783+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536299+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:34:26.536299+0000","last_peered":"2024-04-26T10:34:26.536299+0000","last_clean":"2024-04-26T10:34:26.536299+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:34:26.536299+0000","last_undegraded":"2024-04-26T10:34:26.536299+0000","last_fullsized":"2024-04-26T10:34:26.536299+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:03.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535431+0000","last_change":"2024-04-26T10:34:14.509249+0000","last_active":"2024-04-26T10:34:26.535431+0000","last_peered":"2024-04-26T10:34:26.535431+0000","last_clean":"2024-04-26T10:34:26.535431+0000","last_became_active":"2024-04-26T10:34:14.508371+0000","last_became_peered":"2024-04-26T10:34:14.508371+0000","last_unstale":"2024-04-26T10:34:26.535431+0000","last_undegraded":"2024-04-26T10:34:26.535431+0000","last_fullsized":"2024-04-26T10:34:26.535431+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:35.257141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536167+0000","last_change":"2024-04-26T10:32:52.004257+0000","last_active":"2024-04-26T10:34:26.536167+0000","last_peered":"2024-04-26T10:34:26.536167+0000","last_clean":"2024-04-26T10:34:26.536167+0000","last_became_active":"2024-04-26T10:32:52.003337+0000","last_became_peered":"2024-04-26T10:32:52.003337+0000","last_unstale":"2024-04-26T10:34:26.536167+0000","last_undegraded":"2024-04-26T10:34:26.536167+0000","last_fullsized":"2024-04-26T10:34:26.536167+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:53:51.202850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.533853+0000","last_change":"2024-04-26T10:32:52.005326+0000","last_active":"2024-04-26T10:34:26.533853+0000","last_peered":"2024-04-26T10:34:26.533853+0000","last_clean":"2024-04-26T10:34:26.533853+0000","last_became_active":"2024-04-26T10:32:52.003973+0000","last_became_peered":"2024-04-26T10:32:52.003973+0000","last_unstale":"2024-04-26T10:34:26.533853+0000","last_undegraded":"2024-04-26T10:34:26.533853+0000","last_fullsized":"2024-04-26T10:34:26.533853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535057+0000","last_change":"2024-04-26T10:32:52.008241+0000","last_active":"2024-04-26T10:34:26.535057+0000","last_peered":"2024-04-26T10:34:26.535057+0000","last_clean":"2024-04-26T10:34:26.535057+0000","last_became_active":"2024-04-26T10:32:52.007356+0000","last_became_peered":"2024-04-26T10:32:52.007356+0000","last_unstale":"2024-04-26T10:34:26.535057+0000","last_undegraded":"2024-04-26T10:34:26.535057+0000","last_fullsized":"2024-04-26T10:34:26.535057+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:52.453645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536508+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:34:26.536508+0000","last_peered":"2024-04-26T10:34:26.536508+0000","last_clean":"2024-04-26T10:34:26.536508+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:34:26.536508+0000","last_undegraded":"2024-04-26T10:34:26.536508+0000","last_fullsized":"2024-04-26T10:34:26.536508+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.343269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.537653+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:34:26.537653+0000","last_peered":"2024-04-26T10:34:26.537653+0000","last_clean":"2024-04-26T10:34:26.537653+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:34:26.537653+0000","last_undegraded":"2024-04-26T10:34:26.537653+0000","last_fullsized":"2024-04-26T10:34:26.537653+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535396+0000","last_change":"2024-04-26T10:32:52.001763+0000","last_active":"2024-04-26T10:34:26.535396+0000","last_peered":"2024-04-26T10:34:26.535396+0000","last_clean":"2024-04-26T10:34:26.535396+0000","last_became_active":"2024-04-26T10:32:52.001226+0000","last_became_peered":"2024-04-26T10:32:52.001226+0000","last_unstale":"2024-04-26T10:34:26.535396+0000","last_undegraded":"2024-04-26T10:34:26.535396+0000","last_fullsized":"2024-04-26T10:34:26.535396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534874+0000","last_change":"2024-04-26T10:32:52.005650+0000","last_active":"2024-04-26T10:34:26.534874+0000","last_peered":"2024-04-26T10:34:26.534874+0000","last_clean":"2024-04-26T10:34:26.534874+0000","last_became_active":"2024-04-26T10:32:52.004472+0000","last_became_peered":"2024-04-26T10:32:52.004472+0000","last_unstale":"2024-04-26T10:34:26.534874+0000","last_undegraded":"2024-04-26T10:34:26.534874+0000","last_fullsized":"2024-04-26T10:34:26.534874+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:46.265777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536718+0000","last_change":"2024-04-26T10:32:52.008711+0000","last_active":"2024-04-26T10:34:26.536718+0000","last_peered":"2024-04-26T10:34:26.536718+0000","last_clean":"2024-04-26T10:34:26.536718+0000","last_became_active":"2024-04-26T10:32:52.008384+0000","last_became_peered":"2024-04-26T10:32:52.008384+0000","last_unstale":"2024-04-26T10:34:26.536718+0000","last_undegraded":"2024-04-26T10:34:26.536718+0000","last_fullsized":"2024-04-26T10:34:26.536718+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:54:17.226434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534626+0000","last_change":"2024-04-26T10:32:52.008991+0000","last_active":"2024-04-26T10:34:26.534626+0000","last_peered":"2024-04-26T10:34:26.534626+0000","last_clean":"2024-04-26T10:34:26.534626+0000","last_became_active":"2024-04-26T10:32:52.008682+0000","last_became_peered":"2024-04-26T10:32:52.008682+0000","last_unstale":"2024-04-26T10:34:26.534626+0000","last_undegraded":"2024-04-26T10:34:26.534626+0000","last_fullsized":"2024-04-26T10:34:26.534626+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536312+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:34:26.536312+0000","last_peered":"2024-04-26T10:34:26.536312+0000","last_clean":"2024-04-26T10:34:26.536312+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:34:26.536312+0000","last_undegraded":"2024-04-26T10:34:26.536312+0000","last_fullsized":"2024-04-26T10:34:26.536312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536885+0000","last_change":"2024-04-26T10:34:14.511829+0000","last_active":"2024-04-26T10:34:26.536885+0000","last_peered":"2024-04-26T10:34:26.536885+0000","last_clean":"2024-04-26T10:34:26.536885+0000","last_became_active":"2024-04-26T10:34:14.511584+0000","last_became_peered":"2024-04-26T10:34:14.511584+0000","last_unstale":"2024-04-26T10:34:26.536885+0000","last_undegraded":"2024-04-26T10:34:26.536885+0000","last_fullsized":"2024-04-26T10:34:26.536885+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:30.166797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535941+0000","last_change":"2024-04-26T10:32:52.011360+0000","last_active":"2024-04-26T10:34:26.535941+0000","last_peered":"2024-04-26T10:34:26.535941+0000","last_clean":"2024-04-26T10:34:26.535941+0000","last_became_active":"2024-04-26T10:32:52.011033+0000","last_became_peered":"2024-04-26T10:32:52.011033+0000","last_unstale":"2024-04-26T10:34:26.535941+0000","last_undegraded":"2024-04-26T10:34:26.535941+0000","last_fullsized":"2024-04-26T10:34:26.535941+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:45.041278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536544+0000","last_change":"2024-04-26T10:32:52.007676+0000","last_active":"2024-04-26T10:34:26.536544+0000","last_peered":"2024-04-26T10:34:26.536544+0000","last_clean":"2024-04-26T10:34:26.536544+0000","last_became_active":"2024-04-26T10:32:52.005379+0000","last_became_peered":"2024-04-26T10:32:52.005379+0000","last_unstale":"2024-04-26T10:34:26.536544+0000","last_undegraded":"2024-04-26T10:34:26.536544+0000","last_fullsized":"2024-04-26T10:34:26.536544+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:10.496410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536828+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:34:26.536828+0000","last_peered":"2024-04-26T10:34:26.536828+0000","last_clean":"2024-04-26T10:34:26.536828+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:34:26.536828+0000","last_undegraded":"2024-04-26T10:34:26.536828+0000","last_fullsized":"2024-04-26T10:34:26.536828+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.537013+0000","last_change":"2024-04-26T10:32:52.010039+0000","last_active":"2024-04-26T10:34:26.537013+0000","last_peered":"2024-04-26T10:34:26.537013+0000","last_clean":"2024-04-26T10:34:26.537013+0000","last_became_active":"2024-04-26T10:32:52.009665+0000","last_became_peered":"2024-04-26T10:32:52.009665+0000","last_unstale":"2024-04-26T10:34:26.537013+0000","last_undegraded":"2024-04-26T10:34:26.537013+0000","last_fullsized":"2024-04-26T10:34:26.537013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534703+0000","last_change":"2024-04-26T10:32:51.588661+0000","last_active":"2024-04-26T10:34:26.534703+0000","last_peered":"2024-04-26T10:34:26.534703+0000","last_clean":"2024-04-26T10:34:26.534703+0000","last_became_active":"2024-04-26T10:32:51.588303+0000","last_became_peered":"2024-04-26T10:32:51.588303+0000","last_unstale":"2024-04-26T10:34:26.534703+0000","last_undegraded":"2024-04-26T10:34:26.534703+0000","last_fullsized":"2024-04-26T10:34:26.534703+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536010+0000","last_change":"2024-04-26T10:32:52.011560+0000","last_active":"2024-04-26T10:34:26.536010+0000","last_peered":"2024-04-26T10:34:26.536010+0000","last_clean":"2024-04-26T10:34:26.536010+0000","last_became_active":"2024-04-26T10:32:52.011255+0000","last_became_peered":"2024-04-26T10:32:52.011255+0000","last_unstale":"2024-04-26T10:34:26.536010+0000","last_undegraded":"2024-04-26T10:34:26.536010+0000","last_fullsized":"2024-04-26T10:34:26.536010+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:54.873348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":63,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.538111+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:34:26.538111+0000","last_peered":"2024-04-26T10:34:26.538111+0000","last_clean":"2024-04-26T10:34:26.538111+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:34:26.538111+0000","last_undegraded":"2024-04-26T10:34:26.538111+0000","last_fullsized":"2024-04-26T10:34:26.538111+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:19.856062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.537072+0000","last_change":"2024-04-26T10:32:52.008147+0000","last_active":"2024-04-26T10:34:26.537072+0000","last_peered":"2024-04-26T10:34:26.537072+0000","last_clean":"2024-04-26T10:34:26.537072+0000","last_became_active":"2024-04-26T10:32:52.007844+0000","last_became_peered":"2024-04-26T10:32:52.007844+0000","last_unstale":"2024-04-26T10:34:26.537072+0000","last_undegraded":"2024-04-26T10:34:26.537072+0000","last_fullsized":"2024-04-26T10:34:26.537072+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:37.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:27.538545+0000","last_change":"2024-04-26T10:34:26.537188+0000","last_active":"2024-04-26T10:34:27.538545+0000","last_peered":"2024-04-26T10:34:27.538545+0000","last_clean":"2024-04-26T10:34:27.538545+0000","last_became_active":"2024-04-26T10:34:26.536934+0000","last_became_peered":"2024-04-26T10:34:26.536934+0000","last_unstale":"2024-04-26T10:34:27.538545+0000","last_undegraded":"2024-04-26T10:34:27.538545+0000","last_fullsized":"2024-04-26T10:34:27.538545+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:02.447434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.537935+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:34:26.537935+0000","last_peered":"2024-04-26T10:34:26.537935+0000","last_clean":"2024-04-26T10:34:26.537935+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:34:26.537935+0000","last_undegraded":"2024-04-26T10:34:26.537935+0000","last_fullsized":"2024-04-26T10:34:26.537935+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:04.852453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534826+0000","last_change":"2024-04-26T10:32:51.585627+0000","last_active":"2024-04-26T10:34:26.534826+0000","last_peered":"2024-04-26T10:34:26.534826+0000","last_clean":"2024-04-26T10:34:26.534826+0000","last_became_active":"2024-04-26T10:32:51.584185+0000","last_became_peered":"2024-04-26T10:32:51.584185+0000","last_unstale":"2024-04-26T10:34:26.534826+0000","last_undegraded":"2024-04-26T10:34:26.534826+0000","last_fullsized":"2024-04-26T10:34:26.534826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:09.198318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534834+0000","last_change":"2024-04-26T10:32:52.011684+0000","last_active":"2024-04-26T10:34:26.534834+0000","last_peered":"2024-04-26T10:34:26.534834+0000","last_clean":"2024-04-26T10:34:26.534834+0000","last_became_active":"2024-04-26T10:32:52.011285+0000","last_became_peered":"2024-04-26T10:32:52.011285+0000","last_unstale":"2024-04-26T10:34:26.534834+0000","last_undegraded":"2024-04-26T10:34:26.534834+0000","last_fullsized":"2024-04-26T10:34:26.534834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":25,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536383+0000","last_change":"2024-04-26T10:34:14.518131+0000","last_active":"2024-04-26T10:34:26.536383+0000","last_peered":"2024-04-26T10:34:26.536383+0000","last_clean":"2024-04-26T10:34:26.536383+0000","last_became_active":"2024-04-26T10:34:14.506010+0000","last_became_peered":"2024-04-26T10:34:14.506010+0000","last_unstale":"2024-04-26T10:34:26.536383+0000","last_undegraded":"2024-04-26T10:34:26.536383+0000","last_fullsized":"2024-04-26T10:34:26.536383+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:35:51.842115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536054+0000","last_change":"2024-04-26T10:34:14.509381+0000","last_active":"2024-04-26T10:34:26.536054+0000","last_peered":"2024-04-26T10:34:26.536054+0000","last_clean":"2024-04-26T10:34:26.536054+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:34:26.536054+0000","last_undegraded":"2024-04-26T10:34:26.536054+0000","last_fullsized":"2024-04-26T10:34:26.536054+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:05.841519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":89,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535429+0000","last_change":"2024-04-26T10:34:14.548596+0000","last_active":"2024-04-26T10:34:26.535429+0000","last_peered":"2024-04-26T10:34:26.535429+0000","last_clean":"2024-04-26T10:34:26.535429+0000","last_became_active":"2024-04-26T10:34:14.512027+0000","last_became_peered":"2024-04-26T10:34:14.512027+0000","last_unstale":"2024-04-26T10:34:26.535429+0000","last_undegraded":"2024-04-26T10:34:26.535429+0000","last_fullsized":"2024-04-26T10:34:26.535429+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:39.957573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535211+0000","last_change":"2024-04-26T10:34:14.513656+0000","last_active":"2024-04-26T10:34:26.535211+0000","last_peered":"2024-04-26T10:34:26.535211+0000","last_clean":"2024-04-26T10:34:26.535211+0000","last_became_active":"2024-04-26T10:34:14.513402+0000","last_became_peered":"2024-04-26T10:34:14.513402+0000","last_unstale":"2024-04-26T10:34:26.535211+0000","last_undegraded":"2024-04-26T10:34:26.535211+0000","last_fullsized":"2024-04-26T10:34:26.535211+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:22.053611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536031+0000","last_change":"2024-04-26T10:32:51.584310+0000","last_active":"2024-04-26T10:34:26.536031+0000","last_peered":"2024-04-26T10:34:26.536031+0000","last_clean":"2024-04-26T10:34:26.536031+0000","last_became_active":"2024-04-26T10:32:51.583155+0000","last_became_peered":"2024-04-26T10:32:51.583155+0000","last_unstale":"2024-04-26T10:34:26.536031+0000","last_undegraded":"2024-04-26T10:34:26.536031+0000","last_fullsized":"2024-04-26T10:34:26.536031+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536612+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:34:26.536612+0000","last_peered":"2024-04-26T10:34:26.536612+0000","last_clean":"2024-04-26T10:34:26.536612+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:34:26.536612+0000","last_undegraded":"2024-04-26T10:34:26.536612+0000","last_fullsized":"2024-04-26T10:34:26.536612+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:02.872251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536167+0000","last_change":"2024-04-26T10:32:51.589193+0000","last_active":"2024-04-26T10:34:26.536167+0000","last_peered":"2024-04-26T10:34:26.536167+0000","last_clean":"2024-04-26T10:34:26.536167+0000","last_became_active":"2024-04-26T10:32:51.588831+0000","last_became_peered":"2024-04-26T10:32:51.588831+0000","last_unstale":"2024-04-26T10:34:26.536167+0000","last_undegraded":"2024-04-26T10:34:26.536167+0000","last_fullsized":"2024-04-26T10:34:26.536167+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:15.122240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536450+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:34:26.536450+0000","last_peered":"2024-04-26T10:34:26.536450+0000","last_clean":"2024-04-26T10:34:26.536450+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:34:26.536450+0000","last_undegraded":"2024-04-26T10:34:26.536450+0000","last_fullsized":"2024-04-26T10:34:26.536450+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:43.500342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535986+0000","last_change":"2024-04-26T10:34:14.509818+0000","last_active":"2024-04-26T10:34:26.535986+0000","last_peered":"2024-04-26T10:34:26.535986+0000","last_clean":"2024-04-26T10:34:26.535986+0000","last_became_active":"2024-04-26T10:34:14.509270+0000","last_became_peered":"2024-04-26T10:34:14.509270+0000","last_unstale":"2024-04-26T10:34:26.535986+0000","last_undegraded":"2024-04-26T10:34:26.535986+0000","last_fullsized":"2024-04-26T10:34:26.535986+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:45.412620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536053+0000","last_change":"2024-04-26T10:32:52.011888+0000","last_active":"2024-04-26T10:34:26.536053+0000","last_peered":"2024-04-26T10:34:26.536053+0000","last_clean":"2024-04-26T10:34:26.536053+0000","last_became_active":"2024-04-26T10:32:52.011662+0000","last_became_peered":"2024-04-26T10:32:52.011662+0000","last_unstale":"2024-04-26T10:34:26.536053+0000","last_undegraded":"2024-04-26T10:34:26.536053+0000","last_fullsized":"2024-04-26T10:34:26.536053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":91,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534107+0000","last_change":"2024-04-26T10:34:14.531646+0000","last_active":"2024-04-26T10:34:26.534107+0000","last_peered":"2024-04-26T10:34:26.534107+0000","last_clean":"2024-04-26T10:34:26.534107+0000","last_became_active":"2024-04-26T10:34:14.511911+0000","last_became_peered":"2024-04-26T10:34:14.511911+0000","last_unstale":"2024-04-26T10:34:26.534107+0000","last_undegraded":"2024-04-26T10:34:26.534107+0000","last_fullsized":"2024-04-26T10:34:26.534107+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:39.588939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535581+0000","last_change":"2024-04-26T10:32:52.011546+0000","last_active":"2024-04-26T10:34:26.535581+0000","last_peered":"2024-04-26T10:34:26.535581+0000","last_clean":"2024-04-26T10:34:26.535581+0000","last_became_active":"2024-04-26T10:32:52.011244+0000","last_became_peered":"2024-04-26T10:32:52.011244+0000","last_unstale":"2024-04-26T10:34:26.535581+0000","last_undegraded":"2024-04-26T10:34:26.535581+0000","last_fullsized":"2024-04-26T10:34:26.535581+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:20.551018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"51'10561","reported_seq":13669,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.053043+0000","last_change":"2024-04-26T10:34:14.549017+0000","last_active":"2024-04-26T10:34:30.053043+0000","last_peered":"2024-04-26T10:34:30.053043+0000","last_clean":"2024-04-26T10:34:30.053043+0000","last_became_active":"2024-04-26T10:34:14.518037+0000","last_became_peered":"2024-04-26T10:34:14.518037+0000","last_unstale":"2024-04-26T10:34:30.053043+0000","last_undegraded":"2024-04-26T10:34:30.053043+0000","last_fullsized":"2024-04-26T10:34:30.053043+0000","mapping_epoch":41,"log_start":"35'6791","ondisk_log_start":"35'6791","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3770,"log_dups_size":1542,"ondisk_log_size":3770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:21.571693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413335552,"num_objects":6307,"num_object_clones":0,"num_object_copies":12614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10561,"num_write_kb":539776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1524,"num_bytes_recovered":99876864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":72,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535171+0000","last_change":"2024-04-26T10:34:14.536943+0000","last_active":"2024-04-26T10:34:26.535171+0000","last_peered":"2024-04-26T10:34:26.535171+0000","last_clean":"2024-04-26T10:34:26.535171+0000","last_became_active":"2024-04-26T10:34:14.511960+0000","last_became_peered":"2024-04-26T10:34:14.511960+0000","last_unstale":"2024-04-26T10:34:26.535171+0000","last_undegraded":"2024-04-26T10:34:26.535171+0000","last_fullsized":"2024-04-26T10:34:26.535171+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:23.329973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536125+0000","last_change":"2024-04-26T10:32:52.010208+0000","last_active":"2024-04-26T10:34:26.536125+0000","last_peered":"2024-04-26T10:34:26.536125+0000","last_clean":"2024-04-26T10:34:26.536125+0000","last_became_active":"2024-04-26T10:32:52.008645+0000","last_became_peered":"2024-04-26T10:32:52.008645+0000","last_unstale":"2024-04-26T10:34:26.536125+0000","last_undegraded":"2024-04-26T10:34:26.536125+0000","last_fullsized":"2024-04-26T10:34:26.536125+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:43:49.126089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"51'10718","reported_seq":10760,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.059780+0000","last_change":"2024-04-26T10:33:16.346351+0000","last_active":"2024-04-26T10:34:30.059780+0000","last_peered":"2024-04-26T10:34:30.059780+0000","last_clean":"2024-04-26T10:34:30.059780+0000","last_became_active":"2024-04-26T10:33:16.346122+0000","last_became_peered":"2024-04-26T10:33:16.346122+0000","last_unstale":"2024-04-26T10:34:30.059780+0000","last_undegraded":"2024-04-26T10:34:30.059780+0000","last_fullsized":"2024-04-26T10:34:30.059780+0000","mapping_epoch":16,"log_start":"32'6764","ondisk_log_start":"32'6764","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3954,"log_dups_size":0,"ondisk_log_size":3954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:45:13.714464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428998656,"num_objects":6546,"num_object_clones":0,"num_object_copies":13092,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6546,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10718,"num_write_kb":552448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536827+0000","last_change":"2024-04-26T10:32:51.588342+0000","last_active":"2024-04-26T10:34:26.536827+0000","last_peered":"2024-04-26T10:34:26.536827+0000","last_clean":"2024-04-26T10:34:26.536827+0000","last_became_active":"2024-04-26T10:32:51.588164+0000","last_became_peered":"2024-04-26T10:32:51.588164+0000","last_unstale":"2024-04-26T10:34:26.536827+0000","last_undegraded":"2024-04-26T10:34:26.536827+0000","last_fullsized":"2024-04-26T10:34:26.536827+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:41.710899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536073+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:34:26.536073+0000","last_peered":"2024-04-26T10:34:26.536073+0000","last_clean":"2024-04-26T10:34:26.536073+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:34:26.536073+0000","last_undegraded":"2024-04-26T10:34:26.536073+0000","last_fullsized":"2024-04-26T10:34:26.536073+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:12.954308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"51'10626","reported_seq":13979,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.058149+0000","last_change":"2024-04-26T10:34:15.510456+0000","last_active":"2024-04-26T10:34:30.058149+0000","last_peered":"2024-04-26T10:34:30.058149+0000","last_clean":"2024-04-26T10:34:30.058149+0000","last_became_active":"2024-04-26T10:34:15.505397+0000","last_became_peered":"2024-04-26T10:34:15.505397+0000","last_unstale":"2024-04-26T10:34:30.058149+0000","last_undegraded":"2024-04-26T10:34:30.058149+0000","last_fullsized":"2024-04-26T10:34:30.058149+0000","mapping_epoch":42,"log_start":"32'6664","ondisk_log_start":"32'6664","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3962,"log_dups_size":1442,"ondisk_log_size":3962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:31:45.190570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":419168256,"num_objects":6396,"num_object_clones":0,"num_object_copies":12792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6396,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10626,"num_write_kb":544704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1649,"num_bytes_recovered":108068864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536738+0000","last_change":"2024-04-26T10:32:51.585650+0000","last_active":"2024-04-26T10:34:26.536738+0000","last_peered":"2024-04-26T10:34:26.536738+0000","last_clean":"2024-04-26T10:34:26.536738+0000","last_became_active":"2024-04-26T10:32:51.583967+0000","last_became_peered":"2024-04-26T10:32:51.583967+0000","last_unstale":"2024-04-26T10:34:26.536738+0000","last_undegraded":"2024-04-26T10:34:26.536738+0000","last_fullsized":"2024-04-26T10:34:26.536738+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535340+0000","last_change":"2024-04-26T10:32:52.002592+0000","last_active":"2024-04-26T10:34:26.535340+0000","last_peered":"2024-04-26T10:34:26.535340+0000","last_clean":"2024-04-26T10:34:26.535340+0000","last_became_active":"2024-04-26T10:32:52.001116+0000","last_became_peered":"2024-04-26T10:32:52.001116+0000","last_unstale":"2024-04-26T10:34:26.535340+0000","last_undegraded":"2024-04-26T10:34:26.535340+0000","last_fullsized":"2024-04-26T10:34:26.535340+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:42.916976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"51'10621","reported_seq":10664,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.090487+0000","last_change":"2024-04-26T10:33:16.346212+0000","last_active":"2024-04-26T10:34:30.090487+0000","last_peered":"2024-04-26T10:34:30.090487+0000","last_clean":"2024-04-26T10:34:30.090487+0000","last_became_active":"2024-04-26T10:33:16.346004+0000","last_became_peered":"2024-04-26T10:33:16.346004+0000","last_unstale":"2024-04-26T10:34:30.090487+0000","last_undegraded":"2024-04-26T10:34:30.090487+0000","last_fullsized":"2024-04-26T10:34:30.090487+0000","mapping_epoch":16,"log_start":"36'7054","ondisk_log_start":"36'7054","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3567,"log_dups_size":1542,"ondisk_log_size":3567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:27.495754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416612352,"num_objects":6357,"num_object_clones":0,"num_object_copies":12714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6357,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10621,"num_write_kb":543296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535058+0000","last_change":"2024-04-26T10:32:51.584071+0000","last_active":"2024-04-26T10:34:26.535058+0000","last_peered":"2024-04-26T10:34:26.535058+0000","last_clean":"2024-04-26T10:34:26.535058+0000","last_became_active":"2024-04-26T10:32:51.583144+0000","last_became_peered":"2024-04-26T10:32:51.583144+0000","last_unstale":"2024-04-26T10:34:26.535058+0000","last_undegraded":"2024-04-26T10:34:26.535058+0000","last_fullsized":"2024-04-26T10:34:26.535058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535189+0000","last_change":"2024-04-26T10:32:52.009943+0000","last_active":"2024-04-26T10:34:26.535189+0000","last_peered":"2024-04-26T10:34:26.535189+0000","last_clean":"2024-04-26T10:34:26.535189+0000","last_became_active":"2024-04-26T10:32:52.009663+0000","last_became_peered":"2024-04-26T10:32:52.009663+0000","last_unstale":"2024-04-26T10:34:26.535189+0000","last_undegraded":"2024-04-26T10:34:26.535189+0000","last_fullsized":"2024-04-26T10:34:26.535189+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.510926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"51'10532","reported_seq":10587,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.050573+0000","last_change":"2024-04-26T10:34:15.511727+0000","last_active":"2024-04-26T10:34:30.050573+0000","last_peered":"2024-04-26T10:34:30.050573+0000","last_clean":"2024-04-26T10:34:30.050573+0000","last_became_active":"2024-04-26T10:34:15.508075+0000","last_became_peered":"2024-04-26T10:34:15.508075+0000","last_unstale":"2024-04-26T10:34:30.050573+0000","last_undegraded":"2024-04-26T10:34:30.050573+0000","last_fullsized":"2024-04-26T10:34:30.050573+0000","mapping_epoch":42,"log_start":"32'6572","ondisk_log_start":"32'6572","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3960,"log_dups_size":1442,"ondisk_log_size":3960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:48:13.011834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":412811288,"num_objects":6300,"num_object_clones":0,"num_object_copies":12600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6300,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10532,"num_write_kb":538561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535068+0000","last_change":"2024-04-26T10:32:51.588622+0000","last_active":"2024-04-26T10:34:26.535068+0000","last_peered":"2024-04-26T10:34:26.535068+0000","last_clean":"2024-04-26T10:34:26.535068+0000","last_became_active":"2024-04-26T10:32:51.588201+0000","last_became_peered":"2024-04-26T10:32:51.588201+0000","last_unstale":"2024-04-26T10:34:26.535068+0000","last_undegraded":"2024-04-26T10:34:26.535068+0000","last_fullsized":"2024-04-26T10:34:26.535068+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:12.927205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535148+0000","last_change":"2024-04-26T10:32:52.008026+0000","last_active":"2024-04-26T10:34:26.535148+0000","last_peered":"2024-04-26T10:34:26.535148+0000","last_clean":"2024-04-26T10:34:26.535148+0000","last_became_active":"2024-04-26T10:32:52.007089+0000","last_became_peered":"2024-04-26T10:32:52.007089+0000","last_unstale":"2024-04-26T10:34:26.535148+0000","last_undegraded":"2024-04-26T10:34:26.535148+0000","last_fullsized":"2024-04-26T10:34:26.535148+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:09.703157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"51'10407","reported_seq":10450,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.086724+0000","last_change":"2024-04-26T10:33:16.349242+0000","last_active":"2024-04-26T10:34:30.086724+0000","last_peered":"2024-04-26T10:34:30.086724+0000","last_clean":"2024-04-26T10:34:30.086724+0000","last_became_active":"2024-04-26T10:33:16.349063+0000","last_became_peered":"2024-04-26T10:33:16.349063+0000","last_unstale":"2024-04-26T10:34:30.086724+0000","last_undegraded":"2024-04-26T10:34:30.086724+0000","last_fullsized":"2024-04-26T10:34:30.086724+0000","mapping_epoch":16,"log_start":"36'6862","ondisk_log_start":"36'6862","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3545,"log_dups_size":1442,"ondisk_log_size":3545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:09.297624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417529856,"num_objects":6371,"num_object_clones":0,"num_object_copies":12742,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6371,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10407,"num_write_kb":536896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535177+0000","last_change":"2024-04-26T10:32:51.585929+0000","last_active":"2024-04-26T10:34:26.535177+0000","last_peered":"2024-04-26T10:34:26.535177+0000","last_clean":"2024-04-26T10:34:26.535177+0000","last_became_active":"2024-04-26T10:32:51.584477+0000","last_became_peered":"2024-04-26T10:32:51.584477+0000","last_unstale":"2024-04-26T10:34:26.535177+0000","last_undegraded":"2024-04-26T10:34:26.535177+0000","last_fullsized":"2024-04-26T10:34:26.535177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:08.607963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536730+0000","last_change":"2024-04-26T10:32:52.007443+0000","last_active":"2024-04-26T10:34:26.536730+0000","last_peered":"2024-04-26T10:34:26.536730+0000","last_clean":"2024-04-26T10:34:26.536730+0000","last_became_active":"2024-04-26T10:32:52.004398+0000","last_became_peered":"2024-04-26T10:32:52.004398+0000","last_unstale":"2024-04-26T10:34:26.536730+0000","last_undegraded":"2024-04-26T10:34:26.536730+0000","last_fullsized":"2024-04-26T10:34:26.536730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:52.744537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"51'10255","reported_seq":10316,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.047939+0000","last_change":"2024-04-26T10:34:14.549556+0000","last_active":"2024-04-26T10:34:30.047939+0000","last_peered":"2024-04-26T10:34:30.047939+0000","last_clean":"2024-04-26T10:34:30.047939+0000","last_became_active":"2024-04-26T10:34:14.520855+0000","last_became_peered":"2024-04-26T10:34:14.520855+0000","last_unstale":"2024-04-26T10:34:30.047939+0000","last_undegraded":"2024-04-26T10:34:30.047939+0000","last_fullsized":"2024-04-26T10:34:30.047939+0000","mapping_epoch":41,"log_start":"32'6505","ondisk_log_start":"32'6505","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3750,"log_dups_size":1442,"ondisk_log_size":3750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:48.789996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401145856,"num_objects":6121,"num_object_clones":0,"num_object_copies":12242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6121,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10255,"num_write_kb":524032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536146+0000","last_change":"2024-04-26T10:32:51.584178+0000","last_active":"2024-04-26T10:34:26.536146+0000","last_peered":"2024-04-26T10:34:26.536146+0000","last_clean":"2024-04-26T10:34:26.536146+0000","last_became_active":"2024-04-26T10:32:51.583722+0000","last_became_peered":"2024-04-26T10:32:51.583722+0000","last_unstale":"2024-04-26T10:34:26.536146+0000","last_undegraded":"2024-04-26T10:34:26.536146+0000","last_fullsized":"2024-04-26T10:34:26.536146+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:14.186955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534881+0000","last_change":"2024-04-26T10:34:14.509460+0000","last_active":"2024-04-26T10:34:26.534881+0000","last_peered":"2024-04-26T10:34:26.534881+0000","last_clean":"2024-04-26T10:34:26.534881+0000","last_became_active":"2024-04-26T10:34:14.509213+0000","last_became_peered":"2024-04-26T10:34:14.509213+0000","last_unstale":"2024-04-26T10:34:26.534881+0000","last_undegraded":"2024-04-26T10:34:26.534881+0000","last_fullsized":"2024-04-26T10:34:26.534881+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:15.816526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"51'10401","reported_seq":10443,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.063808+0000","last_change":"2024-04-26T10:33:16.344866+0000","last_active":"2024-04-26T10:34:30.063808+0000","last_peered":"2024-04-26T10:34:30.063808+0000","last_clean":"2024-04-26T10:34:30.063808+0000","last_became_active":"2024-04-26T10:33:16.344614+0000","last_became_peered":"2024-04-26T10:33:16.344614+0000","last_unstale":"2024-04-26T10:34:30.063808+0000","last_undegraded":"2024-04-26T10:34:30.063808+0000","last_fullsized":"2024-04-26T10:34:30.063808+0000","mapping_epoch":16,"log_start":"32'6354","ondisk_log_start":"32'6354","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415039488,"num_objects":6333,"num_object_clones":0,"num_object_copies":12666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6333,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10401,"num_write_kb":535488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536000+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:34:26.536000+0000","last_peered":"2024-04-26T10:34:26.536000+0000","last_clean":"2024-04-26T10:34:26.536000+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:34:26.536000+0000","last_undegraded":"2024-04-26T10:34:26.536000+0000","last_fullsized":"2024-04-26T10:34:26.536000+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:35.111495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535220+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:34:26.535220+0000","last_peered":"2024-04-26T10:34:26.535220+0000","last_clean":"2024-04-26T10:34:26.535220+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:34:26.535220+0000","last_undegraded":"2024-04-26T10:34:26.535220+0000","last_fullsized":"2024-04-26T10:34:26.535220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"51'10476","reported_seq":10519,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.073597+0000","last_change":"2024-04-26T10:33:16.349280+0000","last_active":"2024-04-26T10:34:30.073597+0000","last_peered":"2024-04-26T10:34:30.073597+0000","last_clean":"2024-04-26T10:34:30.073597+0000","last_became_active":"2024-04-26T10:33:16.349010+0000","last_became_peered":"2024-04-26T10:33:16.349010+0000","last_unstale":"2024-04-26T10:34:30.073597+0000","last_undegraded":"2024-04-26T10:34:30.073597+0000","last_fullsized":"2024-04-26T10:34:30.073597+0000","mapping_epoch":16,"log_start":"36'6871","ondisk_log_start":"36'6871","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3605,"log_dups_size":1442,"ondisk_log_size":3605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:08.933996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405929984,"num_objects":6194,"num_object_clones":0,"num_object_copies":12388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6194,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10476,"num_write_kb":533440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535309+0000","last_change":"2024-04-26T10:34:14.511174+0000","last_active":"2024-04-26T10:34:26.535309+0000","last_peered":"2024-04-26T10:34:26.535309+0000","last_clean":"2024-04-26T10:34:26.535309+0000","last_became_active":"2024-04-26T10:34:14.510907+0000","last_became_peered":"2024-04-26T10:34:14.510907+0000","last_unstale":"2024-04-26T10:34:26.535309+0000","last_undegraded":"2024-04-26T10:34:26.535309+0000","last_fullsized":"2024-04-26T10:34:26.535309+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:57:34.574586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536624+0000","last_change":"2024-04-26T10:32:51.586101+0000","last_active":"2024-04-26T10:34:26.536624+0000","last_peered":"2024-04-26T10:34:26.536624+0000","last_clean":"2024-04-26T10:34:26.536624+0000","last_became_active":"2024-04-26T10:32:51.585746+0000","last_became_peered":"2024-04-26T10:32:51.585746+0000","last_unstale":"2024-04-26T10:34:26.536624+0000","last_undegraded":"2024-04-26T10:34:26.536624+0000","last_fullsized":"2024-04-26T10:34:26.536624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:17.347428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536438+0000","last_change":"2024-04-26T10:34:14.506552+0000","last_active":"2024-04-26T10:34:26.536438+0000","last_peered":"2024-04-26T10:34:26.536438+0000","last_clean":"2024-04-26T10:34:26.536438+0000","last_became_active":"2024-04-26T10:34:14.506008+0000","last_became_peered":"2024-04-26T10:34:14.506008+0000","last_unstale":"2024-04-26T10:34:26.536438+0000","last_undegraded":"2024-04-26T10:34:26.536438+0000","last_fullsized":"2024-04-26T10:34:26.536438+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:59.031036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"51'10440","reported_seq":10483,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.087683+0000","last_change":"2024-04-26T10:33:16.349302+0000","last_active":"2024-04-26T10:34:30.087683+0000","last_peered":"2024-04-26T10:34:30.087683+0000","last_clean":"2024-04-26T10:34:30.087683+0000","last_became_active":"2024-04-26T10:33:16.348992+0000","last_became_peered":"2024-04-26T10:33:16.348992+0000","last_unstale":"2024-04-26T10:34:30.087683+0000","last_undegraded":"2024-04-26T10:34:30.087683+0000","last_fullsized":"2024-04-26T10:34:30.087683+0000","mapping_epoch":16,"log_start":"36'6857","ondisk_log_start":"36'6857","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3583,"log_dups_size":1442,"ondisk_log_size":3583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:44:15.154950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409731072,"num_objects":6252,"num_object_clones":0,"num_object_copies":12504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6252,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10440,"num_write_kb":534144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536210+0000","last_change":"2024-04-26T10:32:46.553998+0000","last_active":"2024-04-26T10:34:26.536210+0000","last_peered":"2024-04-26T10:34:26.536210+0000","last_clean":"2024-04-26T10:34:26.536210+0000","last_became_active":"2024-04-26T10:32:46.553681+0000","last_became_peered":"2024-04-26T10:32:46.553681+0000","last_unstale":"2024-04-26T10:34:26.536210+0000","last_undegraded":"2024-04-26T10:34:26.536210+0000","last_fullsized":"2024-04-26T10:34:26.536210+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:54:09.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535065+0000","last_change":"2024-04-26T10:32:51.583151+0000","last_active":"2024-04-26T10:34:26.535065+0000","last_peered":"2024-04-26T10:34:26.535065+0000","last_clean":"2024-04-26T10:34:26.535065+0000","last_became_active":"2024-04-26T10:32:51.582787+0000","last_became_peered":"2024-04-26T10:32:51.582787+0000","last_unstale":"2024-04-26T10:34:26.535065+0000","last_undegraded":"2024-04-26T10:34:26.535065+0000","last_fullsized":"2024-04-26T10:34:26.535065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535197+0000","last_change":"2024-04-26T10:34:14.513348+0000","last_active":"2024-04-26T10:34:26.535197+0000","last_peered":"2024-04-26T10:34:26.535197+0000","last_clean":"2024-04-26T10:34:26.535197+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:34:26.535197+0000","last_undegraded":"2024-04-26T10:34:26.535197+0000","last_fullsized":"2024-04-26T10:34:26.535197+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:21.161769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"51'10503","reported_seq":10546,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.092083+0000","last_change":"2024-04-26T10:33:16.349181+0000","last_active":"2024-04-26T10:34:30.092083+0000","last_peered":"2024-04-26T10:34:30.092083+0000","last_clean":"2024-04-26T10:34:30.092083+0000","last_became_active":"2024-04-26T10:33:16.348981+0000","last_became_peered":"2024-04-26T10:33:16.348981+0000","last_unstale":"2024-04-26T10:34:30.092083+0000","last_undegraded":"2024-04-26T10:34:30.092083+0000","last_fullsized":"2024-04-26T10:34:30.092083+0000","mapping_epoch":16,"log_start":"36'6884","ondisk_log_start":"36'6884","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3619,"log_dups_size":1442,"ondisk_log_size":3619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:22.592628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416219136,"num_objects":6351,"num_object_clones":0,"num_object_copies":12702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6351,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10503,"num_write_kb":539328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534551+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:34:26.534551+0000","last_peered":"2024-04-26T10:34:26.534551+0000","last_clean":"2024-04-26T10:34:26.534551+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:34:26.534551+0000","last_undegraded":"2024-04-26T10:34:26.534551+0000","last_fullsized":"2024-04-26T10:34:26.534551+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536206+0000","last_change":"2024-04-26T10:32:51.586172+0000","last_active":"2024-04-26T10:34:26.536206+0000","last_peered":"2024-04-26T10:34:26.536206+0000","last_clean":"2024-04-26T10:34:26.536206+0000","last_became_active":"2024-04-26T10:32:51.585918+0000","last_became_peered":"2024-04-26T10:32:51.585918+0000","last_unstale":"2024-04-26T10:34:26.536206+0000","last_undegraded":"2024-04-26T10:34:26.536206+0000","last_fullsized":"2024-04-26T10:34:26.536206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:28:56.910682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535497+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:34:26.535497+0000","last_peered":"2024-04-26T10:34:26.535497+0000","last_clean":"2024-04-26T10:34:26.535497+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:34:26.535497+0000","last_undegraded":"2024-04-26T10:34:26.535497+0000","last_fullsized":"2024-04-26T10:34:26.535497+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:57.803542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"51'10494","reported_seq":10548,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.057918+0000","last_change":"2024-04-26T10:34:15.513418+0000","last_active":"2024-04-26T10:34:30.057918+0000","last_peered":"2024-04-26T10:34:30.057918+0000","last_clean":"2024-04-26T10:34:30.057918+0000","last_became_active":"2024-04-26T10:34:15.508062+0000","last_became_peered":"2024-04-26T10:34:15.508062+0000","last_unstale":"2024-04-26T10:34:30.057918+0000","last_undegraded":"2024-04-26T10:34:30.057918+0000","last_fullsized":"2024-04-26T10:34:30.057918+0000","mapping_epoch":42,"log_start":"32'6457","ondisk_log_start":"32'6457","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":4037,"log_dups_size":1542,"ondisk_log_size":4037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:44:12.573855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417595392,"num_objects":6372,"num_object_clones":0,"num_object_copies":12744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6372,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10494,"num_write_kb":539712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535030+0000","last_change":"2024-04-26T10:32:46.554066+0000","last_active":"2024-04-26T10:34:26.535030+0000","last_peered":"2024-04-26T10:34:26.535030+0000","last_clean":"2024-04-26T10:34:26.535030+0000","last_became_active":"2024-04-26T10:32:46.553783+0000","last_became_peered":"2024-04-26T10:32:46.553783+0000","last_unstale":"2024-04-26T10:34:26.535030+0000","last_undegraded":"2024-04-26T10:34:26.535030+0000","last_fullsized":"2024-04-26T10:34:26.535030+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:18:42.950020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":288,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.533926+0000","last_change":"2024-04-26T10:34:17.427146+0000","last_active":"2024-04-26T10:34:26.533926+0000","last_peered":"2024-04-26T10:34:26.533926+0000","last_clean":"2024-04-26T10:34:26.533926+0000","last_became_active":"2024-04-26T10:34:17.426852+0000","last_became_peered":"2024-04-26T10:34:17.426852+0000","last_unstale":"2024-04-26T10:34:26.533926+0000","last_undegraded":"2024-04-26T10:34:26.533926+0000","last_fullsized":"2024-04-26T10:34:26.533926+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:50.963578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535985+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:34:26.535985+0000","last_peered":"2024-04-26T10:34:26.535985+0000","last_clean":"2024-04-26T10:34:26.535985+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:34:26.535985+0000","last_undegraded":"2024-04-26T10:34:26.535985+0000","last_fullsized":"2024-04-26T10:34:26.535985+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536692+0000","last_change":"2024-04-26T10:34:14.509642+0000","last_active":"2024-04-26T10:34:26.536692+0000","last_peered":"2024-04-26T10:34:26.536692+0000","last_clean":"2024-04-26T10:34:26.536692+0000","last_became_active":"2024-04-26T10:34:14.509329+0000","last_became_peered":"2024-04-26T10:34:14.509329+0000","last_unstale":"2024-04-26T10:34:26.536692+0000","last_undegraded":"2024-04-26T10:34:26.536692+0000","last_fullsized":"2024-04-26T10:34:26.536692+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:20.861292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"51'10331","reported_seq":10374,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.032729+0000","last_change":"2024-04-26T10:33:16.344693+0000","last_active":"2024-04-26T10:34:30.032729+0000","last_peered":"2024-04-26T10:34:30.032729+0000","last_clean":"2024-04-26T10:34:30.032729+0000","last_became_active":"2024-04-26T10:33:16.344478+0000","last_became_peered":"2024-04-26T10:33:16.344478+0000","last_unstale":"2024-04-26T10:34:30.032729+0000","last_undegraded":"2024-04-26T10:34:30.032729+0000","last_fullsized":"2024-04-26T10:34:30.032729+0000","mapping_epoch":16,"log_start":"32'6533","ondisk_log_start":"32'6533","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3798,"log_dups_size":1442,"ondisk_log_size":3798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:24.298876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415825920,"num_objects":6345,"num_object_clones":0,"num_object_copies":12690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6345,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10331,"num_write_kb":533632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534006+0000","last_change":"2024-04-26T10:34:14.509367+0000","last_active":"2024-04-26T10:34:26.534006+0000","last_peered":"2024-04-26T10:34:26.534006+0000","last_clean":"2024-04-26T10:34:26.534006+0000","last_became_active":"2024-04-26T10:34:14.508465+0000","last_became_peered":"2024-04-26T10:34:14.508465+0000","last_unstale":"2024-04-26T10:34:26.534006+0000","last_undegraded":"2024-04-26T10:34:26.534006+0000","last_fullsized":"2024-04-26T10:34:26.534006+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:31.790156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534411+0000","last_change":"2024-04-26T10:32:51.586651+0000","last_active":"2024-04-26T10:34:26.534411+0000","last_peered":"2024-04-26T10:34:26.534411+0000","last_clean":"2024-04-26T10:34:26.534411+0000","last_became_active":"2024-04-26T10:32:51.586364+0000","last_became_peered":"2024-04-26T10:32:51.586364+0000","last_unstale":"2024-04-26T10:34:26.534411+0000","last_undegraded":"2024-04-26T10:34:26.534411+0000","last_fullsized":"2024-04-26T10:34:26.534411+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:39.091599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536911+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:34:26.536911+0000","last_peered":"2024-04-26T10:34:26.536911+0000","last_clean":"2024-04-26T10:34:26.536911+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:34:26.536911+0000","last_undegraded":"2024-04-26T10:34:26.536911+0000","last_fullsized":"2024-04-26T10:34:26.536911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"51'10603","reported_seq":10646,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.050932+0000","last_change":"2024-04-26T10:33:16.344694+0000","last_active":"2024-04-26T10:34:30.050932+0000","last_peered":"2024-04-26T10:34:30.050932+0000","last_clean":"2024-04-26T10:34:30.050932+0000","last_became_active":"2024-04-26T10:33:16.344461+0000","last_became_peered":"2024-04-26T10:33:16.344461+0000","last_unstale":"2024-04-26T10:34:30.050932+0000","last_undegraded":"2024-04-26T10:34:30.050932+0000","last_fullsized":"2024-04-26T10:34:30.050932+0000","mapping_epoch":16,"log_start":"35'6884","ondisk_log_start":"35'6884","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":1442,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:03:29.374096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417792000,"num_objects":6375,"num_object_clones":0,"num_object_copies":12750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6375,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10603,"num_write_kb":543296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536704+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:34:26.536704+0000","last_peered":"2024-04-26T10:34:26.536704+0000","last_clean":"2024-04-26T10:34:26.536704+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:34:26.536704+0000","last_undegraded":"2024-04-26T10:34:26.536704+0000","last_fullsized":"2024-04-26T10:34:26.536704+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":63,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535422+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:34:26.535422+0000","last_peered":"2024-04-26T10:34:26.535422+0000","last_clean":"2024-04-26T10:34:26.535422+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:34:26.535422+0000","last_undegraded":"2024-04-26T10:34:26.535422+0000","last_fullsized":"2024-04-26T10:34:26.535422+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:21.048381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536625+0000","last_change":"2024-04-26T10:32:52.008448+0000","last_active":"2024-04-26T10:34:26.536625+0000","last_peered":"2024-04-26T10:34:26.536625+0000","last_clean":"2024-04-26T10:34:26.536625+0000","last_became_active":"2024-04-26T10:32:52.008047+0000","last_became_peered":"2024-04-26T10:32:52.008047+0000","last_unstale":"2024-04-26T10:34:26.536625+0000","last_undegraded":"2024-04-26T10:34:26.536625+0000","last_fullsized":"2024-04-26T10:34:26.536625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"51'10508","reported_seq":10551,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.044288+0000","last_change":"2024-04-26T10:33:16.344714+0000","last_active":"2024-04-26T10:34:30.044288+0000","last_peered":"2024-04-26T10:34:30.044288+0000","last_clean":"2024-04-26T10:34:30.044288+0000","last_became_active":"2024-04-26T10:33:16.344500+0000","last_became_peered":"2024-04-26T10:33:16.344500+0000","last_unstale":"2024-04-26T10:34:30.044288+0000","last_undegraded":"2024-04-26T10:34:30.044288+0000","last_fullsized":"2024-04-26T10:34:30.044288+0000","mapping_epoch":16,"log_start":"32'6735","ondisk_log_start":"32'6735","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3773,"log_dups_size":1442,"ondisk_log_size":3773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:36:19.056484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422182912,"num_objects":6442,"num_object_clones":0,"num_object_copies":12884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6442,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10508,"num_write_kb":542400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535139+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:34:26.535139+0000","last_peered":"2024-04-26T10:34:26.535139+0000","last_clean":"2024-04-26T10:34:26.535139+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:34:26.535139+0000","last_undegraded":"2024-04-26T10:34:26.535139+0000","last_fullsized":"2024-04-26T10:34:26.535139+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536125+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:34:26.536125+0000","last_peered":"2024-04-26T10:34:26.536125+0000","last_clean":"2024-04-26T10:34:26.536125+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:34:26.536125+0000","last_undegraded":"2024-04-26T10:34:26.536125+0000","last_fullsized":"2024-04-26T10:34:26.536125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.172123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.537862+0000","last_change":"2024-04-26T10:32:52.009663+0000","last_active":"2024-04-26T10:34:26.537862+0000","last_peered":"2024-04-26T10:34:26.537862+0000","last_clean":"2024-04-26T10:34:26.537862+0000","last_became_active":"2024-04-26T10:32:52.009345+0000","last_became_peered":"2024-04-26T10:32:52.009345+0000","last_unstale":"2024-04-26T10:34:26.537862+0000","last_undegraded":"2024-04-26T10:34:26.537862+0000","last_fullsized":"2024-04-26T10:34:26.537862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:55:02.445620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"51'10474","reported_seq":10526,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T10:34:30.057720+0000","last_change":"2024-04-26T10:34:15.510428+0000","last_active":"2024-04-26T10:34:30.057720+0000","last_peered":"2024-04-26T10:34:30.057720+0000","last_clean":"2024-04-26T10:34:30.057720+0000","last_became_active":"2024-04-26T10:34:15.505392+0000","last_became_peered":"2024-04-26T10:34:15.505392+0000","last_unstale":"2024-04-26T10:34:30.057720+0000","last_undegraded":"2024-04-26T10:34:30.057720+0000","last_fullsized":"2024-04-26T10:34:30.057720+0000","mapping_epoch":42,"log_start":"32'6488","ondisk_log_start":"32'6488","created":16,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:33:15.334608+0000","last_clean_scrub_stamp":"2024-04-26T10:33:15.334608+0000","objects_scrubbed":0,"log_size":3986,"log_dups_size":1442,"ondisk_log_size":3986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:56.871872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410779648,"num_objects":6268,"num_object_clones":0,"num_object_copies":12536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6268,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10474,"num_write_kb":535744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535311+0000","last_change":"2024-04-26T10:34:14.512226+0000","last_active":"2024-04-26T10:34:26.535311+0000","last_peered":"2024-04-26T10:34:26.535311+0000","last_clean":"2024-04-26T10:34:26.535311+0000","last_became_active":"2024-04-26T10:34:14.511888+0000","last_became_peered":"2024-04-26T10:34:14.511888+0000","last_unstale":"2024-04-26T10:34:26.535311+0000","last_undegraded":"2024-04-26T10:34:26.535311+0000","last_fullsized":"2024-04-26T10:34:26.535311+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:58.832869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535979+0000","last_change":"2024-04-26T10:32:51.589658+0000","last_active":"2024-04-26T10:34:26.535979+0000","last_peered":"2024-04-26T10:34:26.535979+0000","last_clean":"2024-04-26T10:34:26.535979+0000","last_became_active":"2024-04-26T10:32:51.589348+0000","last_became_peered":"2024-04-26T10:32:51.589348+0000","last_unstale":"2024-04-26T10:34:26.535979+0000","last_undegraded":"2024-04-26T10:34:26.535979+0000","last_fullsized":"2024-04-26T10:34:26.535979+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:57.774892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535992+0000","last_change":"2024-04-26T10:34:14.510158+0000","last_active":"2024-04-26T10:34:26.535992+0000","last_peered":"2024-04-26T10:34:26.535992+0000","last_clean":"2024-04-26T10:34:26.535992+0000","last_became_active":"2024-04-26T10:34:14.509584+0000","last_became_peered":"2024-04-26T10:34:14.509584+0000","last_unstale":"2024-04-26T10:34:26.535992+0000","last_undegraded":"2024-04-26T10:34:26.535992+0000","last_fullsized":"2024-04-26T10:34:26.535992+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:39.230972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536579+0000","last_change":"2024-04-26T10:34:14.508334+0000","last_active":"2024-04-26T10:34:26.536579+0000","last_peered":"2024-04-26T10:34:26.536579+0000","last_clean":"2024-04-26T10:34:26.536579+0000","last_became_active":"2024-04-26T10:34:14.507205+0000","last_became_peered":"2024-04-26T10:34:14.507205+0000","last_unstale":"2024-04-26T10:34:26.536579+0000","last_undegraded":"2024-04-26T10:34:26.536579+0000","last_fullsized":"2024-04-26T10:34:26.536579+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:20.747187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536911+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:34:26.536911+0000","last_peered":"2024-04-26T10:34:26.536911+0000","last_clean":"2024-04-26T10:34:26.536911+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:34:26.536911+0000","last_undegraded":"2024-04-26T10:34:26.536911+0000","last_fullsized":"2024-04-26T10:34:26.536911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535313+0000","last_change":"2024-04-26T10:32:51.585667+0000","last_active":"2024-04-26T10:34:26.535313+0000","last_peered":"2024-04-26T10:34:26.535313+0000","last_clean":"2024-04-26T10:34:26.535313+0000","last_became_active":"2024-04-26T10:32:51.584449+0000","last_became_peered":"2024-04-26T10:32:51.584449+0000","last_unstale":"2024-04-26T10:34:26.535313+0000","last_undegraded":"2024-04-26T10:34:26.535313+0000","last_fullsized":"2024-04-26T10:34:26.535313+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:59.345928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534978+0000","last_change":"2024-04-26T10:32:52.004609+0000","last_active":"2024-04-26T10:34:26.534978+0000","last_peered":"2024-04-26T10:34:26.534978+0000","last_clean":"2024-04-26T10:34:26.534978+0000","last_became_active":"2024-04-26T10:32:51.999311+0000","last_became_peered":"2024-04-26T10:32:51.999311+0000","last_unstale":"2024-04-26T10:34:26.534978+0000","last_undegraded":"2024-04-26T10:34:26.534978+0000","last_fullsized":"2024-04-26T10:34:26.534978+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:44:28.340228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536926+0000","last_change":"2024-04-26T10:32:51.586294+0000","last_active":"2024-04-26T10:34:26.536926+0000","last_peered":"2024-04-26T10:34:26.536926+0000","last_clean":"2024-04-26T10:34:26.536926+0000","last_became_active":"2024-04-26T10:32:51.585985+0000","last_became_peered":"2024-04-26T10:32:51.585985+0000","last_unstale":"2024-04-26T10:34:26.536926+0000","last_undegraded":"2024-04-26T10:34:26.536926+0000","last_fullsized":"2024-04-26T10:34:26.536926+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:56.296314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535287+0000","last_change":"2024-04-26T10:32:52.003279+0000","last_active":"2024-04-26T10:34:26.535287+0000","last_peered":"2024-04-26T10:34:26.535287+0000","last_clean":"2024-04-26T10:34:26.535287+0000","last_became_active":"2024-04-26T10:32:52.001657+0000","last_became_peered":"2024-04-26T10:32:52.001657+0000","last_unstale":"2024-04-26T10:34:26.535287+0000","last_undegraded":"2024-04-26T10:34:26.535287+0000","last_fullsized":"2024-04-26T10:34:26.535287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:49.167748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536090+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:34:26.536090+0000","last_peered":"2024-04-26T10:34:26.536090+0000","last_clean":"2024-04-26T10:34:26.536090+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:34:26.536090+0000","last_undegraded":"2024-04-26T10:34:26.536090+0000","last_fullsized":"2024-04-26T10:34:26.536090+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536238+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:34:26.536238+0000","last_peered":"2024-04-26T10:34:26.536238+0000","last_clean":"2024-04-26T10:34:26.536238+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:34:26.536238+0000","last_undegraded":"2024-04-26T10:34:26.536238+0000","last_fullsized":"2024-04-26T10:34:26.536238+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":51,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535301+0000","last_change":"2024-04-26T10:32:51.589502+0000","last_active":"2024-04-26T10:34:26.535301+0000","last_peered":"2024-04-26T10:34:26.535301+0000","last_clean":"2024-04-26T10:34:26.535301+0000","last_became_active":"2024-04-26T10:32:51.589268+0000","last_became_peered":"2024-04-26T10:32:51.589268+0000","last_unstale":"2024-04-26T10:34:26.535301+0000","last_undegraded":"2024-04-26T10:34:26.535301+0000","last_fullsized":"2024-04-26T10:34:26.535301+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:15.532739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534903+0000","last_change":"2024-04-26T10:32:52.005367+0000","last_active":"2024-04-26T10:34:26.534903+0000","last_peered":"2024-04-26T10:34:26.534903+0000","last_clean":"2024-04-26T10:34:26.534903+0000","last_became_active":"2024-04-26T10:32:52.003270+0000","last_became_peered":"2024-04-26T10:32:52.003270+0000","last_unstale":"2024-04-26T10:34:26.534903+0000","last_undegraded":"2024-04-26T10:34:26.534903+0000","last_fullsized":"2024-04-26T10:34:26.534903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534005+0000","last_change":"2024-04-26T10:32:51.999923+0000","last_active":"2024-04-26T10:34:26.534005+0000","last_peered":"2024-04-26T10:34:26.534005+0000","last_clean":"2024-04-26T10:34:26.534005+0000","last_became_active":"2024-04-26T10:32:51.998794+0000","last_became_peered":"2024-04-26T10:32:51.998794+0000","last_unstale":"2024-04-26T10:34:26.534005+0000","last_undegraded":"2024-04-26T10:34:26.534005+0000","last_fullsized":"2024-04-26T10:34:26.534005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:52.254943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.534485+0000","last_change":"2024-04-26T10:34:14.513276+0000","last_active":"2024-04-26T10:34:26.534485+0000","last_peered":"2024-04-26T10:34:26.534485+0000","last_clean":"2024-04-26T10:34:26.534485+0000","last_became_active":"2024-04-26T10:34:14.512930+0000","last_became_peered":"2024-04-26T10:34:14.512930+0000","last_unstale":"2024-04-26T10:34:26.534485+0000","last_undegraded":"2024-04-26T10:34:26.534485+0000","last_fullsized":"2024-04-26T10:34:26.534485+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:37.809739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":46,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536814+0000","last_change":"2024-04-26T10:32:52.009914+0000","last_active":"2024-04-26T10:34:26.536814+0000","last_peered":"2024-04-26T10:34:26.536814+0000","last_clean":"2024-04-26T10:34:26.536814+0000","last_became_active":"2024-04-26T10:32:52.008880+0000","last_became_peered":"2024-04-26T10:32:52.008880+0000","last_unstale":"2024-04-26T10:34:26.536814+0000","last_undegraded":"2024-04-26T10:34:26.536814+0000","last_fullsized":"2024-04-26T10:34:26.536814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":62,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.535370+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:34:26.535370+0000","last_peered":"2024-04-26T10:34:26.535370+0000","last_clean":"2024-04-26T10:34:26.535370+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:34:26.535370+0000","last_undegraded":"2024-04-26T10:34:26.535370+0000","last_fullsized":"2024-04-26T10:34:26.535370+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.021846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T10:34:26.536530+0000","last_change":"2024-04-26T10:34:14.507476+0000","last_active":"2024-04-26T10:34:26.536530+0000","last_peered":"2024-04-26T10:34:26.536530+0000","last_clean":"2024-04-26T10:34:26.536530+0000","last_became_active":"2024-04-26T10:34:14.507171+0000","last_became_peered":"2024-04-26T10:34:14.507171+0000","last_unstale":"2024-04-26T10:34:26.536530+0000","last_undegraded":"2024-04-26T10:34:26.536530+0000","last_fullsized":"2024-04-26T10:34:26.536530+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:32.536858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":6640697368,"num_objects":101330,"num_object_clones":0,"num_object_copies":202660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101330,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":167950,"num_write_kb":8616897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3174,"num_bytes_recovered":208011264,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13278060544,"data_stored":13278052400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60675,"ondisk_log_size":60675,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738392,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5544448,"kb_used_data":5300600,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":88827392,"statfs":{"total":96636764160,"available":90959249408,"internally_reserved":0,"allocated":5427814400,"data_stored":5427449074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249428422},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":1.681},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":1.982}]},{"osd":1,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":1.6439999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4311204,"kb_used_data":4109272,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":90060636,"statfs":{"total":96636764160,"available":92222091264,"internally_reserved":0,"allocated":4207894528,"data_stored":4207498748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":1.4019999999999999}]},{"osd":2,"last update":"Fri Apr 26 10:33:45 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.53700000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738391,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3849564,"kb_used_data":3706000,"kb_used_omap":1,"kb_used_meta":143486,"kb_avail":90522276,"statfs":{"total":96636764160,"available":92694810624,"internally_reserved":0,"allocated":3794944000,"data_stored":3794555796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146930118},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.182},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.25900000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.214},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.23499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4133883904,"data_stored":4133879832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3735490560,"data_stored":3735486488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5408686080,"data_stored":5408686080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:34:34.459 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T10:34:34.459 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:34:34.459 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T10:34:34.459 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T10:34:34.479 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:34.479 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:34.479 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:34.480 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:34.480 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:34.495 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:34.541 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:34.541+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:34.607 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:34.606+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:34.682 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:34.682 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:34.682 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:34.682 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:34.682 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.682 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:34.682 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:34.683 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 66.878571925000003, 2024-04-26T10:34:34.683 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:34.683 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.683 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.683 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.683 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.683 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.683 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:34.683 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.683 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.683 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.683 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.683 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.684 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.685 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.686 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:34.686 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:34.686 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.686 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.686 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.686 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:34.686 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:34.686 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.686 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.686 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.686 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:34.686 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:34.686 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:34.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.688 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.688 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.688 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:34.688 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:34.688 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.688 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.688 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.688 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.688 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.688 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:34.689 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:34.689 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 66.877743844999998, 2024-04-26T10:34:34.689 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:34.689 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.689 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.689 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.689 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.689 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.689 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:34.689 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.689 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.689 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.689 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.690 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.691 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.691 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:34.691 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:34.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.691 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.691 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.691 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:34.691 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:34.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.691 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.691 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.692 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.693 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.693 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:34.693 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:34.693 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.693 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.693 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.693 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.694 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 66.876814781999997, 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.695 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.696 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.697 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.697 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.697 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:34.697 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.697 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.697 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.697 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.697 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:34.697 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:34.697 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.697 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.697 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.697 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:34.698 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:34.698 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.698 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.698 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.698 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:34.698 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:34.698 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.698 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.698 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.698 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:34.698 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:34.698 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.699 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.699 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.699 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:34.699 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:34.699 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.699 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.699 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.699 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:34.699 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:34.700 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.700 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.700 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.700 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:34.700 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:34.700 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.700 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.700 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.701 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:34.701 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:34.701 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.701 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.701 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.701 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:34.701 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:34.701 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.701 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.701 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.701 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:34.701 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:34.701 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.702 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.702 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.702 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.702 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.702 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:34.702 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:34.702 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 66.876129340999995, 2024-04-26T10:34:34.702 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:34.702 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.702 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.703 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.703 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.703 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.703 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:34.703 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.703 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.703 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.703 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.703 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:34.703 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.704 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.704 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.704 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.704 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:34.704 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.704 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.704 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.704 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.704 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:34.704 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.704 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.705 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.705 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.705 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:34.705 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:34.705 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.705 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.705 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.705 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:34.705 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:34.705 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.705 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.705 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.706 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:34.706 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:34.706 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.706 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.706 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.706 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:34.706 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:34.706 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.706 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:34.707 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.708 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.708 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.708 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:34.708 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:34.708 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.708 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.709 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.709 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:34.709 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:34.709 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.709 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.709 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.709 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:34.710 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:34.710 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.710 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.710 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.710 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.710 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.710 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103337 5.d 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.711 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:34.711 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.490470668, 2024-04-26T10:34:34.711 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.058853520999999999, 2024-04-26T10:34:34.711 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.711 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.711 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.711 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.712 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.712 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103337 2024-04-26T10:34:34.712 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.712 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.712 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.712 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.712 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:34.712 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.712 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.712 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.712 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.712 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188132+0000", 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6197000000000003e-05 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.713 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188144+0000", 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2001000000000001e-05 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188152+0000", 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9349999999999994e-06 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188185+0000", 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3436000000000003e-05 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.714 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.715 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188275+0000", 2024-04-26T10:34:34.715 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9995999999999997e-05 2024-04-26T10:34:34.715 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.715 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.715 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:34.715 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188365+0000", 2024-04-26T10:34:34.715 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0254999999999996e-05 2024-04-26T10:34:34.715 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.715 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.715 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.715 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.194973+0000", 2024-04-26T10:34:34.716 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066073490000000002 2024-04-26T10:34:34.716 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.716 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.716 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.716 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246781+0000", 2024-04-26T10:34:34.716 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.051808372999999998 2024-04-26T10:34:34.716 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.716 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.716 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.717 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246865+0000", 2024-04-26T10:34:34.717 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3498999999999995e-05 2024-04-26T10:34:34.717 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.717 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.717 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.717 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246920+0000", 2024-04-26T10:34:34.717 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5208999999999999e-05 2024-04-26T10:34:34.717 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.717 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.718 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.718 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.718 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.718 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.718 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:34.718 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.299838899000001, 2024-04-26T10:34:34.718 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:34.718 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.719 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.719 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.719 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.719 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.719 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:34.719 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.719 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.719 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.719 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.720 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:34.720 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.720 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.720 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.720 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.720 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:34.720 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.720 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.721 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.721 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.721 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:34.721 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.721 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.721 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.721 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.721 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:34.721 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:34.722 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.722 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.722 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.722 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:34.722 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:34.722 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.722 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.722 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.723 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:34.723 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:34.723 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.723 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.723 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.723 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:34.723 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:34.723 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.724 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.724 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.724 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:34.724 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:34.724 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.724 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.724 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.724 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:34.724 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:34.725 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.725 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.725 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.725 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:34.725 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:34.725 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.725 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.725 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.725 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:34.726 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:34.726 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.726 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.726 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.726 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:34.726 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:34.726 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.726 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:34.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:34.727 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.727 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.727 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.728 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.728 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:34.728 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.299619595000003, 2024-04-26T10:34:34.728 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:34.728 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.728 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.728 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.728 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.728 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.729 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:34.729 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.729 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.729 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.729 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.729 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:34.729 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.729 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.730 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.730 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.730 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:34.730 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.730 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.730 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.730 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.730 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:34.730 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.731 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:34.731 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:34.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:34.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:34.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.732 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:34.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:34.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:34.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:34.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:34.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:34.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.735 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.299539789999997, 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:34.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:34.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:34.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:34.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:34.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:34.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.298175759999999, 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.741 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.742 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:34.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.742 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.742 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.742 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:34.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.742 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.742 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:34.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:34.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:34.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:34.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:34.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:34.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:34.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:34.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:34.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:34.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:34.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:34.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.297581422999997, 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.747 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.748 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:34.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:34.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:34.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:34.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:34.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:34.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:34.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:34.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:34.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:34.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:34.753 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.753 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.753 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.753 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.753 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.753 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.753 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:34.753 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.296821067000003, 2024-04-26T10:34:34.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:34.753 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.753 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.753 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.754 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.754 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.754 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:34.754 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.754 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.754 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.754 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.754 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:34.754 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.754 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.754 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.754 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.754 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:34.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:34.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:34.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:34.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:34.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:34.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.757 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.757 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:34.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:34.757 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.757 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.757 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:34.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:34.757 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:34.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.296203607000002, 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:34.759 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.760 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.760 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.760 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.760 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.760 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:34.760 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.760 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.760 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.760 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.760 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:34.760 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.760 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.760 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:34.761 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.762 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.762 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.762 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:34.762 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:34.762 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.762 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.762 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.762 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:34.762 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:34.762 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.762 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.762 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.762 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:34.763 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:34.763 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.763 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.763 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.763 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:34.763 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:34.763 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.763 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.763 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:34.763 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:34.763 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:34.763 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.763 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:34.764 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.295638603999997, 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:34.765 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.766 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.767 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.768 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.769 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.295095291999999, 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:34.770 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.771 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.772 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.773 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.774 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.293623291999999, 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.775 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:34.776 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:34.777 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.778 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:34.779 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.780 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.293057871999999, 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.781 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:34.782 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:34.783 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:34.784 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.292993021999997, 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.785 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.786 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:34.786 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.786 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.786 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.786 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.786 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:34.786 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.786 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.786 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.786 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.786 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:34.786 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.786 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.787 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.787 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.787 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:34.787 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:34.787 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.787 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.787 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.787 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:34.787 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:34.787 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.787 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.787 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.787 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.788 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:34.789 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.292232042000002, 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.790 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:34.791 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:34.792 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.291210614000001, 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:34.793 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.794 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:34.794 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.794 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.794 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.794 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:34.794 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.794 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.794 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.794 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.794 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:34.794 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.794 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.794 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.795 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.796 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.796 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:34.796 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:34.796 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.796 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.796 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.796 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:34.796 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:34.796 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.796 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.796 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.796 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:34.796 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103647 5.b e32/16 ondisk, result = 0)", 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 36.291191914999999, 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060768513000000003, 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:34.798 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387344+0000", 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387350+0000", 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.22e-06 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.799 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447917+0000", 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060567523999999998 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447925+0000", 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7689999999999996e-06 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448004+0000", 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9246000000000007e-05 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:34.800 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448012+0000", 2024-04-26T10:34:34.801 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3490000000000003e-06 2024-04-26T10:34:34.801 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:34.801 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:34.801 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:34.801 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448114+0000", 2024-04-26T10:34:34.801 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010205299999999999 2024-04-26T10:34:34.801 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.801 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.801 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.801 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:34.801 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:34.801 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:34.803 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:34.803 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:34.802+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:34.846 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:34:34.846 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-26T10:34:34.846 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 55, 2024-04-26T10:34:34.846 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "6d35b773-83ef-4e54-be62-89cec0b09327", 2024-04-26T10:34:34.846 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-04-26T10:32:36.651799+0000", 2024-04-26T10:34:34.846 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-04-26T10:34:33.548954+0000", 2024-04-26T10:34:34.846 INFO:teuthology.orchestra.run.smithi043.stdout: "last_up_change": "2024-04-26T10:32:44.545583+0000", 2024-04-26T10:34:34.846 INFO:teuthology.orchestra.run.smithi043.stdout: "last_in_change": "2024-04-26T10:32:37.588200+0000", 2024-04-26T10:34:34.846 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T10:34:34.846 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_num": 5804032, 2024-04-26T10:34:34.846 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_set": [ 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "nodeep-scrub", 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "pglog_hardlimit", 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "purged_snapdirs", 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_deletes", 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "sortbitwise" 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_version": 4, 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_snapshot": "", 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_max": 5, 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd": 3, 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "require_min_compat_client": "luminous", 2024-04-26T10:34:34.847 INFO:teuthology.orchestra.run.smithi043.stdout: "min_compat_client": "luminous", 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: "require_osd_release": "reef", 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_crimson": false, 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: "pools": [ 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 1, 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": ".mgr", 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.037545+0000", 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:34.848 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 1, 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 1, 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 1, 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 1, 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 1, 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:34.849 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:34.850 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:34.851 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:34:34.852 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_max": 32, 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 1 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": {} 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 2.9900000095367432, 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 2.9900000095367432, 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 2, 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 2, 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:34.853 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 2, 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "rbd", 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.393201+0000", 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:34.854 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 8, 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 8, 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 8, 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 8, 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 8, 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:34.855 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.856 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:34:34.856 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:34.856 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:34.856 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:34.856 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:34.856 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:34.856 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:34.856 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:34.856 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:34.856 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:34.856 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:34.856 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:34.856 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:34.857 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:34.857 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:34.857 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:34.857 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:34.857 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:34.857 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:34.857 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:34.857 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:34.857 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:34.857 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:34.857 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:34.857 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:34.857 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:34.858 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd": {} 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.5, 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.5, 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.5, 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.5, 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.859 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.860 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.860 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 3, 2024-04-26T10:34:34.860 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_metadata", 2024-04-26T10:34:34.860 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:49.859710+0000", 2024-04-26T10:34:34.860 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:34.860 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:34.860 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:34.860 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:34.860 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:34.860 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:34.860 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:34.860 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:34.860 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 32, 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 32, 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 32, 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 32, 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 32, 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:34.861 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "14", 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:34.862 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:34.863 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_bias": 4, 2024-04-26T10:34:34.864 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 16, 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_priority": 5 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": "cephfs" 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:34.865 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 4, 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_data", 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:50.968196+0000", 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:34.866 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 64, 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 64, 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 64, 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 64, 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 64, 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:34.867 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:34.868 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:34.868 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:34.868 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:34.868 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.868 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "15", 2024-04-26T10:34:34.868 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:34.868 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:34.868 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:34.868 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:34.868 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:34.868 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:34.868 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:34.868 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:34.869 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:34.869 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:34.869 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:34.869 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:34.869 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:34.869 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:34.869 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:34.869 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:34.869 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:34.869 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:34.869 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:34.869 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:34.869 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:34.870 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 64, 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: "data": "cephfs" 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:34.871 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 5, 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "unique_pool_0", 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:33:15.284422+0000", 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:34:34.872 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 16, 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 16, 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 16, 2024-04-26T10:34:34.873 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 16, 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 16, 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "18", 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:34:34.874 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:34:34.875 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:34:34.876 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: "rados": {} 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 1, 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:34:34.877 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:34:34.878 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 1, 2024-04-26T10:34:34.878 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 1, 2024-04-26T10:34:34.878 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 1 2024-04-26T10:34:34.878 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.878 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.878 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:34.878 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:34:34.878 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.878 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:34:34.878 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "32399f03-8160-43f7-a69f-1db73f105676", 2024-04-26T10:34:34.878 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:34:34.878 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:34:34.878 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:34:34.879 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:34:34.879 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:34:34.879 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:34:34.879 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:34:34.879 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 49, 2024-04-26T10:34:34.879 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:34:34.879 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:34:34.879 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:34:34.879 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:34.879 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.879 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:34.879 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6800", 2024-04-26T10:34:34.879 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:34.880 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.880 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.880 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:34.880 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6801", 2024-04-26T10:34:34.880 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:34.880 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.880 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.880 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.880 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:34:34.880 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:34.880 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.880 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:34.880 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6802", 2024-04-26T10:34:34.881 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:34.881 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.881 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.881 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:34.881 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6803", 2024-04-26T10:34:34.881 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:34.881 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.881 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.881 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.881 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:34:34.881 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:34.881 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.881 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6806", 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6807", 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.882 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6804", 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6805", 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.112:6801/41771", 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.112:6803/41771", 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.112:6807/41771", 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.112:6805/41771", 2024-04-26T10:34:34.883 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:34:34.884 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:34:34.884 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:34:34.884 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.884 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.884 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.884 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:34:34.884 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "89e46a83-bfff-458f-bbac-258edb6ddad2", 2024-04-26T10:34:34.884 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:34:34.884 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:34:34.884 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:34:34.884 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:34:34.884 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 42, 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6800", 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.885 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6801", 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6802", 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.886 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6803", 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6806", 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:34.887 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6807", 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6804", 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6805", 2024-04-26T10:34:34.888 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.186:6801/41804", 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.186:6803/41804", 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.186:6807/41804", 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.186:6805/41804", 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.889 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "24c9e06d-1386-4075-b64e-d6c1d57c57bb", 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 41, 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:34.890 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6800", 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6801", 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.891 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6802", 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6803", 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:34.892 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6806", 2024-04-26T10:34:34.893 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:34.893 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.893 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.893 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:34.893 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6807", 2024-04-26T10:34:34.893 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:34.893 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.893 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.893 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.893 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:34:34.893 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:34:34.893 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.893 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6804", 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6805", 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.187:6801/41919", 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.187:6803/41919", 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.187:6807/41919", 2024-04-26T10:34:34.894 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.187:6805/41919", 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_xinfo": [ 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:34:34.895 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.579572+0000", 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.596783+0000", 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.896 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.632883+0000", 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap": [ 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: "pgid": "3.17", 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-04-26T10:34:34.897 INFO:teuthology.orchestra.run.smithi043.stdout: 2 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_items": [], 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_primaries": [], 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_temp": [], 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_temp": [], 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklist": {}, 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: "range_blocklist": {}, 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profiles": { 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: "default": { 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-failure-domain": "osd", 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: "k": "2", 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: "m": "1", 2024-04-26T10:34:34.898 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin": "jerasure", 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: "technique": "reed_sol_van" 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps_queue": [], 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: "new_removed_snaps": [], 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: "new_purged_snaps": [], 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_node_flags": {}, 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: "device_class_flags": {}, 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": { 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_enabled": false, 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_bucket_count": 0, 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: "degraded_stretch_mode": 0, 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: "recovering_stretch_mode": 0, 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_bucket": 0 2024-04-26T10:34:34.899 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:34:34.900 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-26T10:34:34.901 INFO:tasks.thrashosds.thrasher:j is {'epoch': 55, 'fsid': '6d35b773-83ef-4e54-be62-89cec0b09327', 'created': '2024-04-26T10:32:36.651799+0000', 'modified': '2024-04-26T10:34:33.548954+0000', 'last_up_change': '2024-04-26T10:32:44.545583+0000', 'last_in_change': '2024-04-26T10:32:37.588200+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:32:45.037545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:32:45.393201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:32:49.859710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:32:50.968196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-26T10:33:15.284422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '32399f03-8160-43f7-a69f-1db73f105676', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 49, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 41771}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 41771}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 41771}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 41771}]}, 'public_addr': '172.21.15.112:6801/41771', 'cluster_addr': '172.21.15.112:6803/41771', 'heartbeat_back_addr': '172.21.15.112:6807/41771', 'heartbeat_front_addr': '172.21.15.112:6805/41771', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '89e46a83-bfff-458f-bbac-258edb6ddad2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6800', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6801', 'nonce': 41804}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6802', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6803', 'nonce': 41804}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6806', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6807', 'nonce': 41804}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6804', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6805', 'nonce': 41804}]}, 'public_addr': '172.21.15.186:6801/41804', 'cluster_addr': '172.21.15.186:6803/41804', 'heartbeat_back_addr': '172.21.15.186:6807/41804', 'heartbeat_front_addr': '172.21.15.186:6805/41804', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '24c9e06d-1386-4075-b64e-d6c1d57c57bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 41919}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 41919}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 41919}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 41919}]}, 'public_addr': '172.21.15.187:6801/41919', 'cluster_addr': '172.21.15.187:6803/41919', 'heartbeat_back_addr': '172.21.15.187:6807/41919', 'heartbeat_front_addr': '172.21.15.187:6805/41919', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.579572+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.596783+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.632883+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.17', 'osds': [0, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T10:34:34.901 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-26T10:34:34.903 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:34.903+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:35.004 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:35.004+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:35.005 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:35.005 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:35.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.006 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:181810 5.1 e55/16 5:855b91fa:::benchmark_data_smithi043_45180_object47168:head v 55'11449, mlcod=55'11445)", 2024-04-26T10:34:35.006 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:34.991502+0000", 2024-04-26T10:34:35.006 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0044147509999999997, 2024-04-26T10:34:35.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0044383310000000002, 2024-04-26T10:34:35.006 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:35.006 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:35.006 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:35.006 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.006 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:35.006 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991502+0000", 2024-04-26T10:34:35.006 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:35.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991502+0000", 2024-04-26T10:34:35.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:35.007 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991502+0000", 2024-04-26T10:34:35.007 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967296 2024-04-26T10:34:35.007 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.007 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:35.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991504+0000", 2024-04-26T10:34:35.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2299999999999998e-06 2024-04-26T10:34:35.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:35.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991507+0000", 2024-04-26T10:34:35.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7769999999999998e-06 2024-04-26T10:34:35.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991509+0000", 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2529999999999999e-06 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994546+0000", 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003036581 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994563+0000", 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6841e-05 2024-04-26T10:34:35.009 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.010 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:35.010 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.010 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:181815 5.6 5:650cc241:::benchmark_data_smithi043_45180_object47173:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:34:35.010 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:34.992038+0000", 2024-04-26T10:34:35.010 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0038787359999999998, 2024-04-26T10:34:35.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0039734280000000002, 2024-04-26T10:34:35.010 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:35.010 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:35.010 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:35.010 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 181815 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992038+0000", 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992038+0000", 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992037+0000", 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992042+0000", 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9150000000000004e-06 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992055+0000", 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2608e-05 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:35.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992063+0000", 2024-04-26T10:34:35.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2640000000000008e-06 2024-04-26T10:34:35.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:35.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992105+0000", 2024-04-26T10:34:35.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1705999999999997e-05 2024-04-26T10:34:35.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:35.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992235+0000", 2024-04-26T10:34:35.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013049000000000001 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992352+0000", 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011740599999999999 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995555+0000", 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032027710000000001 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.015 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:181819 5.6 5:62f83025:::benchmark_data_smithi043_45180_object47177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:34:35.015 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:34.992082+0000", 2024-04-26T10:34:35.015 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00383476, 2024-04-26T10:34:35.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0040183980000000003, 2024-04-26T10:34:35.015 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:35.015 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:35.015 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:35.015 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:35.015 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:35.015 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 181819 2024-04-26T10:34:35.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.016 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:35.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:35.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992082+0000", 2024-04-26T10:34:35.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.016 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:35.016 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992082+0000", 2024-04-26T10:34:35.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992082+0000", 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992084+0000", 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6390000000000001e-06 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992092+0000", 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1890000000000007e-06 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992098+0000", 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3909999999999997e-06 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993960+0000", 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001861878 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994059+0000", 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9537000000000006e-05 2024-04-26T10:34:35.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994131+0000", 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1533999999999996e-05 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995773+0000", 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001641904 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:181817 5.1 e55/16 5:84d08a74:::benchmark_data_smithi043_45180_object47175:head v 55'11450, mlcod=55'11445)", 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:34.992508+0000", 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0034090790000000002, 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003651386, 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992508+0000", 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992508+0000", 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992507+0000", 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992512+0000", 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5870000000000003e-06 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992519+0000", 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9319999999999999e-06 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.992524+0000", 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4240000000000001e-06 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995826+0000", 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0033018489999999999 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:35.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995844+0000", 2024-04-26T10:34:35.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8034e-05 2024-04-26T10:34:35.023 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.023 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:35.023 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.023 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:181822 5.1 e55/16)", 2024-04-26T10:34:35.023 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:34.993712+0000", 2024-04-26T10:34:35.023 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0022045340000000002, 2024-04-26T10:34:35.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024806300000000002, 2024-04-26T10:34:35.023 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993712+0000", 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993712+0000", 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993712+0000", 2024-04-26T10:34:35.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:35.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:35.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993717+0000", 2024-04-26T10:34:35.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0200000000000002e-06 2024-04-26T10:34:35.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:35.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993725+0000", 2024-04-26T10:34:35.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.721e-06 2024-04-26T10:34:35.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:35.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993731+0000", 2024-04-26T10:34:35.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5570000000000003e-06 2024-04-26T10:34:35.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.026 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:35.026 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:181823 5.5 5:aa673f65:::benchmark_data_smithi043_45180_object47181:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:34.993972+0000", 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00194509, 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022507479999999999, 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 181823 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:35.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:35.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993972+0000", 2024-04-26T10:34:35.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:35.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993972+0000", 2024-04-26T10:34:35.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:35.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993971+0000", 2024-04-26T10:34:35.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993976+0000", 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7899999999999999e-06 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993985+0000", 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8679999999999994e-06 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993992+0000", 2024-04-26T10:34:35.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7750000000000004e-06 2024-04-26T10:34:35.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:35.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994048+0000", 2024-04-26T10:34:35.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5670000000000001e-05 2024-04-26T10:34:35.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:35.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994179+0000", 2024-04-26T10:34:35.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013125499999999999 2024-04-26T10:34:35.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994301+0000", 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121606 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:181815 5.6 e55/16)", 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:34.994321+0000", 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00159531, 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0019808880000000001, 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:35.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994321+0000", 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994321+0000", 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994321+0000", 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:35.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994325+0000", 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0470000000000004e-06 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994333+0000", 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9880000000000004e-06 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994339+0000", 2024-04-26T10:34:35.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0990000000000004e-06 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:181826 5.c 5:39bd0a02:::benchmark_data_smithi043_45180_object47184:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:34.994900+0000", 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00101677, 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014670239999999999, 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:35.034 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 181826 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994900+0000", 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994900+0000", 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994899+0000", 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994903+0000", 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7170000000000002e-06 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994911+0000", 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5279999999999998e-06 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994917+0000", 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9859999999999999e-06 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.994959+0000", 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2165e-05 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995072+0000", 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011372899999999999 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.037 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995137+0000", 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4858999999999997e-05 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:181827 5.4 e55/42 5:2ca89813:::benchmark_data_smithi043_45180_object47185:head v 55'11355, mlcod=55'11353)", 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:34.995325+0000", 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00059208100000000005, 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011026460000000001, 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:35.038 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995325+0000", 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995325+0000", 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995324+0000", 2024-04-26T10:34:35.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995328+0000", 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2390000000000004e-06 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995339+0000", 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0496000000000001e-05 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995343+0000", 2024-04-26T10:34:35.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5050000000000001e-06 2024-04-26T10:34:35.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:35.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995370+0000", 2024-04-26T10:34:35.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6336999999999999e-05 2024-04-26T10:34:35.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.041 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:35.041 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.995385+0000", 2024-04-26T10:34:35.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5599000000000001e-05 2024-04-26T10:34:35.041 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.041 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:35.041 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:181819 5.6 e55/16)", 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:34.996187+0000", 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9997296, 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000280198, 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.996187+0000", 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.996187+0000", 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.996186+0000", 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.996191+0000", 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6059999999999996e-06 2024-04-26T10:34:35.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.996203+0000", 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2384e-05 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.996210+0000", 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7739999999999999e-06 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:181830 5.a 5.44061baa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:34:35.044 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:34.996452+0000", 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9994645, 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5945000000000001e-05, 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 181830 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.996452+0000", 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.996452+0000", 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.996451+0000", 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.996456+0000", 2024-04-26T10:34:35.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.374e-06 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.996464+0000", 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7099999999999996e-06 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.996476+0000", 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1802e-05 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.048 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:181803 5.1 e55/16 5:81241edd:::benchmark_data_smithi043_45180_object47161:head v 55'11447, mlcod=55'11445)", 2024-04-26T10:34:35.048 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:34.991236+0000", 2024-04-26T10:34:35.048 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0046811650000000002, 2024-04-26T10:34:35.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0052978549999999998, 2024-04-26T10:34:35.048 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:35.048 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:35.048 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:35.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:35.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991236+0000", 2024-04-26T10:34:35.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991236+0000", 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991235+0000", 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991239+0000", 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7720000000000001e-06 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991246+0000", 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2060000000000001e-06 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991251+0000", 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8289999999999998e-06 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991288+0000", 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7558999999999997e-05 2024-04-26T10:34:35.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991308+0000", 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9834e-05 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:181807 5.1 e55/16 5:8b7ee4a6:::benchmark_data_smithi043_45180_object47165:head v 55'11448, mlcod=55'11445)", 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:34.991486+0000", 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0044307089999999997, 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051104740000000003, 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:35.051 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991486+0000", 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991486+0000", 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991486+0000", 2024-04-26T10:34:35.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967296 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991492+0000", 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9109999999999998e-06 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991495+0000", 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3390000000000001e-06 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.991498+0000", 2024-04-26T10:34:35.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3649999999999998e-06 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993044+0000", 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00154696 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:34.993064+0000", 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9355999999999999e-05 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.054 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:35.055 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:34:35.055 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 13 2024-04-26T10:34:35.055 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:35.055 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:34:35.056 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:35.105 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:35.104+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:35.205 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:35.204+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:35.206 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:35.227 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:35.246 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:35.246 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:35.247 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:34:35.247 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:34:35.247 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:35.247 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:35.248 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:35.248 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:35.248 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:35.259 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:35.306 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:35.306+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:35.407 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:35.405+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:35.466 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:35.466 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:35.477 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:35.508 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:35.508+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:35.577 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:34:35.608 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:35.608+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:35.652 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:35.652 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:35.665 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:35.709 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:35.708+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:35.810 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:35.808+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:35.846 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:35.847 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:35.859 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:35.943 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:35.941+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:36.012 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:36.011+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:36.076 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:36.076 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:36.090 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:36.114 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:36.113+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:36.214 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:36.214+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:36.265 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:36.265 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:36.279 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:36.320 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:36.320+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:36.415 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:36.414+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:36.494 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:36.494 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:36.508 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:36.516 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:36.515+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:36.565 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-26T10:34:36.617 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:36.617+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:36.691 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:36.691 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:36.707 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:36.718 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:36.718+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:36.819 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:36.818+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:36.904 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:36.904 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:36.920 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:36.921 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:36.918+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:37.021 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:37.019+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:37.118 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:37.118 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:37.121 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:37.120+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:37.134 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:37.222 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:37.220+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:37.261 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:37.323 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:37.321+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:37.328 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:37.328 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:37.344 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:37.415 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:37.423 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:37.421+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:37.435 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:37.458 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:37.460 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:37.460 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:37.460 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:37.519 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:37.519 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:37.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.519 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:188797 5.d e56/42 5:b6d07382:::benchmark_data_smithi043_45180_object54155:head v 56'11858, mlcod=56'11855)", 2024-04-26T10:34:37.519 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:37.516694+0000", 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.001709012, 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001726041, 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516694+0000", 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516694+0000", 2024-04-26T10:34:37.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516693+0000", 2024-04-26T10:34:37.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:37.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516698+0000", 2024-04-26T10:34:37.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3820000000000003e-06 2024-04-26T10:34:37.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516706+0000", 2024-04-26T10:34:37.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6569999999999997e-06 2024-04-26T10:34:37.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516711+0000", 2024-04-26T10:34:37.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6500000000000004e-06 2024-04-26T10:34:37.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516745+0000", 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4610999999999998e-05 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516759+0000", 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.341e-05 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:188800 5.1 5:8cbaf5cb:::benchmark_data_smithi043_45180_object54158:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:37.516902+0000", 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.001500992, 2024-04-26T10:34:37.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015597790000000001, 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 188800 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516902+0000", 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516902+0000", 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516901+0000", 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516906+0000", 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7270000000000004e-06 2024-04-26T10:34:37.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516919+0000", 2024-04-26T10:34:37.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2245999999999999e-05 2024-04-26T10:34:37.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516928+0000", 2024-04-26T10:34:37.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5419999999999994e-06 2024-04-26T10:34:37.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.516973+0000", 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5000999999999998e-05 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517098+0000", 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012537799999999999 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517209+0000", 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110708 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.527 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:188801 5.f 5:f5f29594:::benchmark_data_smithi043_45180_object54159:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:37.517028+0000", 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.001374351, 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001501961, 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 188801 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.528 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517028+0000", 2024-04-26T10:34:37.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517028+0000", 2024-04-26T10:34:37.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517027+0000", 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517032+0000", 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2350000000000001e-06 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517042+0000", 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.031e-05 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517049+0000", 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6159999999999998e-06 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517086+0000", 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7443e-05 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517197+0000", 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011131199999999999 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:37.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517299+0000", 2024-04-26T10:34:37.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010184 2024-04-26T10:34:37.532 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.532 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.532 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.532 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:188799 5.3 e56/16 5:c1cedd4b:::benchmark_data_smithi043_45180_object54157:head v 56'11760, mlcod=56'11758)", 2024-04-26T10:34:37.532 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:37.517753+0000", 2024-04-26T10:34:37.532 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.00064949400000000003, 2024-04-26T10:34:37.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00083191899999999997, 2024-04-26T10:34:37.532 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.532 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:37.533 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517753+0000", 2024-04-26T10:34:37.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517753+0000", 2024-04-26T10:34:37.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517753+0000", 2024-04-26T10:34:37.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:37.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517756+0000", 2024-04-26T10:34:37.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7670000000000001e-06 2024-04-26T10:34:37.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517763+0000", 2024-04-26T10:34:37.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3450000000000002e-06 2024-04-26T10:34:37.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517768+0000", 2024-04-26T10:34:37.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:34:37.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517799+0000", 2024-04-26T10:34:37.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1297999999999997e-05 2024-04-26T10:34:37.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.517816+0000", 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6838999999999999e-05 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:188806 5.2 5:42282bfc:::benchmark_data_smithi043_45180_object54164:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:37.518298+0000", 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.000104924, 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032471900000000001, 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:37.536 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:37.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:37.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:37.537 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 188806 2024-04-26T10:34:37.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.537 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.518298+0000", 2024-04-26T10:34:37.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.518298+0000", 2024-04-26T10:34:37.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.518297+0000", 2024-04-26T10:34:37.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:37.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.518302+0000", 2024-04-26T10:34:37.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1019999999999996e-06 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.518313+0000", 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1228e-05 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.518320+0000", 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2740000000000002e-06 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.518523+0000", 2024-04-26T10:34:37.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020228299999999999 2024-04-26T10:34:37.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:37.518614+0000", 2024-04-26T10:34:37.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1692000000000002e-05 2024-04-26T10:34:37.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.540 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.540 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-04-26T10:34:37.540 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 5 2024-04-26T10:34:37.540 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:37.542 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:37.542 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:37.539+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:37.642 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:37.641+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:37.743 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:37.742+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:37.754 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:34:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-04-26T10:34:37.754 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-04-26T10:34:37.755 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:37.769 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:37.844 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:37.843+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:37.947 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:37.945+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:37.949 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:34:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-04-26T10:34:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-04-26T10:34:37.949 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:35804 5.2 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.146049684999994, 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.106440911, 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 35804 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800110+0000", 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800175+0000", 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5927999999999996e-05 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800186+0000", 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.075e-05 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800195+0000", 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4999999999999999e-06 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800226+0000", 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1294000000000002e-05 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800319+0000", 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2553000000000006e-05 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.800410+0000", 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1469000000000001e-05 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.801765+0000", 2024-04-26T10:34:37.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001355249 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906486+0000", 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.104720203 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906516+0000", 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0079000000000001e-05 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:37.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:27.906551+0000", 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5811e-05 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103328 5.6 e32/16 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head v 32'6425, mlcod=32'6423)", 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.761800375999997, 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064716840999999997, 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184360+0000", 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184359+0000", 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184419+0000", 2024-04-26T10:34:37.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9345999999999997e-05 2024-04-26T10:34:37.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184425+0000", 2024-04-26T10:34:37.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1190000000000002e-06 2024-04-26T10:34:37.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184429+0000", 2024-04-26T10:34:37.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.296e-06 2024-04-26T10:34:37.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184461+0000", 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2122999999999997e-05 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184477+0000", 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5877000000000001e-05 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249048+0000", 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064570494000000006 2024-04-26T10:34:37.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249077+0000", 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9081000000000002e-05 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103327 5.c e32/16 5:3133c183:::benchmark_data_smithi043_45180_object103326:head v 32'6430, mlcod=32'6425)", 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.761633777999997, 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064984741999999998, 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.959 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184526+0000", 2024-04-26T10:34:37.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184592+0000", 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6027999999999999e-05 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184597+0000", 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8570000000000003e-06 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184600+0000", 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3390000000000001e-06 2024-04-26T10:34:37.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184620+0000", 2024-04-26T10:34:37.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9890000000000001e-05 2024-04-26T10:34:37.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.184631+0000", 2024-04-26T10:34:37.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1073999999999999e-05 2024-04-26T10:34:37.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:37.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249477+0000", 2024-04-26T10:34:37.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064845485999999994 2024-04-26T10:34:37.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:37.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.249511+0000", 2024-04-26T10:34:37.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4508000000000002e-05 2024-04-26T10:34:37.963 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.963 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.963 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.963 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103329 5.6 e32/16 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head v 32'6426, mlcod=32'6423)", 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.757799957000003, 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063744996999999998, 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188360+0000", 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188359+0000", 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188389+0000", 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9416000000000001e-05 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243409+0000", 2024-04-26T10:34:37.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.055020409999999999 2024-04-26T10:34:37.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243419+0000", 2024-04-26T10:34:37.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0071000000000001e-05 2024-04-26T10:34:37.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243465+0000", 2024-04-26T10:34:37.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5799e-05 2024-04-26T10:34:37.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243491+0000", 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5619999999999999e-05 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252067+0000", 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085763809999999992 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.252105+0000", 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8040999999999997e-05 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.967 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.968 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.968 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:103337 5.d e32/16 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head v 32'6429, mlcod=32'6427)", 2024-04-26T10:34:37.968 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:37.968 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.757729580000003, 2024-04-26T10:34:37.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.057982037, 2024-04-26T10:34:37.968 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.968 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:37.968 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:37.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188431+0000", 2024-04-26T10:34:37.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188430+0000", 2024-04-26T10:34:37.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:37.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.188500+0000", 2024-04-26T10:34:37.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0062999999999996e-05 2024-04-26T10:34:37.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243434+0000", 2024-04-26T10:34:37.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.054933760999999998 2024-04-26T10:34:37.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243442+0000", 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4139999999999994e-06 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243490+0000", 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8312000000000001e-05 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.243511+0000", 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0781999999999999e-05 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246370+0000", 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028590930000000001 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.246413+0000", 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2413000000000002e-05 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103660 5.9 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:37.972 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:37.973 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.563793935, 2024-04-26T10:34:37.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.067661676000000004, 2024-04-26T10:34:37.973 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.973 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:37.973 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:37.973 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:37.973 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:37.973 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103660 2024-04-26T10:34:37.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382366+0000", 2024-04-26T10:34:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382365+0000", 2024-04-26T10:34:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382430+0000", 2024-04-26T10:34:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4850000000000004e-05 2024-04-26T10:34:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382439+0000", 2024-04-26T10:34:37.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382445+0000", 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0229999999999998e-06 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382482+0000", 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6909000000000002e-05 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382613+0000", 2024-04-26T10:34:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013072600000000001 2024-04-26T10:34:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.382756+0000", 2024-04-26T10:34:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000143306 2024-04-26T10:34:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385090+0000", 2024-04-26T10:34:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002333786 2024-04-26T10:34:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449925+0000", 2024-04-26T10:34:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064835173999999995 2024-04-26T10:34:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.449985+0000", 2024-04-26T10:34:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0124999999999998e-05 2024-04-26T10:34:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450028+0000", 2024-04-26T10:34:37.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2457999999999999e-05 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103662 5.f 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.561350124999997, 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.068705924000000002, 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:37.979 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103662 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384810+0000", 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384809+0000", 2024-04-26T10:34:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384908+0000", 2024-04-26T10:34:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9146000000000002e-05 2024-04-26T10:34:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384921+0000", 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2622e-05 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384931+0000", 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0108e-05 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.384984+0000", 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2849000000000002e-05 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017266800000000001 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385313+0000", 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015649300000000001 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388446+0000", 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003133481 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:37.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453401+0000", 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.064955075000000001 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453462+0000", 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1134000000000001e-05 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453516+0000", 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3477999999999999e-05 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103664 5.9 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.561067440999999, 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.065076041000000001, 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103664 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385093+0000", 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385092+0000", 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385145+0000", 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3143000000000003e-05 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385156+0000", 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0473e-05 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385163+0000", 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2030000000000003e-06 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385193+0000", 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0638e-05 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385284+0000", 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599000000000005e-05 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.385375+0000", 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0606999999999995e-05 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387556+0000", 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021809529999999998 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450072+0000", 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062516408999999995 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450123+0000", 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1406000000000002e-05 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.450169+0000", 2024-04-26T10:34:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5380000000000003e-05 2024-04-26T10:34:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103666 5.f 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.559304068000003, 2024-04-26T10:34:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066830159, 2024-04-26T10:34:37.990 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103666 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386856+0000", 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386855+0000", 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386928+0000", 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386937+0000", 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1090000000000004e-06 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386945+0000", 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2749999999999998e-06 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.386981+0000", 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5899999999999998e-05 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387071+0000", 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9954e-05 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387161+0000", 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0898999999999998e-05 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390584+0000", 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0034229030000000001 2024-04-26T10:34:37.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453579+0000", 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.062994267000000007 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453640+0000", 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1162999999999997e-05 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453686+0000", 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6493999999999999e-05 2024-04-26T10:34:37.995 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:103667 5.f 5:f4dc36e8:::benchmark_data_smithi043_45180_object103666:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.558442997999997, 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.066218387000000004, 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 103667 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.996 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387717+0000", 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387783+0000", 2024-04-26T10:34:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5973e-05 2024-04-26T10:34:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387791+0000", 2024-04-26T10:34:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1850000000000004e-06 2024-04-26T10:34:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:37.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.387796+0000", 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2630000000000003e-06 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388469+0000", 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0006734 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388547+0000", 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7188999999999996e-05 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:37.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.388630+0000", 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3892000000000002e-05 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.390598+0000", 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00196759 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453803+0000", 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.063205069000000003 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453844+0000", 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1248999999999998e-05 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:33:58.453936+0000", 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1201999999999999e-05 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:107998 5.9 5:9ce23eb0:::benchmark_data_smithi043_45180_object107997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:38.001 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.450524618000003, 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025313064, 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 107998 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495636+0000", 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495634+0000", 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495754+0000", 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119893 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495769+0000", 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4769999999999999e-05 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.495781+0000", 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1858999999999999e-05 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502521+0000", 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067402410000000001 2024-04-26T10:34:38.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502675+0000", 2024-04-26T10:34:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015405099999999999 2024-04-26T10:34:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1,2", 2024-04-26T10:34:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.502846+0000", 2024-04-26T10:34:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000171001 2024-04-26T10:34:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.505743+0000", 2024-04-26T10:34:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028975490000000001 2024-04-26T10:34:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.508006+0000", 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022627620000000002 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520788+0000", 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012782244 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520846+0000", 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7976999999999997e-05 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.520949+0000", 2024-04-26T10:34:38.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102267 2024-04-26T10:34:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:108005 5.c e35/16 5:3b5c73fa:::benchmark_data_smithi043_45180_object108004:head v 35'6720, mlcod=33'6718)", 2024-04-26T10:34:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.431436781999999, 2024-04-26T10:34:38.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025223481999999998, 2024-04-26T10:34:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514723+0000", 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514766+0000", 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2818999999999998e-05 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514773+0000", 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0299999999999996e-06 2024-04-26T10:34:38.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.514777+0000", 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6199999999999998e-06 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522074+0000", 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072964029999999999 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.522096+0000", 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2027000000000001e-05 2024-04-26T10:34:38.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539924+0000", 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017827749 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:02.539947+0000", 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3232999999999999e-05 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.012 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:166165 5.7 5:ec907294:::benchmark_data_smithi043_45180_object31523:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.433361+0000", 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.5127992270000004, 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.03059839, 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 166165 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433361+0000", 2024-04-26T10:34:38.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433361+0000", 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433360+0000", 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:38.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433365+0000", 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2349999999999999e-06 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433373+0000", 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9689999999999994e-06 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.433380+0000", 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5000000000000002e-06 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:38.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.434799+0000", 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014180919999999999 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.434894+0000", 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5243999999999998e-05 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.434976+0000", 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2231000000000006e-05 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:38.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438020+0000", 2024-04-26T10:34:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003043689 2024-04-26T10:34:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439281+0000", 2024-04-26T10:34:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001261302 2024-04-26T10:34:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463901+0000", 2024-04-26T10:34:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024619458 2024-04-26T10:34:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463959+0000", 2024-04-26T10:34:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8816000000000001e-05 2024-04-26T10:34:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:166166 5.7 5:e25c7322:::benchmark_data_smithi043_45180_object31524:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.435038+0000", 2024-04-26T10:34:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.5111216760000001, 2024-04-26T10:34:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.031246537000000001, 2024-04-26T10:34:38.018 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 166166 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435038+0000", 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435038+0000", 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435038+0000", 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435042+0000", 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3800000000000004e-06 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435053+0000", 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0676000000000001e-05 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.435059+0000", 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0580000000000003e-06 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.436287+0000", 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001228593 2024-04-26T10:34:38.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.436391+0000", 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104045 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.436494+0000", 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010254799999999999 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438209+0000", 2024-04-26T10:34:38.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001714564 2024-04-26T10:34:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464023+0000", 2024-04-26T10:34:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025814664000000001 2024-04-26T10:34:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466246+0000", 2024-04-26T10:34:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022227599999999998 2024-04-26T10:34:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466285+0000", 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.909e-05 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:166169 5.c e51/16 5:3d9a2afe:::benchmark_data_smithi043_45180_object31527:head v 51'10313, mlcod=51'10309)", 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.437235+0000", 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.5089249299999992, 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026796387000000001, 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.024 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437235+0000", 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437235+0000", 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437234+0000", 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:38.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437242+0000", 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4410000000000004e-06 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437251+0000", 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1020000000000003e-06 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437258+0000", 2024-04-26T10:34:38.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0090000000000001e-06 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437292+0000", 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4455999999999997e-05 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437307+0000", 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4800999999999999e-05 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464004+0000", 2024-04-26T10:34:38.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026697591 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464032+0000", 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7144e-05 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:166175 5.3 e51/16 5:c0cd40ee:::benchmark_data_smithi043_45180_object31533:head v 51'10380, mlcod=51'10377)", 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.437538+0000", 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.5086225740000003, 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026367978, 2024-04-26T10:34:38.028 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437538+0000", 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437538+0000", 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:38.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437537+0000", 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437542+0000", 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4410000000000003e-06 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437549+0000", 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6739999999999997e-06 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437555+0000", 2024-04-26T10:34:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6119999999999998e-06 2024-04-26T10:34:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437598+0000", 2024-04-26T10:34:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3417000000000001e-05 2024-04-26T10:34:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.437616+0000", 2024-04-26T10:34:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7651000000000001e-05 2024-04-26T10:34:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439302+0000", 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016857809999999999 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463906+0000", 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024603861000000001 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:166176 5.c e51/16 5:3df338d2:::benchmark_data_smithi043_45180_object31534:head v 51'10314, mlcod=51'10310)", 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.438991+0000", 2024-04-26T10:34:38.032 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.5071692750000008, 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025419694, 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438991+0000", 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438991+0000", 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438990+0000", 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.438995+0000", 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.921e-06 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439004+0000", 2024-04-26T10:34:38.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.833e-06 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439009+0000", 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2209999999999996e-06 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439033+0000", 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4043999999999999e-05 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:38.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439049+0000", 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6082999999999998e-05 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464388+0000", 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025338270999999999 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464411+0000", 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2841e-05 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop_reply(client.4538.0:166166 5.7 e51/16 ondisk, result = 0)", 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.439292+0000", 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.5068685290000001, 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026999493999999999, 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439292+0000", 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439292+0000", 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439291+0000", 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439294+0000", 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.852e-06 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439302+0000", 2024-04-26T10:34:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8979999999999996e-06 2024-04-26T10:34:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439308+0000", 2024-04-26T10:34:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9410000000000004e-06 2024-04-26T10:34:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:38.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464010+0000", 2024-04-26T10:34:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02470224 2024-04-26T10:34:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464017+0000", 2024-04-26T10:34:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3420000000000002e-06 2024-04-26T10:34:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466291+0000", 2024-04-26T10:34:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002273635 2024-04-26T10:34:38.040 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4538.0:166180 5.2 5:4fb08ef8:::benchmark_data_smithi043_45180_object31538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.439326+0000", 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.5068338509999997, 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.027447910999999998, 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4538", 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.041 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 166180 2024-04-26T10:34:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439326+0000", 2024-04-26T10:34:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439326+0000", 2024-04-26T10:34:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439325+0000", 2024-04-26T10:34:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.999999 2024-04-26T10:34:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.439329+0000", 2024-04-26T10:34:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.76e-06 2024-04-26T10:34:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:38.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463882+0000", 2024-04-26T10:34:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024552416000000001 2024-04-26T10:34:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463895+0000", 2024-04-26T10:34:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3286e-05 2024-04-26T10:34:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463938+0000", 2024-04-26T10:34:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2892999999999997e-05 2024-04-26T10:34:38.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464092+0000", 2024-04-26T10:34:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153731 2024-04-26T10:34:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464233+0000", 2024-04-26T10:34:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014117900000000001 2024-04-26T10:34:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466687+0000", 2024-04-26T10:34:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024545510000000001 2024-04-26T10:34:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-04-26T10:34:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466695+0000", 2024-04-26T10:34:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5959999999999998e-06 2024-04-26T10:34:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466734+0000", 2024-04-26T10:34:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8688e-05 2024-04-26T10:34:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.466774+0000", 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0661000000000003e-05 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4538.0:166190 5.d e51/42 5:b85cf01f:::benchmark_data_smithi043_45180_object31548:head v 51'10424, mlcod=51'10422)", 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-04-26T10:34:29.443282+0000", 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 8.5028782159999992, 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026511429999999999, 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-04-26T10:34:38.047 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.443282+0000", 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.443282+0000", 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-04-26T10:34:38.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.443281+0000", 2024-04-26T10:34:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-04-26T10:34:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.443287+0000", 2024-04-26T10:34:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0850000000000002e-06 2024-04-26T10:34:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-04-26T10:34:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463882+0000", 2024-04-26T10:34:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020594057999999998 2024-04-26T10:34:38.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463891+0000", 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8700000000000004e-06 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.463998+0000", 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010639 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.464019+0000", 2024-04-26T10:34:38.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0767e-05 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.469760+0000", 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057416230000000004 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-04-26T10:34:29.469793+0000", 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3210000000000002e-05 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-04-26T10:34:38.051 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:34:38.053 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:38.051+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:38.053 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:38.154 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:38.152+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:38.228 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:38.228 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:38.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.229 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:190845 5.b 5:d2d1b57e:::benchmark_data_smithi043_45180_object56203:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:38.229 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:38.222745+0000", 2024-04-26T10:34:38.229 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0044136310000000003, 2024-04-26T10:34:38.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0044349080000000004, 2024-04-26T10:34:38.229 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.229 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:38.229 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.229 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.229 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.229 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 190845 2024-04-26T10:34:38.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.229 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222745+0000", 2024-04-26T10:34:38.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222745+0000", 2024-04-26T10:34:38.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222744+0000", 2024-04-26T10:34:38.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222748+0000", 2024-04-26T10:34:38.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.754e-06 2024-04-26T10:34:38.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222756+0000", 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9170000000000006e-06 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222761+0000", 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7790000000000003e-06 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222791+0000", 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0108e-05 2024-04-26T10:34:38.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222877+0000", 2024-04-26T10:34:38.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6272000000000003e-05 2024-04-26T10:34:38.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222948+0000", 2024-04-26T10:34:38.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0970000000000007e-05 2024-04-26T10:34:38.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.224469+0000", 2024-04-26T10:34:38.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001521143 2024-04-26T10:34:38.234 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.234 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.234 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.234 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:190846 5.0 5:0ef1d988:::benchmark_data_smithi043_45180_object56204:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:38.234 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:38.222767+0000", 2024-04-26T10:34:38.234 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0043914729999999999, 2024-04-26T10:34:38.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0044667320000000002, 2024-04-26T10:34:38.234 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.234 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 190846 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222767+0000", 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222767+0000", 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222767+0000", 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222769+0000", 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2639999999999998e-06 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222775+0000", 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:34:38.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222780+0000", 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2889999999999997e-06 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.222977+0000", 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000196379 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.223056+0000", 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9210999999999998e-05 2024-04-26T10:34:38.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.223129+0000", 2024-04-26T10:34:38.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3397000000000002e-05 2024-04-26T10:34:38.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.224631+0000", 2024-04-26T10:34:38.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015017640000000001 2024-04-26T10:34:38.238 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.238 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:190851 5.0 5:0ab30c4b:::benchmark_data_smithi043_45180_object56209:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:38.225761+0000", 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0013971490000000001, 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015184739999999999, 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 190851 2024-04-26T10:34:38.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225761+0000", 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225761+0000", 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225761+0000", 2024-04-26T10:34:38.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225765+0000", 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5879999999999999e-06 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225773+0000", 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0420000000000003e-06 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225796+0000", 2024-04-26T10:34:38.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2566999999999999e-05 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225843+0000", 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6650999999999998e-05 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225963+0000", 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012053900000000001 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226078+0000", 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114417 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:190852 5.d 5:bae611e6:::benchmark_data_smithi043_45180_object56210:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:38.225802+0000", 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0013560989999999999, 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015295040000000001, 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.243 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 190852 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225802+0000", 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225802+0000", 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225802+0000", 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225804+0000", 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.734e-06 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225808+0000", 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7960000000000002e-06 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225811+0000", 2024-04-26T10:34:38.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2090000000000001e-06 2024-04-26T10:34:38.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225849+0000", 2024-04-26T10:34:38.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8544000000000002e-05 2024-04-26T10:34:38.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225980+0000", 2024-04-26T10:34:38.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000130953 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226117+0000", 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013702000000000001 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:190853 5.8 5:19ff5b1c:::benchmark_data_smithi043_45180_object56211:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:38.225815+0000", 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00134362, 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015648280000000001, 2024-04-26T10:34:38.247 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 190853 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225815+0000", 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225815+0000", 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225815+0000", 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225816+0000", 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.525e-06 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225820+0000", 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8039999999999999e-06 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225823+0000", 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7369999999999998e-06 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225862+0000", 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8813999999999998e-05 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.225982+0000", 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120606 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226097+0000", 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114373 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:190837 5.0 e56/42)", 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:38.226060+0000", 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0010987519999999999, 2024-04-26T10:34:38.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013589380000000001, 2024-04-26T10:34:38.252 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.252 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:38.252 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226060+0000", 2024-04-26T10:34:38.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226060+0000", 2024-04-26T10:34:38.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226059+0000", 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226062+0000", 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9900000000000002e-06 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226068+0000", 2024-04-26T10:34:38.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4979999999999997e-06 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226072+0000", 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8089999999999999e-06 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:190854 5.a e56/16 5:59bb5a8d:::benchmark_data_smithi043_45180_object56212:head v 56'12062, mlcod=56'12060)", 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:38.226076+0000", 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001082354, 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013711769999999999, 2024-04-26T10:34:38.254 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226076+0000", 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226076+0000", 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226076+0000", 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967296 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226079+0000", 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7480000000000002e-06 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226082+0000", 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2229999999999999e-06 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226089+0000", 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1289999999999998e-06 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226124+0000", 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.472e-05 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226143+0000", 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9470000000000002e-05 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.257 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:190849 5.f e56/41 5:f964fdea:::benchmark_data_smithi043_45180_object56207:head v 56'11617, mlcod=56'11615)", 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:38.226102+0000", 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0010561940000000001, 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013800609999999999, 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226102+0000", 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226102+0000", 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226102+0000", 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226106+0000", 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2390000000000004e-06 2024-04-26T10:34:38.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226114+0000", 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9680000000000006e-06 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226119+0000", 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0200000000000002e-06 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226160+0000", 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1239000000000003e-05 2024-04-26T10:34:38.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.226176+0000", 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5506999999999999e-05 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:190837 5.0 5:093571fe:::benchmark_data_smithi043_45180_object56195:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:38.220748+0000", 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0064104970000000002, 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0067688000000000002, 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.261 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 190837 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.220748+0000", 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.220748+0000", 2024-04-26T10:34:38.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.220748+0000", 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.220751+0000", 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0599999999999999e-06 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.220757+0000", 2024-04-26T10:34:38.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1040000000000003e-06 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.220760+0000", 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7000000000000002e-06 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.220792+0000", 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1828000000000001e-05 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.220911+0000", 2024-04-26T10:34:38.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011828 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.221017+0000", 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000106555 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:38.224368+0000", 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0033513219999999999 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:34:38.265 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 9 2024-04-26T10:34:38.266 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:38.267 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:38.267 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:38.265+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:38.368 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:38.367+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:38.468 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:38.467+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:38.482 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:38.482 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:38.482 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:38.482 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:38.482 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:38.497 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:38.569 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:38.568+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:38.577 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:34:38.670 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:38.668+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:38.709 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:38.709 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:38.709 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:38.709 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:38.709 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.709 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:38.709 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:38.709 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 70.906069512000002, 2024-04-26T10:34:38.709 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:38.709 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.709 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.709 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.709 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.710 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.710 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:38.710 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.710 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.710 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.710 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.710 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:38.710 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.710 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.710 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.710 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.710 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:38.710 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:38.711 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:38.712 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:38.713 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.714 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 70.905241431999997, 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.715 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.716 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:38.717 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:38.718 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:38.719 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 70.904312368999996, 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.720 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.721 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:38.722 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:38.723 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:38.724 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:38.725 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:38.726 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 70.903626927999994, 2024-04-26T10:34:38.726 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:38.726 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.726 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.726 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.726 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.726 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.726 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:38.726 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.726 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.726 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.726 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.726 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.728 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:38.729 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:38.730 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103337 5.d 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.517968255, 2024-04-26T10:34:38.731 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.058853520999999999, 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103337 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.732 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188132+0000", 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6197000000000003e-05 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188144+0000", 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2001000000000001e-05 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188152+0000", 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9349999999999994e-06 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188185+0000", 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3436000000000003e-05 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.734 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188275+0000", 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9995999999999997e-05 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188365+0000", 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0254999999999996e-05 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.194973+0000", 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066073490000000002 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246781+0000", 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.051808372999999998 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246865+0000", 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3498999999999995e-05 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246920+0000", 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5208999999999999e-05 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.327336486, 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:38.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:38.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:38.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.327117182000002, 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:38.742 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.744 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.747 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.327037377000003, 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.748 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:38.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:38.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:38.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:38.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:38.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:38.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:38.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:38.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:38.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:38.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:38.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:38.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.753 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.325673346999999, 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.754 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.757 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:38.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:38.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:38.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:38.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.758 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.758 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:38.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:38.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.325079010000003, 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.759 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.760 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:38.761 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.761 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.761 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.761 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.761 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:38.761 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.761 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.761 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.761 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.761 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:38.761 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:38.761 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.761 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.762 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.762 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:38.762 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:38.762 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.762 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.762 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.762 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:38.762 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:38.762 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.762 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.762 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.762 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:38.762 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:38.763 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.763 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.763 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.763 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:38.763 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:38.763 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.763 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.763 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.763 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:38.763 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:38.763 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.763 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.763 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.764 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.324318654000002, 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.765 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:38.766 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:38.767 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.768 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.769 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.770 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.323701194000002, 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.771 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.772 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:38.773 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:38.774 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:38.775 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.323136191000003, 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:38.776 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.777 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:38.778 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.778 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.778 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.778 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.778 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:38.778 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:38.778 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.778 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.778 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.778 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:38.778 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:38.778 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.778 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.779 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:38.780 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.322592878999998, 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.781 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:38.782 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:38.783 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:38.784 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:38.785 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.321120878999999, 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:38.786 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.787 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.788 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.789 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.790 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:38.790 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:38.790 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:38.790 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.790 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.790 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:38.790 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:38.790 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:38.790 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.790 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.790 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:38.790 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:38.790 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.791 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.320555458999998, 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.792 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.793 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:38.794 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:38.795 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.320490608999997, 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.796 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.797 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:38.798 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:38.799 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.319729629000001, 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.800 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:38.801 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:38.802 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:38.803 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.318708201, 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.804 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.805 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.806 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.807 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103647 5.b e32/16 ondisk, result = 0)", 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 40.318689501999998, 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060768513000000003, 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:38.808 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387344+0000", 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:38.809 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.810 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.810 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:38.810 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387350+0000", 2024-04-26T10:34:38.810 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.22e-06 2024-04-26T10:34:38.810 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.810 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.810 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:38.810 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447917+0000", 2024-04-26T10:34:38.810 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060567523999999998 2024-04-26T10:34:38.810 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.810 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.810 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:38.810 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447925+0000", 2024-04-26T10:34:38.811 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7689999999999996e-06 2024-04-26T10:34:38.811 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.811 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.811 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:38.811 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448004+0000", 2024-04-26T10:34:38.811 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9246000000000007e-05 2024-04-26T10:34:38.811 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.811 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.813 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:38.813 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448012+0000", 2024-04-26T10:34:38.813 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3490000000000003e-06 2024-04-26T10:34:38.813 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:38.813 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:38.813 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:38.813 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448114+0000", 2024-04-26T10:34:38.814 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010205299999999999 2024-04-26T10:34:38.814 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.814 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.814 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.814 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:38.814 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:38.814 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:38.816 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:38.816 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:38.815+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:38.916 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:38.915+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:39.007 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:39.007 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:39.007 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.007 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:193071 5.2 e56/16 5:4dac57f5:::benchmark_data_smithi043_45180_object58429:head v 56'12191, mlcod=56'12183)", 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:38.999315+0000", 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0057468099999999998, 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0057669369999999998, 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:38.999315+0000", 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:38.999315+0000", 2024-04-26T10:34:39.008 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:38.999314+0000", 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:38.999322+0000", 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2320000000000004e-06 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.009 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:38.999329+0000", 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1679999999999998e-06 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:38.999335+0000", 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.088e-06 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.001466+0000", 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021307819999999999 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.010 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.001483+0000", 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7265000000000002e-05 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005079+0000", 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035959609999999999 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:193074 5.5 5:a99a5ad4:::benchmark_data_smithi043_45180_object58432:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:39.011 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:39.001681+0000", 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.003381247, 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003487104, 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 193074 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.001681+0000", 2024-04-26T10:34:39.012 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.001681+0000", 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.001679+0000", 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.001685+0000", 2024-04-26T10:34:39.013 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2630000000000003e-06 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.001696+0000", 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0803e-05 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.001702+0000", 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8580000000000002e-06 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.014 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.001749+0000", 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.001878+0000", 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012925299999999999 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.001991+0000", 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000113225 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.015 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003711+0000", 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017192959999999999 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:193076 5.6 5:64b55948:::benchmark_data_smithi043_45180_object58434:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:39.002469+0000", 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0025926640000000002, 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027984720000000002, 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.016 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 193076 2024-04-26T10:34:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002469+0000", 2024-04-26T10:34:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002469+0000", 2024-04-26T10:34:39.017 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002469+0000", 2024-04-26T10:34:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002472+0000", 2024-04-26T10:34:39.018 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1999999999999999e-06 2024-04-26T10:34:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002480+0000", 2024-04-26T10:34:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9480000000000008e-06 2024-04-26T10:34:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002485+0000", 2024-04-26T10:34:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9030000000000003e-06 2024-04-26T10:34:39.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002515+0000", 2024-04-26T10:34:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0550999999999999e-05 2024-04-26T10:34:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002593+0000", 2024-04-26T10:34:39.020 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7464000000000002e-05 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002661+0000", 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8870999999999998e-05 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:193075 5.e e56/16 5:7cbc7af7:::benchmark_data_smithi043_45180_object58433:head v 56'11997, mlcod=56'11995)", 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:39.002748+0000", 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0023133260000000001, 2024-04-26T10:34:39.021 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026037529999999999, 2024-04-26T10:34:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002748+0000", 2024-04-26T10:34:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002748+0000", 2024-04-26T10:34:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002748+0000", 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002753+0000", 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1460000000000004e-06 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002762+0000", 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0659999999999993e-06 2024-04-26T10:34:39.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002768+0000", 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9200000000000001e-06 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002804+0000", 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6327e-05 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002829+0000", 2024-04-26T10:34:39.024 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4672999999999999e-05 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:193077 5.b e56/42 5:d5ebc4e3:::benchmark_data_smithi043_45180_object58435:head v 56'12215, mlcod=56'12213)", 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:39.002778+0000", 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.002283598, 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026688530000000001, 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.025 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002778+0000", 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002778+0000", 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002778+0000", 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.026 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002781+0000", 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.54e-06 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002787+0000", 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1580000000000004e-06 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002791+0000", 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9400000000000004e-06 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.027 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002853+0000", 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2552999999999996e-05 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.002874+0000", 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.048e-05 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:193078 5.3 5:c9eb411f:::benchmark_data_smithi043_45180_object58436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:39.028 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:39.003440+0000", 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0016215240000000001, 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0020739539999999998, 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 193078 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003440+0000", 2024-04-26T10:34:39.029 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003440+0000", 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003440+0000", 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003444+0000", 2024-04-26T10:34:39.030 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2019999999999997e-06 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003453+0000", 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.4890000000000001e-06 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003460+0000", 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9959999999999996e-06 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.031 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003666+0000", 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000205732 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003774+0000", 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010772600000000001 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003870+0000", 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.6403000000000005e-05 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:193081 5.6 5:65b6547f:::benchmark_data_smithi043_45180_object58439:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:39.003587+0000", 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0014744039999999999, 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002003594, 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 193081 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.033 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003587+0000", 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003587+0000", 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003587+0000", 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.034 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003590+0000", 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5880000000000002e-06 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003598+0000", 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.199e-06 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003604+0000", 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8619999999999999e-06 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.035 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.004240+0000", 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00063619600000000001 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.004309+0000", 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9309999999999999e-05 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.004370+0000", 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0606000000000002e-05 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.036 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:193082 5.a 5:556df1ba:::benchmark_data_smithi043_45180_object58440:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:39.003608+0000", 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001453478, 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002064677, 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 193082 2024-04-26T10:34:39.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003608+0000", 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003608+0000", 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003608+0000", 2024-04-26T10:34:39.038 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003610+0000", 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8870000000000001e-06 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003615+0000", 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1789999999999999e-06 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003619+0000", 2024-04-26T10:34:39.039 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2810000000000002e-06 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005100+0000", 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0014805389999999999 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005221+0000", 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000120862 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005335+0000", 2024-04-26T10:34:39.040 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114024 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:193086 5.c 5:332d1b27:::benchmark_data_smithi043_45180_object58444:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:39.005092+0000", 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.99997, 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00065713399999999997, 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.041 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 193086 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005092+0000", 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005092+0000", 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.042 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005091+0000", 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005097+0000", 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9490000000000001e-06 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005108+0000", 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1481000000000001e-05 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.043 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005117+0000", 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7110000000000001e-06 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005155+0000", 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8005e-05 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005265+0000", 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010993300000000001 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.044 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005366+0000", 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000101203 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:193066 5.a e56/16)", 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:39.005172+0000", 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9998894, 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00065642200000000004, 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:39.045 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005172+0000", 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005172+0000", 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005172+0000", 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.046 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005176+0000", 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7759999999999999e-06 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005183+0000", 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3320000000000003e-06 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005188+0000", 2024-04-26T10:34:39.047 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3909999999999997e-06 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:193084 5.8 e56/16 5:1304c98d:::benchmark_data_smithi043_45180_object58442:head v 56'12268, mlcod=56'12266)", 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:39.005195+0000", 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9998665, 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00068340800000000004, 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.048 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005195+0000", 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005195+0000", 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005195+0000", 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.049 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005199+0000", 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0810000000000004e-06 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005205+0000", 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7980000000000002e-06 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005210+0000", 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4819999999999996e-06 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.050 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005262+0000", 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2966000000000001e-05 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005282+0000", 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9533000000000001e-05 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:193088 5.6 5:631dfe0a:::benchmark_data_smithi043_45180_object58446:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:39.005386+0000", 2024-04-26T10:34:39.051 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9996758, 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00055487199999999998, 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 193088 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005386+0000", 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.052 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005386+0000", 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005386+0000", 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005390+0000", 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0110000000000002e-06 2024-04-26T10:34:39.053 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005398+0000", 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005405+0000", 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2199999999999997e-06 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005904+0000", 2024-04-26T10:34:39.054 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00049955699999999997 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:193083 5.b e56/42 5:d0be77f3:::benchmark_data_smithi043_45180_object58441:head v 56'12216, mlcod=56'12213)", 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:39.005465+0000", 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9995966, 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00054243200000000003, 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.055 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005465+0000", 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005465+0000", 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005465+0000", 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.056 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005469+0000", 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8709999999999996e-06 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005477+0000", 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.447e-06 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005482+0000", 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2909999999999998e-06 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.057 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005535+0000", 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2469999999999997e-05 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.005554+0000", 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9165999999999999e-05 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:193085 5.8 e56/16)", 2024-04-26T10:34:39.058 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:39.006032+0000", 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9990296, 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3624000000000002e-05, 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.006032+0000", 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.006032+0000", 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.006032+0000", 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.006040+0000", 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3289999999999994e-06 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.006054+0000", 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3882e-05 2024-04-26T10:34:39.060 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.006060+0000", 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1759999999999998e-06 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:193066 5.a 5:5495817f:::benchmark_data_smithi043_45180_object58424:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:38.996861+0000", 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0082004950000000004, 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0092613450000000007, 2024-04-26T10:34:39.061 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 193066 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:38.996861+0000", 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.062 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:38.996861+0000", 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:38.996861+0000", 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:38.996864+0000", 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.534e-06 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.063 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:38.996871+0000", 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0999999999999998e-06 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:38.996877+0000", 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3090000000000003e-06 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003185+0000", 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0063083820000000004 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.064 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003281+0000", 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.5716000000000003e-05 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:39.003350+0000", 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.9350000000000005e-05 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 15 2024-04-26T10:34:39.065 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:39.067 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:39.068 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:39.066+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:39.167 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:39.165+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:39.265 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:39.265 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:39.265 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:34:39.265 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:34:39.265 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:39.268 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:39.267+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:39.280 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:39.369 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:39.368+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:39.471 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:39.469+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:39.471 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:34:39.480 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:39.480 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.677499381999993, 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:39.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:39.486 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.677498396999994, 2024-04-26T10:34:39.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:39.487 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.487 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.487 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:39.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:39.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:39.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:39.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.677429774000004, 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:39.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:39.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:39.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:39.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:39.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:39.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:39.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.677377993999997, 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.496 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:39.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:39.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:39.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:39.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:39.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:39.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:39.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:39.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:39.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:39.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:39.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:39.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:39.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:39.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:39.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:39.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:39.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:39.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:39.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:39.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:39.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:39.505 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.505 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.506 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.506 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:39.506 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:39.507 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.677318143999997, 2024-04-26T10:34:39.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:39.507 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.507 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.507 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.507 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.507 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.508 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:39.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.508 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:39.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.509 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.509 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:39.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:39.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:39.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:39.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:39.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:39.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:39.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:39.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:39.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:39.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:39.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:39.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:39.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:39.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:39.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:39.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:39.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:39.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:39.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:39.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:39.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:39.518 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.518 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.518 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.519 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:39.519 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:39.519 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.675605439999998, 2024-04-26T10:34:39.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:39.520 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.520 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.520 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.520 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.520 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.520 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:39.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.521 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:39.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:39.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:39.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:39.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:39.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:39.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:39.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:39.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:39.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:39.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:39.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:39.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:39.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:39.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:39.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:39.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:39.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:39.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.675490373000002, 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.530 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:39.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:39.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:39.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.675397232999998, 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:39.534 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.539 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.675203073000006, 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.543 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.673995704999996, 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:39.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:39.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.547 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.673186797, 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:39.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:39.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.673083258999995, 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.553 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:39.558 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.673006385999997, 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:39.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:39.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:39.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:39.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 71.672891002, 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 41.296246949, 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:39.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 41.294217101000001, 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.573 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.575 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:39.578 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 41.293741298, 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:39.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.580 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.580 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.580 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.580 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:39.580 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.581 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:39.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:39.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:39.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:39.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.582 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.582 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:39.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:39.582 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:39.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.585 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:39.585 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:39.585 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 41.291774244000003, 2024-04-26T10:34:39.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:39.585 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.585 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.585 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.585 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.585 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.585 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:39.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.586 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:39.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:39.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:39.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:39.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:39.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:39.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:39.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:39.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:39.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:39.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:39.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:39.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:39.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:39.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:39.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:39.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:39.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:39.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:39.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:39.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:39.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103336 5.6 5:6c0cef20:::benchmark_data_smithi043_45180_object103335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 41.289664938999998, 2024-04-26T10:34:39.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064107786, 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103336 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188502+0000", 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188540+0000", 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8445000000000002e-05 2024-04-26T10:34:39.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.594 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.594 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188553+0000", 2024-04-26T10:34:39.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2768e-05 2024-04-26T10:34:39.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.594 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.594 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188563+0000", 2024-04-26T10:34:39.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9760000000000007e-06 2024-04-26T10:34:39.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191877+0000", 2024-04-26T10:34:39.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003313908 2024-04-26T10:34:39.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192004+0000", 2024-04-26T10:34:39.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012663 2024-04-26T10:34:39.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192143+0000", 2024-04-26T10:34:39.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013964199999999999 2024-04-26T10:34:39.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.596 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.596 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.196467+0000", 2024-04-26T10:34:39.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043232230000000002 2024-04-26T10:34:39.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.596 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.596 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252539+0000", 2024-04-26T10:34:39.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056072085000000001 2024-04-26T10:34:39.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252577+0000", 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8730999999999999e-05 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252611+0000", 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3769000000000001e-05 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.597 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:39.598 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:39.598 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 41.289106506000003, 2024-04-26T10:34:39.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:39.598 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:39.598 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:39.598 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:39.598 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:39.598 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:39.598 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:39.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.598 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:39.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:39.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:39.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:39.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:39.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:39.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:39.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:39.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:39.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:39.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:39.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:39.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:39.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:39.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:39.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:39.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:39.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:39.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:39.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:39.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:39.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:39.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:39.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:39.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:39.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:39.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:39.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:39.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:39.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:39.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:39.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:39.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:39.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:39.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:39.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:39.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:39.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:39.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:39.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:39.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:39.603 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.604 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.604 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.604 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:39.604 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:39.604 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:39.605 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:34:39.603+0000 7f86b1add700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 41769) UID: 0 2024-04-26T10:34:39.606 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-26T10:34:39.607 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:34:39.626 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:39.647 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:39.671 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:39.672 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:39.708 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:39.706+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:39.782 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:39.782 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:39.797 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:34:39.806 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:39.805+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:39.902 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:34:39.902 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:34:39.903 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2024-04-26T10:34:39.903 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T10:34:39.903 INFO:teuthology.orchestra.console.smithi112:Power off 2024-04-26T10:34:39.903 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T10:34:39.914 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:39.913+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:39.930 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2024-04-26T10:34:39.931 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:34:39.955 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-04-26T10:34:39.973 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:39.973 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:39.987 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:34:40.016 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:40.015+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:40.115 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:40.114+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:40.161 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:40.161 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:40.175 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:40.220 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:40.219+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:40.316 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:40.315+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:40.366 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:40.366 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:40.381 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:40.422 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:40.421+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:40.519 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:40.517+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:40.608 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:40.608 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:40.620 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:40.619+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:40.622 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:40.721 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:40.719+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:40.822 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:40.820+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:40.865 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:40.865 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:40.874 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:40.923 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:40.922+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:41.026 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:41.025+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:41.055 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:41.055 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:41.068 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:41.125 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:41.124+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:41.226 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:41.225+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:41.242 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:41.242 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:41.254 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:41.329 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:41.326+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:41.428 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:41.428+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:41.433 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:41.433 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:41.448 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:41.530 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:41.528+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:41.608 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:34:41.631 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:41.630+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:41.642 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:41.642 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:41.660 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:41.684 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:41.731 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:41.730+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:41.832 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:41.831+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:41.841 INFO:teuthology.orchestra.run.smithi043.stdout:osd.0: {} 2024-04-26T10:34:41.859 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:41.859 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:41.861 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:41.875 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:41.881 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:41.883 INFO:teuthology.orchestra.run.smithi043.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:34:41.883 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:41.883 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:41.933 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:41.932+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:42.038 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:42.035+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:42.071 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:42.072 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:42.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:42.072 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:42.072 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.072 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:42.072 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:42.072 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.266937467999995, 2024-04-26T10:34:42.072 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:42.073 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.073 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.073 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.073 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.073 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.073 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:42.073 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.073 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:42.074 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.074 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.074 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.074 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.074 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:42.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.075 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.075 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:42.075 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.075 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.075 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:42.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:42.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.076 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.076 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.076 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:42.076 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:42.076 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.077 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.077 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.077 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:42.077 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:42.077 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:42.078 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:42.078 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.078 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.078 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.078 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:42.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:42.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.079 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.079 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:42.079 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:42.079 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.079 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:42.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:42.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.080 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:42.080 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:42.080 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.080 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.080 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:42.081 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:42.082 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.266936482999995, 2024-04-26T10:34:42.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:42.082 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.082 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.082 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:42.082 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.082 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.082 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.082 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.082 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:42.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:42.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.083 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.083 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.083 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:42.083 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:42.083 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:42.084 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.085 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.266867860000005, 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.086 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.087 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.087 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:42.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.087 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.087 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:42.087 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.087 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.087 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.087 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:42.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:42.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.088 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.088 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.088 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:42.088 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:42.088 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:42.089 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:42.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:42.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:42.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.090 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:42.090 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:42.090 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.090 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.090 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.091 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.266816079999998, 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.092 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.093 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:42.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:42.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.094 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.094 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:42.094 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:42.094 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.094 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:42.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:42.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:42.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:42.095 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.095 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.095 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.095 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:42.095 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:42.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.097 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.097 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.097 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:42.097 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:42.097 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.098 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:42.098 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:42.098 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.098 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.098 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:42.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:42.099 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.099 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.099 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.099 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:42.099 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:42.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.100 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.100 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.100 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:42.100 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:42.100 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.101 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.101 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.101 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:42.101 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:42.101 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.102 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.102 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.102 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.102 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.102 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:42.102 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:42.103 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.266756229999999, 2024-04-26T10:34:42.103 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:42.103 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.103 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.103 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.103 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.103 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.103 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:42.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.104 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.104 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.104 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.104 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:42.104 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.104 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.105 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.105 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:42.105 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.105 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.105 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.106 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:42.106 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.106 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.106 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.106 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:42.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:42.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.107 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.107 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.107 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:42.107 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:42.107 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:42.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:42.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:42.108 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:42.108 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.108 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.108 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.108 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.109 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:42.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:42.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:42.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:42.110 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.110 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.110 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.110 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:42.110 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.265043525999999, 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.111 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.112 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.113 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:42.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:42.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:42.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:42.114 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.114 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.114 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.114 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:42.114 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:42.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:42.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:42.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:42.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.115 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:42.115 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:42.115 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.115 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.115 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.116 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.264928459000004, 2024-04-26T10:34:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:42.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:42.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:42.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:42.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.264835318999999, 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:42.121 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.122 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.122 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.122 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.122 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.122 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:42.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.122 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:42.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:42.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:42.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:42.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:42.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:42.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:42.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:42.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:42.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:42.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:42.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:42.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:42.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:42.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:42.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:42.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.264641159000007, 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:42.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:42.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:42.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.263433790999997, 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:42.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:42.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:42.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:42.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:42.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:42.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:42.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:42.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:42.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:42.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:42.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:42.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.262624883000001, 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.137 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.138 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.138 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.138 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.138 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:42.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.138 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:42.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:42.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:42.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:42.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:42.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:42.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:42.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:42.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:42.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:42.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:42.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:42.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:42.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.262521344999996, 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:42.143 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.144 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.144 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.144 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.144 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.144 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:42.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.144 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:42.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:42.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:42.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:42.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:42.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:42.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:42.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:42.149 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.149 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.149 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.149 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:42.149 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:42.149 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.262444471999999, 2024-04-26T10:34:42.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:42.149 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.149 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:42.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:42.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:42.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:42.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:42.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:42.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:42.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:42.155 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.155 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.155 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.155 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:42.155 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:42.155 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 74.262329088000001, 2024-04-26T10:34:42.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:42.156 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.156 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:42.156 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:42.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:42.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:42.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:42.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:42.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:42.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:42.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.159 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:42.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:42.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:42.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:42.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:42.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:42.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:42.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:42.162 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.162 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.162 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.162 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.163 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:42.163 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.885685035000002, 2024-04-26T10:34:42.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:42.163 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.163 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.163 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.163 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.164 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.164 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:42.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.164 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:42.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:42.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:42.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:42.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:42.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:42.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:42.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:42.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:42.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:42.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:42.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:42.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:42.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:42.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:42.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:42.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:42.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:42.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:42.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:42.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.883655187000002, 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:42.172 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.178 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.178 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.178 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:42.178 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.883179384000002, 2024-04-26T10:34:42.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:42.178 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.178 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.178 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.178 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.178 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.178 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:42.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.179 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:42.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:42.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:42.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:42.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:42.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:42.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:42.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:42.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:42.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:42.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:42.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:42.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:42.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:42.183 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.184 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.184 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.184 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.184 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:42.184 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.881212329999997, 2024-04-26T10:34:42.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:42.184 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.184 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.184 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.184 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.184 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:42.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:42.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:42.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:42.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:42.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:42.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103336 5.6 5:6c0cef20:::benchmark_data_smithi043_45180_object103335:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.879103024999999, 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.064107786, 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103336 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188503+0000", 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188502+0000", 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188540+0000", 2024-04-26T10:34:42.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8445000000000002e-05 2024-04-26T10:34:42.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188553+0000", 2024-04-26T10:34:42.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2768e-05 2024-04-26T10:34:42.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.188563+0000", 2024-04-26T10:34:42.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9760000000000007e-06 2024-04-26T10:34:42.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191877+0000", 2024-04-26T10:34:42.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003313908 2024-04-26T10:34:42.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192004+0000", 2024-04-26T10:34:42.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012663 2024-04-26T10:34:42.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.192143+0000", 2024-04-26T10:34:42.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013964199999999999 2024-04-26T10:34:42.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.196467+0000", 2024-04-26T10:34:42.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043232230000000002 2024-04-26T10:34:42.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252539+0000", 2024-04-26T10:34:42.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056072085000000001 2024-04-26T10:34:42.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252577+0000", 2024-04-26T10:34:42.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8730999999999999e-05 2024-04-26T10:34:42.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252611+0000", 2024-04-26T10:34:42.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3769000000000001e-05 2024-04-26T10:34:42.197 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.197 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.197 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.197 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.198 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:42.198 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 43.878544591999997, 2024-04-26T10:34:42.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:42.198 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:42.198 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.198 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:42.198 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:42.199 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.199 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:42.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.199 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:42.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:42.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:42.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:42.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:42.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:42.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:42.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:42.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:42.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:42.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:42.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:42.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:42.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:42.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:42.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:42.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:42.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:42.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:42.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:42.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:42.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:42.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:42.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:42.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:42.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:42.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:42.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:42.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:42.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:42.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:42.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:42.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:42.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:42.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:42.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:42.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:42.207 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.207 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.207 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.207 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:42.207 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:42.207 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:42.209 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:42.208+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:42.209 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:42.309 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:42.308+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:42.390 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:42.390 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:202556 5.e 5:742c7f22:::benchmark_data_smithi043_45180_object67914:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:42.385533+0000", 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0037677019999999999, 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037864719999999999, 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 202556 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.391 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385533+0000", 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385533+0000", 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385532+0000", 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.392 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385536+0000", 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5199999999999999e-06 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385546+0000", 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3200000000000006e-06 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385553+0000", 2024-04-26T10:34:42.393 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5209999999999997e-06 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385593+0000", 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9619999999999997e-05 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385737+0000", 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000143769 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.394 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385845+0000", 2024-04-26T10:34:42.395 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000108319 2024-04-26T10:34:42.395 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.395 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.395 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.395 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387995+0000", 2024-04-26T10:34:42.395 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0021500120000000002 2024-04-26T10:34:42.395 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.395 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.395 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.395 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.395 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.395 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:202560 5.8 5:1a2d6869:::benchmark_data_smithi043_45180_object67918:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:34:42.395 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:42.386597+0000", 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0027028949999999999, 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027804779999999999, 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 202560 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386597+0000", 2024-04-26T10:34:42.396 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386597+0000", 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386597+0000", 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386601+0000", 2024-04-26T10:34:42.397 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2660000000000003e-06 2024-04-26T10:34:42.398 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.398 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.398 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.398 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386610+0000", 2024-04-26T10:34:42.398 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7579999999999998e-06 2024-04-26T10:34:42.398 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.398 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.398 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.398 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386615+0000", 2024-04-26T10:34:42.398 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3619999999999997e-06 2024-04-26T10:34:42.398 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.398 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.398 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.399 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386642+0000", 2024-04-26T10:34:42.399 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6543999999999999e-05 2024-04-26T10:34:42.399 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.399 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.399 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.399 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386743+0000", 2024-04-26T10:34:42.399 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010124900000000001 2024-04-26T10:34:42.399 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.399 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.399 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.399 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386805+0000", 2024-04-26T10:34:42.399 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1792999999999996e-05 2024-04-26T10:34:42.399 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:202561 5.0 5:05d73d47:::benchmark_data_smithi043_45180_object67919:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:42.386701+0000", 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0025993140000000001, 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027302820000000001, 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.400 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 202561 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386701+0000", 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386701+0000", 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.401 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.402 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386700+0000", 2024-04-26T10:34:42.402 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.402 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.402 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.402 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.402 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386705+0000", 2024-04-26T10:34:42.402 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.194e-06 2024-04-26T10:34:42.402 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.402 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.402 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.402 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386713+0000", 2024-04-26T10:34:42.402 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2889999999999998e-06 2024-04-26T10:34:42.402 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.403 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.403 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.403 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.386719+0000", 2024-04-26T10:34:42.403 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5919999999999997e-06 2024-04-26T10:34:42.403 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.403 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.403 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.403 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387031+0000", 2024-04-26T10:34:42.403 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00031124899999999999 2024-04-26T10:34:42.403 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.403 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.403 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.403 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387163+0000", 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013201700000000001 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387272+0000", 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010921600000000001 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:202564 5.d 5:b8a1bb32:::benchmark_data_smithi043_45180_object67922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:42.387862+0000", 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001438204, 2024-04-26T10:34:42.404 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016186009999999999, 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 202564 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387862+0000", 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.405 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387862+0000", 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387862+0000", 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387865+0000", 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2310000000000001e-06 2024-04-26T10:34:42.406 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387872+0000", 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6179999999999997e-06 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387877+0000", 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.831e-06 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387916+0000", 2024-04-26T10:34:42.407 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8967999999999997e-05 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.388040+0000", 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012374799999999999 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.388152+0000", 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000111699 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.408 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:202566 5.8 5:1efef509:::benchmark_data_smithi043_45180_object67924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:42.387938+0000", 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001361931, 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015917769999999999, 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 202566 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.409 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.410 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.410 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387938+0000", 2024-04-26T10:34:42.410 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.410 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.410 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.410 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.410 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387938+0000", 2024-04-26T10:34:42.410 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.410 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.410 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.410 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.410 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387938+0000", 2024-04-26T10:34:42.410 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387941+0000", 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2030000000000001e-06 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387947+0000", 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1290000000000001e-06 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.387951+0000", 2024-04-26T10:34:42.411 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.664e-06 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.388626+0000", 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000675583 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.388746+0000", 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000119883 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.412 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.388984+0000", 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00023755900000000001 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:202545 5.0 5:026cab66:::benchmark_data_smithi043_45180_object67903:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:42.380407+0000", 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0088936390000000001, 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0091887449999999999, 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.413 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 202545 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.380407+0000", 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.380407+0000", 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.414 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.380406+0000", 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.380409+0000", 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2200000000000001e-06 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.380417+0000", 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0909999999999993e-06 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.415 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.380423+0000", 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5060000000000003e-06 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.380463+0000", 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0160999999999997e-05 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.380579+0000", 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000115843 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.416 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.380886+0000", 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000307091 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.383428+0000", 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002541991 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:202554 5.0 5:062bb0e0:::benchmark_data_smithi043_45180_object67912:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:34:42.417 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:42.385201+0000", 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0040988680000000003, 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0044483989999999996, 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 202554 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385201+0000", 2024-04-26T10:34:42.418 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.419 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.419 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.419 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385201+0000", 2024-04-26T10:34:42.419 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.419 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.419 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.419 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385201+0000", 2024-04-26T10:34:42.419 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.419 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.419 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385206+0000", 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.485e-06 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385216+0000", 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0071999999999999e-05 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385223+0000", 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3390000000000004e-06 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.420 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385340+0000", 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011664599999999999 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385435+0000", 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5131999999999997e-05 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:42.385510+0000", 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4431000000000006e-05 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.421 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.422 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.422 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.422 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:34:42.422 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 7 2024-04-26T10:34:42.422 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:42.423 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:42.424 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:42.421+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:42.524 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:42.523+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:42.578 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-26T10:34:42.624 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:42.623+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:42.640 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:42.640 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:42.640 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:42.641 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:42.641 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:42.653 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:42.737 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:42.736+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:42.826 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:42.825+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:42.868 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:42.868 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:42.868 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 75.065265590999999, 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.869 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:42.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.871 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:42.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:42.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.871 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:42.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:42.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:42.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:42.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:42.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:42.874 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.874 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.874 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 75.064437510999994, 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.877 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:42.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:42.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 75.063508447999993, 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:42.880 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:42.882 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.882 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.882 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.882 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.882 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:42.882 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.882 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.882 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.882 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.882 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:42.882 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:42.882 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:42.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:42.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:42.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:42.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:42.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:42.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:42.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.886 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:42.886 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:42.886 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.886 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.886 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.886 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.886 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.886 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:42.886 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:42.886 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 75.062823007000006, 2024-04-26T10:34:42.886 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:42.886 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.886 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.887 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.888 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:42.889 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:42.889 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.889 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.889 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:42.889 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:42.889 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.889 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.889 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:42.889 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:42.889 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.890 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.890 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:42.890 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:42.890 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.890 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.890 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.890 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:42.890 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:42.890 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.890 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.890 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.890 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:42.890 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:42.891 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.891 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.891 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.891 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:42.891 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:42.891 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.891 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.891 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.891 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:42.891 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:42.891 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103337 5.d 5:b2743ee9:::benchmark_data_smithi043_45180_object103336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.677164333999997, 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.058853520999999999, 2024-04-26T10:34:42.892 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.893 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.893 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.893 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.893 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.893 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103337 2024-04-26T10:34:42.893 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.893 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.893 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.893 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.893 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:42.893 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.893 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.893 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.894 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.894 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:42.894 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.894 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.894 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.894 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.894 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188066+0000", 2024-04-26T10:34:42.894 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.894 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.894 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.894 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.894 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188132+0000", 2024-04-26T10:34:42.894 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6197000000000003e-05 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188144+0000", 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2001000000000001e-05 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188152+0000", 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9349999999999994e-06 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188185+0000", 2024-04-26T10:34:42.895 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3436000000000003e-05 2024-04-26T10:34:42.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.896 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188275+0000", 2024-04-26T10:34:42.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9995999999999997e-05 2024-04-26T10:34:42.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.896 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.188365+0000", 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0254999999999996e-05 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.194973+0000", 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0066073490000000002 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246781+0000", 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.051808372999999998 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246865+0000", 2024-04-26T10:34:42.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3498999999999995e-05 2024-04-26T10:34:42.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.898 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.246920+0000", 2024-04-26T10:34:42.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5208999999999999e-05 2024-04-26T10:34:42.898 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.898 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.898 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.898 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.486532564999997, 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.899 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.900 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.901 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:42.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:42.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.486313260999999, 2024-04-26T10:34:42.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.905 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:42.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:42.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.486233456000001, 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.910 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:42.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:42.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.913 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:42.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:42.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.913 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:42.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:42.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:42.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.484869426000003, 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.917 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.918 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:42.920 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.484275089, 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:42.921 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.922 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.922 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.922 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.922 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.922 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:42.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.922 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.922 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:42.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:42.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.924 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.924 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.924 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:42.924 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:42.924 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.924 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.924 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.924 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:42.924 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:42.924 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.924 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.924 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.924 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.925 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:42.926 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:42.926 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.926 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.926 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.926 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:42.926 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:42.926 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.926 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.926 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.926 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:42.926 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:42.926 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.926 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.483514733, 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.927 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:42.929 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.930 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.932 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.933 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.933 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.933 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.933 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:42.933 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.482897272999999, 2024-04-26T10:34:42.933 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:42.933 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.933 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.933 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.933 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.933 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.933 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:42.933 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.934 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.935 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.936 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.937 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.938 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.482332270000001, 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:42.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.940 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.942 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.481788958000003, 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.943 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:42.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:42.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.946 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:42.946 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:42.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.946 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:42.946 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:42.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.947 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:42.948 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:42.949 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.480316958000003, 2024-04-26T10:34:42.949 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:42.949 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.949 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.949 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:42.949 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:42.949 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:42.949 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:42.949 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.949 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.949 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.949 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.949 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.950 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.951 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:42.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:42.953 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.479751538000002, 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.954 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:42.955 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.955 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.955 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.955 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.955 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:42.955 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.955 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.955 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.955 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.955 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:42.955 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.955 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:42.956 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:42.957 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.958 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.958 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.958 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:42.958 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:42.958 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.958 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.958 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.958 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.958 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.958 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:42.958 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:42.958 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.479686688000001, 2024-04-26T10:34:42.958 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.959 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.960 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.961 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:42.962 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.478925707999998, 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.963 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:42.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:42.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.966 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.966 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.966 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:42.966 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:42.966 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.966 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.966 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.966 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.966 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.966 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:42.966 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:42.966 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.477904279999997, 2024-04-26T10:34:42.966 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.967 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.968 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.969 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103647 5.b e32/16 ondisk, result = 0)", 2024-04-26T10:34:42.970 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 44.477885581000002, 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060768513000000003, 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387345+0000", 2024-04-26T10:34:42.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387344+0000", 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387350+0000", 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.22e-06 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447917+0000", 2024-04-26T10:34:42.972 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060567523999999998 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447925+0000", 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7689999999999996e-06 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448004+0000", 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9246000000000007e-05 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448012+0000", 2024-04-26T10:34:42.973 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.3490000000000003e-06 2024-04-26T10:34:42.974 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:42.974 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:42.974 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:42.974 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448114+0000", 2024-04-26T10:34:42.974 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010205299999999999 2024-04-26T10:34:42.974 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.974 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.974 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.974 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:42.974 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:42.974 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:42.976 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:42.975+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:42.976 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:43.076 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:43.075+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:43.163 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:204755 5.3 5:cf5dc83b:::benchmark_data_smithi043_45180_object70113:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:43.162496+0000", 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.000203356, 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023162599999999999, 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 204755 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.164 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162496+0000", 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162496+0000", 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162495+0000", 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:43.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162501+0000", 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2449999999999998e-06 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162508+0000", 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7819999999999994e-06 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162514+0000", 2024-04-26T10:34:43.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.699e-06 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162560+0000", 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5766999999999997e-05 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162672+0000", 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000112241 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162739+0000", 2024-04-26T10:34:43.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6896999999999993e-05 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:204743 5.5 5:ac66a80b:::benchmark_data_smithi043_45180_object70101:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:43.152364+0000", 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.010335641, 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010457701999999999, 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.168 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 204743 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152364+0000", 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152364+0000", 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152363+0000", 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152366+0000", 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3949999999999999e-06 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152372+0000", 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4949999999999996e-06 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152376+0000", 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8800000000000001e-06 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152412+0000", 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5645999999999997e-05 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152494+0000", 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2566999999999997e-05 2024-04-26T10:34:43.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152562+0000", 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7409000000000005e-05 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.154160+0000", 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001597947 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.172 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:204744 5.6 5:61882b48:::benchmark_data_smithi043_45180_object70102:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:43.152384+0000", 2024-04-26T10:34:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.010315876999999999, 2024-04-26T10:34:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.010494076, 2024-04-26T10:34:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 204744 2024-04-26T10:34:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152384+0000", 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152384+0000", 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152383+0000", 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152385+0000", 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1969999999999999e-06 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152391+0000", 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4600000000000002e-06 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152396+0000", 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6550000000000003e-06 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152430+0000", 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4434999999999998e-05 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152546+0000", 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011591000000000001 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.152653+0000", 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106672 2024-04-26T10:34:43.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.154564+0000", 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001911769 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:204747 5.6 5:667fa750:::benchmark_data_smithi043_45180_object70105:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:43.154701+0000", 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0079987760000000008, 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0082370329999999995, 2024-04-26T10:34:43.177 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 204747 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.154701+0000", 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.154701+0000", 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.154700+0000", 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.154705+0000", 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4770000000000002e-06 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.154716+0000", 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0329000000000001e-05 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.154724+0000", 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2509999999999994e-06 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.154802+0000", 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7527999999999994e-05 2024-04-26T10:34:43.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.154876+0000", 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4881000000000004e-05 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.154941+0000", 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4777000000000007e-05 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.156317+0000", 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00137549 2024-04-26T10:34:43.181 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:204745 5.1 e58/16 5:819163b6:::benchmark_data_smithi043_45180_object70103:head v 58'12902, mlcod=58'12899)", 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:43.161753+0000", 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00094616199999999996, 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012699829999999999, 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.161753+0000", 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.161753+0000", 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.161753+0000", 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.161756+0000", 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.574e-06 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.161762+0000", 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5670000000000002e-06 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.161765+0000", 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1190000000000001e-06 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.161793+0000", 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8272e-05 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.161806+0000", 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2594e-05 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:204753 5.0 e58/42 5:04bb3b5a:::benchmark_data_smithi043_45180_object70111:head v 58'12774, mlcod=58'12772)", 2024-04-26T10:34:43.185 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:43.162160+0000", 2024-04-26T10:34:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00053970600000000004, 2024-04-26T10:34:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00093255499999999995, 2024-04-26T10:34:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162160+0000", 2024-04-26T10:34:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162160+0000", 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162159+0000", 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162165+0000", 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.446e-06 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162174+0000", 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7429999999999997e-06 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162180+0000", 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1959999999999999e-06 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162212+0000", 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2863e-05 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.162231+0000", 2024-04-26T10:34:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8949000000000001e-05 2024-04-26T10:34:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:34:43.190 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 6 2024-04-26T10:34:43.190 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:43.192 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:43.192 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:43.190+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:43.292 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:43.291+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:43.393 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:43.392+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:43.402 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:43.403 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:43.403 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:34:43.403 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:34:43.403 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:43.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:43.501 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:43.500+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:43.599 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:43.597+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:43.636 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:43.637 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:43.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:43.637 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:43.637 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.637 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:43.637 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:43.637 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.833823287000001, 2024-04-26T10:34:43.637 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:43.637 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.637 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.637 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.637 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.637 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.638 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.639 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.640 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.641 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:43.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:43.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.642 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.642 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:43.642 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:43.642 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.642 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.642 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.642 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.642 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.833822302000002, 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.643 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.644 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.645 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.646 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.833753678999997, 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.647 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.648 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.649 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:43.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:43.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:43.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:43.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.650 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.650 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.650 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:43.650 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.651 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:43.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:43.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.652 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.652 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:43.652 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:43.652 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.652 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.652 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.652 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.652 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.652 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:43.652 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.833701899000005, 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:43.653 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.654 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.655 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.656 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.833642049000005, 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.658 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.663 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.831929345000006, 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.665 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.831814277999996, 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:43.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:43.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.831721138000006, 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:43.673 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:43.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:43.678 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.831526977999999, 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:43.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.830319610000004, 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:43.683 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:43.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:43.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:43.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:43.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:43.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:43.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.829510701999993, 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.687 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:43.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:43.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:43.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:43.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:43.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:43.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:43.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:43.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.829407164000003, 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.693 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:43.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.694 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:43.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:43.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:43.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:43.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:43.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:43.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.698 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.829330291000005, 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.699 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:43.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:43.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:43.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:43.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:43.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:43.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 75.829214906999994, 2024-04-26T10:34:43.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:43.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.452570854000001, 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:43.708 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.713 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.450541006000002, 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.714 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:43.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:43.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:43.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:43.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:43.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:43.719 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.719 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.719 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.719 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:43.719 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:43.719 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.450065203000001, 2024-04-26T10:34:43.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:43.720 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.720 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.720 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.720 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.720 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.720 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:43.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.720 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:43.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:43.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:43.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:43.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:43.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:43.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:43.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:43.725 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.448098149000003, 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:43.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:43.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.730 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 45.445430410999997, 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.731 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:43.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:43.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:43.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:43.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:43.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:204862 5.5 5:a0d5a512:::benchmark_data_smithi043_45180_object70220:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.41345778500000002, 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.069348507000000004, 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:43.738 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 204862 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:43.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221036+0000", 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4099999999999998e-06 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221042+0000", 2024-04-26T10:34:43.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7379999999999999e-06 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221047+0000", 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6569999999999996e-06 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221081+0000", 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3948000000000001e-05 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:43.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221203+0000", 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122359 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221313+0000", 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110268 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.223990+0000", 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026766519999999999 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290298+0000", 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066308304999999998 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290346+0000", 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7494000000000003e-05 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290383+0000", 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7061999999999999e-05 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.743 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.744 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:43.744 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:43.744 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:43.746 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:43.745+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:43.746 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:43.847 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:43.846+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:43.874 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:43.874 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:43.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.874 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:205668 5.9 5.cba32469 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:34:43.874 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.593061+0000", 2024-04-26T10:34:43.874 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.28039162299999998, 2024-04-26T10:34:43.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.28041704200000001, 2024-04-26T10:34:43.874 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:43.874 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:34:43.874 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:43.874 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 205668 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593061+0000", 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593061+0000", 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593061+0000", 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593066+0000", 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6289999999999998e-06 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593077+0000", 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0431000000000001e-05 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593089+0000", 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2143999999999999e-05 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593127+0000", 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8748000000000002e-05 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593135+0000", 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6990000000000003e-06 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:43.877 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:43.878 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:43.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.878 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:205674 5.9 5.3fc6aa9 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:34:43.878 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.593108+0000", 2024-04-26T10:34:43.878 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.28034479899999998, 2024-04-26T10:34:43.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.28041469899999999, 2024-04-26T10:34:43.878 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:43.878 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:34:43.878 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:43.878 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:43.878 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.878 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 205674 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593108+0000", 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593108+0000", 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593108+0000", 2024-04-26T10:34:43.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593111+0000", 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.331e-06 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593118+0000", 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9020000000000002e-06 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.593125+0000", 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1210000000000001e-06 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.594095+0000", 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00096962000000000003 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.594105+0000", 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0851e-05 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:43.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.882 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.882 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:205687 5.d 5.9ea0ce3d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:34:43.882 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.598074+0000", 2024-04-26T10:34:43.882 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.27537917200000001, 2024-04-26T10:34:43.882 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.27548710100000001, 2024-04-26T10:34:43.882 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:43.882 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:34:43.882 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:43.882 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:43.882 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:43.882 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 205687 2024-04-26T10:34:43.882 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.882 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.598074+0000", 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.598074+0000", 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.598073+0000", 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:43.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.598077+0000", 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2660000000000003e-06 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.598093+0000", 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5455999999999999e-05 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.598100+0000", 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1430000000000001e-06 2024-04-26T10:34:43.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.598138+0000", 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8420999999999997e-05 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.598148+0000", 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2750000000000001e-06 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:43.885 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:34:43.886 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 3 2024-04-26T10:34:43.886 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:43.887 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:43.899 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:34:43.947 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:43.946+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:43.957 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:34:44.013 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:44.014 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:44.014 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:44.014 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:44.014 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:44.023 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:44.049 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:44.067 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-04-26T10:34:44.067 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:44.066+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:44.069 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:44.069 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T10:34:44.070 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:44.070 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:44.072 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:34:44.072 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:34:44.150 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:44.149+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:44.150 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:44.150 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:44.160 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:44.251 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:44.250+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:44.289 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:44.290 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:44.298 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:44.352 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:44.351+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:44.425 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:44.426 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:44.436 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:44.452 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:44.451+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:44.553 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:44.552+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:44.592 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:34:44.621 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:44.622 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:44.633 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:44.674 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:44.673+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:44.754 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:44.754+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:44.809 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:44.809 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:44.822 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:44.867 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:44.866+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:44.957 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:44.956+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:44.999 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:45.000 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:45.013 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:45.097 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:45.096+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:45.159 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:45.158+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:45.237 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:45.237 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:45.249 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:45.293 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:45.292+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:45.361 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:45.359+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:45.451 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:45.452 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:45.462 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:45.461+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:45.467 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:45.564 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:45.562+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:45.593 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-26T10:34:45.664 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:45.663+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:45.711 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:45.712 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:45.724 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:45.768 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:45.767+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:45.872 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:45.867+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:45.921 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:45.921 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:45.939 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:45.983 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:45.982+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:46.068 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:46.067+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:46.073 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:46.121 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:46.121 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:46.135 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:46.176 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:46.175+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:46.223 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:46.246 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:46.247 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T10:34:46.247 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:46.247 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:46.249 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:34:46.249 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:34:46.270 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:46.269+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:46.375 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:46.375 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:46.375 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:46.375 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:46.375 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:46.376 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:46.374+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:46.380 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:46.472 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:46.471+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:46.572 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:46.571+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:46.604 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:46.604 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:46.604 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:46.604 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 78.801106589, 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.605 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.606 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.606 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:46.606 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.606 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.606 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.606 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.606 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:46.606 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.606 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.606 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.606 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.606 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:46.606 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.607 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.608 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.609 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.610 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 78.800278508999995, 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.611 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.612 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.613 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.614 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.615 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 78.799349445999994, 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.616 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.617 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.617 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:46.617 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.617 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.617 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.617 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.617 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:46.617 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.617 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.617 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.617 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.617 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:46.617 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.618 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.619 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.620 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:46.621 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:46.621 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.621 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.621 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.621 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:46.621 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:46.621 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.621 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.621 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.621 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:46.621 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:46.621 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.621 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 78.798664005000006, 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:46.622 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.623 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.623 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.623 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.623 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:46.623 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.623 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.623 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.623 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.623 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:46.623 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.623 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.623 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.623 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.624 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.625 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:46.626 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.627 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.222373562999998, 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.628 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.629 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.630 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.631 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:46.632 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.222154259, 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.633 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.634 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:46.635 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.635 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.635 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.635 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.635 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:46.635 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.635 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.635 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.635 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.635 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:46.635 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:46.635 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.635 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.636 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.637 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.638 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.638 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:46.638 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:46.638 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.638 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.638 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.638 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:46.638 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:46.638 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.638 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.638 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.638 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:46.638 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.222074454000001, 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.639 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.640 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.642 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.642 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:46.642 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:46.642 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.642 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.642 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.642 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:46.642 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:46.642 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.642 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.642 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.642 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.643 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.644 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:46.644 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:46.644 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.644 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.644 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.644 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:46.644 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:46.644 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.644 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.644 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.644 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:46.644 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:46.644 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.645 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.645 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.645 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.645 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.645 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:46.645 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:46.645 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.220710424000004, 2024-04-26T10:34:46.645 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:46.645 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.645 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.645 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.645 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.646 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.646 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:46.646 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.646 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.646 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.646 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.646 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:46.646 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.646 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.646 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.646 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.647 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.648 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.649 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:46.650 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.220116087000001, 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:46.651 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.652 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.653 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:46.654 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:46.654 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.654 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.654 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.654 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:46.654 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:46.654 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.654 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.654 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.654 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:46.654 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:46.654 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.654 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.655 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:46.656 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.219355731, 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:46.657 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.658 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.658 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.658 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.658 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:46.658 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.658 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.658 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.658 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.658 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:46.658 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:46.658 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.658 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.658 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.659 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.660 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.661 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.218738270999999, 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.662 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.663 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.664 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.665 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.666 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:46.667 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.218173268000001, 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.668 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.669 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:46.670 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:46.670 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.670 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.670 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.670 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:46.670 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:46.670 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.670 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.670 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.670 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:46.670 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:46.670 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.670 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:46.671 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.217629956000003, 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:46.672 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.673 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.674 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:46.675 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:46.676 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.677 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:46.678 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:46.678 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.678 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.678 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.678 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.678 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.678 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:46.678 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:46.678 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.216157956000004, 2024-04-26T10:34:46.678 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:46.678 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.678 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.678 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:46.679 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:46.680 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:46.681 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.682 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.683 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.215592536000003, 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:46.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:46.686 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:46.687 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.215527686000001, 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.688 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.689 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.690 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:46.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.214766705999999, 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.692 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:46.693 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:46.694 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:46.695 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 48.213745277999998, 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.696 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.697 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.698 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.698 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:46.698 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:46.698 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.698 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.698 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.698 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:46.698 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:46.698 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.698 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.698 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.698 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:46.698 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.699 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:46.700 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:46.700 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.700 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.700 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.700 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:46.700 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:46.700 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.700 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.700 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.700 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.700 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.700 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204849 5.d 5:bce18511:::benchmark_data_smithi043_45180_object70207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:46.700 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 3.3849321680000002, 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.072723889999999999, 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204849 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.701 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.702 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.702 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.702 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:46.702 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.702 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.702 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.702 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.702 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216139+0000", 2024-04-26T10:34:46.702 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.702 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.702 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.702 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.702 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216142+0000", 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4480000000000001e-06 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216148+0000", 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6930000000000001e-06 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216153+0000", 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1290000000000004e-06 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.703 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216184+0000", 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190999999999999e-05 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216276+0000", 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2357999999999999e-05 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216337+0000", 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1171000000000001e-05 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.704 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.218045+0000", 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017078060000000001 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288778+0000", 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.070732858999999995 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288831+0000", 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2751999999999999e-05 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.705 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288863+0000", 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2872e-05 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204868 5.d 5:b5b0e42d:::benchmark_data_smithi043_45180_object70226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 3.375935626, 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.065177963000000005, 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:46.706 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204868 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:46.707 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225135+0000", 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225140+0000", 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2390000000000004e-06 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225148+0000", 2024-04-26T10:34:46.708 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225153+0000", 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1200000000000001e-06 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225181+0000", 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8225000000000002e-05 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225262+0000", 2024-04-26T10:34:46.709 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0817999999999998e-05 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225326+0000", 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3986999999999996e-05 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.227004+0000", 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016777879999999999 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:46.710 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290265+0000", 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063261060999999993 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290289+0000", 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4012999999999999e-05 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290314+0000", 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5011000000000002e-05 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.711 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:46.712 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:46.712 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:46.713 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:46.713 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:46.711+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:46.817 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:46.814+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:46.911 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:46.911 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:46.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.911 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:212204 5.b e61/42 5:d536cd44:::benchmark_data_smithi043_45180_object77562:head v 61'13437, mlcod=61'13435)", 2024-04-26T10:34:46.911 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:46.901126+0000", 2024-04-26T10:34:46.911 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0035759770000000001, 2024-04-26T10:34:46.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0035988370000000001, 2024-04-26T10:34:46.911 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:46.911 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:46.911 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.901126+0000", 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.901126+0000", 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.901125+0000", 2024-04-26T10:34:46.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.901130+0000", 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9520000000000002e-06 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.901138+0000", 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3529999999999997e-06 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.901143+0000", 2024-04-26T10:34:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5589999999999996e-06 2024-04-26T10:34:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.902481+0000", 2024-04-26T10:34:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0013375850000000001 2024-04-26T10:34:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.902500+0000", 2024-04-26T10:34:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9434999999999999e-05 2024-04-26T10:34:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.904704+0000", 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002204077 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.904725+0000", 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0369000000000001e-05 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:212202 5.0 e61/42 5:0353d6ca:::benchmark_data_smithi043_45180_object77560:head v 61'13272, mlcod=61'13269)", 2024-04-26T10:34:46.915 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:46.902928+0000", 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001773604, 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001875701, 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.902928+0000", 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.902928+0000", 2024-04-26T10:34:46.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.902927+0000", 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.902933+0000", 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1390000000000003e-06 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:46.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.902942+0000", 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1360000000000003e-06 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.902949+0000", 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8090000000000004e-06 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.902978+0000", 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9329e-05 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.902990+0000", 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.221e-05 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:212208 5.6 5:6ce46b40:::benchmark_data_smithi043_45180_object77566:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:46.903003+0000", 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0016988859999999999, 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018635909999999999, 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:46.919 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 212208 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903003+0000", 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903003+0000", 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903002+0000", 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903006+0000", 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1969999999999998e-06 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903014+0000", 2024-04-26T10:34:46.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3219999999999993e-06 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903020+0000", 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0689999999999998e-06 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903500+0000", 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00047983599999999998 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:46.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903622+0000", 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121904 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:212209 5.1 5:8b9810eb:::benchmark_data_smithi043_45180_object77567:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:46.903183+0000", 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00151844, 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017735019999999999, 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:46.923 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 212209 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903183+0000", 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903183+0000", 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903183+0000", 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903187+0000", 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.941e-06 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903195+0000", 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8760000000000005e-06 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903201+0000", 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.144e-06 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903236+0000", 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4944000000000003e-05 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903343+0000", 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000107224 2024-04-26T10:34:46.926 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:212210 5.6 5.a79b8176 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:46.903210+0000", 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001491476, 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018073970000000001, 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.927 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 212210 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903210+0000", 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903210+0000", 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.928 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903210+0000", 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903212+0000", 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3140000000000002e-06 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903218+0000", 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6160000000000001e-06 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903223+0000", 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1479999999999997e-06 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:212212 5.a 5:5ba45501:::benchmark_data_smithi043_45180_object77570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:46.903349+0000", 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0013528909999999999, 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017306540000000001, 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:46.930 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 212212 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903349+0000", 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903349+0000", 2024-04-26T10:34:46.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903348+0000", 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903352+0000", 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5860000000000001e-06 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903360+0000", 2024-04-26T10:34:46.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8199999999999997e-06 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903365+0000", 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5770000000000001e-06 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903400+0000", 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4947999999999998e-05 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:46.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903510+0000", 2024-04-26T10:34:46.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109788 2024-04-26T10:34:46.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.934 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:46.934 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.903613+0000", 2024-04-26T10:34:46.934 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103187 2024-04-26T10:34:46.934 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.934 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:46.934 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.934 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.934 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.934 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:212197 5.7 5.8fd367f7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:34:46.934 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:46.899701+0000", 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0050009340000000003, 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0054235280000000004, 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 212197 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.899701+0000", 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.935 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.899701+0000", 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.899700+0000", 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.899703+0000", 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.21e-06 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.936 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.899708+0000", 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4410000000000001e-06 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:46.899712+0000", 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.369e-06 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 7 2024-04-26T10:34:46.937 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:46.939 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:46.939 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:46.938+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:47.040 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:47.038+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:47.140 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:47.139+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:47.179 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:34:47.179 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:34:47.179 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:47.195 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:47.241 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:47.240+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:47.346 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:47.343+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:47.399 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:47.399 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:47.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:47.399 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:47.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.399 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:47.399 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:47.399 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.594822588, 2024-04-26T10:34:47.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:47.399 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.399 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.399 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:47.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:47.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.404 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.594821603, 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:47.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:47.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:47.408 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.594752979999996, 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.409 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:47.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:47.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:47.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:47.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:47.414 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.414 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.414 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.594701200000003, 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:47.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:47.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:47.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:47.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:47.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:47.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:47.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.594641350000003, 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.420 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.422 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.425 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.592928646000004, 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:47.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.427 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:47.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:47.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:47.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:47.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:47.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:47.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:47.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.432 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.592813578999994, 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:47.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:47.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.434 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.434 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.435 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.436 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.592720439000004, 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.437 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:47.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:47.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:47.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:47.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:47.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:47.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:47.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:47.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:47.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:47.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:47.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:47.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.592526278999998, 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:47.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:47.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:47.447 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.591318911000002, 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:47.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:47.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.590510003000006, 2024-04-26T10:34:47.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:47.454 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:47.455 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:47.456 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.590406465000001, 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.457 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.459 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:47.460 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:47.461 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.462 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.590329592000003, 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.463 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.464 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.465 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.466 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.467 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 79.590214208000006, 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.468 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.469 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:47.471 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.213570154999999, 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.472 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.473 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.474 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.475 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:47.476 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.477 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.211540307, 2024-04-26T10:34:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.478 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.479 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.480 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.481 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:47.482 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.211064503999999, 2024-04-26T10:34:47.483 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.484 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:47.485 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:47.486 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:47.487 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.488 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.209097450000002, 2024-04-26T10:34:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.489 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:47.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 49.206429712000002, 2024-04-26T10:34:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.495 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:47.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:47.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:204862 5.5 5:a0d5a512:::benchmark_data_smithi043_45180_object70220:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.1744570860000003, 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.069348507000000004, 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 204862 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221036+0000", 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4099999999999998e-06 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221042+0000", 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7379999999999999e-06 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221047+0000", 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6569999999999996e-06 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221081+0000", 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3948000000000001e-05 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221203+0000", 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122359 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221313+0000", 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110268 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.223990+0000", 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026766519999999999 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290298+0000", 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066308304999999998 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290346+0000", 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7494000000000003e-05 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:47.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290383+0000", 2024-04-26T10:34:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7061999999999999e-05 2024-04-26T10:34:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.506 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.507 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:47.507 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:47.507 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:47.508 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:47.507+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:47.508 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:47.605 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:34:47.609 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:47.607+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:47.684 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:47.684 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:47.685 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.685 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:214360 5.b 5:dfb85cae:::benchmark_data_smithi043_45180_object79718:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:34:47.685 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:47.676717+0000", 2024-04-26T10:34:47.685 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.007134558, 2024-04-26T10:34:47.685 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0071522640000000002, 2024-04-26T10:34:47.685 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:47.685 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:47.685 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:47.685 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:47.685 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.685 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 214360 2024-04-26T10:34:47.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.685 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:47.686 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.686 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:47.686 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.676717+0000", 2024-04-26T10:34:47.686 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:47.686 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.686 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.686 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:47.686 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.676717+0000", 2024-04-26T10:34:47.686 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:47.686 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.686 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.686 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.676716+0000", 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.676720+0000", 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9199999999999997e-06 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.676729+0000", 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0599999999999997e-06 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.687 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.676736+0000", 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8379999999999996e-06 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.676772+0000", 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6091999999999999e-05 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.676878+0000", 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000106217 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.688 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.676978+0000", 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.9335999999999999e-05 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.678734+0000", 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001755894 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:214378 5.d 5.ce50ea2d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:34:47.689 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:47.683901+0000", 2024-04-26T10:34:47.690 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4294967295.9999509, 2024-04-26T10:34:47.690 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4562999999999998e-05, 2024-04-26T10:34:47.690 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:47.690 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:47.690 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:47.690 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:47.690 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:47.690 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 214378 2024-04-26T10:34:47.690 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.690 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:47.690 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.690 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:47.690 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.683901+0000", 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.683901+0000", 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.683900+0000", 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:47.691 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.683904+0000", 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5199999999999999e-06 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.683914+0000", 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8749999999999995e-06 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:47.683921+0000", 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5520000000000001e-06 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:47.692 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:47.693 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:47.693 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:34:47.693 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 2 2024-04-26T10:34:47.693 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:47.699 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:47.710 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:47.709+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:47.811 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:47.809+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:47.911 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:47.910+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:47.918 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:47.918 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:47.918 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:47.918 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:47.918 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:47.931 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:48.013 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:48.012+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:48.068 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:34:48.114 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:48.113+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:48.145 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:48.145 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:48.145 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:48.145 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:48.145 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.145 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:48.145 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:48.145 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 80.342131128000005, 2024-04-26T10:34:48.146 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:48.146 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.146 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.146 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.146 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.146 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.146 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:48.146 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.146 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.146 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.146 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.146 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:48.146 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.147 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.148 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.149 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.150 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.150 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:48.150 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:48.150 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.150 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.150 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.150 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:48.150 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:48.150 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.150 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.150 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.150 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:48.150 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 80.341303048, 2024-04-26T10:34:48.151 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.152 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.153 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:48.154 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:48.155 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:48.156 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 80.340373984999999, 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.157 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.158 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.159 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.160 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:48.161 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.162 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 80.339688543999998, 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:48.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:48.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:48.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.763398101999996, 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:48.168 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:48.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:48.173 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.763178797999998, 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.174 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.178 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:48.178 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:48.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:48.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.178 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.178 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:48.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:48.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.178 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.178 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:48.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.763098993, 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:48.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:48.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:48.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.761734963000002, 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:48.185 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:48.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:48.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.761140626, 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.191 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:48.196 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.760380269999999, 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:48.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:48.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:48.202 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.202 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.202 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.202 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:48.202 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:48.202 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.759762809999998, 2024-04-26T10:34:48.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:48.202 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.202 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:48.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:48.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:48.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.204 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.204 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:48.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:48.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:48.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:48.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.759197807, 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.208 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:48.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:48.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:48.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:48.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:48.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:48.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:48.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.758654495000002, 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:48.212 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.213 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:48.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:48.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:48.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.757182495000002, 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.218 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.223 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.756617075000001, 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:48.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:48.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:48.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:48.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:48.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:48.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:48.227 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.756552225, 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:48.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.755791244999998, 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:48.232 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 49.754769817000003, 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.236 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204849 5.d 5:bce18511:::benchmark_data_smithi043_45180_object70207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:48.240 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.9259567070000001, 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.072723889999999999, 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204849 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:48.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:48.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216139+0000", 2024-04-26T10:34:48.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:48.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216142+0000", 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4480000000000001e-06 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216148+0000", 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6930000000000001e-06 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216153+0000", 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1290000000000004e-06 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216184+0000", 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190999999999999e-05 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216276+0000", 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2357999999999999e-05 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216337+0000", 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1171000000000001e-05 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.218045+0000", 2024-04-26T10:34:48.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017078060000000001 2024-04-26T10:34:48.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288778+0000", 2024-04-26T10:34:48.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.070732858999999995 2024-04-26T10:34:48.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288831+0000", 2024-04-26T10:34:48.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2751999999999999e-05 2024-04-26T10:34:48.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288863+0000", 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2872e-05 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204868 5.d 5:b5b0e42d:::benchmark_data_smithi043_45180_object70226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4.9169601649999999, 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.065177963000000005, 2024-04-26T10:34:48.246 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204868 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225135+0000", 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225140+0000", 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2390000000000004e-06 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225148+0000", 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225153+0000", 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1200000000000001e-06 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225181+0000", 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8225000000000002e-05 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225262+0000", 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0817999999999998e-05 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225326+0000", 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3986999999999996e-05 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.227004+0000", 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016777879999999999 2024-04-26T10:34:48.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290265+0000", 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063261060999999993 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290289+0000", 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4012999999999999e-05 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290314+0000", 2024-04-26T10:34:48.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5011000000000002e-05 2024-04-26T10:34:48.252 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.252 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.252 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.252 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:48.252 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:48.252 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:48.253 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:34:48.255 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:48.252+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:48.255 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:48.256 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-04-26T10:34:48.354 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:48.353+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:48.356 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-04-26T10:34:48.403 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:48.426 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:48.426 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T10:34:48.426 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:48.426 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:48.428 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:34:48.428 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:34:48.448 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:48.448 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:48.454 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:48.453+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:48.465 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:48.560 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:48.557+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:48.647 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-26T10:34:48.658 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:48.657+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:48.666 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:48.666 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:48.683 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:48.768 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:48.767+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:48.862 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:48.861+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:48.908 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:48.909 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:48.923 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:48.965 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:48.965+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:49.063 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:49.062+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:49.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-26T10:34:49.105 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:49.105 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:49.118 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:49.202 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:49.201+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:49.266 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:49.265+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:49.338 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:49.338 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:49.353 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:49.395 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:49.394+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:49.469 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:49.467+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:49.568 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:49.568 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:49.569 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:49.568+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:49.584 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:49.669 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:49.668+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:49.770 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:49.768+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:49.776 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:49.777 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:49.790 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:49.876 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:49.872+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:49.971 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:49.970+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:49.986 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:49.986 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:50.000 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:50.072 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:50.071+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:50.173 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:50.172+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:50.229 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:50.229 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:50.245 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:50.286 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:50.285+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:50.374 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:50.373+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:50.423 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:50.423 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:50.430 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:50.437 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:50.476 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:50.475+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:50.576 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:50.575+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:50.583 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:50.604 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:50.604 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T10:34:50.604 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:50.604 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:50.607 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:34:50.607 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:34:50.609 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:50.610 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:50.610 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:50.610 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:50.610 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:50.625 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:50.659 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:34:50.678 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:50.677+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:50.779 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:50.778+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:50.845 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:50.845 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:50.845 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:50.845 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:50.845 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.846 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:50.846 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:50.846 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 83.040692398999994, 2024-04-26T10:34:50.846 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:50.846 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.846 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.846 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.847 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.847 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.847 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:50.847 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.847 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.847 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.848 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.848 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:50.848 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.848 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.848 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.848 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.849 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:50.849 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.849 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.849 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.849 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.849 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:50.850 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:50.850 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.850 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.850 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.850 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:50.851 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:50.851 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.851 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.851 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.851 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:50.851 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:50.852 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.852 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.852 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.852 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:50.852 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:50.852 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.853 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.853 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.853 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:50.853 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:50.853 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.854 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.854 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.854 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:50.854 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:50.854 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.854 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.854 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:50.855 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:50.855 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:50.855 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.855 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.855 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.855 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:50.855 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:50.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:50.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:50.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:50.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:50.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 83.039864319000003, 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.857 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.858 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.858 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.858 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:50.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.858 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.858 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.858 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:50.858 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.858 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.858 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.859 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.860 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.862 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.863 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:50.863 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:50.863 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 83.038935256000002, 2024-04-26T10:34:50.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:50.863 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.863 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.863 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.863 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.863 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.865 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.866 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.866 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:50.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:50.866 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.866 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.866 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.866 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:50.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:50.866 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.866 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.866 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.866 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:50.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:50.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:50.867 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:50.867 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:50.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.867 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:50.867 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:50.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.868 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:50.868 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:50.868 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.868 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.868 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:50.869 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:50.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.869 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.869 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.869 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:50.869 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:50.869 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.869 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.869 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 83.038249815, 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.871 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:50.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.871 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.871 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:50.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:50.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:50.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:50.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:50.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:50.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:50.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:50.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:50.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:50.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:50.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:50.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:50.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:50.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:50.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:50.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.876 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:50.877 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:50.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.877 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.877 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.877 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:50.877 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:50.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:50.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:50.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:50.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:50.879 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.879 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.879 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.879 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:50.880 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:50.880 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.461959372999999, 2024-04-26T10:34:50.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:50.880 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.880 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.880 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.880 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.881 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.881 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:50.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.881 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.882 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:50.882 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.882 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.882 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.882 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.882 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:50.882 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:50.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:50.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.886 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.886 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:50.886 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:50.886 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.886 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.886 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.886 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:50.886 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:50.886 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.886 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.886 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.886 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:50.887 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:50.887 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.887 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.887 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.887 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:50.887 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:50.887 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.887 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.887 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.887 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.888 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.888 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:50.888 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:50.888 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.461740069000001, 2024-04-26T10:34:50.888 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:50.888 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.888 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.888 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.888 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.888 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.889 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:50.889 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.889 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.889 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.889 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:50.889 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.889 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.889 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.890 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:50.890 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.890 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.890 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.890 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.890 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:50.890 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:50.890 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.890 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.890 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.891 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:50.891 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:50.891 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.891 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.891 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.891 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:50.891 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:50.891 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.891 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.891 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.892 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.893 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.894 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.894 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:50.894 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:50.894 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.894 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.894 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.894 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:50.894 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:50.894 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.894 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.894 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.894 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.894 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.461660264000002, 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.895 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:50.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:50.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.898 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:50.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:50.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.898 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:50.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:50.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:50.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:50.899 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.460296233999998, 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:50.900 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.901 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:50.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.902 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:50.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:50.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.902 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:50.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:50.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:50.905 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.906 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.906 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.906 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:50.906 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:50.906 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.459701897000002, 2024-04-26T10:34:50.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:50.906 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.906 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.906 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.906 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.906 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:50.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:50.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:50.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:50.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:50.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:50.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:50.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:50.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:50.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:50.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:50.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.458941541000002, 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.912 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:50.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:50.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:50.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:50.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:50.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:50.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:50.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:50.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:50.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:50.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:50.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:50.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:50.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:50.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:50.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.917 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:50.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:50.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.917 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.918 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:50.918 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:50.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.918 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.918 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.918 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:50.918 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:50.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:50.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:50.919 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.919 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.919 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.920 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.920 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:50.920 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:50.920 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.458324081000001, 2024-04-26T10:34:50.920 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:50.920 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.920 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.920 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.920 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.921 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.921 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:50.921 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.921 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.921 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.921 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:50.921 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.921 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.922 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:50.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.922 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:50.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:50.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.923 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:50.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:50.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.923 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.924 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.924 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:50.924 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:50.924 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.924 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.924 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.924 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:50.924 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:50.925 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.925 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.925 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.925 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:50.925 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:50.925 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.925 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.925 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.926 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:50.926 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:50.926 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.926 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.926 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:50.926 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:50.926 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:50.926 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.927 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.927 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.927 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:50.927 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:50.927 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.927 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.927 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.927 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:50.927 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:50.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.928 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.928 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.928 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:50.928 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:50.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.928 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.928 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.929 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:50.929 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:50.929 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.929 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.929 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.929 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.929 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.929 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:50.929 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:50.930 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.457759078000002, 2024-04-26T10:34:50.930 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:50.930 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.930 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.930 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.930 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.930 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.930 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:50.930 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.930 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:50.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:50.932 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:50.933 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:50.934 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.934 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.934 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.934 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.934 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.934 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:50.934 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:50.934 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.457215765999997, 2024-04-26T10:34:50.934 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:50.934 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:50.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:50.937 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.938 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.455743765999998, 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.940 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:50.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:50.942 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.942 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.942 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:50.942 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:50.942 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.942 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.942 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:50.942 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:50.942 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.942 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.943 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:50.943 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:50.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.943 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.943 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.943 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:50.943 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:50.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.943 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.943 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:50.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:50.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:50.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:50.945 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.945 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.945 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.946 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:50.946 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:50.946 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.455178345999997, 2024-04-26T10:34:50.946 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:50.946 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.946 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.946 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.946 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:50.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.947 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.947 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.947 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:50.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.947 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.947 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.947 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:50.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:50.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.947 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.948 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.948 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:50.948 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:50.948 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.948 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.948 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.948 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:50.948 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:50.948 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.948 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.948 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.949 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:50.949 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:50.949 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.949 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.949 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.949 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:50.949 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:50.949 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.949 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.950 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.950 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:50.950 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:50.950 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.950 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.950 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.950 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:50.950 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:50.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.951 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.951 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.951 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:50.951 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:50.951 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.951 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.951 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.951 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.951 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:50.951 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:50.951 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.455113496000003, 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:50.953 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:50.954 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.954 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.954 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.954 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:50.954 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:50.954 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.954 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.954 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.954 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:50.954 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:50.954 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.955 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.955 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.955 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:50.955 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:50.955 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.955 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.955 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.955 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:50.955 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:50.956 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.956 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.956 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.956 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:50.956 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:50.956 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.956 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.956 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.956 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.956 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.454352516, 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.957 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.958 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:50.958 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.958 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.958 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.958 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.958 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:50.958 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:50.958 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.958 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.958 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.958 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:50.958 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.959 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.960 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 52.453331087999999, 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.961 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.962 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.962 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.962 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:50.962 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.962 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.962 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.962 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.962 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:50.962 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:50.962 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.962 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.962 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.963 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:50.963 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:50.963 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.963 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.963 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.963 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:50.963 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:50.963 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.963 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.963 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.964 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204849 5.d 5:bce18511:::benchmark_data_smithi043_45180_object70207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 7.6245179780000001, 2024-04-26T10:34:50.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.072723889999999999, 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204849 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.966 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216139+0000", 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216142+0000", 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4480000000000001e-06 2024-04-26T10:34:50.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216148+0000", 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6930000000000001e-06 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216153+0000", 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1290000000000004e-06 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216184+0000", 2024-04-26T10:34:50.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190999999999999e-05 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216276+0000", 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2357999999999999e-05 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216337+0000", 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1171000000000001e-05 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.969 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.218045+0000", 2024-04-26T10:34:50.970 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017078060000000001 2024-04-26T10:34:50.970 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.970 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.970 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.970 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288778+0000", 2024-04-26T10:34:50.970 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.070732858999999995 2024-04-26T10:34:50.970 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.970 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.970 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.970 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288831+0000", 2024-04-26T10:34:50.970 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2751999999999999e-05 2024-04-26T10:34:50.970 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288863+0000", 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2872e-05 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204868 5.d 5:b5b0e42d:::benchmark_data_smithi043_45180_object70226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 7.6155214359999999, 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.065177963000000005, 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:50.971 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204868 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:50.972 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225135+0000", 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225140+0000", 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2390000000000004e-06 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.973 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:50.974 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225148+0000", 2024-04-26T10:34:50.974 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:34:50.974 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.974 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.974 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:50.974 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225153+0000", 2024-04-26T10:34:50.974 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1200000000000001e-06 2024-04-26T10:34:50.974 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.974 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.974 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:50.974 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225181+0000", 2024-04-26T10:34:50.974 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8225000000000002e-05 2024-04-26T10:34:50.974 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225262+0000", 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0817999999999998e-05 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225326+0000", 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3986999999999996e-05 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.227004+0000", 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016777879999999999 2024-04-26T10:34:50.975 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290265+0000", 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063261060999999993 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290289+0000", 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4012999999999999e-05 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290314+0000", 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5011000000000002e-05 2024-04-26T10:34:50.976 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.977 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.977 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.977 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:50.977 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:50.977 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:50.978 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:50.977+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:50.979 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:51.079 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:51.078+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:51.173 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:224242 5.2 5:4786fb8e:::benchmark_data_smithi043_45180_object89600:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.164730+0000", 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.006355762, 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0063841200000000001, 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 224242 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.164730+0000", 2024-04-26T10:34:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.164730+0000", 2024-04-26T10:34:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.164730+0000", 2024-04-26T10:34:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.164733+0000", 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.667e-06 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.164739+0000", 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7689999999999999e-06 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.164744+0000", 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0590000000000002e-06 2024-04-26T10:34:51.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166887+0000", 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021424410000000001 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.167001+0000", 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114277 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171103+0000", 2024-04-26T10:34:51.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0041018360000000002 2024-04-26T10:34:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:224244 5.6 5:68272e09:::benchmark_data_smithi043_45180_object89602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:34:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.164784+0000", 2024-04-26T10:34:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0063024040000000002, 2024-04-26T10:34:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0064277149999999996, 2024-04-26T10:34:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.178 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 224244 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.164784+0000", 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.164784+0000", 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.164783+0000", 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.164786+0000", 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8150000000000002e-06 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.164793+0000", 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.046e-06 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.164799+0000", 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168451+0000", 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003652233 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168641+0000", 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018953000000000001 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:224243 5.0 e62/42 5:0aa1e8c9:::benchmark_data_smithi043_45180_object89601:head v 62'13994, mlcod=62'13992)", 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.165083+0000", 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0060034370000000004, 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0062169429999999999, 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.165083+0000", 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.165083+0000", 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.165082+0000", 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.165088+0000", 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5799999999999999e-06 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.165097+0000", 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1220000000000001e-06 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.165103+0000", 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.891e-06 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166814+0000", 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001711153 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166833+0000", 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9034000000000001e-05 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:224247 5.a 5:538cf5a5:::benchmark_data_smithi043_45180_object89605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.166497+0000", 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0045895299999999997, 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0048900439999999996, 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.185 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 224247 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166497+0000", 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166497+0000", 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166496+0000", 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166500+0000", 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.788e-06 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166507+0000", 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7039999999999997e-06 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166512+0000", 2024-04-26T10:34:51.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0660000000000003e-06 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166879+0000", 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00036750699999999999 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.167002+0000", 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122788 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.167115+0000", 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000112695 2024-04-26T10:34:51.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.169372+0000", 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022575400000000002 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171286+0000", 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00191439 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171345+0000", 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8904999999999999e-05 2024-04-26T10:34:51.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171387+0000", 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1307000000000003e-05 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:224246 5.8 e62/16 5:1aea8a4c:::benchmark_data_smithi043_45180_object89604:head v 62'14308, mlcod=62'14305)", 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.166729+0000", 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.004357044, 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0048001759999999997, 2024-04-26T10:34:51.190 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166729+0000", 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166729+0000", 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166729+0000", 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967296 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166732+0000", 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9390000000000002e-06 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166737+0000", 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3410000000000002e-06 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.166740+0000", 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9270000000000001e-06 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168844+0000", 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002103461 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168861+0000", 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.732e-05 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.193 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:224250 5.0 e62/42 5:0d4942b8:::benchmark_data_smithi043_45180_object89608:head v 62'13995, mlcod=62'13992)", 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.168360+0000", 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0027263349999999999, 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003250157, 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168360+0000", 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168360+0000", 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168359+0000", 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168365+0000", 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9440000000000002e-06 2024-04-26T10:34:51.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168374+0000", 2024-04-26T10:34:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6070000000000008e-06 2024-04-26T10:34:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168380+0000", 2024-04-26T10:34:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0290000000000002e-06 2024-04-26T10:34:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170643+0000", 2024-04-26T10:34:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002262919 2024-04-26T10:34:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170667+0000", 2024-04-26T10:34:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4539999999999999e-05 2024-04-26T10:34:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.197 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:224252 5.7 5:e8635754:::benchmark_data_smithi043_45180_object89610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:34:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.168887+0000", 2024-04-26T10:34:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.002199552, 2024-04-26T10:34:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028149020000000002, 2024-04-26T10:34:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 224252 2024-04-26T10:34:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168887+0000", 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168887+0000", 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168886+0000", 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168890+0000", 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1829999999999996e-06 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168899+0000", 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3279999999999995e-06 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168906+0000", 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2019999999999998e-06 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.169000+0000", 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3539e-05 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.169087+0000", 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6773000000000004e-05 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:224253 5.7 5:eaef474e:::benchmark_data_smithi043_45180_object89611:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.168917+0000", 2024-04-26T10:34:51.201 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0021691050000000002, 2024-04-26T10:34:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923629999999998, 2024-04-26T10:34:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-26T10:34:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 224253 2024-04-26T10:34:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168917+0000", 2024-04-26T10:34:51.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168917+0000", 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168917+0000", 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168919+0000", 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2419999999999999e-06 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168925+0000", 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7060000000000001e-06 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.168929+0000", 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.826e-06 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171687+0000", 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027580439999999999 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:224254 5.2 5:439560b8:::benchmark_data_smithi043_45180_object89612:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.169157+0000", 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0019294259999999999, 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027288680000000002, 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 224254 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.169157+0000", 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.169157+0000", 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.169156+0000", 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.169160+0000", 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6720000000000002e-06 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.169168+0000", 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9179999999999994e-06 2024-04-26T10:34:51.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.169174+0000", 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9179999999999999e-06 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.169208+0000", 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4839000000000003e-05 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.169318+0000", 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000109918 2024-04-26T10:34:51.208 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:224255 5.e e62/16 5:784278cc:::benchmark_data_smithi043_45180_object89613:head v 62'13927, mlcod=62'13924)", 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.170794+0000", 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0002921, 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011590070000000001, 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170794+0000", 2024-04-26T10:34:51.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170794+0000", 2024-04-26T10:34:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170794+0000", 2024-04-26T10:34:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170800+0000", 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.139e-06 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170808+0000", 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7949999999999996e-06 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170816+0000", 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0990000000000001e-06 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170950+0000", 2024-04-26T10:34:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000133993 2024-04-26T10:34:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170971+0000", 2024-04-26T10:34:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1294999999999999e-05 2024-04-26T10:34:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:224257 5.5 5:a88df573:::benchmark_data_smithi043_45180_object89615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.170837+0000", 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00024903600000000001, 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00117983, 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 224257 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170837+0000", 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170837+0000", 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170836+0000", 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170841+0000", 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3950000000000003e-06 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170849+0000", 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170856+0000", 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8619999999999997e-06 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171017+0000", 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016110399999999999 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171125+0000", 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010760999999999999 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:224256 5.0 e62/42)", 2024-04-26T10:34:51.216 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.170895+0000", 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00019100200000000001, 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001186568, 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170895+0000", 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170895+0000", 2024-04-26T10:34:51.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170895+0000", 2024-04-26T10:34:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170899+0000", 2024-04-26T10:34:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4449999999999998e-06 2024-04-26T10:34:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170906+0000", 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2799999999999998e-06 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170911+0000", 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9239999999999998e-06 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:224259 5.7 5.b7845437 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.170967+0000", 2024-04-26T10:34:51.219 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.000119463, 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011629769999999999, 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 224259 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170967+0000", 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170967+0000", 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170966+0000", 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170969+0000", 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1410000000000001e-06 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170978+0000", 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9069999999999996e-06 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.170985+0000", 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1269999999999997e-06 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:224260 5.b e62/42 5:d337af04:::benchmark_data_smithi043_45180_object89618:head v 62'14216, mlcod=62'14214)", 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:51.171372+0000", 2024-04-26T10:34:51.222 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9997144, 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00081660299999999995, 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171372+0000", 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171372+0000", 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171372+0000", 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171380+0000", 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5830000000000007e-06 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171392+0000", 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2322e-05 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171401+0000", 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2470000000000008e-06 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171454+0000", 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3740999999999999e-05 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:51.171482+0000", 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7161e-05 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.225 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:34:51.226 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 14 2024-04-26T10:34:51.226 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:51.227 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:51.225+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:51.228 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:51.331 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:51.330+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:51.429 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:51.427+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:51.465 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:51.465 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:51.466 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:34:51.466 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:34:51.466 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:51.478 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:51.529 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:51.528+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:51.630 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:51.629+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:51.657 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-26T10:34:51.716 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:51.716 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:51.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:51.716 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.912069900000006, 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:51.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:51.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:51.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:51.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:51.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:51.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:51.722 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.912068915000006, 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:51.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:51.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:51.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.912000292000002, 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.727 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.728 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:51.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.728 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:51.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:51.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:51.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:51.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.735 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.911948511999995, 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.736 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:51.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:51.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:51.741 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.911888661999996, 2024-04-26T10:34:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:51.745 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:51.747 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.910175957999996, 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:51.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:51.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:51.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:51.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:51.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.910060891000001, 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.753 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.757 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.909967750999996, 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.760 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:51.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.909773591000004, 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:51.763 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:51.767 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.908566222999994, 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:51.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:51.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:51.771 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.907757314999998, 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:51.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.907653776999993, 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.777 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:51.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:51.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:51.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.907576903999995, 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:51.783 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:51.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 83.907461519999998, 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:51.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:51.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.530817466999999, 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.793 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:51.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.797 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.798 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.528787618999999, 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:51.799 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.800 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.801 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:51.802 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:51.803 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.528311815999999, 2024-04-26T10:34:51.804 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.805 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.806 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.807 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.808 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:51.809 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.526344762000001, 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.810 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:51.811 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.812 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.813 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:51.814 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.815 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 53.523677024000001, 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.816 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.817 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.818 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:51.819 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:51.820 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:204862 5.5 5:a0d5a512:::benchmark_data_smithi043_45180_object70220:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 8.4917043979999995, 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.069348507000000004, 2024-04-26T10:34:51.821 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 204862 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:51.822 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221036+0000", 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4099999999999998e-06 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.823 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221042+0000", 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7379999999999999e-06 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221047+0000", 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6569999999999996e-06 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221081+0000", 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3948000000000001e-05 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.824 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221203+0000", 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122359 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221313+0000", 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110268 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.223990+0000", 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026766519999999999 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.825 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290298+0000", 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066308304999999998 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290346+0000", 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7494000000000003e-05 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290383+0000", 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7061999999999999e-05 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.826 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:51.827 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:51.827 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:51.828 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:51.829 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:51.827+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:51.929 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:51.928+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:52.014 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:52.014 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:52.014 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.014 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:226591 5.e 5:779d7919:::benchmark_data_smithi043_45180_object91949:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:34:52.014 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:52.009097+0000", 2024-04-26T10:34:52.014 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0032047970000000001, 2024-04-26T10:34:52.014 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003232132, 2024-04-26T10:34:52.014 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.014 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:52.014 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.014 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.015 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.015 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 226591 2024-04-26T10:34:52.015 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.015 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.015 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.015 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.015 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009097+0000", 2024-04-26T10:34:52.015 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.015 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.015 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.015 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.015 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009097+0000", 2024-04-26T10:34:52.015 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009096+0000", 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009100+0000", 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.374e-06 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.016 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009109+0000", 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7960000000000001e-06 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009114+0000", 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9320000000000004e-06 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009148+0000", 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4291000000000001e-05 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.017 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009267+0000", 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011857399999999999 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009379+0000", 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011186799999999999 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011592+0000", 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002213582 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.018 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:226592 5.0 5:0ffd44bf:::benchmark_data_smithi043_45180_object91950:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:52.009132+0000", 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0031698400000000002, 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003289204, 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 226592 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.019 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009132+0000", 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009132+0000", 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009131+0000", 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.020 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009134+0000", 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.128e-06 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009141+0000", 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5749999999999997e-06 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009147+0000", 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.246e-06 2024-04-26T10:34:52.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009181+0000", 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3898e-05 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009292+0000", 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011141000000000001 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009390+0000", 2024-04-26T10:34:52.022 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7304000000000002e-05 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011611+0000", 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0022210540000000001 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:226594 5.8 5:159ebbf8:::benchmark_data_smithi043_45180_object91952:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:52.009152+0000", 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0031495799999999999, 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0033599630000000001, 2024-04-26T10:34:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 226594 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009152+0000", 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.024 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009152+0000", 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009151+0000", 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009153+0000", 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7850000000000001e-06 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.025 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009157+0000", 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.517e-06 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009160+0000", 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8600000000000001e-06 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009204+0000", 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4286999999999998e-05 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.026 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009325+0000", 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012105800000000001 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009439+0000", 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000113509 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:226596 5.4 5:25d671fe:::benchmark_data_smithi043_45180_object91954:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:34:52.027 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:52.009560+0000", 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0027414269999999998, 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0030106920000000001, 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 226596 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009560+0000", 2024-04-26T10:34:52.028 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009560+0000", 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009559+0000", 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009563+0000", 2024-04-26T10:34:52.029 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9480000000000001e-06 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009570+0000", 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1980000000000004e-06 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009575+0000", 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9400000000000001e-06 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.030 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009611+0000", 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5454000000000003e-05 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009722+0000", 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000111576 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009825+0000", 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010294 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.031 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011991+0000", 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0021657730000000002 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:226597 5.f 5:fe412444:::benchmark_data_smithi043_45180_object91955:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:52.009970+0000", 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0023312430000000002, 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002648362, 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:52.032 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 226597 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009970+0000", 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009970+0000", 2024-04-26T10:34:52.033 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.034 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.034 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.034 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.034 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009969+0000", 2024-04-26T10:34:52.034 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.034 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.034 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.034 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.034 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009973+0000", 2024-04-26T10:34:52.034 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7910000000000002e-06 2024-04-26T10:34:52.034 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.034 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.034 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009984+0000", 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0705e-05 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.009991+0000", 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6340000000000003e-06 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.010032+0000", 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1338999999999998e-05 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.035 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.010150+0000", 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011784499999999999 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:226598 5.f 5:f3f1fa95:::benchmark_data_smithi043_45180_object91956:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:52.010530+0000", 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0017715420000000001, 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0021296800000000001, 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.036 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 226598 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.010530+0000", 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.010530+0000", 2024-04-26T10:34:52.037 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.038 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.038 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.038 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.038 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.010529+0000", 2024-04-26T10:34:52.038 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.038 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.038 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.038 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.038 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.010533+0000", 2024-04-26T10:34:52.038 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6459999999999999e-06 2024-04-26T10:34:52.038 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.038 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.038 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.010541+0000", 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1659999999999994e-06 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.010547+0000", 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7640000000000002e-06 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.012185+0000", 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016380430000000001 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.039 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.012311+0000", 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000125771 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:226600 5.9 5:9bdfb6e5:::benchmark_data_smithi043_45180_object91958:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:52.011602+0000", 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00069902300000000001, 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0010965390000000001, 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.040 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 226600 2024-04-26T10:34:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011602+0000", 2024-04-26T10:34:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011602+0000", 2024-04-26T10:34:52.041 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011602+0000", 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011606+0000", 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7790000000000003e-06 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.042 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011616+0000", 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.3989999999999993e-06 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011622+0000", 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.767e-06 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011659+0000", 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7240000000000003e-05 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.043 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011767+0000", 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000108433 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:226601 5.9 5.8dee1a89 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:52.011633+0000", 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00066790399999999998, 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001104863, 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.044 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 226601 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011633+0000", 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011633+0000", 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.045 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011633+0000", 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011636+0000", 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.072e-06 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011643+0000", 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6189999999999996e-06 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.046 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011650+0000", 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9770000000000003e-06 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:226602 5.8 5:1d126f69:::benchmark_data_smithi043_45180_object91960:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:52.011656+0000", 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00064534399999999995, 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001120568, 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:52.047 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 226602 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011656+0000", 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011656+0000", 2024-04-26T10:34:52.048 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011656+0000", 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011658+0000", 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4679999999999999e-06 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011664+0000", 2024-04-26T10:34:52.049 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9719999999999997e-06 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011669+0000", 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9150000000000004e-06 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011705+0000", 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6480000000000003e-05 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.050 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011789+0000", 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3032000000000001e-05 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011868+0000", 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9105999999999998e-05 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:226603 5.8 5.c7769828 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:52.011724+0000", 2024-04-26T10:34:52.051 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00057786899999999995, 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0010992599999999999, 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 226603 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011724+0000", 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.052 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011724+0000", 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011723+0000", 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011727+0000", 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9430000000000002e-06 2024-04-26T10:34:52.053 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011735+0000", 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4929999999999998e-06 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011746+0000", 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1252e-05 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.054 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:226604 5.b 5:dd4c312b:::benchmark_data_smithi043_45180_object91962:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:52.011816+0000", 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00048537, 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0010428169999999999, 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 226604 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011816+0000", 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011816+0000", 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011815+0000", 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.056 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011819+0000", 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.738e-06 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011827+0000", 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5059999999999998e-06 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011833+0000", 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0009999999999998e-06 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.057 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011872+0000", 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9140000000000001e-05 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.011987+0000", 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000115572 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:52.012088+0000", 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010090399999999999 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.058 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.059 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:34:52.059 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 11 2024-04-26T10:34:52.059 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:52.060 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:52.060 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:52.058+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:52.161 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:52.159+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:52.262 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:52.261+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:52.276 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:52.276 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:52.277 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:52.277 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:52.277 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:52.290 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:52.363 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:52.362+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:52.463 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:52.462+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:52.511 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:52.511 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:52.511 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:52.511 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:52.511 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.511 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:52.511 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:52.511 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 84.708274899000003, 2024-04-26T10:34:52.511 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:52.511 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.511 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.511 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.515 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:52.516 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 84.707446818999998, 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.517 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.518 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.519 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.520 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:52.521 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.522 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 84.706517755999997, 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.523 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.524 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.525 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.526 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.526 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:52.526 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:52.526 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.526 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.526 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.526 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:52.526 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:52.526 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.526 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.526 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.526 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:52.526 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.527 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:52.528 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 84.705832314999995, 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:52.530 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:52.531 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:52.532 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:52.533 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.129541873000001, 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.534 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.535 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.536 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.537 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:52.538 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.539 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.129322569000003, 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.540 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:52.541 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.541 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.541 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.541 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.541 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:52.541 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.541 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.541 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.541 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.541 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:52.541 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.541 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.541 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:52.542 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:52.543 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:52.544 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.129242763999997, 2024-04-26T10:34:52.545 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:52.546 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.546 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.546 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.546 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.546 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.546 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:52.546 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.546 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.546 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.546 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.546 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:52.546 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.546 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:52.547 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:52.548 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.549 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.550 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.127878733999999, 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.551 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:52.552 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.553 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:52.554 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:52.554 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.554 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.554 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.554 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:52.554 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:52.554 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.554 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.554 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.554 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:52.554 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:52.554 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.554 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.555 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.555 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:52.555 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:52.555 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.555 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.555 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.555 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:52.555 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:52.555 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.555 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.555 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.555 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:52.555 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.556 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.127284396999997, 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.557 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.558 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:52.559 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.560 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.561 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.562 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.126524041000003, 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:52.563 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.564 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.564 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.564 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.564 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:52.564 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.564 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.564 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.564 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.564 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:52.564 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.564 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.564 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.564 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.565 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:52.565 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:52.565 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.565 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.565 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.565 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:52.565 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:52.565 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.565 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.565 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.565 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:52.565 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:52.565 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.566 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.566 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.566 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:52.566 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:52.566 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.566 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.566 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.566 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:52.566 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:52.566 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.566 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.566 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.566 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.567 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.568 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.569 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.569 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.569 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:52.569 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:52.569 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.125906581000002, 2024-04-26T10:34:52.569 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:52.569 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.569 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.569 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.569 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.569 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.569 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:52.569 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.570 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.571 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.572 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.573 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.574 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.125341577999997, 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.575 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.577 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.578 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:52.578 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:52.578 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.578 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.578 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.578 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:52.578 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:52.578 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.578 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.578 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.578 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:52.578 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:52.578 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.124798265999999, 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.579 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.580 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.581 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.582 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:52.582 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:52.582 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.582 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.582 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.582 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:52.582 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:52.582 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.582 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.582 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.582 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:52.582 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:52.582 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:52.583 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.584 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.123326265999999, 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.585 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.586 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:52.586 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.586 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.586 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.586 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.586 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:52.586 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.586 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.586 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.586 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.586 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:52.586 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:52.586 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:52.587 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:52.588 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:52.589 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.122760845999998, 2024-04-26T10:34:52.590 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:52.592 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:52.593 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.594 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.595 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:52.595 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:52.595 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.122695995999997, 2024-04-26T10:34:52.595 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:52.595 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.595 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.595 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.595 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.595 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.595 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:52.595 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.595 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.595 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:52.596 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:52.597 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.121935016000002, 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.599 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.600 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.601 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.602 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:52.602 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:52.602 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.602 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.602 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.602 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:52.602 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:52.602 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.602 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.602 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.602 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:52.602 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:52.602 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 54.120913588000001, 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:52.603 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:52.604 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:52.605 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:52.606 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204849 5.d 5:bce18511:::benchmark_data_smithi043_45180_object70207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.2921004780000001, 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.072723889999999999, 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204849 2024-04-26T10:34:52.607 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216139+0000", 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.608 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216142+0000", 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4480000000000001e-06 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216148+0000", 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6930000000000001e-06 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216153+0000", 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1290000000000004e-06 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.609 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216184+0000", 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190999999999999e-05 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216276+0000", 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2357999999999999e-05 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216337+0000", 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1171000000000001e-05 2024-04-26T10:34:52.610 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.218045+0000", 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017078060000000001 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288778+0000", 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.070732858999999995 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288831+0000", 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2751999999999999e-05 2024-04-26T10:34:52.611 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288863+0000", 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2872e-05 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204868 5.d 5:b5b0e42d:::benchmark_data_smithi043_45180_object70226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.2831039359999998, 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.065177963000000005, 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:52.612 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204868 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:52.613 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225135+0000", 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225140+0000", 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2390000000000004e-06 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225148+0000", 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:34:52.614 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225153+0000", 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1200000000000001e-06 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225181+0000", 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8225000000000002e-05 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225262+0000", 2024-04-26T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0817999999999998e-05 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225326+0000", 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3986999999999996e-05 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.227004+0000", 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016777879999999999 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290265+0000", 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063261060999999993 2024-04-26T10:34:52.616 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.617 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.617 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:52.617 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290289+0000", 2024-04-26T10:34:52.617 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4012999999999999e-05 2024-04-26T10:34:52.617 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:52.617 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:52.617 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:52.617 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290314+0000", 2024-04-26T10:34:52.617 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5011000000000002e-05 2024-04-26T10:34:52.617 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.617 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.617 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.617 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:52.618 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:52.618 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:52.618 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:34:52.620 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:52.620 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:52.617+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:52.720 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:52.719+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:52.771 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:52.794 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:52.795 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T10:34:52.795 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:52.795 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:52.797 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:34:52.797 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:34:52.809 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:52.809 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:52.820 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:52.819+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:52.828 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:52.921 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:52.920+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:53.022 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:53.021+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:53.057 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:53.057 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:53.072 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:53.123 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:53.122+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:53.224 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:53.223+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:53.310 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:53.310 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:53.324 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:53.325 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:53.323+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:53.425 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:53.424+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:53.458 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-26T10:34:53.458 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:34:53.458 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T10:34:53.459 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T10:34:53.459 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T10:34:53.459 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T10:34:53.501 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:53.501 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:53.514 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:53.555 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:53.554+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:53.629 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:53.627+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:53.644 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:53.645 INFO:teuthology.orchestra.run.smithi186.stdout: "success": "" 2024-04-26T10:34:53.645 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:53.669 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:34:53.728 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:53.726+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:53.741 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:53.741 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:53.758 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:53.828 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:53.827+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:53.928 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:53.928+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:53.940 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:53.940 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:53.953 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:54.029 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:54.028+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:54.130 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:54.130+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:54.147 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:54.147 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:54.158 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:54.244 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:54.243+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:54.333 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:54.332+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:54.388 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:54.389 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:54.402 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:54.434 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:54.433+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:54.535 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:54.535+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:54.635 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:54.634+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:54.651 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:54.651 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:54.659 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-26T10:34:54.669 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:54.736 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:54.735+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:54.798 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:54.836 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:54.836+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:54.846 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:54.847 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:54.861 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:54.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-04-26T10:34:54.938 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:54.936+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:54.950 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:54.973 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:54.974 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T10:34:54.974 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:54.974 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:54.976 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:34:54.977 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:34:55.034 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:55.034 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:55.034 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:55.034 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:55.035 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:55.039 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:55.037+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:55.049 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:55.140 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:55.139+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:55.241 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:55.240+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:55.271 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:55.271 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:55.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:55.271 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:55.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.271 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:55.271 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:55.271 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 87.467511525999996, 2024-04-26T10:34:55.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:55.271 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.274 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:55.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:55.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:55.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:55.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:55.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:55.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:55.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.276 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.277 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.277 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:55.277 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:55.277 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 87.466683446000005, 2024-04-26T10:34:55.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:55.277 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.277 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.277 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.277 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.277 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.278 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:55.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.278 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.278 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.278 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:55.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.278 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.278 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:55.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:55.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:55.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.280 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:55.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:55.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.280 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:55.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:55.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:55.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:55.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:55.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:55.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:55.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 87.465754383000004, 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.283 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:55.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:55.286 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.286 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:55.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:55.286 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.286 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:55.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 87.465068942000002, 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.289 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:55.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:55.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:55.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.293 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.888778500000001, 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.295 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:55.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.297 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:55.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:55.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.297 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:55.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:55.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.297 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:55.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:55.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:55.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:55.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:55.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:55.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:55.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:55.299 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.888559196000003, 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:55.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:55.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.302 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:55.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:55.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:55.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:55.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:55.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:55.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.888479390999997, 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.305 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.306 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.306 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.306 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:55.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.306 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:55.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.308 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.310 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.887115360999999, 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:55.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:55.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.315 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:55.316 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.886521023999997, 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:55.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:55.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:55.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:55.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.321 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.885760668000003, 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.322 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:55.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:55.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:55.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.326 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:55.326 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:55.326 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:55.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.326 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.326 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:55.326 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:55.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.326 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.327 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.885143208000002, 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.328 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:55.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.333 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.884578204999997, 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.337 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.338 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:55.338 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:55.338 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.884034892999999, 2024-04-26T10:34:55.338 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:55.338 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.338 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.338 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.338 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.338 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.338 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:55.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.340 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.341 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.342 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:55.343 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.882562892999999, 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:55.344 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.345 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.346 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.347 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.348 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.881997472999998, 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.349 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:55.350 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:55.351 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.352 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:55.353 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.881932622999997, 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.354 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.355 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.355 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.355 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:55.355 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.355 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.355 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.355 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.355 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:55.355 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:55.355 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.355 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.355 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.356 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.357 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.881171643000002, 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.358 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:55.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.360 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.360 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.360 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:55.360 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:55.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.360 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.360 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.360 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:55.360 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:55.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.360 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:55.361 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.362 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.362 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.362 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.362 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.362 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:55.362 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:55.362 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 56.880150215, 2024-04-26T10:34:55.362 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:55.362 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.362 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.362 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.362 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.362 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:55.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:55.365 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:55.366 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.366 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.366 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.366 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:55.366 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:55.366 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.366 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.366 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.366 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.366 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.366 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204849 5.d 5:bce18511:::benchmark_data_smithi043_45180_object70207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:55.366 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:55.366 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.051337105, 2024-04-26T10:34:55.367 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.072723889999999999, 2024-04-26T10:34:55.367 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.367 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.367 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.367 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.367 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.367 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204849 2024-04-26T10:34:55.367 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.367 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.367 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.367 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.367 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:55.367 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216139+0000", 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216142+0000", 2024-04-26T10:34:55.368 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4480000000000001e-06 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216148+0000", 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6930000000000001e-06 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216153+0000", 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1290000000000004e-06 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.369 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216184+0000", 2024-04-26T10:34:55.370 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190999999999999e-05 2024-04-26T10:34:55.370 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.370 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.370 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.370 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216276+0000", 2024-04-26T10:34:55.370 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2357999999999999e-05 2024-04-26T10:34:55.370 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.370 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.370 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216337+0000", 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1171000000000001e-05 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.218045+0000", 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017078060000000001 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288778+0000", 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.070732858999999995 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.371 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.372 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288831+0000", 2024-04-26T10:34:55.372 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2751999999999999e-05 2024-04-26T10:34:55.372 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.372 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.372 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.372 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288863+0000", 2024-04-26T10:34:55.372 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2872e-05 2024-04-26T10:34:55.372 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.372 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.372 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.372 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.372 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.372 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204868 5.d 5:b5b0e42d:::benchmark_data_smithi043_45180_object70226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 12.042340563, 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.065177963000000005, 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204868 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:55.373 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.374 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.374 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.374 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:55.374 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:55.374 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:55.374 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.374 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.374 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:55.374 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225135+0000", 2024-04-26T10:34:55.374 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.374 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.374 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.374 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225140+0000", 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2390000000000004e-06 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225148+0000", 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225153+0000", 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1200000000000001e-06 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.375 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225181+0000", 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8225000000000002e-05 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225262+0000", 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0817999999999998e-05 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225326+0000", 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3986999999999996e-05 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.376 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.227004+0000", 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016777879999999999 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290265+0000", 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063261060999999993 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290289+0000", 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4012999999999999e-05 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:55.377 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:55.378 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290314+0000", 2024-04-26T10:34:55.378 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5011000000000002e-05 2024-04-26T10:34:55.378 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.378 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.378 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.378 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:55.378 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:55.378 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:55.379 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:55.378+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:55.380 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:55.483 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:55.479+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:55.581 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:55.580+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:55.582 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:236655 5.3 5:cea4416b:::benchmark_data_smithi043_45180_object102013:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:34:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:55.577012+0000", 2024-04-26T10:34:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0011740660000000001, 2024-04-26T10:34:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001199531, 2024-04-26T10:34:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:55.582 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 236655 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577012+0000", 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577012+0000", 2024-04-26T10:34:55.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577011+0000", 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577016+0000", 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.391e-06 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:55.584 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577024+0000", 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0579999999999998e-06 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577029+0000", 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5099999999999998e-06 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577064+0000", 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4669000000000003e-05 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577171+0000", 2024-04-26T10:34:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000106495 2024-04-26T10:34:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:236660 5.a 5:5add5f5f:::benchmark_data_smithi043_45180_object102018:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:34:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:55.577068+0000", 2024-04-26T10:34:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0011184789999999999, 2024-04-26T10:34:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0012193620000000001, 2024-04-26T10:34:55.586 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 236660 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577068+0000", 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:55.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577068+0000", 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577067+0000", 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577071+0000", 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9400000000000004e-06 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:55.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577080+0000", 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4109999999999996e-06 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577086+0000", 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.319e-06 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577118+0000", 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1862000000000001e-05 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577233+0000", 2024-04-26T10:34:55.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000114707 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577325+0000", 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2068e-05 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:236662 5.3 5.bd56ccd3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:55.577197+0000", 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00098987199999999993, 2024-04-26T10:34:55.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011618799999999999, 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 236662 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577197+0000", 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577197+0000", 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577196+0000", 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577200+0000", 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577208+0000", 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1629999999999996e-06 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577215+0000", 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6660000000000002e-06 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:236665 5.2 5.bdcc4012 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:55.577460+0000", 2024-04-26T10:34:55.593 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00072637500000000002, 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00095045600000000002, 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 236665 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577460+0000", 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.594 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577460+0000", 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577460+0000", 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577463+0000", 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.692e-06 2024-04-26T10:34:55.595 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577473+0000", 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9550000000000004e-06 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577481+0000", 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6459999999999993e-06 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.596 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:236657 5.b e64/42)", 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:55.577494+0000", 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00069297900000000003, 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00096771699999999999, 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577494+0000", 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577494+0000", 2024-04-26T10:34:55.597 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577493+0000", 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577497+0000", 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9310000000000001e-06 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577504+0000", 2024-04-26T10:34:55.598 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.905e-06 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577508+0000", 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2629999999999997e-06 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:236659 5.0 e64/42 5:01421899:::benchmark_data_smithi043_45180_object102017:head v 64'14744, mlcod=64'14742)", 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:55.577517+0000", 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00066909399999999996, 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00099054299999999998, 2024-04-26T10:34:55.599 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577517+0000", 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577517+0000", 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.600 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577517+0000", 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577520+0000", 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9620000000000002e-06 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577526+0000", 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.959e-06 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.601 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577530+0000", 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3109999999999999e-06 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577552+0000", 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2089000000000001e-05 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577564+0000", 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1462e-05 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.602 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:236661 5.e e64/16 5:7f5cb371:::benchmark_data_smithi043_45180_object102019:head v 64'14701, mlcod=64'14699)", 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:55.577555+0000", 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00063125500000000005, 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001009416, 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577555+0000", 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.603 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577555+0000", 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577555+0000", 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577559+0000", 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5200000000000002e-06 2024-04-26T10:34:55.604 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577564+0000", 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9279999999999998e-06 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577569+0000", 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3460000000000004e-06 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577606+0000", 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6949999999999997e-05 2024-04-26T10:34:55.605 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.577625+0000", 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9125000000000001e-05 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:236642 5.2 5:47e5cc8d:::benchmark_data_smithi043_45180_object102000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:55.571315+0000", 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0068713309999999996, 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073098499999999997, 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:55.606 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 236642 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.571315+0000", 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:55.607 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.571315+0000", 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.571315+0000", 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.571318+0000", 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3790000000000002e-06 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.571326+0000", 2024-04-26T10:34:55.608 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3040000000000005e-06 2024-04-26T10:34:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.571332+0000", 2024-04-26T10:34:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:34:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:55.609 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.573567+0000", 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022350249999999999 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.573685+0000", 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000117663 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:236644 5.a 5:5f2b8a78:::benchmark_data_smithi043_45180_object102002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:55.571358+0000", 2024-04-26T10:34:55.610 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0068282789999999996, 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0073533369999999997, 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 236644 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.571358+0000", 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.571358+0000", 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.571358+0000", 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.571360+0000", 2024-04-26T10:34:55.612 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1110000000000002e-06 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.571365+0000", 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1580000000000004e-06 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.571370+0000", 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4800000000000003e-06 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.573060+0000", 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001690167 2024-04-26T10:34:55.613 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.573165+0000", 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105216 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.573275+0000", 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010954 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.575670+0000", 2024-04-26T10:34:55.614 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023952750000000001 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:236650 5.2 5:433aa536:::benchmark_data_smithi043_45180_object102008:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:55.573675+0000", 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0045118479999999997, 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0051218909999999999, 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:55.615 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 236650 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.573675+0000", 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.573675+0000", 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.573674+0000", 2024-04-26T10:34:55.616 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.573677+0000", 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6929999999999999e-06 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.573683+0000", 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3060000000000003e-06 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:55.617 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.573688+0000", 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8300000000000003e-06 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.575381+0000", 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016924329999999999 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:55.575489+0000", 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000108334 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:55.618 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:34:55.619 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 10 2024-04-26T10:34:55.619 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:55.620 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:55.682 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:55.681+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:55.817 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:55.816+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:55.858 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:55.858 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:34:55.859 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:34:55.859 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:55.875 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:55.916 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:55.915+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:56.018 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:56.016+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:56.115 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:34:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:34:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:34:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.308194090000001, 2024-04-26T10:34:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:34:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.116 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.117 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:34:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:34:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:34:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.118 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.119 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.120 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:34:56.121 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:34:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.308193105000001, 2024-04-26T10:34:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:34:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.122 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.123 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.124 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:34:56.125 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.308124481999997, 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:34:56.126 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.127 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.128 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:34:56.129 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:34:56.130 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:34:56.131 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.308072702000004, 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.132 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.133 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:34:56.134 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:34:56.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:34:56.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.308012852000005, 2024-04-26T10:34:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:34:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:34:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:34:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:34:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:34:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:34:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:34:56.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:34:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:34:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:34:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:34:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:56.143 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.306300148000005, 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:34:56.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.306185080999995, 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.149 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:34:56.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.152 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.306091941000005, 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:34:56.153 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:34:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:34:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:34:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:34:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:34:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:34:56.156 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.157 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.158 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.305897780999999, 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:34:56.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:34:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:34:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:34:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:34:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.304690413000003, 2024-04-26T10:34:56.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:34:56.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:34:56.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.303881505000007, 2024-04-26T10:34:56.167 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:34:56.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:34:56.170 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.303777967000002, 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.173 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:34:56.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:34:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:34:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:34:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:34:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:34:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:34:56.178 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.303701094000004, 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.179 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.180 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.184 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 88.303585709999993, 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:56.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:34:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:34:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:34:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.188 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 57.926941657, 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.189 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:34:56.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:34:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:34:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 57.924911809000001, 2024-04-26T10:34:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:34:56.194 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:34:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:34:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:34:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:34:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:34:56.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:34:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:34:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:34:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:34:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:34:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:34:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:34:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:34:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 57.924436006000001, 2024-04-26T10:34:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:34:56.200 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:34:56.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:34:56.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 57.922468952000003, 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.206 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:34:56.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:34:56.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:34:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:34:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:34:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:34:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.211 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 57.919801214000003, 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:34:56.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:34:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:34:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:34:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:34:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:204862 5.5 5:a0d5a512:::benchmark_data_smithi043_45180_object70220:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:56.217 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 12.887828588, 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.069348507000000004, 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 204862 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:34:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:34:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:34:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:34:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:34:56.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221036+0000", 2024-04-26T10:34:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4099999999999998e-06 2024-04-26T10:34:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:34:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221042+0000", 2024-04-26T10:34:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7379999999999999e-06 2024-04-26T10:34:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221047+0000", 2024-04-26T10:34:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6569999999999996e-06 2024-04-26T10:34:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:34:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221081+0000", 2024-04-26T10:34:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3948000000000001e-05 2024-04-26T10:34:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:34:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221203+0000", 2024-04-26T10:34:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122359 2024-04-26T10:34:56.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221313+0000", 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110268 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.223990+0000", 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026766519999999999 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290298+0000", 2024-04-26T10:34:56.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066308304999999998 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290346+0000", 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7494000000000003e-05 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290383+0000", 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7061999999999999e-05 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.224 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:34:56.225 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:34:56.225 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:56.226 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:56.225+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:56.226 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:56.328 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:56.326+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:56.405 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:56.406 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:56.406 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.406 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:238960 5.e 5:7fbc5c70:::benchmark_data_smithi043_45180_object104318:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:34:56.406 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:56.398548+0000", 2024-04-26T10:34:56.406 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0059872329999999998, 2024-04-26T10:34:56.406 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0060056320000000003, 2024-04-26T10:34:56.406 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 238960 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.398548+0000", 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.407 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.398548+0000", 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.398547+0000", 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.398551+0000", 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.551e-06 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.408 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.398563+0000", 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1992e-05 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.398569+0000", 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8479999999999997e-06 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.398601+0000", 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2634e-05 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.409 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.398678+0000", 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6167000000000004e-05 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.398739+0000", 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1606999999999995e-05 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.402620+0000", 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0038805210000000001 2024-04-26T10:34:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.411 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.411 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.411 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.411 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.411 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:238965 5.8 5:1b520cda:::benchmark_data_smithi043_45180_object104323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:34:56.411 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:56.399624+0000", 2024-04-26T10:34:56.411 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0049108440000000001, 2024-04-26T10:34:56.411 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0049843689999999998, 2024-04-26T10:34:56.411 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.412 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:56.412 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.412 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.412 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.412 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 238965 2024-04-26T10:34:56.412 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.412 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.412 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.412 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.412 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.399624+0000", 2024-04-26T10:34:56.412 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.412 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.412 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.399624+0000", 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.399624+0000", 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.399628+0000", 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3250000000000001e-06 2024-04-26T10:34:56.413 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.414 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.414 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.414 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.399638+0000", 2024-04-26T10:34:56.414 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7159999999999998e-06 2024-04-26T10:34:56.414 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.414 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.414 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.414 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.399644+0000", 2024-04-26T10:34:56.414 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7279999999999998e-06 2024-04-26T10:34:56.414 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.414 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.414 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.414 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.399676+0000", 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1624000000000001e-05 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.399764+0000", 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7394999999999999e-05 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.399828+0000", 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4216999999999999e-05 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403260+0000", 2024-04-26T10:34:56.415 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0034324440000000002 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:238969 5.0 5:02af75b9:::benchmark_data_smithi043_45180_object104327:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:56.400501+0000", 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0040345329999999999, 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041539100000000002, 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.416 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 238969 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.400501+0000", 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.400501+0000", 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.417 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.400500+0000", 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.400503+0000", 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0429999999999999e-06 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.400514+0000", 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1116e-05 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.418 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.400520+0000", 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6899999999999997e-06 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.401663+0000", 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001142613 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.401740+0000", 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7176999999999996e-05 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.419 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.401812+0000", 2024-04-26T10:34:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2291000000000003e-05 2024-04-26T10:34:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:238971 5.b 5:d1659700:::benchmark_data_smithi043_45180_object104329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:34:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:56.403006+0000", 2024-04-26T10:34:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0015288599999999999, 2024-04-26T10:34:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017046380000000001, 2024-04-26T10:34:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.421 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:34:56.421 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.421 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.421 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.421 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 238971 2024-04-26T10:34:56.421 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.421 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.421 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.421 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.421 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403006+0000", 2024-04-26T10:34:56.421 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.421 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.421 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.422 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.422 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403006+0000", 2024-04-26T10:34:56.422 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.422 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.422 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.422 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.422 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403006+0000", 2024-04-26T10:34:56.422 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.423 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.423 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.423 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.423 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403010+0000", 2024-04-26T10:34:56.423 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5449999999999997e-06 2024-04-26T10:34:56.423 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.423 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.423 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.423 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403021+0000", 2024-04-26T10:34:56.423 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270999999999999e-05 2024-04-26T10:34:56.423 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.424 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.424 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.424 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403029+0000", 2024-04-26T10:34:56.424 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9249999999999995e-06 2024-04-26T10:34:56.424 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.424 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.425 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.425 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403067+0000", 2024-04-26T10:34:56.425 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7527999999999997e-05 2024-04-26T10:34:56.425 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.425 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.425 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.426 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403193+0000", 2024-04-26T10:34:56.426 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000126415 2024-04-26T10:34:56.426 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.426 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.426 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.426 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403306+0000", 2024-04-26T10:34:56.427 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112858 2024-04-26T10:34:56.427 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.427 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.427 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.427 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.427 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.428 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:238972 5.9 5:9cf2282a:::benchmark_data_smithi043_45180_object104330:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:34:56.428 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:56.403037+0000", 2024-04-26T10:34:56.428 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0014979119999999999, 2024-04-26T10:34:56.428 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017422010000000001, 2024-04-26T10:34:56.428 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.428 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:56.429 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.429 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.429 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.429 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 238972 2024-04-26T10:34:56.429 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.429 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.430 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.430 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.430 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403037+0000", 2024-04-26T10:34:56.430 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.430 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.430 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.430 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.430 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403037+0000", 2024-04-26T10:34:56.430 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.430 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403037+0000", 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403039+0000", 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.289e-06 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403045+0000", 2024-04-26T10:34:56.431 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9100000000000002e-06 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403050+0000", 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9840000000000001e-06 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403077+0000", 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6771000000000002e-05 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.432 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403155+0000", 2024-04-26T10:34:56.433 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8362999999999995e-05 2024-04-26T10:34:56.433 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.433 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.433 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.433 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.433 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.433 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:238973 5.a e64/16 5:50971fbd:::benchmark_data_smithi043_45180_object104331:head v 64'15089, mlcod=64'15087)", 2024-04-26T10:34:56.433 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:56.403341+0000", 2024-04-26T10:34:56.434 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0011943469999999999, 2024-04-26T10:34:56.434 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014782980000000001, 2024-04-26T10:34:56.434 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.434 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:56.434 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.434 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.434 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.434 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403341+0000", 2024-04-26T10:34:56.434 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.434 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.434 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.434 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403341+0000", 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403340+0000", 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403347+0000", 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2280000000000003e-06 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.435 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403354+0000", 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403358+0000", 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.228e-06 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403398+0000", 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9620999999999999e-05 2024-04-26T10:34:56.436 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403417+0000", 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.8754999999999999e-05 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:238978 5.9 5.26cd0e9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:56.403429+0000", 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.001106337, 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014269110000000001, 2024-04-26T10:34:56.437 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.438 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:34:56.438 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.438 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.438 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.438 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 238978 2024-04-26T10:34:56.438 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.438 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.438 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.438 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.438 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403429+0000", 2024-04-26T10:34:56.438 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.439 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.439 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.439 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.439 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403429+0000", 2024-04-26T10:34:56.439 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.439 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.439 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.439 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.439 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403428+0000", 2024-04-26T10:34:56.439 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.439 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.439 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.439 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403432+0000", 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9179999999999996e-06 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403439+0000", 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1930000000000004e-06 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:56.403445+0000", 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3380000000000004e-06 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.440 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.441 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.441 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:34:56.441 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 7 2024-04-26T10:34:56.441 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:56.442 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:56.441+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:56.443 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:56.543 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:56.541+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:56.644 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:56.643+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:56.661 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:56.662 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:56.662 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:56.662 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:56.662 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:56.671 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:34:56.677 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:56.763 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:56.760+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:56.846 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:56.845+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:56.895 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:56.895 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:56.895 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:56.895 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:56.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.895 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:56.895 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:56.895 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 89.091657427000001, 2024-04-26T10:34:56.895 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:56.895 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:56.899 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:56.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 89.090829346999996, 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.901 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:56.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.905 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 89.089900283999995, 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:56.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:56.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 89.089214842999993, 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:56.912 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.512924400999999, 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.918 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.920 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.512705097000001, 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.923 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:56.925 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.926 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.927 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.512625292000003, 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.929 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.930 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:56.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:56.933 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.511261261999998, 2024-04-26T10:34:56.934 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.935 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.936 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.937 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:56.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:56.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.510666925000002, 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:56.940 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:56.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:56.942 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.943 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.509906569000002, 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:56.945 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.946 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.947 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.948 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.949 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.950 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.509289109000001, 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.951 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.952 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:56.954 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.954 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.954 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.954 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:56.954 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:56.954 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.954 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.954 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.954 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:56.954 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:56.954 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.954 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.954 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.955 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:56.956 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.508724106000003, 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.957 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:56.958 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.508180793999998, 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:56.961 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.962 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.963 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.964 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.965 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.506708793999998, 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.966 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.967 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:56.968 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:56.969 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.969 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.969 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.969 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:56.969 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:56.969 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.969 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.969 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.969 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:56.969 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:56.969 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.969 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.969 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.970 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.971 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.506143373999997, 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.972 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:56.973 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.974 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.974 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.974 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:56.974 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:56.974 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.974 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.974 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.974 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:56.974 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:56.974 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.974 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.974 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.974 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.975 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.506078524000003, 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.976 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.977 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:56.977 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.977 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.977 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.977 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.977 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:56.977 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.977 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.977 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:56.978 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.979 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.979 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.979 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:56.979 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:56.979 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.979 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.979 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.979 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:56.979 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:56.979 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.979 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.979 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.980 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:56.980 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:56.980 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.980 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.980 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.980 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:56.980 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:56.980 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.980 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.980 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.980 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:56.980 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:56.980 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.981 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.981 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.981 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.981 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.981 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:56.981 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:56.981 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.505317544, 2024-04-26T10:34:56.981 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:56.981 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.981 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:56.981 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.982 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.982 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.982 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:56.982 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.982 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.982 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.982 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.982 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:56.982 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.982 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.982 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.982 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.982 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.983 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:56.984 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:56.984 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.984 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.984 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.984 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:56.984 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:56.984 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.984 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.984 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.984 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:56.984 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:56.985 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.985 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.985 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.985 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:56.985 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:56.985 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.985 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.985 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.985 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.985 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.985 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 58.504296115999999, 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.986 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.987 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.989 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204849 5.d 5:bce18511:::benchmark_data_smithi043_45180_object70207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 13.675483006, 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.072723889999999999, 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204849 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.990 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216139+0000", 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.991 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216142+0000", 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4480000000000001e-06 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216148+0000", 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6930000000000001e-06 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216153+0000", 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1290000000000004e-06 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.992 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.993 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:56.993 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216184+0000", 2024-04-26T10:34:56.993 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190999999999999e-05 2024-04-26T10:34:56.993 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.993 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.993 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:56.993 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216276+0000", 2024-04-26T10:34:56.993 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2357999999999999e-05 2024-04-26T10:34:56.993 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.993 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.993 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:56.994 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216337+0000", 2024-04-26T10:34:56.994 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1171000000000001e-05 2024-04-26T10:34:56.994 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.994 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.994 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:56.994 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.218045+0000", 2024-04-26T10:34:56.994 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017078060000000001 2024-04-26T10:34:56.994 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.994 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.994 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:56.994 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288778+0000", 2024-04-26T10:34:56.995 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.070732858999999995 2024-04-26T10:34:56.995 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.995 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.995 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:56.995 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288831+0000", 2024-04-26T10:34:56.995 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2751999999999999e-05 2024-04-26T10:34:56.995 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.995 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.995 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288863+0000", 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2872e-05 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204868 5.d 5:b5b0e42d:::benchmark_data_smithi043_45180_object70226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 13.666486464, 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.065177963000000005, 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:56.996 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:56.997 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:56.997 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204868 2024-04-26T10:34:56.997 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.997 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:56.997 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.997 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:56.997 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:56.997 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.997 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.997 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.997 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:56.997 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:56.997 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:56.998 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.998 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.998 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:56.998 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225135+0000", 2024-04-26T10:34:56.998 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:56.998 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.998 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.998 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:56.999 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225140+0000", 2024-04-26T10:34:56.999 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2390000000000004e-06 2024-04-26T10:34:56.999 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.999 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.999 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:56.999 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225148+0000", 2024-04-26T10:34:56.999 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:34:56.999 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:56.999 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:56.999 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:56.999 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225153+0000", 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1200000000000001e-06 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225181+0000", 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8225000000000002e-05 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225262+0000", 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0817999999999998e-05 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:57.000 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225326+0000", 2024-04-26T10:34:57.001 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3986999999999996e-05 2024-04-26T10:34:57.001 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:57.001 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:57.001 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:57.001 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.227004+0000", 2024-04-26T10:34:57.001 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016777879999999999 2024-04-26T10:34:57.001 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:57.001 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:57.001 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:57.001 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290265+0000", 2024-04-26T10:34:57.001 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063261060999999993 2024-04-26T10:34:57.002 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:57.002 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:57.002 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:57.002 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290289+0000", 2024-04-26T10:34:57.002 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4012999999999999e-05 2024-04-26T10:34:57.002 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:57.002 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:57.002 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:57.003 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290314+0000", 2024-04-26T10:34:57.003 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5011000000000002e-05 2024-04-26T10:34:57.003 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:57.003 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:57.003 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:57.003 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:57.003 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:57.003 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:57.004 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:34:57.006 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:57.004+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:57.006 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:57.105 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:57.104+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:57.157 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:57.181 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:57.181 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T10:34:57.181 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:57.181 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:57.183 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:34:57.184 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:34:57.208 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:57.208 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:57.208 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:57.207+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:57.222 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:57.307 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:57.307+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:57.408 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:57.407+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:57.448 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:57.448 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:57.465 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:57.509 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:57.507+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:57.609 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:57.608+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:57.670 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-26T10:34:57.698 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:57.698 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:57.710 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:57.709+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:57.714 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:57.813 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:57.810+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:57.901 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:57.901 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:57.912 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:57.911+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:57.915 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:58.013 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:58.012+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:58.114 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:58.113+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:58.135 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:58.135 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:58.149 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:58.214 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:58.213+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:58.315 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:58.314+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:58.325 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:58.325 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:58.340 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:58.415 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:58.415+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:58.518 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:58.517+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:58.537 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:58.538 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:58.554 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:58.644 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:58.642+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:58.662 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-26T10:34:58.663 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:34:58.663 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T10:34:58.663 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.900198 2024-04-26T10:34:58.663 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.9001979184368228 2024-04-26T10:34:58.718 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:58.717+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:58.792 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:58.792 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:58.810 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:34:58.819 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:58.817+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:58.920 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:58.919+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:59.023 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:59.022+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:59.042 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:59.042 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:59.057 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:34:59.122 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:59.121+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:59.185 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:34:59.224 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:59.224+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:59.231 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:34:59.231 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:34:59.246 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:34:59.324 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:59.323+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:34:59.337 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:34:59.360 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:34:59.360 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T10:34:59.360 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:34:59.360 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:34:59.362 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:34:59.363 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:34:59.425 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:59.425 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:34:59.425 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:34:59.425 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:34:59.425 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:59.426 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:59.425+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:59.437 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:34:59.526 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:59.525+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:59.627 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:59.626+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:59.657 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:34:59.657 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:34:59.657 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:34:59.657 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:34:59.657 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.657 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:59.657 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:59.657 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 91.853340277000001, 2024-04-26T10:34:59.657 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:34:59.657 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.657 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.658 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.658 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.658 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.658 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:34:59.658 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.658 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.658 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.658 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.658 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:59.658 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.658 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.658 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.658 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.659 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.660 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.661 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:34:59.662 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 91.852512196999996, 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:34:59.663 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:34:59.664 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.665 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.666 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.667 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.668 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 91.851583133999995, 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.669 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.670 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.671 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:34:59.672 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:34:59.673 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 91.850897692999993, 2024-04-26T10:34:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.675 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.676 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.676 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:34:59.676 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.676 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.676 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.676 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.676 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:34:59.676 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:59.676 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.676 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.676 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.676 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:34:59.676 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:34:59.677 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.678 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.679 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.274607250999999, 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.680 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.681 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:34:59.682 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:34:59.683 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:34:59.684 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:34:59.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.685 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.685 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.685 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:34:59.685 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:34:59.685 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.685 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.685 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.685 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:34:59.685 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.274387947000001, 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.686 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.687 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.688 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:34:59.688 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:59.688 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.688 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.688 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.688 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:34:59.688 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:34:59.688 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.688 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.688 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.688 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:34:59.689 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:34:59.689 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.689 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.689 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.689 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:34:59.689 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:34:59.689 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.689 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.689 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.689 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:34:59.689 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:34:59.689 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:34:59.690 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:34:59.691 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.274308142000002, 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.692 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.693 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.694 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.695 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.696 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:59.697 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.272944111999998, 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:59.698 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:34:59.699 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.700 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.701 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.702 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.272349775000002, 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.703 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.704 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.705 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:34:59.706 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:34:59.707 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.708 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.271589419000001, 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:59.709 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.710 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.711 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.712 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.713 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.714 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:34:59.714 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:34:59.714 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.714 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.714 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.714 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.714 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.714 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:59.714 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:59.714 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.270971959000001, 2024-04-26T10:34:59.714 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:34:59.714 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.714 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.715 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.715 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.715 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.715 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:34:59.715 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.715 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.715 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.715 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.715 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:59.715 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.715 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.715 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:34:59.716 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:34:59.717 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:34:59.718 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:34:59.719 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.270406956000002, 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.720 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.721 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.722 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.723 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.269863643999997, 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.724 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.725 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:34:59.726 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:34:59.727 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.728 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.729 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.268391643999998, 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.730 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.731 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.732 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:34:59.733 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:34:59.733 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.733 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.733 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.733 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.734 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.735 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.267826223999997, 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.736 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.737 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:34:59.738 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:34:59.739 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.267761374000003, 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.740 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.741 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.742 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.743 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.267000394, 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.744 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:34:59.745 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:34:59.746 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:34:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 61.265978965999999, 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:59.748 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:34:59.749 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:34:59.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:34:59.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:34:59.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.750 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:34:59.750 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:34:59.750 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.750 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.750 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.751 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.752 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:34:59.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:34:59.752 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.752 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.752 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.752 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.752 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.752 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204849 5.d 5:bce18511:::benchmark_data_smithi043_45180_object70207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:59.752 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:59.752 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 16.437165856, 2024-04-26T10:34:59.752 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.072723889999999999, 2024-04-26T10:34:59.752 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.752 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204849 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:34:59.753 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216139+0000", 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216142+0000", 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4480000000000001e-06 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.754 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216148+0000", 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6930000000000001e-06 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216153+0000", 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1290000000000004e-06 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216184+0000", 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190999999999999e-05 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.755 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216276+0000", 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2357999999999999e-05 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216337+0000", 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1171000000000001e-05 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.218045+0000", 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017078060000000001 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.756 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288778+0000", 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.070732858999999995 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288831+0000", 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2751999999999999e-05 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288863+0000", 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2872e-05 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.757 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204868 5.d 5:b5b0e42d:::benchmark_data_smithi043_45180_object70226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 16.428169314000002, 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.065177963000000005, 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204868 2024-04-26T10:34:59.758 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225135+0000", 2024-04-26T10:34:59.759 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225140+0000", 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2390000000000004e-06 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225148+0000", 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:34:59.760 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225153+0000", 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1200000000000001e-06 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225181+0000", 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8225000000000002e-05 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225262+0000", 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0817999999999998e-05 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:34:59.761 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225326+0000", 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3986999999999996e-05 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.227004+0000", 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016777879999999999 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290265+0000", 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063261060999999993 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.762 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:34:59.763 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290289+0000", 2024-04-26T10:34:59.763 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4012999999999999e-05 2024-04-26T10:34:59.763 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:34:59.763 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:34:59.763 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:34:59.763 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290314+0000", 2024-04-26T10:34:59.763 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5011000000000002e-05 2024-04-26T10:34:59.763 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.763 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.763 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.763 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:34:59.763 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:34:59.763 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:34:59.764 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:34:59.765 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:59.764+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:59.766 INFO:teuthology.orchestra.run.smithi043.stderr:set osd.2 primary-affinity to 0.900198 (8589952) 2024-04-26T10:34:59.767 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:34:59.866 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:34:59.865+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:34:59.894 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:34:59.895 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:34:59.895 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-26T10:34:59.895 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:34:59.905 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:34:59.966 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:34:59.965+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:00.067 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:00.066+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:00.072 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:00.072 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:35:00.072 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:35:00.073 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:35:00.073 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:00.082 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:35:00.168 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:00.167+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:00.211 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:00.212 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:35:00.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:35:00.212 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:35:00.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.212 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:00.212 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:00.212 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.408445025000006, 2024-04-26T10:35:00.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:35:00.212 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.212 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.212 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.212 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.212 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:35:00.217 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.408444040000006, 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:35:00.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:35:00.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.408375417000002, 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.408323636999995, 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.227 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.228 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:35:00.229 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:35:00.230 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:35:00.231 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.232 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.408263786999996, 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.233 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.234 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.235 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.236 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.237 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.406551082999997, 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.238 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.239 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:35:00.240 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:35:00.241 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:35:00.242 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.243 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.406436016000001, 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.244 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.245 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.246 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.247 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.406342875999997, 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.248 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.249 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.250 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.251 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:35:00.252 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.406148716000004, 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.253 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:00.254 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:35:00.255 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:35:00.256 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.404941347999994, 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:35:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.258 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.259 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.260 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.404132439999998, 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.261 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.262 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:35:00.263 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:35:00.264 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:35:00.265 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.266 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.404028901999993, 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.267 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.268 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.269 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.270 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.271 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.403952028999996, 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.272 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:35:00.273 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:35:00.274 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:35:00.275 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.276 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.277 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 92.403836644999998, 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.278 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:35:00.279 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:35:00.280 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.281 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103327 5.c 5:3133c183:::benchmark_data_smithi043_45180_object103326:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.027192591999999, 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067832482, 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103327 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.282 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181921+0000", 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181920+0000", 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.283 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181979+0000", 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8489999999999997e-05 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181989+0000", 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0181e-05 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.181997+0000", 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.8949999999999998e-06 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.284 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184038+0000", 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00204134 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184194+0000", 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015535700000000001 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184532+0000", 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00033874600000000001 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.285 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.191118+0000", 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0065857789999999999 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249686+0000", 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058567558999999998 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249717+0000", 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1371000000000002e-05 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.286 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249754+0000", 2024-04-26T10:35:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6711000000000001e-05 2024-04-26T10:35:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103328 5.6 5:6d10fd31:::benchmark_data_smithi043_45180_object103327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:35:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.025162743999999, 2024-04-26T10:35:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066097468000000006, 2024-04-26T10:35:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.287 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103328 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.288 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183951+0000", 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.183950+0000", 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184023+0000", 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3307999999999997e-05 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.289 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184036+0000", 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2411e-05 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184045+0000", 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6240000000000008e-06 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184103+0000", 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8959000000000003e-05 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.290 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184236+0000", 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013221199999999999 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184356+0000", 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012042 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194165+0000", 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0098091129999999995 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.291 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.249977+0000", 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.055812195000000002 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250016+0000", 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8720999999999997e-05 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.250049+0000", 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2518999999999998e-05 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.292 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103329 5.6 5:6a0dd310:::benchmark_data_smithi043_45180_object103328:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.024686940999999, 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.067966578, 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103329 2024-04-26T10:35:00.293 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184427+0000", 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184426+0000", 2024-04-26T10:35:00.294 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184481+0000", 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.5034999999999997e-05 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184491+0000", 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0161e-05 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.295 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.184499+0000", 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4290000000000004e-06 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186241+0000", 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001742534 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186368+0000", 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012695800000000001 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.296 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186521+0000", 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000153117 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194172+0000", 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0076508469999999997 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252313+0000", 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058140200000000003 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.297 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252358+0000", 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5362999999999999e-05 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252394+0000", 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5660000000000001e-05 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103335 5.6 5:63d7d425:::benchmark_data_smithi043_45180_object103334:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.298 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.022719887000001, 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066112225999999996, 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103335 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.299 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186394+0000", 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186393+0000", 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186423+0000", 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9519999999999999e-05 2024-04-26T10:35:00.300 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186431+0000", 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4100000000000008e-06 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.186437+0000", 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189593+0000", 2024-04-26T10:35:00.301 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0031558409999999999 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189721+0000", 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012841 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189857+0000", 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013576500000000001 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.302 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194178+0000", 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043213360000000003 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252430+0000", 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.058251266000000003 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252476+0000", 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.655e-05 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.303 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.252506+0000", 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9950999999999998e-05 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:103341 5.6 5:623bcb2b:::benchmark_data_smithi043_45180_object103340:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 62.020052149000001, 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.065574734999999995, 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.304 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 103341 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189062+0000", 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.305 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189061+0000", 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189152+0000", 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0705000000000007e-05 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189160+0000", 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.306 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.189166+0000", 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194213+0000", 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0050470819999999996 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194359+0000", 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014534500000000001 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.307 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.194508+0000", 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014879499999999999 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.197801+0000", 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0032932220000000002 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254584+0000", 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.056783509000000003 2024-04-26T10:35:00.308 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254615+0000", 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1105000000000001e-05 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:58.254637+0000", 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1049000000000001e-05 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.309 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:204862 5.5 5:a0d5a512:::benchmark_data_smithi043_45180_object70220:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 16.988079523, 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.069348507000000004, 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 204862 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:35:00.310 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221034+0000", 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:00.311 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221036+0000", 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4099999999999998e-06 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221042+0000", 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7379999999999999e-06 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221047+0000", 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6569999999999996e-06 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:00.312 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221081+0000", 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3948000000000001e-05 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221203+0000", 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122359 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.221313+0000", 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000110268 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:00.313 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.223990+0000", 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026766519999999999 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290298+0000", 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.066308304999999998 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290346+0000", 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7494000000000003e-05 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:00.314 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:34:43.290383+0000", 2024-04-26T10:35:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7061999999999999e-05 2024-04-26T10:35:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:00.315 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:00.315 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:00.316 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:00.316+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:00.317 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:35:00.417 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:00.416+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:00.452 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:35:00.453 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:35:00.453 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.453 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248337 5.a 5.db11be1a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.453 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:00.453 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.73521896799999997, 2024-04-26T10:35:00.453 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.73524393600000004, 2024-04-26T10:35:00.453 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.453 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.453 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.453 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.454 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.454 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248337 2024-04-26T10:35:00.454 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.454 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.454 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.454 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.454 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:00.454 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.454 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.454 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.454 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.454 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:00.454 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715411+0000", 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1080000000000003e-06 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715419+0000", 2024-04-26T10:35:00.455 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2400000000000007e-06 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715424+0000", 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.164e-06 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715454+0000", 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9824000000000001e-05 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715461+0000", 2024-04-26T10:35:00.456 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0269999999999998e-06 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248282 5.a 5.cf4e029a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.692105+0000", 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.75852156699999995, 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.75859160000000003, 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.457 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248282 2024-04-26T10:35:00.458 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.458 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.458 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.458 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.458 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692105+0000", 2024-04-26T10:35:00.458 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.458 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.458 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.458 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.458 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692105+0000", 2024-04-26T10:35:00.458 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.459 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.459 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.459 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.459 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692104+0000", 2024-04-26T10:35:00.459 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.459 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.459 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.459 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.459 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692109+0000", 2024-04-26T10:35:00.459 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6469999999999997e-06 2024-04-26T10:35:00.459 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.459 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692117+0000", 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8610000000000004e-06 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692124+0000", 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5989999999999998e-06 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.694096+0000", 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001971946 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.460 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.694106+0000", 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0301e-05 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248310 5.a 5.92347c0a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.74666491199999996, 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.74677176700000003, 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.461 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.462 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.462 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.462 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248310 2024-04-26T10:35:00.462 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.462 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.462 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.462 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.462 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:00.462 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.462 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.462 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.462 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.462 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:00.463 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.463 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.463 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.463 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.463 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:00.463 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.463 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.463 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.463 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.463 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703965+0000", 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0280000000000002e-06 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703973+0000", 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5639999999999997e-06 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703980+0000", 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.392e-06 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.464 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.704020+0000", 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0516999999999998e-05 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.704031+0000", 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0317e-05 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248343 5.a 5.c56d0daa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.719500+0000", 2024-04-26T10:35:00.466 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.73112658500000005, 2024-04-26T10:35:00.466 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.73126941599999995, 2024-04-26T10:35:00.466 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.466 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.466 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.466 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.467 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.467 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248343 2024-04-26T10:35:00.467 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.467 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.467 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.467 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.467 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719500+0000", 2024-04-26T10:35:00.467 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.467 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.467 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.468 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.468 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719500+0000", 2024-04-26T10:35:00.468 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.468 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.468 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.468 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.468 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719499+0000", 2024-04-26T10:35:00.468 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.468 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.468 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.468 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.468 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719502+0000", 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5809999999999999e-06 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719509+0000", 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7390000000000002e-06 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719513+0000", 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1230000000000002e-06 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.469 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.470 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719543+0000", 2024-04-26T10:35:00.470 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0423999999999999e-05 2024-04-26T10:35:00.470 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.470 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.470 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.470 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719549+0000", 2024-04-26T10:35:00.470 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3759999999999996e-06 2024-04-26T10:35:00.470 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.470 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.470 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.470 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.470 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.470 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248320 5.a 5.e3f72e1a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.74292087200000001, 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.74309972599999996, 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248320 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:00.471 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707709+0000", 2024-04-26T10:35:00.472 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8890000000000004e-06 2024-04-26T10:35:00.473 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.473 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.473 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.473 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707719+0000", 2024-04-26T10:35:00.473 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0477e-05 2024-04-26T10:35:00.473 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.473 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.473 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.473 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707724+0000", 2024-04-26T10:35:00.473 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2449999999999998e-06 2024-04-26T10:35:00.473 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.473 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707761+0000", 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6427000000000002e-05 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707771+0000", 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0487e-05 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.474 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248225 5.a 5.e5cc8f8a (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.672106+0000", 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.77852049499999998, 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.77873499700000004, 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248225 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.475 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672106+0000", 2024-04-26T10:35:00.476 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.476 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.476 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.476 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.476 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672106+0000", 2024-04-26T10:35:00.476 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.476 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.476 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.476 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.476 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672105+0000", 2024-04-26T10:35:00.476 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.477 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.477 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.477 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.477 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672110+0000", 2024-04-26T10:35:00.477 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0849999999999996e-06 2024-04-26T10:35:00.477 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.477 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.478 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.478 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672120+0000", 2024-04-26T10:35:00.478 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0068000000000001e-05 2024-04-26T10:35:00.478 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.478 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.478 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.478 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672127+0000", 2024-04-26T10:35:00.478 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4209999999999998e-06 2024-04-26T10:35:00.479 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.479 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.479 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.479 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672158+0000", 2024-04-26T10:35:00.479 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0889999999999997e-05 2024-04-26T10:35:00.479 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.479 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.480 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.480 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672164+0000", 2024-04-26T10:35:00.480 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7049999999999996e-06 2024-04-26T10:35:00.480 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.480 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.481 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.481 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.481 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.481 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248226 5.a 5.ecbbe19a (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.481 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.672136+0000", 2024-04-26T10:35:00.481 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.77849042599999996, 2024-04-26T10:35:00.481 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.77874028699999998, 2024-04-26T10:35:00.482 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.482 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.482 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.482 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.482 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.482 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248226 2024-04-26T10:35:00.482 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.483 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.483 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.483 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.483 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672136+0000", 2024-04-26T10:35:00.483 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.483 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.483 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.483 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.484 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672136+0000", 2024-04-26T10:35:00.484 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.484 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.484 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.484 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.484 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672135+0000", 2024-04-26T10:35:00.484 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.485 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.485 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.485 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.485 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672138+0000", 2024-04-26T10:35:00.485 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.475e-06 2024-04-26T10:35:00.485 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.485 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.486 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.486 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672144+0000", 2024-04-26T10:35:00.486 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6119999999999998e-06 2024-04-26T10:35:00.486 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.486 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.486 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.487 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672149+0000", 2024-04-26T10:35:00.487 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7479999999999999e-06 2024-04-26T10:35:00.487 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.487 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.487 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.487 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672192+0000", 2024-04-26T10:35:00.487 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3137999999999999e-05 2024-04-26T10:35:00.488 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.488 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.488 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.488 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672201+0000", 2024-04-26T10:35:00.488 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7660000000000004e-06 2024-04-26T10:35:00.488 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.488 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.488 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.488 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.488 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.488 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248291 5.a 5.107f80ea (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.488 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.696026+0000", 2024-04-26T10:35:00.488 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.75460059700000004, 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.75488655999999998, 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248291 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696026+0000", 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.489 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.490 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.490 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.490 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696026+0000", 2024-04-26T10:35:00.490 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.490 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.490 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.490 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.490 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696025+0000", 2024-04-26T10:35:00.490 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.490 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.490 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.490 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.490 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696029+0000", 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0940000000000001e-06 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696037+0000", 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8199999999999997e-06 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696044+0000", 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.81e-06 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.491 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.492 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696078+0000", 2024-04-26T10:35:00.492 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4748e-05 2024-04-26T10:35:00.492 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.492 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.492 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.492 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696091+0000", 2024-04-26T10:35:00.492 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2687999999999999e-05 2024-04-26T10:35:00.492 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.492 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.492 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.492 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.492 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.492 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248324 5.a 5.3ca462aa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.493 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.709388+0000", 2024-04-26T10:35:00.493 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.74123824299999996, 2024-04-26T10:35:00.493 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.74155906500000002, 2024-04-26T10:35:00.493 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.493 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.493 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.493 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.493 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.493 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248324 2024-04-26T10:35:00.493 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.493 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.494 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.494 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.494 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709388+0000", 2024-04-26T10:35:00.494 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.494 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.494 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.494 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709388+0000", 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709387+0000", 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709391+0000", 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7290000000000002e-06 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.495 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.496 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.496 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709405+0000", 2024-04-26T10:35:00.496 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3799e-05 2024-04-26T10:35:00.496 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.496 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.496 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.496 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709411+0000", 2024-04-26T10:35:00.496 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5999999999999997e-06 2024-04-26T10:35:00.496 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.496 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.496 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.496 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709451+0000", 2024-04-26T10:35:00.496 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0450000000000001e-05 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709461+0000", 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7210000000000006e-06 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248296 5.a 5.995bb37a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.751265882, 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.75162180599999995, 2024-04-26T10:35:00.497 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.498 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.498 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.498 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.498 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.498 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248296 2024-04-26T10:35:00.498 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.498 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.498 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.498 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.498 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:00.498 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.498 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.498 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.499 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.499 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:00.499 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.499 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.499 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.499 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.499 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:00.499 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.500 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.500 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.500 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.500 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699364+0000", 2024-04-26T10:35:00.500 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4479999999999996e-06 2024-04-26T10:35:00.500 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.500 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.500 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.500 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699371+0000", 2024-04-26T10:35:00.500 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1500000000000002e-06 2024-04-26T10:35:00.500 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.500 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699377+0000", 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3240000000000002e-06 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699411+0000", 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4724999999999997e-05 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699417+0000", 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1020000000000002e-06 2024-04-26T10:35:00.501 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.502 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.502 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.502 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.502 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.502 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248356 5.a 5.c035bcaa (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.502 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.736996+0000", 2024-04-26T10:35:00.502 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.71363062200000005, 2024-04-26T10:35:00.502 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.71402136400000005, 2024-04-26T10:35:00.502 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.502 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.503 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.503 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.503 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.503 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248356 2024-04-26T10:35:00.503 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.503 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.503 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.503 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.503 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.736996+0000", 2024-04-26T10:35:00.504 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.504 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.504 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.504 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.504 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.736996+0000", 2024-04-26T10:35:00.504 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.504 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.504 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.505 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.505 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.736994+0000", 2024-04-26T10:35:00.505 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999981 2024-04-26T10:35:00.505 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.505 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.505 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.505 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737005+0000", 2024-04-26T10:35:00.506 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.115e-05 2024-04-26T10:35:00.506 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.506 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.506 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.506 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737033+0000", 2024-04-26T10:35:00.506 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7832999999999999e-05 2024-04-26T10:35:00.506 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.506 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.506 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.506 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737049+0000", 2024-04-26T10:35:00.506 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5913000000000002e-05 2024-04-26T10:35:00.506 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737133+0000", 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4550999999999997e-05 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737141+0000", 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2969999999999998e-06 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.507 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248273 5.a 5.ef0259a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.508 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:00.508 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.76011514700000005, 2024-04-26T10:35:00.508 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.76054110699999999, 2024-04-26T10:35:00.508 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.508 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.508 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.508 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.508 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.508 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248273 2024-04-26T10:35:00.508 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:00.509 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.510 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.510 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.510 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.510 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690513+0000", 2024-04-26T10:35:00.510 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6759999999999999e-06 2024-04-26T10:35:00.510 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.510 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.510 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.510 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690520+0000", 2024-04-26T10:35:00.510 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3720000000000001e-06 2024-04-26T10:35:00.510 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.510 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690525+0000", 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5840000000000002e-06 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.693881+0000", 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003355406 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.693887+0000", 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:35:00.511 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248371 5.a 5.e1ed6bba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.766367+0000", 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.68425969399999997, 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.68474333200000004, 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248371 2024-04-26T10:35:00.512 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.513 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.513 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.513 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.513 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766367+0000", 2024-04-26T10:35:00.513 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.513 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.513 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.513 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.513 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766367+0000", 2024-04-26T10:35:00.513 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.513 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766366+0000", 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766370+0000", 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3660000000000002e-06 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766381+0000", 2024-04-26T10:35:00.514 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0314e-05 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766403+0000", 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2486000000000001e-05 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766442+0000", 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8719e-05 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.515 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766449+0000", 2024-04-26T10:35:00.516 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7100000000000007e-06 2024-04-26T10:35:00.516 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.516 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.516 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.516 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.516 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.516 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248238 5.a 5.1f2672ba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.516 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.675816+0000", 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.77481032999999999, 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.77533099800000005, 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248238 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675816+0000", 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.517 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675816+0000", 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675815+0000", 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675819+0000", 2024-04-26T10:35:00.518 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7809999999999999e-06 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675827+0000", 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675832+0000", 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5539999999999997e-06 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675870+0000", 2024-04-26T10:35:00.520 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7645999999999998e-05 2024-04-26T10:35:00.520 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.520 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.520 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.520 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675880+0000", 2024-04-26T10:35:00.520 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0159e-05 2024-04-26T10:35:00.520 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.520 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.520 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.520 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.521 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.521 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248303 5.a 5.5e70f60a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.521 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:00.521 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.75062987199999998, 2024-04-26T10:35:00.521 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.75119028099999996, 2024-04-26T10:35:00.521 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.521 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.521 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.521 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.522 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.522 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248303 2024-04-26T10:35:00.522 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.522 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.522 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.522 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.522 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:00.522 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.522 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.522 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.522 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.522 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:00.522 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699999+0000", 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.022e-06 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700005+0000", 2024-04-26T10:35:00.523 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8889999999999999e-06 2024-04-26T10:35:00.524 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.524 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.524 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.524 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700008+0000", 2024-04-26T10:35:00.524 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6210000000000001e-06 2024-04-26T10:35:00.524 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.524 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.524 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.524 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700048+0000", 2024-04-26T10:35:00.524 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9756999999999999e-05 2024-04-26T10:35:00.524 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.524 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.525 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.525 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700062+0000", 2024-04-26T10:35:00.525 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4231e-05 2024-04-26T10:35:00.525 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.525 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.525 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.525 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.525 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.525 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248333 5.a 5.64265eba (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:00.525 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:00.525 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.736795007, 2024-04-26T10:35:00.526 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.73739172399999997, 2024-04-26T10:35:00.526 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.526 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for peered", 2024-04-26T10:35:00.526 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.526 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.526 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.526 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248333 2024-04-26T10:35:00.527 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.527 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.527 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.527 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.527 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:00.527 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.527 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.527 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.527 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.527 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:00.528 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.528 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.528 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.528 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.528 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:00.528 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713834+0000", 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6459999999999999e-06 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713840+0000", 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8699999999999997e-06 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.529 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713846+0000", 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3299999999999998e-06 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713873+0000", 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7606999999999998e-05 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713879+0000", 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.530 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.531 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.531 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:35:00.531 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 16 2024-04-26T10:35:00.531 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:35:00.532 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:00.531+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:00.533 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:35:00.632 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:00.632+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:00.660 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:35:00.660 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:35:00.660 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:35:00.660 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:35:00.660 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:35:00.670 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:35:00.677 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-26T10:35:00.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~12s 2024-04-26T10:35:00.733 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:00.732+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:00.834 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:00.833+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:00.842 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:35:00.842 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:35:00.843 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:35:00.843 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:35:00.843 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.843 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:00.843 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:35:00.843 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 93.039250486, 2024-04-26T10:35:00.843 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:35:00.843 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.843 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.843 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.843 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.843 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.843 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.844 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.845 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:35:00.846 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:35:00.847 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.848 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 93.038422405999995, 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.849 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.850 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.851 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.852 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 93.037493342999994, 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.854 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:00.855 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:35:00.856 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:35:00.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:35:00.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:35:00.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.857 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:35:00.857 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:35:00.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.857 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.857 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.858 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:35:00.859 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 93.036807902000007, 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.861 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.862 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.863 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.864 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103647 5.b 5:dae2a842:::benchmark_data_smithi043_45180_object103646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.460517459999998, 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069407455000000007, 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103647 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:35:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378698+0000", 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378697+0000", 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378752+0000", 2024-04-26T10:35:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4753999999999998e-05 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378763+0000", 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0532e-05 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378771+0000", 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6580000000000008e-06 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378869+0000", 2024-04-26T10:35:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7329000000000003e-05 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378969+0000", 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000100763 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379060+0000", 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0698000000000005e-05 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384915+0000", 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0058545719999999997 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448018+0000", 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063102847000000004 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448063+0000", 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5661000000000002e-05 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448106+0000", 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2401000000000003e-05 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103649 5.0 5:0ccbede7:::benchmark_data_smithi043_45180_object103648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.460298156, 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.069294669000000003, 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103649 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378917+0000", 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378975+0000", 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8740999999999999e-05 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378986+0000", 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0336000000000001e-05 2024-04-26T10:35:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378991+0000", 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8339999999999998e-06 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379031+0000", 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9903000000000001e-05 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379164+0000", 2024-04-26T10:35:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000133688 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379313+0000", 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014848800000000001 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385260+0000", 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0059470690000000001 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448129+0000", 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062869360999999999 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448175+0000", 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5719000000000001e-05 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448212+0000", 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103650 5.e 5:7e309990:::benchmark_data_smithi043_45180_object103649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.460218351000002, 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068962517000000001, 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103650 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.378997+0000", 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379037+0000", 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0704999999999997e-05 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379042+0000", 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379047+0000", 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379080+0000", 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3015999999999997e-05 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379221+0000", 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000140655 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.379347+0000", 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012599399999999999 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384547+0000", 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0052001749999999996 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386361+0000", 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001814167 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061554891 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447960+0000", 2024-04-26T10:35:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3890000000000002e-05 2024-04-26T10:35:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103653 5.8 5:15ca1c5b:::benchmark_data_smithi043_45180_object103652:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:35:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.458854320999997, 2024-04-26T10:35:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067852776000000004, 2024-04-26T10:35:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103653 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380361+0000", 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380360+0000", 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380426+0000", 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5392e-05 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380436+0000", 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0236e-05 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380443+0000", 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.272e-06 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380858+0000", 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00041453399999999999 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380985+0000", 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012750200000000001 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381123+0000", 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013727800000000001 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385271+0000", 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041486589999999999 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448137+0000", 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.062865879 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448179+0000", 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1430000000000001e-05 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448214+0000", 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:35:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103656 5.b 5:d1f02cc6:::benchmark_data_smithi043_45180_object103655:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.458259984000001, 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067273346999999997, 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103656 2024-04-26T10:35:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380956+0000", 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.380955+0000", 2024-04-26T10:35:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381080+0000", 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012464600000000001 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381094+0000", 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.437e-05 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381101+0000", 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1520000000000003e-06 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381135+0000", 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4167e-05 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381245+0000", 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011008199999999999 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381387+0000", 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000141378 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384918+0000", 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0035311470000000001 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448157+0000", 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063238664 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448197+0000", 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0141000000000001e-05 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448229+0000", 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2227999999999997e-05 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103657 5.b 5:d02bd249:::benchmark_data_smithi043_45180_object103656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.457499628000001, 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.068028674999999997, 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103657 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:35:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381716+0000", 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381715+0000", 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.895 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381807+0000", 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381815+0000", 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0660000000000004e-06 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.381822+0000", 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8530000000000003e-06 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.896 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383225+0000", 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014024829999999999 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383339+0000", 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114648 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383436+0000", 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.6372000000000005e-05 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.897 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448285+0000", 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064849635000000003 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449684+0000", 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0013986059999999999 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449717+0000", 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2923999999999999e-05 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.898 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449745+0000", 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7665e-05 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103659 5.d 5:b2183a8f:::benchmark_data_smithi043_45180_object103658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.456882168, 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067305686000000003, 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.899 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103659 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:35:00.900 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382333+0000", 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382443+0000", 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011030400000000001 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382455+0000", 2024-04-26T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1754e-05 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382463+0000", 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383121+0000", 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00065749500000000002 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.902 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383244+0000", 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012357500000000001 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383390+0000", 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014603899999999999 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386011+0000", 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002621052 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.903 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449557+0000", 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063545451000000003 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449606+0000", 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8982e-05 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449639+0000", 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.324e-05 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.904 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103660 5.9 e32/16 5:991ac10b:::benchmark_data_smithi043_45180_object103659:head v 32'6474, mlcod=32'6471)", 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.456317165000002, 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066928886000000007, 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.905 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382898+0000", 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382970+0000", 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2186000000000003e-05 2024-04-26T10:35:00.906 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382979+0000", 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9260000000000006e-06 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.382985+0000", 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383023+0000", 2024-04-26T10:35:00.907 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8331999999999998e-05 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383044+0000", 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1296000000000001e-05 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449797+0000", 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066752903000000002 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.908 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449827+0000", 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0269000000000001e-05 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103661 5.8 5:1038cad6:::benchmark_data_smithi043_45180_object103660:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.455773852999997, 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.067666562, 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.909 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103661 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383442+0000", 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383441+0000", 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383507+0000", 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5932000000000005e-05 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383515+0000", 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5270000000000001e-06 2024-04-26T10:35:00.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383520+0000", 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383553+0000", 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3219000000000002e-05 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383666+0000", 2024-04-26T10:35:00.912 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112824 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.383746+0000", 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9877999999999997e-05 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448252+0000", 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064505848000000005 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451024+0000", 2024-04-26T10:35:00.913 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027720610000000001 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451069+0000", 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5321000000000002e-05 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.451108+0000", 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8986999999999998e-05 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.914 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:103663 5.4 5:2dfa1d28:::benchmark_data_smithi043_45180_object103662:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.454301852999997, 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064751586, 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 103663 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.915 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384914+0000", 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.384913+0000", 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.916 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385027+0000", 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000114308 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385037+0000", 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0276e-05 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385045+0000", 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4109999999999999e-06 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.917 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385081+0000", 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385166+0000", 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4877999999999996e-05 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385247+0000", 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0347999999999997e-05 2024-04-26T10:35:00.918 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448338+0000", 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063091657999999995 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449594+0000", 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0012553320000000001 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449633+0000", 2024-04-26T10:35:00.919 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9631000000000001e-05 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449665+0000", 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2042999999999998e-05 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103662 5.f e32/16 5:f87f4bf0:::benchmark_data_smithi043_45180_object103661:head v 32'6298, mlcod=32'6296)", 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.453736433000003, 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066640118999999998, 2024-04-26T10:35:00.920 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.921 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385479+0000", 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385527+0000", 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7908000000000003e-05 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385533+0000", 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6880000000000002e-06 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.922 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385538+0000", 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3420000000000001e-06 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385567+0000", 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9459999999999999e-05 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385581+0000", 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3688e-05 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.923 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452074+0000", 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.066493369999999996 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452119+0000", 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5212e-05 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103664 5.9 e32/16 5:9a6b77fc:::benchmark_data_smithi043_45180_object103663:head v 32'6475, mlcod=32'6472)", 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.453671583000002, 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064302409000000005, 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:35:00.925 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385544+0000", 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385575+0000", 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0750999999999997e-05 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.926 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385578+0000", 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9899999999999999e-06 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385582+0000", 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4170000000000001e-06 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385611+0000", 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8762e-05 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.927 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.385628+0000", 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.7419e-05 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449830+0000", 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064202036000000004 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.449846+0000", 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.6283999999999999e-05 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.928 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop_reply(client.4538.0:103650 5.e e32/16 ondisk, result = 0)", 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.452910602999999, 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061661680000000003, 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.929 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386305+0000", 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386304+0000", 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386309+0000", 2024-04-26T10:35:00.930 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.532e-06 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386315+0000", 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9599999999999997e-06 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386319+0000", 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9509999999999999e-06 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386348+0000", 2024-04-26T10:35:00.931 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9794e-05 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.386356+0000", 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2470000000000002e-06 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447967+0000", 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.061610990999999997 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_repop(client.4538.0:103666 5.f e32/16 5:fdf62f0c:::benchmark_data_smithi043_45180_object103665:head v 32'6299, mlcod=32'6296)", 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 62.451889174999998, 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.064820347, 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.933 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387326+0000", 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.387357+0000", 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1356000000000003e-05 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.934 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447901+0000", 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.060544135999999998 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.447916+0000", 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4559000000000001e-05 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448320+0000", 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00040401400000000001 2024-04-26T10:35:00.935 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.448339+0000", 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.9018999999999999e-05 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452124+0000", 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0037847879999999999 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:58.452147+0000", 2024-04-26T10:35:00.936 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.3042000000000001e-05 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204849 5.d 5:bce18511:::benchmark_data_smithi043_45180_object70207:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.623076064999999, 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.072723889999999999, 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.937 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204849 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216140+0000", 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.938 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216139+0000", 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216142+0000", 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4480000000000001e-06 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216148+0000", 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.6930000000000001e-06 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.939 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216153+0000", 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1290000000000004e-06 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216184+0000", 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0190999999999999e-05 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216276+0000", 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.2357999999999999e-05 2024-04-26T10:35:00.940 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.216337+0000", 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1171000000000001e-05 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.218045+0000", 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017078060000000001 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288778+0000", 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.070732858999999995 2024-04-26T10:35:00.941 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288831+0000", 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2751999999999999e-05 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.288863+0000", 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2872e-05 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.942 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:204868 5.d 5:b5b0e42d:::benchmark_data_smithi043_45180_object70226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 17.614079523000001, 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.065177963000000005, 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 204868 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:00.943 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225136+0000", 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225135+0000", 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.944 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225140+0000", 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2390000000000004e-06 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225148+0000", 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225153+0000", 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1200000000000001e-06 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.945 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225181+0000", 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8225000000000002e-05 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225262+0000", 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0817999999999998e-05 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.225326+0000", 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3986999999999996e-05 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.946 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.227004+0000", 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016777879999999999 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290265+0000", 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.063261060999999993 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290289+0000", 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.4012999999999999e-05 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:00.948 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:00.948 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:43.290314+0000", 2024-04-26T10:35:00.948 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5011000000000002e-05 2024-04-26T10:35:00.948 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.948 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.948 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.948 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:00.948 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:00.948 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:35:00.950 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:35:00.951 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:00.948+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:01.050 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:01.049+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:01.159 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:35:01.159 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:249565 5.0 e67/42 5:035f65f1:::benchmark_data_smithi043_45180_object114923:head v 67'15517, mlcod=67'15514)", 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.141226+0000", 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0069703259999999998, 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0069984310000000003, 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.141226+0000", 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.160 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.141226+0000", 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.141226+0000", 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.141229+0000", 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6519999999999999e-06 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.161 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.141235+0000", 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4240000000000001e-06 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.141240+0000", 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.293e-06 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.142981+0000", 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0017405840000000001 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.162 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.142998+0000", 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7133e-05 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:249581 5.0 e67/42 5:0255bbb1:::benchmark_data_smithi043_45180_object114939:head v 67'15518, mlcod=67'15514)", 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.143056+0000", 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0051405979999999997, 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0052436970000000003, 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:01.163 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.143056+0000", 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.143056+0000", 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.143055+0000", 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:01.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.143064+0000", 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6209999999999993e-06 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.143074+0000", 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0349e-05 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.143081+0000", 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7329999999999997e-06 2024-04-26T10:35:01.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144627+0000", 2024-04-26T10:35:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0015457509999999999 2024-04-26T10:35:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144644+0000", 2024-04-26T10:35:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7204e-05 2024-04-26T10:35:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.166 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.168 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:249585 5.3 5:c71fe1b1:::benchmark_data_smithi043_45180_object114943:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:35:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.144222+0000", 2024-04-26T10:35:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0039739729999999996, 2024-04-26T10:35:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0041561569999999997, 2024-04-26T10:35:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.169 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 249585 2024-04-26T10:35:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.170 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144222+0000", 2024-04-26T10:35:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144222+0000", 2024-04-26T10:35:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.172 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144222+0000", 2024-04-26T10:35:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.173 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144225+0000", 2024-04-26T10:35:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.281e-06 2024-04-26T10:35:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.174 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144233+0000", 2024-04-26T10:35:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5369999999999997e-06 2024-04-26T10:35:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144239+0000", 2024-04-26T10:35:01.175 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3310000000000003e-06 2024-04-26T10:35:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144684+0000", 2024-04-26T10:35:01.176 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00044515800000000002 2024-04-26T10:35:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144804+0000", 2024-04-26T10:35:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000120308 2024-04-26T10:35:01.177 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:249586 5.3 5:c2b51cb9:::benchmark_data_smithi043_45180_object114944:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:35:01.178 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.144651+0000", 2024-04-26T10:35:01.179 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0035450310000000001, 2024-04-26T10:35:01.179 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038158559999999998, 2024-04-26T10:35:01.179 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.179 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:01.179 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:01.179 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:01.180 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:01.180 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 249586 2024-04-26T10:35:01.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.180 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.180 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.181 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144651+0000", 2024-04-26T10:35:01.181 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.181 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.181 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.182 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144651+0000", 2024-04-26T10:35:01.182 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.182 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.182 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.182 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144650+0000", 2024-04-26T10:35:01.183 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:01.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.183 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.183 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.183 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144655+0000", 2024-04-26T10:35:01.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7119999999999999e-06 2024-04-26T10:35:01.184 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.184 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.184 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.184 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144666+0000", 2024-04-26T10:35:01.184 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1270999999999999e-05 2024-04-26T10:35:01.185 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.185 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.185 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.185 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144675+0000", 2024-04-26T10:35:01.185 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0600000000000008e-06 2024-04-26T10:35:01.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.186 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.186 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:01.186 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146480+0000", 2024-04-26T10:35:01.186 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00180583 2024-04-26T10:35:01.186 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.187 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.187 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:01.187 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146611+0000", 2024-04-26T10:35:01.187 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013066 2024-04-26T10:35:01.187 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.187 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.188 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.188 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.188 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.188 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:249584 5.b e67/42 5:d083c75a:::benchmark_data_smithi043_45180_object114942:head v 67'15763, mlcod=67'15761)", 2024-04-26T10:35:01.188 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.144713+0000", 2024-04-26T10:35:01.189 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0034834789999999998, 2024-04-26T10:35:01.189 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0038483480000000001, 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144713+0000", 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144713+0000", 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.190 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144712+0000", 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144718+0000", 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.344e-06 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144726+0000", 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5220000000000007e-06 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.191 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.144732+0000", 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9190000000000004e-06 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148423+0000", 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036908420000000002 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148437+0000", 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4005000000000001e-05 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.192 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:249592 5.1 5:84b53282:::benchmark_data_smithi043_45180_object114950:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.146119+0000", 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0020771779999999998, 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0025066699999999999, 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 249592 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.193 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146119+0000", 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146119+0000", 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146118+0000", 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:01.194 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146123+0000", 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6260000000000003e-06 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146135+0000", 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.206e-05 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146144+0000", 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0299999999999999e-06 2024-04-26T10:35:01.195 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146190+0000", 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5800999999999997e-05 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146280+0000", 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.0577999999999999e-05 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148530+0000", 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022493119999999998 2024-04-26T10:35:01.196 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148568+0000", 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.7898999999999997e-05 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148630+0000", 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2414000000000002e-05 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.197 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:249589 5.b e67/42)", 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.146242+0000", 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0019537930000000001, 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.002473879, 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146242+0000", 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146242+0000", 2024-04-26T10:35:01.198 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146242+0000", 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146250+0000", 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.541e-06 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146260+0000", 2024-04-26T10:35:01.199 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.7419999999999992e-06 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146266+0000", 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9429999999999997e-06 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:249595 5.3 5.c632b7b3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.146294+0000", 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0019025019999999999, 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024739889999999998, 2024-04-26T10:35:01.200 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 249595 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146294+0000", 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.201 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146294+0000", 2024-04-26T10:35:01.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146293+0000", 2024-04-26T10:35:01.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:01.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.202 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.202 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146297+0000", 2024-04-26T10:35:01.202 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0999999999999997e-06 2024-04-26T10:35:01.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.202 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146310+0000", 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.2700999999999999e-05 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146317+0000", 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8220000000000001e-06 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:249594 5.4 e67/42 5:207d5438:::benchmark_data_smithi043_45180_object114952:head v 67'15588, mlcod=67'15586)", 2024-04-26T10:35:01.203 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.146582+0000", 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001614189, 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0022468829999999999, 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146582+0000", 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146582+0000", 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146581+0000", 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146590+0000", 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146600+0000", 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3870000000000001e-06 2024-04-26T10:35:01.205 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.146606+0000", 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7229999999999998e-06 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148238+0000", 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0016317599999999999 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148260+0000", 2024-04-26T10:35:01.206 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1481e-05 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:249598 5.7 5:e741c824:::benchmark_data_smithi043_45180_object114956:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.148136+0000", 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 6.0334999999999997e-05, 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00075383299999999998, 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 249598 2024-04-26T10:35:01.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148136+0000", 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148136+0000", 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148135+0000", 2024-04-26T10:35:01.208 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148140+0000", 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4199999999999998e-06 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148154+0000", 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3499999999999999e-05 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148163+0000", 2024-04-26T10:35:01.209 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.5969999999999992e-06 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148208+0000", 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5493e-05 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148366+0000", 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00015827699999999999 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.210 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:249596 5.e e67/16 5:7c13ed72:::benchmark_data_smithi043_45180_object114954:head v 67'15502, mlcod=67'15500)", 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.148679+0000", 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.999517, 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027740099999999998, 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148679+0000", 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.211 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148679+0000", 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148679+0000", 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148685+0000", 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.9290000000000003e-06 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.212 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148694+0000", 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2769999999999994e-06 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148700+0000", 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.1720000000000004e-06 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148800+0000", 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.9529000000000002e-05 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:01.213 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148817+0000", 2024-04-26T10:35:01.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6871000000000002e-05 2024-04-26T10:35:01.214 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.214 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.214 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.214 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.214 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.214 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:249602 5.5 5:a5bcf401:::benchmark_data_smithi043_45180_object114960:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:35:01.214 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.148739+0000", 2024-04-26T10:35:01.214 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9994569, 2024-04-26T10:35:01.214 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000280022, 2024-04-26T10:35:01.214 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.214 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:01.214 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 249602 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148739+0000", 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148739+0000", 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.215 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148739+0000", 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148743+0000", 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0350000000000003e-06 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148750+0000", 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6760000000000007e-06 2024-04-26T10:35:01.216 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148755+0000", 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3989999999999997e-06 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148795+0000", 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0259000000000002e-05 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148916+0000", 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012095999999999999 2024-04-26T10:35:01.217 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:249604 5.2 5.2b13d672 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.148850+0000", 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9993463, 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00023764599999999999, 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 249604 2024-04-26T10:35:01.218 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148850+0000", 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148850+0000", 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148849+0000", 2024-04-26T10:35:01.219 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148853+0000", 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1470000000000003e-06 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148867+0000", 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4127e-05 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148876+0000", 2024-04-26T10:35:01.220 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1620000000000008e-06 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:249599 5.0 e67/42 5:085947f4:::benchmark_data_smithi043_45180_object114957:head v 67'15520, mlcod=67'15517)", 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.148943+0000", 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9992533, 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000200426, 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.221 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148943+0000", 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148943+0000", 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148943+0000", 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.222 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148947+0000", 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6500000000000004e-06 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148957+0000", 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.8039999999999996e-06 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148962+0000", 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.006e-06 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148997+0000", 2024-04-26T10:35:01.223 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5142000000000003e-05 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.149014+0000", 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6583e-05 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:249601 5.8 e67/16)", 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:01.148974+0000", 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4294967295.9992223, 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00024196600000000001, 2024-04-26T10:35:01.224 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148974+0000", 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148974+0000", 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:01.225 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148974+0000", 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148977+0000", 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2049999999999998e-06 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148984+0000", 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0559999999999999e-06 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:01.226 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:01.148989+0000", 2024-04-26T10:35:01.227 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1749999999999996e-06 2024-04-26T10:35:01.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.227 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:01.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.227 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:01.227 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:35:01.227 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 15 2024-04-26T10:35:01.227 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:01.227 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:01.155+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:01.228 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:35:01.270 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:01.269+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:01.352 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:01.352+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:01.364 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:35:01.453 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:01.452+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:01.478 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:01.478 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:35:01.479 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:35:01.479 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:35:01.479 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:01.486 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:35:01.518 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:35:01.540 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:35:01.540 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T10:35:01.540 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:35:01.540 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:35:01.543 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:35:01.543 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:35:01.573 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:01.573+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:01.655 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:01.654+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:01.720 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:01.721 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:01.733 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:35:01.775 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:01.774+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:01.856 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:01.856+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:01.910 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:01.910 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:01.923 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:35:01.957 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:01.956+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:02.058 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:02.056+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:02.104 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:02.104 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:02.118 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:35:02.159 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:02.158+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:02.260 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:02.259+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:02.341 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:02.341 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:02.357 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:35:02.398 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:02.397+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:02.462 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:02.461+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:02.560 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:02.560 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:02.562 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:02.561+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:02.575 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:35:02.668 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:02.663+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:02.691 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:35:02.764 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:02.763+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:02.811 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:02.811 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:02.823 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:35:02.866 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:02.864+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:02.966 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:02.965+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:03.056 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:03.057 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:03.066 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:35:03.068 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:03.067+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:03.172 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:03.171+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:03.252 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:03.252 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:03.267 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:35:03.271 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:03.269+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:03.371 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:03.369+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:03.445 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:03.445 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:03.460 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:35:03.473 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:03.470+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:03.544 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:35:03.571 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:03.570+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:03.676 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:03.674+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:03.680 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is set 2024-04-26T10:35:03.689 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:03.689 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:03.701 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:35:03.703 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:35:03.727 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:35:03.727 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T10:35:03.728 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:35:03.728 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:35:03.730 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:35:03.730 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:35:03.773 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:03.772+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:03.855 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:35:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256907 5.7 5:e49fa53a:::benchmark_data_smithi043_45180_object122265:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.834669+0000", 2024-04-26T10:35:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.018355583000000002, 2024-04-26T10:35:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.018374122999999999, 2024-04-26T10:35:03.855 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256907 2024-04-26T10:35:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.856 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.834669+0000", 2024-04-26T10:35:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.857 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.834669+0000", 2024-04-26T10:35:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.834668+0000", 2024-04-26T10:35:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:35:03.858 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.834676+0000", 2024-04-26T10:35:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0760000000000003e-06 2024-04-26T10:35:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.859 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.834686+0000", 2024-04-26T10:35:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0458999999999999e-05 2024-04-26T10:35:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.860 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.834696+0000", 2024-04-26T10:35:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.2909999999999996e-06 2024-04-26T10:35:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835568+0000", 2024-04-26T10:35:03.861 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00087274499999999997 2024-04-26T10:35:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835696+0000", 2024-04-26T10:35:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012773099999999999 2024-04-26T10:35:03.862 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.863 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.863 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.863 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.863 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.863 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256909 5.6 5.5c58f706 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:03.863 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.835407+0000", 2024-04-26T10:35:03.863 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.017617477999999999, 2024-04-26T10:35:03.863 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017677157999999998, 2024-04-26T10:35:03.864 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.864 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:35:03.864 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:03.864 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:03.864 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:03.864 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256909 2024-04-26T10:35:03.864 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.865 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.865 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.865 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.865 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835407+0000", 2024-04-26T10:35:03.865 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.865 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.866 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.866 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835407+0000", 2024-04-26T10:35:03.866 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.866 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.866 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.867 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835407+0000", 2024-04-26T10:35:03.867 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:03.867 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.867 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.867 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835411+0000", 2024-04-26T10:35:03.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.634e-06 2024-04-26T10:35:03.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835420+0000", 2024-04-26T10:35:03.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3790000000000006e-06 2024-04-26T10:35:03.868 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.868 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.868 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.868 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835427+0000", 2024-04-26T10:35:03.868 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1210000000000001e-06 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:256908 5.e e68/16)", 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.835477+0000", 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.017547960000000001, 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.017636220000000001, 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.869 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835477+0000", 2024-04-26T10:35:03.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835477+0000", 2024-04-26T10:35:03.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.870 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.870 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.870 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.870 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835476+0000", 2024-04-26T10:35:03.870 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:03.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835486+0000", 2024-04-26T10:35:03.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3780000000000007e-06 2024-04-26T10:35:03.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.871 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.871 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.871 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835494+0000", 2024-04-26T10:35:03.871 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1040000000000007e-06 2024-04-26T10:35:03.871 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.872 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.872 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835499+0000", 2024-04-26T10:35:03.872 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4260000000000002e-06 2024-04-26T10:35:03.872 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.872 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.872 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.872 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.872 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.872 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256890 5.6 5:6c163c2d:::benchmark_data_smithi043_45180_object122248:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:03.872 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.084199523999999998, 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.084316398000000001, 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256890 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.873 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:03.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:03.874 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:03.874 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.874 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.874 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.874 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768827+0000", 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0320000000000002e-06 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768832+0000", 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3190000000000002e-06 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768837+0000", 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9189999999999998e-06 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:03.875 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.770074+0000", 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001236429 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.770195+0000", 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000120981 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256897 5.6 5:68cfdf58:::benchmark_data_smithi043_45180_object122255:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:03.876 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.080382462000000002, 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.080536943, 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256897 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.877 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772651+0000", 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9919999999999996e-06 2024-04-26T10:35:03.878 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772657+0000", 2024-04-26T10:35:03.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3269999999999997e-06 2024-04-26T10:35:03.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.879 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.879 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.879 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772663+0000", 2024-04-26T10:35:03.879 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.054e-06 2024-04-26T10:35:03.879 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:03.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774088+0000", 2024-04-26T10:35:03.880 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001424287 2024-04-26T10:35:03.880 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.880 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.880 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:03.880 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774200+0000", 2024-04-26T10:35:03.881 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011267100000000001 2024-04-26T10:35:03.881 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.881 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.881 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.881 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.881 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.882 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256898 5.c 5:3707bdbe:::benchmark_data_smithi043_45180_object122256:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:03.882 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:03.882 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.080352463999999998, 2024-04-26T10:35:03.882 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.080543065999999996, 2024-04-26T10:35:03.882 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.883 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:03.883 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:03.883 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:03.883 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:03.883 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256898 2024-04-26T10:35:03.883 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.884 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.884 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.884 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.884 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:03.884 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.884 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.885 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.885 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:03.885 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.885 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.885 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.886 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:03.886 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:03.886 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.886 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.886 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772675+0000", 2024-04-26T10:35:03.887 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7089999999999998e-06 2024-04-26T10:35:03.887 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.887 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.887 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.887 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772680+0000", 2024-04-26T10:35:03.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6699999999999999e-06 2024-04-26T10:35:03.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.888 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.888 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.888 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772685+0000", 2024-04-26T10:35:03.888 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7700000000000001e-06 2024-04-26T10:35:03.888 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.889 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.889 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:03.889 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.773342+0000", 2024-04-26T10:35:03.889 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00065647199999999996 2024-04-26T10:35:03.889 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.890 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.890 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:03.890 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.773450+0000", 2024-04-26T10:35:03.890 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010794999999999999 2024-04-26T10:35:03.890 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.891 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.891 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.891 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.891 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.891 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256899 5.6 5:6756e015:::benchmark_data_smithi043_45180_object122257:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:03.891 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:03.892 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.080334480999999999, 2024-04-26T10:35:03.892 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.080560471999999994, 2024-04-26T10:35:03.892 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.892 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:03.892 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:03.892 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:03.893 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:03.893 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256899 2024-04-26T10:35:03.893 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.893 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.893 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.893 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:03.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.894 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.894 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:03.894 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.894 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.894 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.895 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:03.895 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:03.895 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.895 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.895 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772692+0000", 2024-04-26T10:35:03.896 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3489999999999999e-06 2024-04-26T10:35:03.896 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.896 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.896 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.896 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772697+0000", 2024-04-26T10:35:03.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1270000000000002e-06 2024-04-26T10:35:03.897 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.897 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.897 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.897 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772702+0000", 2024-04-26T10:35:03.897 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4780000000000002e-06 2024-04-26T10:35:03.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.898 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.898 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:03.898 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833268+0000", 2024-04-26T10:35:03.898 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.060566203999999998 2024-04-26T10:35:03.898 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.899 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.899 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:03.899 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833410+0000", 2024-04-26T10:35:03.899 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014150999999999999 2024-04-26T10:35:03.899 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.899 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.900 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.900 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.900 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.900 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256901 5.6 5:6ab61672:::benchmark_data_smithi043_45180_object122259:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:03.900 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.774982+0000", 2024-04-26T10:35:03.900 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.078042397999999999, 2024-04-26T10:35:03.901 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.078303230000000001, 2024-04-26T10:35:03.901 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.901 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:03.901 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:03.901 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:03.901 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:03.901 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256901 2024-04-26T10:35:03.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.902 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.902 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.902 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774982+0000", 2024-04-26T10:35:03.902 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.902 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.902 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774982+0000", 2024-04-26T10:35:03.903 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.903 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.903 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.903 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.903 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774981+0000", 2024-04-26T10:35:03.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:03.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.904 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.904 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774987+0000", 2024-04-26T10:35:03.904 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3720000000000004e-06 2024-04-26T10:35:03.904 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.904 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774997+0000", 2024-04-26T10:35:03.905 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0193e-05 2024-04-26T10:35:03.905 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.905 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.905 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.905 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775005+0000", 2024-04-26T10:35:03.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9759999999999995e-06 2024-04-26T10:35:03.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:03.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835531+0000", 2024-04-26T10:35:03.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.060526475000000003 2024-04-26T10:35:03.906 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.906 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.906 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:03.906 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835619+0000", 2024-04-26T10:35:03.906 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7266000000000001e-05 2024-04-26T10:35:03.906 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:256900 5.a e68/66 5:5f2e8890:::benchmark_data_smithi043_45180_object122258:head v 68'16240, mlcod=68'16238)", 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.775029+0000", 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.077996112000000006, 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.078292792, 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.907 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775029+0000", 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775029+0000", 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775028+0000", 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.908 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775037+0000", 2024-04-26T10:35:03.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:35:03.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.909 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775045+0000", 2024-04-26T10:35:03.909 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4549999999999998e-06 2024-04-26T10:35:03.909 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.909 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.909 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775051+0000", 2024-04-26T10:35:03.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.455e-06 2024-04-26T10:35:03.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:03.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775084+0000", 2024-04-26T10:35:03.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2563e-05 2024-04-26T10:35:03.910 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.910 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.910 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:03.910 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833084+0000", 2024-04-26T10:35:03.910 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.057999929999999998 2024-04-26T10:35:03.910 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256902 5.2 5:44e3c5e8:::benchmark_data_smithi043_45180_object122260:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.775540+0000", 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.077484974999999998, 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.077813688000000006, 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:03.911 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256902 2024-04-26T10:35:03.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.912 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775540+0000", 2024-04-26T10:35:03.912 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.912 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.912 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.912 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.912 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775540+0000", 2024-04-26T10:35:03.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.913 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775539+0000", 2024-04-26T10:35:03.913 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:03.913 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.913 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.913 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775543+0000", 2024-04-26T10:35:03.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.399e-06 2024-04-26T10:35:03.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.914 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.914 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.914 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833086+0000", 2024-04-26T10:35:03.914 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.057542837999999999 2024-04-26T10:35:03.914 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833107+0000", 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1372000000000001e-05 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833262+0000", 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000154754 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833410+0000", 2024-04-26T10:35:03.915 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014841 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256903 5.7 5:ea2ea6f1:::benchmark_data_smithi043_45180_object122261:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.833141+0000", 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.019883778000000001, 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020248084999999999, 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:03.916 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256903 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833141+0000", 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833141+0000", 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.917 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833139+0000", 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999981 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833151+0000", 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1908e-05 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833161+0000", 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0316000000000001e-05 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.918 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833168+0000", 2024-04-26T10:35:03.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.263e-06 2024-04-26T10:35:03.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.919 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.919 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:03.919 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833272+0000", 2024-04-26T10:35:03.919 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010446 2024-04-26T10:35:03.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.920 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:03.920 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833412+0000", 2024-04-26T10:35:03.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014029400000000001 2024-04-26T10:35:03.920 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.920 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.920 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.920 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.920 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256904 5.3 5:cb2d47ee:::benchmark_data_smithi043_45180_object122262:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:03.920 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.833180+0000", 2024-04-26T10:35:03.920 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.019845239000000001, 2024-04-26T10:35:03.920 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020247169999999998, 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256904 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833180+0000", 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833180+0000", 2024-04-26T10:35:03.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833179+0000", 2024-04-26T10:35:03.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:03.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.922 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.922 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.922 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833182+0000", 2024-04-26T10:35:03.922 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.185e-06 2024-04-26T10:35:03.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833189+0000", 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6640000000000001e-06 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833194+0000", 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0350000000000001e-06 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833274+0000", 2024-04-26T10:35:03.923 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9422e-05 2024-04-26T10:35:03.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.924 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:03.924 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833411+0000", 2024-04-26T10:35:03.924 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013743199999999999 2024-04-26T10:35:03.924 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.924 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.924 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.924 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.924 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.924 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256905 5.3 5:c007e0d8:::benchmark_data_smithi043_45180_object122263:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:03.924 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.833203+0000", 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.019822309, 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020259025999999999, 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "reached pg", 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256905 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833203+0000", 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833203+0000", 2024-04-26T10:35:03.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833202+0000", 2024-04-26T10:35:03.926 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:03.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.926 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.926 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.926 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833205+0000", 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6070000000000002e-06 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833210+0000", 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1499999999999998e-06 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833215+0000", 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5299999999999998e-06 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:03.927 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835653+0000", 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0024380209999999999 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256906 5.5 5:a6d4fc22:::benchmark_data_smithi043_45180_object122264:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.833220+0000", 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.019804423000000002, 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.020273596000000001, 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:03.928 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256906 2024-04-26T10:35:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833220+0000", 2024-04-26T10:35:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833220+0000", 2024-04-26T10:35:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:03.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:03.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833220+0000", 2024-04-26T10:35:03.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:03.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.930 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.930 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:03.930 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833223+0000", 2024-04-26T10:35:03.930 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0350000000000002e-06 2024-04-26T10:35:03.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.931 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:03.931 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833229+0000", 2024-04-26T10:35:03.931 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8470000000000001e-06 2024-04-26T10:35:03.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.931 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:03.932 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833234+0000", 2024-04-26T10:35:03.932 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1059999999999999e-06 2024-04-26T10:35:03.932 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.932 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.932 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:03.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833337+0000", 2024-04-26T10:35:03.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000103399 2024-04-26T10:35:03.933 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:03.933 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:03.933 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:03.933 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833453+0000", 2024-04-26T10:35:03.933 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000115808 2024-04-26T10:35:03.933 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.933 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:03.933 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.933 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:03.934 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:35:03.934 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 14 2024-04-26T10:35:03.934 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:03.935 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:35:03.936 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:03.934+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:04.036 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:04.035+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:04.118 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:04.118 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:35:04.118 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:35:04.119 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:35:04.119 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:04.133 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:35:04.177 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:04.176+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:04.238 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:04.236+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:04.330 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:04.331 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:35:04.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:35:04.331 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:35:04.331 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.331 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:04.331 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:04.331 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.526484964999995, 2024-04-26T10:35:04.331 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:35:04.331 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.331 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.331 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.331 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.332 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.332 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:35:04.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.332 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:04.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.332 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.332 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.332 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.332 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:04.332 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:35:04.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:04.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.333 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:35:04.333 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:35:04.333 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.333 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.333 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:35:04.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:35:04.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:35:04.334 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:35:04.334 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.334 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.334 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.334 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:35:04.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:35:04.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:35:04.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:35:04.335 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.335 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.335 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:04.335 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:35:04.335 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:35:04.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:04.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:35:04.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:35:04.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.336 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:35:04.336 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:35:04.336 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.336 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.336 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:35:04.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:35:04.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.337 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.337 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:35:04.337 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:35:04.337 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.337 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.337 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.337 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.337 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.338 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:35:04.338 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:35:04.338 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.526483979999995, 2024-04-26T10:35:04.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:35:04.338 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.338 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.338 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.338 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.338 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.338 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:35:04.338 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.338 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.339 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:35:04.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.339 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:04.339 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.339 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.339 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.339 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.340 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:35:04.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:35:04.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:35:04.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:35:04.341 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.341 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.341 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.341 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:35:04.341 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:35:04.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.342 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.342 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:35:04.342 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:35:04.342 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.342 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.342 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.342 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.342 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.342 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:04.343 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:35:04.343 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.526415357000005, 2024-04-26T10:35:04.343 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:35:04.343 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.343 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.343 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.343 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.343 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.343 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:35:04.343 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.343 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.343 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:35:04.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:35:04.344 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.344 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.344 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.344 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.344 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:35:04.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:35:04.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:35:04.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.345 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.345 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.345 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:35:04.345 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:35:04.345 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:35:04.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:35:04.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.346 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.346 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:35:04.346 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:35:04.346 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.346 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:35:04.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:35:04.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:04.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:35:04.347 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:35:04.347 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.347 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.347 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:04.347 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:35:04.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:35:04.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:35:04.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:35:04.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.348 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.348 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.348 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:35:04.348 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:35:04.348 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.349 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.349 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:35:04.349 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:35:04.349 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.349 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.349 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.349 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.349 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.349 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:04.349 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:04.349 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.526363576999998, 2024-04-26T10:35:04.350 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:35:04.350 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.350 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.350 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.350 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.350 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.350 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:35:04.350 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.350 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.350 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.350 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.350 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:04.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:04.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.351 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.351 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.351 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:04.351 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.351 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:35:04.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:35:04.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.352 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:35:04.352 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:35:04.352 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.352 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.352 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:35:04.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:35:04.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:35:04.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:35:04.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.353 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.353 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.353 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:35:04.353 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:35:04.353 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:04.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:35:04.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:35:04.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:04.354 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:35:04.354 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:35:04.354 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.354 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.354 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:35:04.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:35:04.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:35:04.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:35:04.355 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.355 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.355 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.355 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:35:04.355 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:35:04.356 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.356 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.356 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.356 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.356 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.356 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:04.356 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:04.356 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.526303726999998, 2024-04-26T10:35:04.356 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:35:04.356 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.356 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.356 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.357 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.357 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.357 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:35:04.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.357 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.357 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:04.357 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.357 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.357 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.357 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:04.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:04.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.358 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.358 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.358 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.358 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:35:04.358 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:35:04.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:35:04.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:35:04.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.359 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.359 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:35:04.359 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:35:04.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.359 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:35:04.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:35:04.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.360 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:35:04.360 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:35:04.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.360 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.360 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:04.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:35:04.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:35:04.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:04.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:35:04.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:35:04.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.361 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.361 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.361 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:35:04.361 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:35:04.361 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:35:04.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:35:04.362 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.362 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.362 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.362 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:35:04.362 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:35:04.362 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.363 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.363 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.363 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.363 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.363 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:04.363 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:35:04.363 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.524591022999999, 2024-04-26T10:35:04.363 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:35:04.363 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.363 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.364 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.364 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.364 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.364 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:35:04.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.364 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.364 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.364 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.364 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:35:04.364 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.364 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:35:04.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.365 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.365 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:35:04.365 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:35:04.365 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.365 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:35:04.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:35:04.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.366 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:35:04.366 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:35:04.366 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.366 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.366 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:35:04.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:35:04.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:35:04.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:35:04.367 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.367 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.367 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.367 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:35:04.367 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:35:04.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:35:04.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:35:04.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:35:04.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.368 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.368 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:04.368 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:35:04.368 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:35:04.368 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:35:04.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:35:04.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.369 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.369 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:35:04.369 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:35:04.369 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.369 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.370 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.370 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:35:04.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:35:04.370 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.370 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.370 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.370 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.370 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.370 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:35:04.370 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:35:04.370 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.524475956000003, 2024-04-26T10:35:04.370 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:35:04.371 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.371 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.371 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:35:04.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.371 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.371 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.371 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:35:04.371 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.371 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:35:04.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.372 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.372 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:35:04.372 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:35:04.372 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.372 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:35:04.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:35:04.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:35:04.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:35:04.373 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.373 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.373 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.373 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:35:04.373 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:35:04.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:35:04.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:35:04.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.374 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.374 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.374 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:35:04.374 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:35:04.374 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.375 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.375 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:35:04.375 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:35:04.375 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.375 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.375 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.375 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.375 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.375 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:04.375 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:35:04.375 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.524382815999999, 2024-04-26T10:35:04.376 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:35:04.376 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.376 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.376 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.376 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.376 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.376 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:35:04.376 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.376 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.376 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.376 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.376 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:35:04.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:35:04.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.377 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.377 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:35:04.377 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.377 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.377 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:35:04.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:35:04.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.378 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:35:04.378 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:35:04.378 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.378 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.378 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:35:04.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:35:04.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:35:04.379 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:35:04.379 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.379 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.379 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.379 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:35:04.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:35:04.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:04.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:35:04.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:35:04.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.380 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:04.380 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:35:04.380 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:35:04.380 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.380 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:35:04.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:35:04.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:35:04.381 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:35:04.381 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.381 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.381 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.381 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:35:04.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:35:04.382 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.382 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.382 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.382 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.382 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.382 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:35:04.382 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:04.382 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.524188656000007, 2024-04-26T10:35:04.382 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:35:04.382 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.382 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.383 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:04.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.383 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:04.383 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.383 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.383 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.383 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.384 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:04.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.384 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.384 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:35:04.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:35:04.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.384 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.384 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.384 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:35:04.384 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:35:04.384 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:35:04.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:35:04.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:35:04.385 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:35:04.385 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.385 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.385 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.385 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:35:04.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:35:04.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:35:04.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:35:04.386 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.386 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.386 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.386 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:35:04.386 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:35:04.386 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.387 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.387 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.387 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.387 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:35:04.387 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:35:04.387 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.522981287999997, 2024-04-26T10:35:04.387 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:35:04.387 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.387 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:04.387 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.387 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:35:04.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:35:04.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.388 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.388 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.388 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.388 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:35:04.388 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:35:04.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:35:04.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.389 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.389 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:35:04.389 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:35:04.389 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.389 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:35:04.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:35:04.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.390 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:35:04.390 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:35:04.390 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.390 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.390 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:35:04.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:35:04.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.391 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.391 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:35:04.391 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:35:04.391 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.391 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.391 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.391 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.391 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.391 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:04.392 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:35:04.392 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.522172380000001, 2024-04-26T10:35:04.392 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:35:04.392 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.392 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.392 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.392 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.392 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.392 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:35:04.392 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.393 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:35:04.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.393 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.393 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:35:04.393 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.393 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.393 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:35:04.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:35:04.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:35:04.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:35:04.394 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.394 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.394 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.394 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:35:04.394 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:35:04.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:35:04.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:35:04.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.395 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.395 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:35:04.395 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:35:04.395 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.395 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:35:04.396 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:04.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:35:04.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:35:04.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.397 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:35:04.397 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:35:04.397 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.397 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.397 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.398 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:35:04.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:35:04.398 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.398 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.398 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.398 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.398 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.398 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:04.398 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:35:04.398 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.522068841999996, 2024-04-26T10:35:04.398 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:35:04.399 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.399 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.399 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.399 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.399 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.399 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:35:04.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.399 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.399 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.399 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.399 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:35:04.399 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:35:04.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.400 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.400 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:35:04.400 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.400 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:35:04.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:35:04.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:35:04.401 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:35:04.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.401 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.401 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.401 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:35:04.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:35:04.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:35:04.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:35:04.402 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.402 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.402 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.402 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:35:04.402 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:35:04.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:04.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:35:04.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:35:04.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.403 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:04.403 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:35:04.403 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:35:04.403 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.403 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:35:04.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:35:04.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:35:04.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:35:04.404 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.404 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.404 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.404 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:35:04.404 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.521991968999998, 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.405 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.406 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:35:04.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.406 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.406 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:35:04.406 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.406 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.406 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.406 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:35:04.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:35:04.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.407 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.407 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.407 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:35:04.407 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:35:04.407 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:35:04.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:35:04.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.408 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:35:04.408 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:35:04.408 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.408 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.408 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:35:04.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:35:04.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:35:04.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:35:04.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.409 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.409 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:04.409 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:35:04.409 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:35:04.409 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:04.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:35:04.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:35:04.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.410 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.410 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:35:04.410 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:35:04.410 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.410 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:35:04.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:35:04.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.411 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.411 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.411 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:35:04.411 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:35:04.411 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.411 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.411 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.411 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.412 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:35:04.412 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:04.412 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 96.521876585000001, 2024-04-26T10:35:04.412 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:35:04.412 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.412 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:04.412 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.412 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.412 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.412 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:04.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:04.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.413 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.413 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:04.413 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.413 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.413 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:35:04.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:35:04.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:35:04.414 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:35:04.414 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.414 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.414 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.414 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:35:04.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:35:04.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:35:04.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:35:04.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.415 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.415 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:35:04.415 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:35:04.415 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.415 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.416 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.416 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:35:04.416 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:35:04.416 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.416 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.416 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.416 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.416 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.416 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256890 5.6 5:6c163c2d:::benchmark_data_smithi043_45180_object122248:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:04.416 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:04.416 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.558328516, 2024-04-26T10:35:04.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102475969, 2024-04-26T10:35:04.417 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.417 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.417 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.417 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.417 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.417 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256890 2024-04-26T10:35:04.417 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.417 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.417 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.417 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.417 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:04.417 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:04.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.418 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.418 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.418 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:04.418 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.418 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768827+0000", 2024-04-26T10:35:04.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0320000000000002e-06 2024-04-26T10:35:04.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.419 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768832+0000", 2024-04-26T10:35:04.419 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3190000000000002e-06 2024-04-26T10:35:04.419 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.419 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.419 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768837+0000", 2024-04-26T10:35:04.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9189999999999998e-06 2024-04-26T10:35:04.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.770074+0000", 2024-04-26T10:35:04.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001236429 2024-04-26T10:35:04.420 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.420 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.420 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.420 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.770195+0000", 2024-04-26T10:35:04.420 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000120981 2024-04-26T10:35:04.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.871197+0000", 2024-04-26T10:35:04.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101002548 2024-04-26T10:35:04.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.421 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.871232+0000", 2024-04-26T10:35:04.421 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:35:04.421 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.421 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.421 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.422 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.871301+0000", 2024-04-26T10:35:04.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.97e-05 2024-04-26T10:35:04.422 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.422 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.422 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.422 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.422 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.422 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256897 5.6 5:68cfdf58:::benchmark_data_smithi043_45180_object122255:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:04.422 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:04.422 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.55451145400000001, 2024-04-26T10:35:04.422 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10094767, 2024-04-26T10:35:04.423 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.423 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.423 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.423 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.423 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.423 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256897 2024-04-26T10:35:04.423 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.423 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.423 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.423 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.423 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:04.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:04.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.424 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.424 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:04.424 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.424 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.424 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772651+0000", 2024-04-26T10:35:04.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9919999999999996e-06 2024-04-26T10:35:04.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772657+0000", 2024-04-26T10:35:04.425 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3269999999999997e-06 2024-04-26T10:35:04.425 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.425 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.425 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.425 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772663+0000", 2024-04-26T10:35:04.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.054e-06 2024-04-26T10:35:04.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774088+0000", 2024-04-26T10:35:04.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001424287 2024-04-26T10:35:04.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.426 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.426 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.426 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774200+0000", 2024-04-26T10:35:04.426 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011267100000000001 2024-04-26T10:35:04.426 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873457+0000", 2024-04-26T10:35:04.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.099256741999999995 2024-04-26T10:35:04.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.427 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873518+0000", 2024-04-26T10:35:04.427 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.143e-05 2024-04-26T10:35:04.427 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.427 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.427 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.428 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873590+0000", 2024-04-26T10:35:04.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1641000000000001e-05 2024-04-26T10:35:04.428 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.428 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.428 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.428 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.428 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.428 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256898 5.c 5:3707bdbe:::benchmark_data_smithi043_45180_object122256:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:04.428 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:04.428 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.55448145599999998, 2024-04-26T10:35:04.428 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.097129550999999995, 2024-04-26T10:35:04.428 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.429 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.429 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.429 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.429 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.429 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256898 2024-04-26T10:35:04.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.429 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.429 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.429 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.429 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:04.429 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.429 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:04.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.430 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.430 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:04.430 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.430 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.430 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772675+0000", 2024-04-26T10:35:04.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7089999999999998e-06 2024-04-26T10:35:04.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772680+0000", 2024-04-26T10:35:04.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6699999999999999e-06 2024-04-26T10:35:04.431 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.431 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.431 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.431 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772685+0000", 2024-04-26T10:35:04.431 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7700000000000001e-06 2024-04-26T10:35:04.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.773342+0000", 2024-04-26T10:35:04.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00065647199999999996 2024-04-26T10:35:04.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.432 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.432 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.432 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.773450+0000", 2024-04-26T10:35:04.432 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010794999999999999 2024-04-26T10:35:04.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869674+0000", 2024-04-26T10:35:04.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.096224133000000003 2024-04-26T10:35:04.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869722+0000", 2024-04-26T10:35:04.433 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8476999999999997e-05 2024-04-26T10:35:04.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.433 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.433 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.433 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869802+0000", 2024-04-26T10:35:04.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9741999999999996e-05 2024-04-26T10:35:04.434 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.434 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.434 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.434 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.434 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256899 5.6 5:6756e015:::benchmark_data_smithi043_45180_object122257:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:04.434 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:04.434 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.55446347299999998, 2024-04-26T10:35:04.434 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10100118399999999, 2024-04-26T10:35:04.434 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.435 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.435 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.435 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.435 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.437 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256899 2024-04-26T10:35:04.437 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.438 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:04.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.438 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.438 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.438 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:04.438 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.438 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:04.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.439 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772692+0000", 2024-04-26T10:35:04.439 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3489999999999999e-06 2024-04-26T10:35:04.439 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.439 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.439 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772697+0000", 2024-04-26T10:35:04.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1270000000000002e-06 2024-04-26T10:35:04.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772702+0000", 2024-04-26T10:35:04.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4780000000000002e-06 2024-04-26T10:35:04.440 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.440 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.440 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.440 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833268+0000", 2024-04-26T10:35:04.440 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.060566203999999998 2024-04-26T10:35:04.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833410+0000", 2024-04-26T10:35:04.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014150999999999999 2024-04-26T10:35:04.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.441 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.441 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873597+0000", 2024-04-26T10:35:04.441 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040187120999999999 2024-04-26T10:35:04.441 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.441 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873638+0000", 2024-04-26T10:35:04.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0988999999999997e-05 2024-04-26T10:35:04.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.442 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.442 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.442 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873692+0000", 2024-04-26T10:35:04.442 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3866000000000002e-05 2024-04-26T10:35:04.442 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.442 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.442 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.442 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.443 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.443 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256901 5.6 5:6ab61672:::benchmark_data_smithi043_45180_object122259:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:04.443 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.774982+0000", 2024-04-26T10:35:04.443 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.55217139000000004, 2024-04-26T10:35:04.443 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.098805830999999997, 2024-04-26T10:35:04.443 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.443 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.443 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:04.443 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:04.443 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.443 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256901 2024-04-26T10:35:04.443 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.444 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774982+0000", 2024-04-26T10:35:04.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.444 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774982+0000", 2024-04-26T10:35:04.444 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.444 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.444 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.444 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774981+0000", 2024-04-26T10:35:04.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:04.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774987+0000", 2024-04-26T10:35:04.445 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3720000000000004e-06 2024-04-26T10:35:04.445 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.445 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.445 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.445 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774997+0000", 2024-04-26T10:35:04.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0193e-05 2024-04-26T10:35:04.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775005+0000", 2024-04-26T10:35:04.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9759999999999995e-06 2024-04-26T10:35:04.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.446 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.446 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.446 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835531+0000", 2024-04-26T10:35:04.446 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.060526475000000003 2024-04-26T10:35:04.446 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835619+0000", 2024-04-26T10:35:04.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7266000000000001e-05 2024-04-26T10:35:04.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:04.447 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873697+0000", 2024-04-26T10:35:04.447 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.038077932000000002 2024-04-26T10:35:04.447 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.447 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.447 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873720+0000", 2024-04-26T10:35:04.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3589999999999999e-05 2024-04-26T10:35:04.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.448 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.448 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873788+0000", 2024-04-26T10:35:04.448 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8089999999999994e-05 2024-04-26T10:35:04.448 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.448 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.448 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.448 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.448 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.448 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:256900 5.a e68/66 5:5f2e8890:::benchmark_data_smithi043_45180_object122258:head v 68'16240, mlcod=68'16238)", 2024-04-26T10:35:04.449 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.775029+0000", 2024-04-26T10:35:04.449 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.55212510400000003, 2024-04-26T10:35:04.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.094889744999999998, 2024-04-26T10:35:04.449 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:04.449 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:04.449 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:04.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:04.449 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775029+0000", 2024-04-26T10:35:04.449 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.449 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.449 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.449 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:04.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775029+0000", 2024-04-26T10:35:04.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:04.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:04.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775028+0000", 2024-04-26T10:35:04.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.450 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.450 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.450 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:04.450 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775037+0000", 2024-04-26T10:35:04.450 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:35:04.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:04.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775045+0000", 2024-04-26T10:35:04.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4549999999999998e-06 2024-04-26T10:35:04.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.451 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.451 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.451 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775051+0000", 2024-04-26T10:35:04.451 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.455e-06 2024-04-26T10:35:04.451 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:04.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775084+0000", 2024-04-26T10:35:04.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2563e-05 2024-04-26T10:35:04.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.452 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:04.452 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833084+0000", 2024-04-26T10:35:04.452 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.057999929999999998 2024-04-26T10:35:04.452 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.452 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:04.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869885+0000", 2024-04-26T10:35:04.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036800737 2024-04-26T10:35:04.453 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:04.453 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:04.453 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:04.453 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869919+0000", 2024-04-26T10:35:04.453 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3974999999999999e-05 2024-04-26T10:35:04.453 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.453 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.453 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.453 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:04.453 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:04.454 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:04.455 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:04.453+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:04.456 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:35:04.557 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:04.556+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:04.639 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:35:04.639 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:35:04.639 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.639 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:259021 5.9 5:9d6ce2bd:::benchmark_data_smithi043_45180_object124379:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:04.639 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:35:04.636411+0000", 2024-04-26T10:35:04.639 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00146327, 2024-04-26T10:35:04.639 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0014896180000000001, 2024-04-26T10:35:04.639 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:04.640 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "started", 2024-04-26T10:35:04.640 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:04.640 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:04.640 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.640 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 259021 2024-04-26T10:35:04.640 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.640 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:04.640 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.640 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:04.640 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636411+0000", 2024-04-26T10:35:04.640 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:04.640 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.641 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.641 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:04.641 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636411+0000", 2024-04-26T10:35:04.641 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:04.641 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.641 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.641 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:04.641 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636411+0000", 2024-04-26T10:35:04.641 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:04.641 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.641 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.641 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:04.641 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636416+0000", 2024-04-26T10:35:04.642 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1159999999999998e-06 2024-04-26T10:35:04.642 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.642 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.642 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:04.642 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636428+0000", 2024-04-26T10:35:04.642 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2325e-05 2024-04-26T10:35:04.642 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.642 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.642 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.642 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636436+0000", 2024-04-26T10:35:04.642 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2409999999999995e-06 2024-04-26T10:35:04.642 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.643 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.643 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:04.643 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636481+0000", 2024-04-26T10:35:04.643 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4356e-05 2024-04-26T10:35:04.643 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.643 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.643 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:04.643 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636607+0000", 2024-04-26T10:35:04.643 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012598500000000001 2024-04-26T10:35:04.643 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:04.643 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:04.643 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:04.643 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.644 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.644 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:259022 5.a 5:59375d83:::benchmark_data_smithi043_45180_object124380:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:04.644 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:35:04.636494+0000", 2024-04-26T10:35:04.644 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.00138057, 2024-04-26T10:35:04.644 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001485664, 2024-04-26T10:35:04.644 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:04.644 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:35:04.644 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:04.644 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:04.644 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.644 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 259022 2024-04-26T10:35:04.644 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.644 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:04.645 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.645 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:04.645 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636494+0000", 2024-04-26T10:35:04.645 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:04.645 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.645 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.645 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:04.645 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636494+0000", 2024-04-26T10:35:04.645 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:04.645 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.645 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.645 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:04.645 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636493+0000", 2024-04-26T10:35:04.646 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.646 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.646 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.646 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:04.646 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636497+0000", 2024-04-26T10:35:04.646 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7720000000000001e-06 2024-04-26T10:35:04.646 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.646 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.646 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:04.646 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636505+0000", 2024-04-26T10:35:04.646 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5580000000000003e-06 2024-04-26T10:35:04.646 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.647 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.647 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.647 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636512+0000", 2024-04-26T10:35:04.647 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0049999999999998e-06 2024-04-26T10:35:04.647 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.647 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.647 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:04.647 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636539+0000", 2024-04-26T10:35:04.647 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7036e-05 2024-04-26T10:35:04.647 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.647 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.647 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:04.648 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636616+0000", 2024-04-26T10:35:04.648 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7086e-05 2024-04-26T10:35:04.648 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.648 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.648 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:04.648 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636684+0000", 2024-04-26T10:35:04.648 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7976000000000001e-05 2024-04-26T10:35:04.648 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:04.648 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:04.648 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:04.648 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.648 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.648 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:259025 5.d 5.162abf2d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:04.649 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:35:04.638007+0000", 2024-04-26T10:35:04.649 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 4294967295.9998674, 2024-04-26T10:35:04.649 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.8912000000000002e-05, 2024-04-26T10:35:04.649 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:04.649 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "queued for pg", 2024-04-26T10:35:04.649 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:04.649 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:04.649 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.649 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 259025 2024-04-26T10:35:04.649 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.649 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:04.649 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.650 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:04.650 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.638007+0000", 2024-04-26T10:35:04.650 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:04.650 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.650 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.650 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:04.650 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.638007+0000", 2024-04-26T10:35:04.650 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:04.650 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.650 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.651 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:04.651 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.638007+0000", 2024-04-26T10:35:04.651 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:04.651 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.651 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.651 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:04.651 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.638011+0000", 2024-04-26T10:35:04.651 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6809999999999997e-06 2024-04-26T10:35:04.651 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.651 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.651 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:04.651 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.638021+0000", 2024-04-26T10:35:04.652 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.4129999999999995e-06 2024-04-26T10:35:04.652 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.652 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.652 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.652 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.638028+0000", 2024-04-26T10:35:04.652 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.9530000000000002e-06 2024-04-26T10:35:04.652 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.652 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.652 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:04.652 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.638059+0000", 2024-04-26T10:35:04.652 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1637000000000002e-05 2024-04-26T10:35:04.652 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:04.653 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:04.653 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:04.653 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.653 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.653 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:258999 5.a 5:5d7a35c2:::benchmark_data_smithi043_45180_object124357:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:04.653 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:35:04.628043+0000", 2024-04-26T10:35:04.653 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.0098312169999999997, 2024-04-26T10:35:04.653 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.010248037999999999, 2024-04-26T10:35:04.653 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:04.653 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:35:04.653 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:04.654 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:04.654 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.654 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 258999 2024-04-26T10:35:04.654 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.654 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:04.654 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.654 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:04.654 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.628043+0000", 2024-04-26T10:35:04.654 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:04.654 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.654 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.654 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:04.655 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.628043+0000", 2024-04-26T10:35:04.655 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:04.655 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.655 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.655 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:04.655 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.628043+0000", 2024-04-26T10:35:04.655 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.655 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.655 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.655 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:04.655 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.628045+0000", 2024-04-26T10:35:04.656 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.193e-06 2024-04-26T10:35:04.656 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.656 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.656 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:04.656 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.628051+0000", 2024-04-26T10:35:04.656 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.2149999999999998e-06 2024-04-26T10:35:04.656 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.656 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.656 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.656 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.628056+0000", 2024-04-26T10:35:04.656 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4789999999999998e-06 2024-04-26T10:35:04.656 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.656 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.657 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:04.657 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.630181+0000", 2024-04-26T10:35:04.657 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0021252340000000002 2024-04-26T10:35:04.657 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.657 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.657 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:04.657 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.630293+0000", 2024-04-26T10:35:04.657 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000112064 2024-04-26T10:35:04.657 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.657 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.657 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:04.657 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.630395+0000", 2024-04-26T10:35:04.657 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000101474 2024-04-26T10:35:04.658 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.658 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.658 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:04.658 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.632276+0000", 2024-04-26T10:35:04.658 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0018815609999999999 2024-04-26T10:35:04.658 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:04.658 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:04.658 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:04.658 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.658 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.658 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:259015 5.8 5:10cb3b8b:::benchmark_data_smithi043_45180_object124373:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:04.659 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:35:04.634077+0000", 2024-04-26T10:35:04.659 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 0.003797978, 2024-04-26T10:35:04.659 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0042661849999999996, 2024-04-26T10:35:04.659 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:04.659 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:35:04.659 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:04.659 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:04.659 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:04.659 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 259015 2024-04-26T10:35:04.659 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.659 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:04.659 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.660 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:04.660 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.634077+0000", 2024-04-26T10:35:04.660 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:04.660 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.660 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.660 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:04.660 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.634077+0000", 2024-04-26T10:35:04.660 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:04.660 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.660 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.660 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:04.660 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.634076+0000", 2024-04-26T10:35:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.634079+0000", 2024-04-26T10:35:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8590000000000001e-06 2024-04-26T10:35:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.634090+0000", 2024-04-26T10:35:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1095e-05 2024-04-26T10:35:04.661 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.634096+0000", 2024-04-26T10:35:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2440000000000001e-06 2024-04-26T10:35:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.634128+0000", 2024-04-26T10:35:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2008000000000003e-05 2024-04-26T10:35:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.662 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.634244+0000", 2024-04-26T10:35:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000115988 2024-04-26T10:35:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.634363+0000", 2024-04-26T10:35:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00011943999999999999 2024-04-26T10:35:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:04.636513+0000", 2024-04-26T10:35:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0021495619999999998 2024-04-26T10:35:04.663 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:04.664 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:04.664 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:04.664 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:04.664 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-26T10:35:04.664 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 5 2024-04-26T10:35:04.664 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:35:04.666 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:35:04.667 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:04.664+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:04.766 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:04.765+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:04.768 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-26T10:35:04.768 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:35:04.769 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-26T10:35:04.769 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T10:35:04.846 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:35:04.846 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:35:04.846 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:35:04.846 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:35:04.846 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:35:04.859 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:35:04.900 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:04.899+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:04.970 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:04.966+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:05.068 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:05.066+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:05.084 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:35:05.084 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:35:05.085 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:35:05.085 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:35:05.085 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.085 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:05.085 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:35:05.086 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 97.279891305000007, 2024-04-26T10:35:05.086 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:35:05.086 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.086 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.086 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.086 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.087 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.087 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:35:05.087 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.087 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.087 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.088 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.088 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:35:05.088 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.088 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.088 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.088 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.089 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:35:05.089 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.089 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.089 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.089 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.089 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:35:05.090 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:05.090 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.090 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.090 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.090 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:35:05.090 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:35:05.091 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.091 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.091 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.091 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:35:05.091 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:35:05.092 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.092 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.092 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.092 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:35:05.092 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:35:05.092 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.093 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.093 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.093 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:35:05.093 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:35:05.093 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.093 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.094 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.094 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:35:05.094 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:35:05.094 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.095 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.095 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.095 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:35:05.095 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:35:05.095 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.095 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.096 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.096 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:35:05.096 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:35:05.096 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.096 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.096 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.097 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:35:05.097 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:35:05.097 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.097 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.097 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.097 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:35:05.098 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:35:05.098 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.098 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.098 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.098 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:35:05.099 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:35:05.099 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.099 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.099 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.099 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.099 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.099 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:05.099 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:35:05.100 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 97.279063225000002, 2024-04-26T10:35:05.100 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:35:05.100 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.100 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.100 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.100 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.100 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.100 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:35:05.100 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.101 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.101 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.101 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.101 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:35:05.101 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.101 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.101 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.101 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.102 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:35:05.102 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.102 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.102 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.102 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.102 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:35:05.102 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.103 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.103 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.103 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.103 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:35:05.103 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:35:05.103 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.103 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.103 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.104 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.105 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.105 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:35:05.105 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:35:05.105 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.105 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.105 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.105 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:35:05.105 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:35:05.105 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.105 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.105 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.105 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:35:05.105 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:35:05.106 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.106 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.106 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.106 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:35:05.106 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:35:05.106 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.106 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.106 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.106 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:35:05.106 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:35:05.106 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.106 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.107 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.107 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:35:05.107 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:35:05.107 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.107 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.107 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.107 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.107 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.107 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:05.108 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:05.108 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 97.278134162000001, 2024-04-26T10:35:05.108 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:35:05.108 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.108 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.108 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.108 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.108 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.108 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:35:05.109 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.109 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.109 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.109 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.109 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:05.109 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.109 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.109 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.109 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.110 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:05.110 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.110 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.110 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.110 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.110 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:05.110 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.111 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.111 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.111 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.111 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:35:05.111 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:35:05.111 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.111 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.111 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.112 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:35:05.112 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:35:05.112 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.112 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.112 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.112 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:35:05.112 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:35:05.112 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.112 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.113 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.113 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:35:05.113 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:35:05.113 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.113 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.113 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.113 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:35:05.113 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:35:05.114 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.114 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.114 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.114 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:35:05.114 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:35:05.114 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.114 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.114 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.115 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:35:05.115 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:35:05.115 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.115 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.115 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.115 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:35:05.115 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:35:05.116 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.116 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.116 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.116 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:35:05.116 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:35:05.116 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.116 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.116 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.117 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:35:05.117 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:35:05.117 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.117 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.117 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.117 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.117 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.117 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:05.117 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:35:05.118 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 97.277448720999999, 2024-04-26T10:35:05.118 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:35:05.118 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.118 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.118 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.118 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.118 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.118 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:35:05.119 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.119 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.119 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.119 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.119 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:35:05.119 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.119 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.119 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.119 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.120 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:35:05.120 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.120 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.120 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.120 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.120 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:35:05.120 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:05.120 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.121 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.121 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.121 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:35:05.121 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:35:05.121 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.121 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.121 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.121 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:35:05.121 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:35:05.121 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.121 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.122 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.122 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:35:05.122 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:35:05.122 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.122 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.122 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.122 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:35:05.122 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:35:05.122 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.122 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.122 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.122 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:35:05.122 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.123 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.124 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.125 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.125 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.125 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248225 5.a 5:51f133a7:::benchmark_data_smithi043_45180_object113583:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.125 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.672106+0000", 2024-04-26T10:35:05.125 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.4077506319999999, 2024-04-26T10:35:05.125 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0378550820000001, 2024-04-26T10:35:05.125 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.125 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "reached pg", 2024-04-26T10:35:05.126 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.126 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.126 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.126 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248225 2024-04-26T10:35:05.126 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.127 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.127 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.127 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.127 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672106+0000", 2024-04-26T10:35:05.127 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.127 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.127 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.127 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.127 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672106+0000", 2024-04-26T10:35:05.127 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.127 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.127 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.127 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672105+0000", 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672110+0000", 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0849999999999996e-06 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672120+0000", 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0068000000000001e-05 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.128 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.129 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.129 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672127+0000", 2024-04-26T10:35:05.129 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4209999999999998e-06 2024-04-26T10:35:05.129 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.129 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.129 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.129 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672158+0000", 2024-04-26T10:35:05.129 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0889999999999997e-05 2024-04-26T10:35:05.129 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.129 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.129 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.129 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672164+0000", 2024-04-26T10:35:05.129 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7049999999999996e-06 2024-04-26T10:35:05.130 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.130 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.130 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.130 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.700907+0000", 2024-04-26T10:35:05.130 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0287429509999999 2024-04-26T10:35:05.130 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.131 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.131 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for missing object", 2024-04-26T10:35:05.131 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701040+0000", 2024-04-26T10:35:05.131 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013340699999999999 2024-04-26T10:35:05.131 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.131 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.131 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.131 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.709878+0000", 2024-04-26T10:35:05.131 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0088376310000000003 2024-04-26T10:35:05.132 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.132 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.132 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.132 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.709961+0000", 2024-04-26T10:35:05.132 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2837000000000007e-05 2024-04-26T10:35:05.132 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.132 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.132 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.132 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.132 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.132 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248226 5.a 5:5987dd37:::benchmark_data_smithi043_45180_object113584:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.132 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.672136+0000", 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.4077205629999998, 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0382583759999999, 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "reached pg", 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248226 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672136+0000", 2024-04-26T10:35:05.133 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.134 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.134 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.134 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.134 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672136+0000", 2024-04-26T10:35:05.134 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.134 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.134 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.134 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.134 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672135+0000", 2024-04-26T10:35:05.134 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.134 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.134 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.134 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672138+0000", 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.475e-06 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672144+0000", 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6119999999999998e-06 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672149+0000", 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7479999999999999e-06 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.135 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672192+0000", 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3137999999999999e-05 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672201+0000", 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7660000000000004e-06 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701238+0000", 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.029036914 2024-04-26T10:35:05.136 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for missing object", 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701416+0000", 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00017760200000000001 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710326+0000", 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0089101230000000007 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710394+0000", 2024-04-26T10:35:05.137 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8384000000000001e-05 2024-04-26T10:35:05.138 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.138 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.138 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.138 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.138 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.138 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248238 5.a 5:5d4e64f8:::benchmark_data_smithi043_45180_object113596:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.138 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.675816+0000", 2024-04-26T10:35:05.138 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.4040404669999997, 2024-04-26T10:35:05.138 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0322745419999999, 2024-04-26T10:35:05.138 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.138 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.138 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.138 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248238 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675816+0000", 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675816+0000", 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.139 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675815+0000", 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675819+0000", 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7809999999999999e-06 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675827+0000", 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:35:05.140 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675832+0000", 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5539999999999997e-06 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675870+0000", 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7645999999999998e-05 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675880+0000", 2024-04-26T10:35:05.141 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0159e-05 2024-04-26T10:35:05.142 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.142 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.142 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.142 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701454+0000", 2024-04-26T10:35:05.142 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0255732449999999 2024-04-26T10:35:05.142 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.142 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.142 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.142 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701552+0000", 2024-04-26T10:35:05.142 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8480000000000006e-05 2024-04-26T10:35:05.143 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.143 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.143 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.143 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701638+0000", 2024-04-26T10:35:05.143 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5971999999999996e-05 2024-04-26T10:35:05.143 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.143 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.143 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.143 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.707916+0000", 2024-04-26T10:35:05.143 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006278006 2024-04-26T10:35:05.143 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.143 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.707990+0000", 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4140999999999994e-05 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708026+0000", 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5422000000000001e-05 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708090+0000", 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4935000000000001e-05 2024-04-26T10:35:05.144 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.145 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.145 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.145 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.145 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.145 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248273 5.a 5:59a40f70:::benchmark_data_smithi043_45180_object113631:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.145 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:05.145 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.389345284, 2024-04-26T10:35:05.145 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.017694576, 2024-04-26T10:35:05.145 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.145 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.145 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.145 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.145 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.146 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248273 2024-04-26T10:35:05.146 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.146 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.146 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.146 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.147 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:05.147 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.147 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.147 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.147 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.147 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:05.147 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.148 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.148 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.148 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.148 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:05.148 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.148 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.148 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.148 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.148 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690513+0000", 2024-04-26T10:35:05.148 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6759999999999999e-06 2024-04-26T10:35:05.148 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.148 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.148 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.149 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690520+0000", 2024-04-26T10:35:05.149 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3720000000000001e-06 2024-04-26T10:35:05.149 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.149 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.149 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.149 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690525+0000", 2024-04-26T10:35:05.149 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5840000000000002e-06 2024-04-26T10:35:05.149 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.149 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.149 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.149 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.693881+0000", 2024-04-26T10:35:05.149 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003355406 2024-04-26T10:35:05.150 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.150 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.150 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.150 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.693887+0000", 2024-04-26T10:35:05.150 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:35:05.150 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.150 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.150 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.151 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.703149+0000", 2024-04-26T10:35:05.151 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.009261918 2024-04-26T10:35:05.151 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.151 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.151 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.152 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.703303+0000", 2024-04-26T10:35:05.152 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015461000000000001 2024-04-26T10:35:05.152 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.152 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.152 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.152 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.703447+0000", 2024-04-26T10:35:05.152 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014344600000000001 2024-04-26T10:35:05.152 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.152 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.152 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.152 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708098+0000", 2024-04-26T10:35:05.153 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0046506960000000002 2024-04-26T10:35:05.153 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.153 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.153 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.153 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708129+0000", 2024-04-26T10:35:05.153 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0981e-05 2024-04-26T10:35:05.153 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.153 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.153 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.153 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708161+0000", 2024-04-26T10:35:05.153 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2254e-05 2024-04-26T10:35:05.153 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.154 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.154 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.154 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708206+0000", 2024-04-26T10:35:05.154 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4913999999999997e-05 2024-04-26T10:35:05.154 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.154 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.154 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.154 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.154 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.155 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248282 5.a 5:594072f3:::benchmark_data_smithi043_45180_object113640:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.155 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.692105+0000", 2024-04-26T10:35:05.155 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.3877517040000003, 2024-04-26T10:35:05.155 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.01817673, 2024-04-26T10:35:05.155 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.155 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.155 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.155 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.155 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.155 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248282 2024-04-26T10:35:05.155 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.155 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.155 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.156 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692105+0000", 2024-04-26T10:35:05.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.156 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.156 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.156 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692105+0000", 2024-04-26T10:35:05.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.156 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.156 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.156 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692104+0000", 2024-04-26T10:35:05.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:05.157 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.157 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.157 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.157 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692109+0000", 2024-04-26T10:35:05.157 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6469999999999997e-06 2024-04-26T10:35:05.157 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.157 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.157 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.158 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692117+0000", 2024-04-26T10:35:05.158 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8610000000000004e-06 2024-04-26T10:35:05.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.158 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.158 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692124+0000", 2024-04-26T10:35:05.158 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5989999999999998e-06 2024-04-26T10:35:05.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.158 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.158 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.694096+0000", 2024-04-26T10:35:05.158 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001971946 2024-04-26T10:35:05.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.159 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.159 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.159 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.694106+0000", 2024-04-26T10:35:05.159 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0301e-05 2024-04-26T10:35:05.159 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.159 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.159 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.159 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.706437+0000", 2024-04-26T10:35:05.159 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.012330838 2024-04-26T10:35:05.160 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.160 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.160 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.160 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.706575+0000", 2024-04-26T10:35:05.160 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013838300000000001 2024-04-26T10:35:05.160 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.160 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.160 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.160 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.706699+0000", 2024-04-26T10:35:05.160 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000123693 2024-04-26T10:35:05.160 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.161 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710000+0000", 2024-04-26T10:35:05.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003301137 2024-04-26T10:35:05.161 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.161 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710152+0000", 2024-04-26T10:35:05.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015147399999999999 2024-04-26T10:35:05.161 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710199+0000", 2024-04-26T10:35:05.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7338e-05 2024-04-26T10:35:05.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710281+0000", 2024-04-26T10:35:05.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2359000000000002e-05 2024-04-26T10:35:05.162 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.162 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.162 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.163 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248291 5.a 5:5701fe08:::benchmark_data_smithi043_45180_object113649:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.163 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.696026+0000", 2024-04-26T10:35:05.163 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.383830734, 2024-04-26T10:35:05.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0145436720000001, 2024-04-26T10:35:05.163 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.163 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.163 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.163 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.164 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.164 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248291 2024-04-26T10:35:05.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.164 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696026+0000", 2024-04-26T10:35:05.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.165 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696026+0000", 2024-04-26T10:35:05.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696025+0000", 2024-04-26T10:35:05.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:05.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696029+0000", 2024-04-26T10:35:05.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0940000000000001e-06 2024-04-26T10:35:05.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696037+0000", 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8199999999999997e-06 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696044+0000", 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.81e-06 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696078+0000", 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4748e-05 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696091+0000", 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2687999999999999e-05 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708226+0000", 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0121351000000001 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708304+0000", 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8147999999999998e-05 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708379+0000", 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4859999999999998e-05 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710441+0000", 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020616290000000002 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710452+0000", 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0946e-05 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710497+0000", 2024-04-26T10:35:05.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5022999999999999e-05 2024-04-26T10:35:05.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710569+0000", 2024-04-26T10:35:05.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2558000000000006e-05 2024-04-26T10:35:05.170 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.170 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.170 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248296 5.a 5:5ecdda99:::benchmark_data_smithi043_45180_object113654:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.3804960189999997, 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0170911979999999, 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248296 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.171 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699364+0000", 2024-04-26T10:35:05.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4479999999999996e-06 2024-04-26T10:35:05.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699371+0000", 2024-04-26T10:35:05.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1500000000000002e-06 2024-04-26T10:35:05.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699377+0000", 2024-04-26T10:35:05.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3240000000000002e-06 2024-04-26T10:35:05.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699411+0000", 2024-04-26T10:35:05.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4724999999999997e-05 2024-04-26T10:35:05.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699417+0000", 2024-04-26T10:35:05.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1020000000000002e-06 2024-04-26T10:35:05.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710606+0000", 2024-04-26T10:35:05.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.011189033 2024-04-26T10:35:05.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710697+0000", 2024-04-26T10:35:05.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0779999999999995e-05 2024-04-26T10:35:05.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710817+0000", 2024-04-26T10:35:05.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012020500000000001 2024-04-26T10:35:05.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716251+0000", 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0054336439999999996 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716311+0000", 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9954000000000002e-05 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716368+0000", 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7362999999999999e-05 2024-04-26T10:35:05.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716452+0000", 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3191999999999999e-05 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248303 5.a 5:506f0e7a:::benchmark_data_smithi043_45180_object113661:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.3798600089999997, 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0198339460000001, 2024-04-26T10:35:05.177 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.178 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.178 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.178 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.178 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.178 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248303 2024-04-26T10:35:05.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.178 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.178 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.178 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:05.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:05.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:05.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699999+0000", 2024-04-26T10:35:05.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.022e-06 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700005+0000", 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8889999999999999e-06 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700008+0000", 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6210000000000001e-06 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700048+0000", 2024-04-26T10:35:05.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9756999999999999e-05 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700062+0000", 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4231e-05 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.712399+0000", 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0123362419999999 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.712529+0000", 2024-04-26T10:35:05.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013045099999999999 2024-04-26T10:35:05.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.712624+0000", 2024-04-26T10:35:05.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5027999999999999e-05 2024-04-26T10:35:05.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.717948+0000", 2024-04-26T10:35:05.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0053243220000000003 2024-04-26T10:35:05.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719708+0000", 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017597750000000001 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719745+0000", 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6989000000000001e-05 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719830+0000", 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5173000000000006e-05 2024-04-26T10:35:05.183 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248310 5.a 5:503e2c49:::benchmark_data_smithi043_45180_object113668:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.3758950490000004, 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.016056098, 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.184 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248310 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:05.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703965+0000", 2024-04-26T10:35:05.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0280000000000002e-06 2024-04-26T10:35:05.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703973+0000", 2024-04-26T10:35:05.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5639999999999997e-06 2024-04-26T10:35:05.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703980+0000", 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.392e-06 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.704020+0000", 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0516999999999998e-05 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.704031+0000", 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0317e-05 2024-04-26T10:35:05.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.713657+0000", 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0096267210000001 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.713763+0000", 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000105979 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.713863+0000", 2024-04-26T10:35:05.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.9316999999999998e-05 2024-04-26T10:35:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.717956+0000", 2024-04-26T10:35:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0040931220000000003 2024-04-26T10:35:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719886+0000", 2024-04-26T10:35:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019307829999999999 2024-04-26T10:35:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719930+0000", 2024-04-26T10:35:05.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3284000000000001e-05 2024-04-26T10:35:05.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720017+0000", 2024-04-26T10:35:05.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7748000000000001e-05 2024-04-26T10:35:05.190 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.190 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.190 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.190 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248320 5.a 5:5874efc7:::benchmark_data_smithi043_45180_object113678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.191 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:05.191 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.3721510089999995, 2024-04-26T10:35:05.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.012436549, 2024-04-26T10:35:05.191 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.191 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.191 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.191 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.191 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.191 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248320 2024-04-26T10:35:05.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.191 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.191 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707709+0000", 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8890000000000004e-06 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707719+0000", 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0477e-05 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707724+0000", 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2449999999999998e-06 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707761+0000", 2024-04-26T10:35:05.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6427000000000002e-05 2024-04-26T10:35:05.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707771+0000", 2024-04-26T10:35:05.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0487e-05 2024-04-26T10:35:05.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.714855+0000", 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0070835440000001 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.714982+0000", 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012729000000000001 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.715102+0000", 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000119912 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719839+0000", 2024-04-26T10:35:05.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0047372320000000001 2024-04-26T10:35:05.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720062+0000", 2024-04-26T10:35:05.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00022245899999999999 2024-04-26T10:35:05.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720090+0000", 2024-04-26T10:35:05.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8238e-05 2024-04-26T10:35:05.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720142+0000", 2024-04-26T10:35:05.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2055999999999998e-05 2024-04-26T10:35:05.197 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.197 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.197 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.197 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248324 5.a 5:5546253c:::benchmark_data_smithi043_45180_object113682:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.197 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.709388+0000", 2024-04-26T10:35:05.197 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.3704683800000002, 2024-04-26T10:35:05.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.015645439, 2024-04-26T10:35:05.198 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.198 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.198 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.198 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.198 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.198 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248324 2024-04-26T10:35:05.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.198 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709388+0000", 2024-04-26T10:35:05.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709388+0000", 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709387+0000", 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709391+0000", 2024-04-26T10:35:05.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7290000000000002e-06 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709405+0000", 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3799e-05 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709411+0000", 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5999999999999997e-06 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709451+0000", 2024-04-26T10:35:05.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0450000000000001e-05 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709461+0000", 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7210000000000006e-06 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716495+0000", 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.007034094 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716626+0000", 2024-04-26T10:35:05.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013135600000000001 2024-04-26T10:35:05.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716737+0000", 2024-04-26T10:35:05.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000111255 2024-04-26T10:35:05.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720150+0000", 2024-04-26T10:35:05.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0034123669999999999 2024-04-26T10:35:05.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.724904+0000", 2024-04-26T10:35:05.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0047543280000000004 2024-04-26T10:35:05.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.724950+0000", 2024-04-26T10:35:05.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6007999999999997e-05 2024-04-26T10:35:05.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725033+0000", 2024-04-26T10:35:05.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3349000000000004e-05 2024-04-26T10:35:05.204 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.204 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.204 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.204 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.204 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248333 5.a 5:5d7a6426:::benchmark_data_smithi043_45180_object113691:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.204 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:05.204 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.366025144, 2024-04-26T10:35:05.204 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0113228000000001, 2024-04-26T10:35:05.204 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.204 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.205 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.205 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.205 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.205 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248333 2024-04-26T10:35:05.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.205 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.205 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.205 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.205 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:05.205 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:05.206 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.206 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.206 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.206 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713834+0000", 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6459999999999999e-06 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713840+0000", 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8699999999999997e-06 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.208 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713846+0000", 2024-04-26T10:35:05.208 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3299999999999998e-06 2024-04-26T10:35:05.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.208 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.208 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713873+0000", 2024-04-26T10:35:05.208 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7606999999999998e-05 2024-04-26T10:35:05.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.208 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.208 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.208 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713879+0000", 2024-04-26T10:35:05.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:35:05.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.209 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.209 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.209 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.717990+0000", 2024-04-26T10:35:05.209 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0041114769999999 2024-04-26T10:35:05.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.210 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.210 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.210 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.718110+0000", 2024-04-26T10:35:05.210 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012011299999999999 2024-04-26T10:35:05.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.211 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.718219+0000", 2024-04-26T10:35:05.211 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000109041 2024-04-26T10:35:05.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.211 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.211 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.723401+0000", 2024-04-26T10:35:05.212 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0051815380000000003 2024-04-26T10:35:05.212 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.212 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.212 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.212 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725070+0000", 2024-04-26T10:35:05.213 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016693490000000001 2024-04-26T10:35:05.213 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.213 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.213 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.213 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725101+0000", 2024-04-26T10:35:05.213 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0392e-05 2024-04-26T10:35:05.214 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.214 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.214 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.214 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725154+0000", 2024-04-26T10:35:05.214 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3319999999999998e-05 2024-04-26T10:35:05.214 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.215 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.215 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.215 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.215 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248337 5.a 5:587d88db:::benchmark_data_smithi043_45180_object113695:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.215 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:05.216 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.3644491050000003, 2024-04-26T10:35:05.216 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0099158159999999, 2024-04-26T10:35:05.216 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.216 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.216 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.216 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.217 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.217 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248337 2024-04-26T10:35:05.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.217 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.217 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.218 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:05.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:05.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:05.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:05.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715411+0000", 2024-04-26T10:35:05.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1080000000000003e-06 2024-04-26T10:35:05.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715419+0000", 2024-04-26T10:35:05.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2400000000000007e-06 2024-04-26T10:35:05.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715424+0000", 2024-04-26T10:35:05.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.164e-06 2024-04-26T10:35:05.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715454+0000", 2024-04-26T10:35:05.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9824000000000001e-05 2024-04-26T10:35:05.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715461+0000", 2024-04-26T10:35:05.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0269999999999998e-06 2024-04-26T10:35:05.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720180+0000", 2024-04-26T10:35:05.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0047187930000001 2024-04-26T10:35:05.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720288+0000", 2024-04-26T10:35:05.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000108457 2024-04-26T10:35:05.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720390+0000", 2024-04-26T10:35:05.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010184200000000001 2024-04-26T10:35:05.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725046+0000", 2024-04-26T10:35:05.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0046562849999999996 2024-04-26T10:35:05.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725200+0000", 2024-04-26T10:35:05.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000153969 2024-04-26T10:35:05.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725245+0000", 2024-04-26T10:35:05.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4660000000000003e-05 2024-04-26T10:35:05.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.230 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725323+0000", 2024-04-26T10:35:05.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8164999999999994e-05 2024-04-26T10:35:05.230 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.230 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.230 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.231 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248343 5.a 5:55b0b6a3:::benchmark_data_smithi043_45180_object113701:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.231 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.719500+0000", 2024-04-26T10:35:05.231 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.3603567219999997, 2024-04-26T10:35:05.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0085441959999999, 2024-04-26T10:35:05.232 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.232 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.232 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.232 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.232 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.232 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248343 2024-04-26T10:35:05.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.233 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719500+0000", 2024-04-26T10:35:05.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719500+0000", 2024-04-26T10:35:05.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719499+0000", 2024-04-26T10:35:05.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719502+0000", 2024-04-26T10:35:05.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5809999999999999e-06 2024-04-26T10:35:05.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719509+0000", 2024-04-26T10:35:05.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7390000000000002e-06 2024-04-26T10:35:05.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719513+0000", 2024-04-26T10:35:05.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1230000000000002e-06 2024-04-26T10:35:05.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719543+0000", 2024-04-26T10:35:05.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0423999999999999e-05 2024-04-26T10:35:05.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719549+0000", 2024-04-26T10:35:05.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3759999999999996e-06 2024-04-26T10:35:05.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.721881+0000", 2024-04-26T10:35:05.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.00233138 2024-04-26T10:35:05.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.241 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.722010+0000", 2024-04-26T10:35:05.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012923000000000001 2024-04-26T10:35:05.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.241 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.722132+0000", 2024-04-26T10:35:05.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000121543 2024-04-26T10:35:05.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725335+0000", 2024-04-26T10:35:05.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003203895 2024-04-26T10:35:05.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.727914+0000", 2024-04-26T10:35:05.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002578402 2024-04-26T10:35:05.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.727965+0000", 2024-04-26T10:35:05.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1479e-05 2024-04-26T10:35:05.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728044+0000", 2024-04-26T10:35:05.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8528000000000004e-05 2024-04-26T10:35:05.244 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.244 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.245 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.245 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248356 5.a 5:553dac03:::benchmark_data_smithi043_45180_object113714:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.245 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.736996+0000", 2024-04-26T10:35:05.245 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.3428607589999997, 2024-04-26T10:35:05.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.99122183799999997, 2024-04-26T10:35:05.246 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.246 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.246 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.246 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.246 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.246 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248356 2024-04-26T10:35:05.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.246 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.736996+0000", 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.736996+0000", 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.736994+0000", 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999981 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737005+0000", 2024-04-26T10:35:05.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.115e-05 2024-04-26T10:35:05.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737033+0000", 2024-04-26T10:35:05.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7832999999999999e-05 2024-04-26T10:35:05.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737049+0000", 2024-04-26T10:35:05.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5913000000000002e-05 2024-04-26T10:35:05.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737133+0000", 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4550999999999997e-05 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737141+0000", 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2969999999999998e-06 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.723438+0000", 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.98629742600000003 2024-04-26T10:35:05.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.723555+0000", 2024-04-26T10:35:05.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000117014 2024-04-26T10:35:05.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.723663+0000", 2024-04-26T10:35:05.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010753599999999999 2024-04-26T10:35:05.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.727862+0000", 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041994609999999998 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728089+0000", 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00022692099999999999 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728137+0000", 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7700000000000001e-05 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728217+0000", 2024-04-26T10:35:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0828999999999995e-05 2024-04-26T10:35:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248371 5.a 5:5dd6b787:::benchmark_data_smithi043_45180_object113729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.766367+0000", 2024-04-26T10:35:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 5.3134898310000001, 2024-04-26T10:35:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.96392391399999999, 2024-04-26T10:35:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:05.253 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:05.253 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:05.253 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:05.253 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:05.253 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248371 2024-04-26T10:35:05.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.253 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:05.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:05.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766367+0000", 2024-04-26T10:35:05.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:05.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766367+0000", 2024-04-26T10:35:05.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:05.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:05.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766366+0000", 2024-04-26T10:35:05.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:05.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766370+0000", 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3660000000000002e-06 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766381+0000", 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0314e-05 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766403+0000", 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2486000000000001e-05 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766442+0000", 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8719e-05 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766449+0000", 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7100000000000007e-06 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725354+0000", 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.95890452100000001 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725444+0000", 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9813000000000002e-05 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725505+0000", 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1198000000000006e-05 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728230+0000", 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027249589999999999 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:05.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.730217+0000", 2024-04-26T10:35:05.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019874670000000001 2024-04-26T10:35:05.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:05.258 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.730257+0000", 2024-04-26T10:35:05.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9329000000000002e-05 2024-04-26T10:35:05.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:05.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:05.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:05.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.730290+0000", 2024-04-26T10:35:05.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3726000000000002e-05 2024-04-26T10:35:05.259 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.259 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.259 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.259 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:05.261 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:05.262 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:35:05.266 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:35:05.267 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:05.262+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:05.267 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:35:05.267 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-26T10:35:05.267 INFO:teuthology.orchestra.run.smithi043.stdout: "epoch": 68, 2024-04-26T10:35:05.268 INFO:teuthology.orchestra.run.smithi043.stdout: "fsid": "6d35b773-83ef-4e54-be62-89cec0b09327", 2024-04-26T10:35:05.268 INFO:teuthology.orchestra.run.smithi043.stdout: "created": "2024-04-26T10:32:36.651799+0000", 2024-04-26T10:35:05.268 INFO:teuthology.orchestra.run.smithi043.stdout: "modified": "2024-04-26T10:35:03.668964+0000", 2024-04-26T10:35:05.268 INFO:teuthology.orchestra.run.smithi043.stdout: "last_up_change": "2024-04-26T10:34:43.574910+0000", 2024-04-26T10:35:05.268 INFO:teuthology.orchestra.run.smithi043.stdout: "last_in_change": "2024-04-26T10:32:37.588200+0000", 2024-04-26T10:35:05.268 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T10:35:05.268 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_num": 5801984, 2024-04-26T10:35:05.268 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_set": [ 2024-04-26T10:35:05.269 INFO:teuthology.orchestra.run.smithi043.stdout: "noscrub", 2024-04-26T10:35:05.269 INFO:teuthology.orchestra.run.smithi043.stdout: "pglog_hardlimit", 2024-04-26T10:35:05.269 INFO:teuthology.orchestra.run.smithi043.stdout: "purged_snapdirs", 2024-04-26T10:35:05.269 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_deletes", 2024-04-26T10:35:05.269 INFO:teuthology.orchestra.run.smithi043.stdout: "sortbitwise" 2024-04-26T10:35:05.269 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:35:05.270 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_version": 4, 2024-04-26T10:35:05.270 INFO:teuthology.orchestra.run.smithi043.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T10:35:05.270 INFO:teuthology.orchestra.run.smithi043.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T10:35:05.270 INFO:teuthology.orchestra.run.smithi043.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T10:35:05.270 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_snapshot": "", 2024-04-26T10:35:05.270 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_max": 5, 2024-04-26T10:35:05.271 INFO:teuthology.orchestra.run.smithi043.stdout: "max_osd": 3, 2024-04-26T10:35:05.271 INFO:teuthology.orchestra.run.smithi043.stdout: "require_min_compat_client": "luminous", 2024-04-26T10:35:05.271 INFO:teuthology.orchestra.run.smithi043.stdout: "min_compat_client": "luminous", 2024-04-26T10:35:05.271 INFO:teuthology.orchestra.run.smithi043.stdout: "require_osd_release": "reef", 2024-04-26T10:35:05.271 INFO:teuthology.orchestra.run.smithi043.stdout: "allow_crimson": false, 2024-04-26T10:35:05.271 INFO:teuthology.orchestra.run.smithi043.stdout: "pools": [ 2024-04-26T10:35:05.272 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.272 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 1, 2024-04-26T10:35:05.272 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": ".mgr", 2024-04-26T10:35:05.272 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.037545+0000", 2024-04-26T10:35:05.272 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:35:05.272 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:35:05.272 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:35:05.273 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:35:05.273 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:35:05.273 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:35:05.273 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:35:05.273 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:35:05.273 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:35:05.273 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:35:05.273 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:35:05.273 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:35:05.273 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 1, 2024-04-26T10:35:05.273 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 1, 2024-04-26T10:35:05.273 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 1, 2024-04-26T10:35:05.274 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 1, 2024-04-26T10:35:05.274 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 1, 2024-04-26T10:35:05.274 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:35:05.274 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:35:05.274 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:35:05.274 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:35:05.274 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:35:05.274 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:35:05.274 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:35:05.274 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.274 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:35:05.275 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.276 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_max": 32, 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 1 2024-04-26T10:35:05.277 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.278 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:35:05.278 INFO:teuthology.orchestra.run.smithi043.stdout: "mgr": {} 2024-04-26T10:35:05.278 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.278 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:35:05.278 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 3.0299999713897705, 2024-04-26T10:35:05.278 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 3.0299999713897705, 2024-04-26T10:35:05.278 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.33000001311302185, 2024-04-26T10:35:05.278 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1, 2024-04-26T10:35:05.278 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1, 2024-04-26T10:35:05.278 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 0.96673077344894409, 2024-04-26T10:35:05.278 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 0.97000002861022949, 2024-04-26T10:35:05.279 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 0.97000002861022949 2024-04-26T10:35:05.279 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.279 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.279 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.279 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 2, 2024-04-26T10:35:05.279 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "rbd", 2024-04-26T10:35:05.279 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:45.393201+0000", 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 8, 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 8, 2024-04-26T10:35:05.280 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 8, 2024-04-26T10:35:05.281 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 8, 2024-04-26T10:35:05.281 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 8, 2024-04-26T10:35:05.281 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:35:05.281 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:35:05.281 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:35:05.281 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:35:05.281 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:35:05.281 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:35:05.281 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:35:05.281 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.281 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "11", 2024-04-26T10:35:05.281 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:35:05.281 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:35:05.282 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:35:05.282 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:35:05.282 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:35:05.282 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:35:05.282 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:35:05.282 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:35:05.282 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:35:05.282 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:35:05.282 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:35:05.282 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:35:05.282 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:35:05.282 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:35:05.282 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:35:05.283 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:35:05.283 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:35:05.283 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:35:05.283 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:35:05.283 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:35:05.283 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:35:05.283 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:35:05.283 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:35:05.283 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:35:05.283 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:35:05.283 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:35:05.283 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:35:05.284 INFO:teuthology.orchestra.run.smithi043.stdout: "rbd": {} 2024-04-26T10:35:05.285 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.285 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:35:05.285 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.4900000095367432, 2024-04-26T10:35:05.285 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.4900000095367432, 2024-04-26T10:35:05.285 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T10:35:05.285 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1, 2024-04-26T10:35:05.285 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1, 2024-04-26T10:35:05.285 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 0.96673077344894409, 2024-04-26T10:35:05.285 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 0.97000002861022949, 2024-04-26T10:35:05.285 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 0.97000002861022949 2024-04-26T10:35:05.285 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.285 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.286 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.286 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 3, 2024-04-26T10:35:05.286 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_metadata", 2024-04-26T10:35:05.286 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:49.859710+0000", 2024-04-26T10:35:05.286 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:35:05.286 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:35:05.286 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:35:05.286 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:35:05.286 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:35:05.286 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:35:05.286 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:35:05.286 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:35:05.286 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:35:05.287 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:35:05.287 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:35:05.287 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:35:05.287 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 32, 2024-04-26T10:35:05.287 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 32, 2024-04-26T10:35:05.287 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 32, 2024-04-26T10:35:05.287 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 32, 2024-04-26T10:35:05.287 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 32, 2024-04-26T10:35:05.287 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:35:05.287 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:35:05.287 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:35:05.287 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:35:05.287 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:35:05.288 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:35:05.288 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:35:05.288 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.288 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "14", 2024-04-26T10:35:05.288 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:35:05.288 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:35:05.288 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:35:05.288 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:35:05.288 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:35:05.288 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:35:05.288 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:35:05.288 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:35:05.288 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:35:05.289 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:35:05.289 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:35:05.289 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:35:05.289 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:35:05.289 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:35:05.289 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:35:05.289 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:35:05.289 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:35:05.289 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:35:05.289 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:35:05.289 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:35:05.289 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:35:05.289 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:35:05.290 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:35:05.290 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:35:05.290 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:35:05.290 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:35:05.290 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.290 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:35:05.290 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:35:05.290 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:35:05.290 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:35:05.290 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:35:05.290 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:35:05.290 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:35:05.290 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_bias": 4, 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 16, 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: "recovery_priority": 5 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: "metadata": "cephfs" 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.291 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.7799999713897705, 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.7799999713897705, 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.190000057220459, 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.190000057220459, 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 0.96673077344894409, 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 0.97000002861022949, 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 0.97000002861022949 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 4, 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "cephfs_data", 2024-04-26T10:35:05.292 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:32:50.968196+0000", 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 64, 2024-04-26T10:35:05.293 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 64, 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 64, 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 64, 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 64, 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "15", 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:35:05.294 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:35:05.295 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:35:05.295 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:35:05.295 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:35:05.295 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:35:05.295 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:35:05.295 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:35:05.295 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:35:05.295 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:35:05.295 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:35:05.295 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:35:05.295 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:35:05.295 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:35:05.295 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:35:05.296 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "options": { 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_min": 64, 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:35:05.297 INFO:teuthology.orchestra.run.smithi043.stdout: "cephfs": { 2024-04-26T10:35:05.298 INFO:teuthology.orchestra.run.smithi043.stdout: "data": "cephfs" 2024-04-26T10:35:05.298 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.298 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.298 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:35:05.298 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.5800000429153442, 2024-04-26T10:35:05.298 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.5800000429153442, 2024-04-26T10:35:05.298 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T10:35:05.298 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.059999942779541, 2024-04-26T10:35:05.298 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.059999942779541, 2024-04-26T10:35:05.298 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 0.96673077344894409, 2024-04-26T10:35:05.298 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 0.97000002861022949, 2024-04-26T10:35:05.298 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 0.97000002861022949 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: "pool": 5, 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_name": "unique_pool_0", 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: "create_time": "2024-04-26T10:33:15.284422+0000", 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: "flags": 1, 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: "flags_names": "hashpspool", 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: "type": 1, 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: "size": 2, 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: "min_size": 1, 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_rule": 0, 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:35:05.299 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:35:05.300 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:35:05.300 INFO:teuthology.orchestra.run.smithi043.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:35:05.300 INFO:teuthology.orchestra.run.smithi043.stdout: "object_hash": 2, 2024-04-26T10:35:05.300 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:35:05.300 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num": 16, 2024-04-26T10:35:05.300 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num": 16, 2024-04-26T10:35:05.300 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_placement_num_target": 16, 2024-04-26T10:35:05.300 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_target": 16, 2024-04-26T10:35:05.300 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_num_pending": 16, 2024-04-26T10:35:05.300 INFO:teuthology.orchestra.run.smithi043.stdout: "last_pg_merge_meta": { 2024-04-26T10:35:05.300 INFO:teuthology.orchestra.run.smithi043.stdout: "source_pgid": "0.0", 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: "ready_epoch": 0, 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_started": 0, 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: "last_epoch_clean": 0, 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: "source_version": "0'0", 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: "target_version": "0'0" 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: "last_change": "18", 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend": "0", 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: "auid": 0, 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_seq": 0, 2024-04-26T10:35:05.301 INFO:teuthology.orchestra.run.smithi043.stdout: "snap_epoch": 0, 2024-04-26T10:35:05.302 INFO:teuthology.orchestra.run.smithi043.stdout: "pool_snaps": [], 2024-04-26T10:35:05.302 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps": "[]", 2024-04-26T10:35:05.302 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_bytes": 0, 2024-04-26T10:35:05.302 INFO:teuthology.orchestra.run.smithi043.stdout: "quota_max_objects": 0, 2024-04-26T10:35:05.302 INFO:teuthology.orchestra.run.smithi043.stdout: "tiers": [], 2024-04-26T10:35:05.302 INFO:teuthology.orchestra.run.smithi043.stdout: "tier_of": -1, 2024-04-26T10:35:05.302 INFO:teuthology.orchestra.run.smithi043.stdout: "read_tier": -1, 2024-04-26T10:35:05.302 INFO:teuthology.orchestra.run.smithi043.stdout: "write_tier": -1, 2024-04-26T10:35:05.302 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_mode": "none", 2024-04-26T10:35:05.302 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_bytes": 0, 2024-04-26T10:35:05.302 INFO:teuthology.orchestra.run.smithi043.stdout: "target_max_objects": 0, 2024-04-26T10:35:05.302 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:35:05.302 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:35:05.303 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:35:05.303 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_flush_age": 0, 2024-04-26T10:35:05.303 INFO:teuthology.orchestra.run.smithi043.stdout: "cache_min_evict_age": 0, 2024-04-26T10:35:05.303 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profile": "", 2024-04-26T10:35:05.303 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_params": { 2024-04-26T10:35:05.303 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "none" 2024-04-26T10:35:05.303 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.303 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_period": 0, 2024-04-26T10:35:05.303 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_count": 0, 2024-04-26T10:35:05.303 INFO:teuthology.orchestra.run.smithi043.stdout: "use_gmt_hitset": true, 2024-04-26T10:35:05.303 INFO:teuthology.orchestra.run.smithi043.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:35:05.303 INFO:teuthology.orchestra.run.smithi043.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:35:05.304 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:35:05.304 INFO:teuthology.orchestra.run.smithi043.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:35:05.304 INFO:teuthology.orchestra.run.smithi043.stdout: "grade_table": [], 2024-04-26T10:35:05.304 INFO:teuthology.orchestra.run.smithi043.stdout: "stripe_width": 0, 2024-04-26T10:35:05.304 INFO:teuthology.orchestra.run.smithi043.stdout: "expected_num_objects": 0, 2024-04-26T10:35:05.304 INFO:teuthology.orchestra.run.smithi043.stdout: "fast_read": false, 2024-04-26T10:35:05.304 INFO:teuthology.orchestra.run.smithi043.stdout: "options": {}, 2024-04-26T10:35:05.305 INFO:teuthology.orchestra.run.smithi043.stdout: "application_metadata": { 2024-04-26T10:35:05.305 INFO:teuthology.orchestra.run.smithi043.stdout: "rados": {} 2024-04-26T10:35:05.305 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.305 INFO:teuthology.orchestra.run.smithi043.stdout: "read_balance": { 2024-04-26T10:35:05.305 INFO:teuthology.orchestra.run.smithi043.stdout: "score_acting": 1.690000057220459, 2024-04-26T10:35:05.305 INFO:teuthology.orchestra.run.smithi043.stdout: "score_stable": 1.690000057220459, 2024-04-26T10:35:05.305 INFO:teuthology.orchestra.run.smithi043.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T10:35:05.305 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T10:35:05.306 INFO:teuthology.orchestra.run.smithi043.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T10:35:05.306 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity_weighted": 0.96673077344894409, 2024-04-26T10:35:05.306 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity": 0.97000002861022949, 2024-04-26T10:35:05.306 INFO:teuthology.orchestra.run.smithi043.stdout: "average_primary_affinity_weighted": 0.97000002861022949 2024-04-26T10:35:05.306 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.306 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.306 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:35:05.307 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:35:05.307 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.307 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:35:05.307 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "32399f03-8160-43f7-a69f-1db73f105676", 2024-04-26T10:35:05.307 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 0, 2024-04-26T10:35:05.307 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:35:05.307 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:35:05.307 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:35:05.308 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:35:05.308 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:35:05.308 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:35:05.308 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 49, 2024-04-26T10:35:05.308 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 59, 2024-04-26T10:35:05.308 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:35:05.308 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:35:05.308 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:35:05.308 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.309 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:35:05.309 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6800", 2024-04-26T10:35:05.309 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:35:05.309 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.309 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.309 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:35:05.309 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6801", 2024-04-26T10:35:05.309 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:35:05.310 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.310 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.310 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.310 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:35:05.310 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:35:05.310 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.310 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:35:05.311 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6802", 2024-04-26T10:35:05.311 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:35:05.311 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.311 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.311 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:35:05.311 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6803", 2024-04-26T10:35:05.311 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:35:05.311 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.311 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.312 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.312 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:35:05.312 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:35:05.312 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.312 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:35:05.312 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6806", 2024-04-26T10:35:05.312 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:35:05.312 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.313 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.313 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:35:05.313 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6807", 2024-04-26T10:35:05.313 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:35:05.313 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.313 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.313 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.313 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:35:05.314 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:35:05.314 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.314 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:35:05.314 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6804", 2024-04-26T10:35:05.314 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:35:05.314 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.314 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.314 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:35:05.315 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.112:6805", 2024-04-26T10:35:05.315 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41771 2024-04-26T10:35:05.315 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.315 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.315 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.315 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.112:6801/41771", 2024-04-26T10:35:05.315 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.112:6803/41771", 2024-04-26T10:35:05.315 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.112:6807/41771", 2024-04-26T10:35:05.316 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.112:6805/41771", 2024-04-26T10:35:05.316 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:35:05.316 INFO:teuthology.orchestra.run.smithi043.stdout: "exists" 2024-04-26T10:35:05.316 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.316 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.316 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.316 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:35:05.316 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "89e46a83-bfff-458f-bbac-258edb6ddad2", 2024-04-26T10:35:05.317 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:35:05.317 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:35:05.317 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:35:05.317 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 1, 2024-04-26T10:35:05.317 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:35:05.317 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:35:05.317 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:35:05.317 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 66, 2024-04-26T10:35:05.317 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:35:05.318 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:35:05.318 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:35:05.318 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:35:05.318 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.318 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:35:05.318 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6800", 2024-04-26T10:35:05.318 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:35:05.318 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.319 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.319 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:35:05.319 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6801", 2024-04-26T10:35:05.319 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:35:05.319 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.319 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.319 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.319 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:35:05.320 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:35:05.320 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.320 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:35:05.320 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6802", 2024-04-26T10:35:05.320 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:35:05.320 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.320 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.320 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:35:05.320 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6803", 2024-04-26T10:35:05.320 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6806", 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6807", 2024-04-26T10:35:05.321 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:35:05.322 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.322 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.322 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.322 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:35:05.322 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:35:05.322 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.322 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:35:05.322 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6804", 2024-04-26T10:35:05.322 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:35:05.322 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.322 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.322 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:35:05.322 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.186:6805", 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41804 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.186:6801/41804", 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.186:6803/41804", 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.186:6807/41804", 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.186:6805/41804", 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.323 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.324 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:35:05.324 INFO:teuthology.orchestra.run.smithi043.stdout: "uuid": "24c9e06d-1386-4075-b64e-d6c1d57c57bb", 2024-04-26T10:35:05.324 INFO:teuthology.orchestra.run.smithi043.stdout: "up": 1, 2024-04-26T10:35:05.324 INFO:teuthology.orchestra.run.smithi043.stdout: "in": 1, 2024-04-26T10:35:05.324 INFO:teuthology.orchestra.run.smithi043.stdout: "weight": 1, 2024-04-26T10:35:05.324 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_affinity": 0.9001922607421875, 2024-04-26T10:35:05.324 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_begin": 0, 2024-04-26T10:35:05.324 INFO:teuthology.orchestra.run.smithi043.stdout: "last_clean_end": 0, 2024-04-26T10:35:05.324 INFO:teuthology.orchestra.run.smithi043.stdout: "up_from": 8, 2024-04-26T10:35:05.324 INFO:teuthology.orchestra.run.smithi043.stdout: "up_thru": 59, 2024-04-26T10:35:05.324 INFO:teuthology.orchestra.run.smithi043.stdout: "down_at": 0, 2024-04-26T10:35:05.324 INFO:teuthology.orchestra.run.smithi043.stdout: "lost_at": 0, 2024-04-26T10:35:05.324 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addrs": { 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6800", 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6801", 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.325 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addrs": { 2024-04-26T10:35:05.326 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:35:05.326 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.326 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:35:05.326 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6802", 2024-04-26T10:35:05.326 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:35:05.326 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.326 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.326 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:35:05.326 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6803", 2024-04-26T10:35:05.326 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:35:05.326 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.326 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.326 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addrs": { 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6806", 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6807", 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.327 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addrs": { 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: "addrvec": [ 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v2", 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6804", 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: "type": "v1", 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: "addr": "172.21.15.187:6805", 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: "nonce": 41919 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.328 INFO:teuthology.orchestra.run.smithi043.stdout: "public_addr": "172.21.15.187:6801/41919", 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: "cluster_addr": "172.21.15.187:6803/41919", 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_back_addr": "172.21.15.187:6807/41919", 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: "heartbeat_front_addr": "172.21.15.187:6805/41919", 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: "state": [ 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: "exists", 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: "up" 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: "osd_xinfo": [ 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 0, 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:35:05.329 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:35:05.330 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:35:05.330 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:35:05.330 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:35:05.330 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.579572+0000", 2024-04-26T10:35:05.330 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 58 2024-04-26T10:35:05.330 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.330 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.330 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 1, 2024-04-26T10:35:05.330 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:35:05.330 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:35:05.330 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:35:05.331 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:35:05.331 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:35:05.331 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.596783+0000", 2024-04-26T10:35:05.331 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:35:05.331 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.331 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.331 INFO:teuthology.orchestra.run.smithi043.stdout: "osd": 2, 2024-04-26T10:35:05.331 INFO:teuthology.orchestra.run.smithi043.stdout: "down_stamp": "0.000000", 2024-04-26T10:35:05.331 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_probability": 0, 2024-04-26T10:35:05.331 INFO:teuthology.orchestra.run.smithi043.stdout: "laggy_interval": 0, 2024-04-26T10:35:05.331 INFO:teuthology.orchestra.run.smithi043.stdout: "features": 4540138322906710015, 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: "old_weight": 0, 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: "last_purged_snaps_scrub": "2024-04-26T10:32:42.632883+0000", 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: "dead_epoch": 0 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap": [ 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: { 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: "pgid": "3.17", 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: "osds": [ 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: 0, 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: 2 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: ] 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: ], 2024-04-26T10:35:05.332 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_items": [], 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_upmap_primaries": [], 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: "pg_temp": [], 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: "primary_temp": [], 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: "blocklist": {}, 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: "range_blocklist": {}, 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: "erasure_code_profiles": { 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: "default": { 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: "crush-failure-domain": "osd", 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: "k": "2", 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: "m": "1", 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: "plugin": "jerasure", 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: "technique": "reed_sol_van" 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: }, 2024-04-26T10:35:05.333 INFO:teuthology.orchestra.run.smithi043.stdout: "removed_snaps_queue": [], 2024-04-26T10:35:05.334 INFO:teuthology.orchestra.run.smithi043.stdout: "new_removed_snaps": [], 2024-04-26T10:35:05.334 INFO:teuthology.orchestra.run.smithi043.stdout: "new_purged_snaps": [], 2024-04-26T10:35:05.334 INFO:teuthology.orchestra.run.smithi043.stdout: "crush_node_flags": {}, 2024-04-26T10:35:05.334 INFO:teuthology.orchestra.run.smithi043.stdout: "device_class_flags": {}, 2024-04-26T10:35:05.334 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode": { 2024-04-26T10:35:05.334 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_enabled": false, 2024-04-26T10:35:05.334 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_bucket_count": 0, 2024-04-26T10:35:05.334 INFO:teuthology.orchestra.run.smithi043.stdout: "degraded_stretch_mode": 0, 2024-04-26T10:35:05.334 INFO:teuthology.orchestra.run.smithi043.stdout: "recovering_stretch_mode": 0, 2024-04-26T10:35:05.334 INFO:teuthology.orchestra.run.smithi043.stdout: "stretch_mode_bucket": 0 2024-04-26T10:35:05.334 INFO:teuthology.orchestra.run.smithi043.stdout: } 2024-04-26T10:35:05.334 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-26T10:35:05.335 INFO:tasks.thrashosds.thrasher:j is {'epoch': 68, 'fsid': '6d35b773-83ef-4e54-be62-89cec0b09327', 'created': '2024-04-26T10:32:36.651799+0000', 'modified': '2024-04-26T10:35:03.668964+0000', 'last_up_change': '2024-04-26T10:34:43.574910+0000', 'last_in_change': '2024-04-26T10:32:37.588200+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:32:45.037545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.9667307734489441, 'average_primary_affinity': 0.9700000286102295, 'average_primary_affinity_weighted': 0.9700000286102295}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:32:45.393201+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.9667307734489441, 'average_primary_affinity': 0.9700000286102295, 'average_primary_affinity_weighted': 0.9700000286102295}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:32:49.859710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 0.9667307734489441, 'average_primary_affinity': 0.9700000286102295, 'average_primary_affinity_weighted': 0.9700000286102295}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:32:50.968196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 0.9667307734489441, 'average_primary_affinity': 0.9700000286102295, 'average_primary_affinity_weighted': 0.9700000286102295}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-26T10:33:15.284422+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.9667307734489441, 'average_primary_affinity': 0.9700000286102295, 'average_primary_affinity_weighted': 0.9700000286102295}}], 'osds': [{'osd': 0, 'uuid': '32399f03-8160-43f7-a69f-1db73f105676', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 49, 'down_at': 59, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6800', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6801', 'nonce': 41771}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6802', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6803', 'nonce': 41771}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6806', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6807', 'nonce': 41771}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.112:6804', 'nonce': 41771}, {'type': 'v1', 'addr': '172.21.15.112:6805', 'nonce': 41771}]}, 'public_addr': '172.21.15.112:6801/41771', 'cluster_addr': '172.21.15.112:6803/41771', 'heartbeat_back_addr': '172.21.15.112:6807/41771', 'heartbeat_front_addr': '172.21.15.112:6805/41771', 'state': ['exists']}, {'osd': 1, 'uuid': '89e46a83-bfff-458f-bbac-258edb6ddad2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 66, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6800', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6801', 'nonce': 41804}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6802', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6803', 'nonce': 41804}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6806', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6807', 'nonce': 41804}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6804', 'nonce': 41804}, {'type': 'v1', 'addr': '172.21.15.186:6805', 'nonce': 41804}]}, 'public_addr': '172.21.15.186:6801/41804', 'cluster_addr': '172.21.15.186:6803/41804', 'heartbeat_back_addr': '172.21.15.186:6807/41804', 'heartbeat_front_addr': '172.21.15.186:6805/41804', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '24c9e06d-1386-4075-b64e-d6c1d57c57bb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.9001922607421875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 59, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6800', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6801', 'nonce': 41919}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6802', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6803', 'nonce': 41919}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6806', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6807', 'nonce': 41919}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6804', 'nonce': 41919}, {'type': 'v1', 'addr': '172.21.15.187:6805', 'nonce': 41919}]}, 'public_addr': '172.21.15.187:6801/41919', 'cluster_addr': '172.21.15.187:6803/41919', 'heartbeat_back_addr': '172.21.15.187:6807/41919', 'heartbeat_front_addr': '172.21.15.187:6805/41919', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.579572+0000', 'dead_epoch': 58}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.596783+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:32:42.632883+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.17', 'osds': [0, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T10:35:05.335 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.17 2024-04-26T10:35:05.336 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.17 2024-04-26T10:35:05.381 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:05.379+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:05.466 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:05.465+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:05.534 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:35:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:261611 5.e e68/16 5:761883ac:::benchmark_data_smithi043_45180_object126969:head v 68'16244, mlcod=68'16242)", 2024-04-26T10:35:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:05.529918+0000", 2024-04-26T10:35:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0026334280000000002, 2024-04-26T10:35:05.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026579680000000001, 2024-04-26T10:35:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529918+0000", 2024-04-26T10:35:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529918+0000", 2024-04-26T10:35:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529917+0000", 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529928+0000", 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0499000000000001e-05 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529938+0000", 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0454e-05 2024-04-26T10:35:05.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529944+0000", 2024-04-26T10:35:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4999999999999999e-06 2024-04-26T10:35:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529987+0000", 2024-04-26T10:35:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3245999999999999e-05 2024-04-26T10:35:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.530005+0000", 2024-04-26T10:35:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7672999999999998e-05 2024-04-26T10:35:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:261613 5.a e68/66 5:5ce0c92c:::benchmark_data_smithi043_45180_object126971:head v 68'16546, mlcod=68'16544)", 2024-04-26T10:35:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:05.529956+0000", 2024-04-26T10:35:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.002595057, 2024-04-26T10:35:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0026840649999999998, 2024-04-26T10:35:05.538 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529956+0000", 2024-04-26T10:35:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:05.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529956+0000", 2024-04-26T10:35:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529956+0000", 2024-04-26T10:35:05.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529965+0000", 2024-04-26T10:35:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9649999999999997e-06 2024-04-26T10:35:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529974+0000", 2024-04-26T10:35:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6570000000000003e-06 2024-04-26T10:35:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529978+0000", 2024-04-26T10:35:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8019999999999999e-06 2024-04-26T10:35:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.530081+0000", 2024-04-26T10:35:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010293699999999999 2024-04-26T10:35:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.530100+0000", 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9106999999999998e-05 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:261616 5.0 e68/42 5:0a264dc0:::benchmark_data_smithi043_45180_object126974:head v 68'16285, mlcod=68'16282)", 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:05.529986+0000", 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00256522, 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027189100000000002, 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:05.543 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529986+0000", 2024-04-26T10:35:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529986+0000", 2024-04-26T10:35:05.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529986+0000", 2024-04-26T10:35:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529989+0000", 2024-04-26T10:35:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6849999999999999e-06 2024-04-26T10:35:05.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529995+0000", 2024-04-26T10:35:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8529999999999997e-06 2024-04-26T10:35:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.529999+0000", 2024-04-26T10:35:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1019999999999999e-06 2024-04-26T10:35:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.530034+0000", 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4146999999999997e-05 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.530054+0000", 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9953999999999999e-05 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:261620 5.0 e68/42 5:0e3538a4:::benchmark_data_smithi043_45180_object126978:head v 68'16286, mlcod=68'16282)", 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:05.530012+0000", 2024-04-26T10:35:05.547 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.0025397559999999998, 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0027503029999999999, 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.530012+0000", 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.530012+0000", 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.530011+0000", 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.530015+0000", 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8800000000000001e-06 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.530023+0000", 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2400000000000007e-06 2024-04-26T10:35:05.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.530028+0000", 2024-04-26T10:35:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2030000000000002e-06 2024-04-26T10:35:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532163+0000", 2024-04-26T10:35:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021355010000000002 2024-04-26T10:35:05.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532184+0000", 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.1001000000000001e-05 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:261614 5.e e68/16 5:723d4627:::benchmark_data_smithi043_45180_object126972:head v 68'16245, mlcod=68'16242)", 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:05.532094+0000", 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00045694000000000003, 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00072796199999999997, 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:05.551 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532094+0000", 2024-04-26T10:35:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532094+0000", 2024-04-26T10:35:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532094+0000", 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532100+0000", 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6359999999999997e-06 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532121+0000", 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0894e-05 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532130+0000", 2024-04-26T10:35:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.568e-06 2024-04-26T10:35:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532164+0000", 2024-04-26T10:35:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4032000000000002e-05 2024-04-26T10:35:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532178+0000", 2024-04-26T10:35:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3784999999999999e-05 2024-04-26T10:35:05.554 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:261622 5.4 e68/42 5:208d6cb0:::benchmark_data_smithi043_45180_object126980:head v 68'16340, mlcod=68'16336)", 2024-04-26T10:35:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:05.532140+0000", 2024-04-26T10:35:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.000411543, 2024-04-26T10:35:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00073979700000000005, 2024-04-26T10:35:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.555 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532140+0000", 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532140+0000", 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532139+0000", 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532144+0000", 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8960000000000002e-06 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532152+0000", 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2099999999999996e-06 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532156+0000", 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8899999999999998e-06 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532185+0000", 2024-04-26T10:35:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.8133999999999999e-05 2024-04-26T10:35:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532202+0000", 2024-04-26T10:35:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7785999999999999e-05 2024-04-26T10:35:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:261624 5.b e68/42 5:d1970a20:::benchmark_data_smithi043_45180_object126982:head v 68'16516, mlcod=68'16514)", 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:05.532164+0000", 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00038717999999999999, 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00078624399999999996, 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532164+0000", 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532164+0000", 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532164+0000", 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532172+0000", 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.7919999999999993e-06 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532178+0000", 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.4330000000000001e-06 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532183+0000", 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6550000000000003e-06 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532213+0000", 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0114e-05 2024-04-26T10:35:05.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532230+0000", 2024-04-26T10:35:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6838999999999999e-05 2024-04-26T10:35:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:261617 5.e e68/16)", 2024-04-26T10:35:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:05.532192+0000", 2024-04-26T10:35:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00035958799999999999, 2024-04-26T10:35:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00081227000000000003, 2024-04-26T10:35:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:35:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:05.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532192+0000", 2024-04-26T10:35:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532192+0000", 2024-04-26T10:35:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:05.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532191+0000", 2024-04-26T10:35:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532195+0000", 2024-04-26T10:35:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.551e-06 2024-04-26T10:35:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532201+0000", 2024-04-26T10:35:05.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8980000000000001e-06 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532205+0000", 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2819999999999998e-06 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:261626 5.a e68/66 5:5fa1da4f:::benchmark_data_smithi043_45180_object126984:head v 68'16547, mlcod=68'16544)", 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:05.532383+0000", 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.000168228, 2024-04-26T10:35:05.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00066972099999999997, 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532383+0000", 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532383+0000", 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532383+0000", 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532388+0000", 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.4410000000000001e-06 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532398+0000", 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0251999999999999e-05 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532404+0000", 2024-04-26T10:35:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7440000000000004e-06 2024-04-26T10:35:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532450+0000", 2024-04-26T10:35:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6329999999999999e-05 2024-04-26T10:35:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:05.570 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532470+0000", 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.9670999999999999e-05 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:261627 5.b e68/42)", 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:05.532522+0000", 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 2.953e-05, 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00058399600000000004, 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "queued for pg", 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532522+0000", 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532522+0000", 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532521+0000", 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532530+0000", 2024-04-26T10:35:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1919999999999994e-06 2024-04-26T10:35:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532539+0000", 2024-04-26T10:35:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4570000000000005e-06 2024-04-26T10:35:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:05.532546+0000", 2024-04-26T10:35:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.7190000000000004e-06 2024-04-26T10:35:05.573 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:35:05.574 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 10 2024-04-26T10:35:05.574 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:05.577 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:35:05.578 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:05.574+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:05.677 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:05.676+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:05.693 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:35:05.732 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:35:05.772 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:05.772 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:35:05.772 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:35:05.772 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:35:05.773 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:05.778 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:05.776+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:05.789 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:35:05.879 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:05.877+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:05.891 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:35:05.912 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:35:05.912 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T10:35:05.912 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:35:05.912 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:35:05.914 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:35:05.915 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:35:05.979 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:05.978+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:05.995 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:05.996 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:06.011 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:35:06.080 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:06.078+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:06.181 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:06.180+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:06.196 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:06.196 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:06.211 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:35:06.282 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:06.280+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:06.383 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:06.381+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:06.426 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:06.426 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:06.442 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:35:06.485 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:06.483+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:06.539 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~17s 2024-04-26T10:35:06.586 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:06.584+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:06.622 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:06.623 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:06.636 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:35:06.684 INFO:teuthology.orchestra.run.smithi043.stderr:clear 3.17 pg_upmap mapping 2024-04-26T10:35:06.685 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is set 2024-04-26T10:35:06.691 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:06.689+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:06.791 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:06.790+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:06.833 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:06.834 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:06.845 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:35:06.893 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:06.891+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:06.993 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:06.991+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:07.041 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:07.041 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:07.057 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:35:07.102 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:07.097+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:07.197 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:07.195+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:07.296 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:07.294+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:07.296 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:07.297 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:07.311 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:35:07.397 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:07.395+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:07.485 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:07.485 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:07.500 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:35:07.500 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:07.497+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:07.599 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:07.597+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:07.682 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:07.682 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:07.696 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:35:07.737 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:07.736+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:07.801 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:07.799+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:07.901 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:07.900+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:07.916 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:35:07.921 INFO:teuthology.orchestra.run.smithi186.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:07.922 INFO:teuthology.orchestra.run.smithi186.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:07.936 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:35:08.005 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:08.003+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:08.068 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:35:08.089 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:35:08.089 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T10:35:08.090 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:35:08.090 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:35:08.092 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:35:08.092 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:35:08.106 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:08.103+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:08.135 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:08.136 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:35:08.136 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.136 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:268888 5.2 5:44dceaf0:::benchmark_data_smithi043_45180_object134246:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T10:35:08.136 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:08.133321+0000", 2024-04-26T10:35:08.136 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001305444, 2024-04-26T10:35:08.136 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001332083, 2024-04-26T10:35:08.136 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.137 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:08.137 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.137 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.137 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.137 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 268888 2024-04-26T10:35:08.137 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.137 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.137 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.137 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133321+0000", 2024-04-26T10:35:08.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.138 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.138 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.138 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133321+0000", 2024-04-26T10:35:08.138 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.139 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.139 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133320+0000", 2024-04-26T10:35:08.139 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:08.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.139 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133325+0000", 2024-04-26T10:35:08.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0320000000000003e-06 2024-04-26T10:35:08.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.140 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.140 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.140 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133342+0000", 2024-04-26T10:35:08.140 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6711999999999999e-05 2024-04-26T10:35:08.140 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.141 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.141 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133350+0000", 2024-04-26T10:35:08.141 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.4060000000000005e-06 2024-04-26T10:35:08.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.141 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133393+0000", 2024-04-26T10:35:08.142 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.3241000000000002e-05 2024-04-26T10:35:08.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.142 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.142 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.142 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133542+0000", 2024-04-26T10:35:08.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014927899999999999 2024-04-26T10:35:08.143 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.143 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.143 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.143 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.143 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:268886 5.4 e69/42 5:2a0419d5:::benchmark_data_smithi043_45180_object134244:head v 69'16838, mlcod=69'16836)", 2024-04-26T10:35:08.143 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:08.133596+0000", 2024-04-26T10:35:08.143 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.001030078, 2024-04-26T10:35:08.143 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0011064250000000001, 2024-04-26T10:35:08.143 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133596+0000", 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133596+0000", 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.144 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133596+0000", 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133601+0000", 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.7339999999999996e-06 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133609+0000", 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9219999999999997e-06 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.145 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133615+0000", 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.0680000000000002e-06 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133638+0000", 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2629999999999998e-05 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133653+0000", 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.4561e-05 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.146 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:268887 5.0 e69/42 5:0fc0d292:::benchmark_data_smithi043_45180_object134245:head v 69'16722, mlcod=69'16719)", 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:08.133687+0000", 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.000939754, 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00105065, 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133687+0000", 2024-04-26T10:35:08.147 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133687+0000", 2024-04-26T10:35:08.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.148 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133686+0000", 2024-04-26T10:35:08.148 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.148 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.148 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.148 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133693+0000", 2024-04-26T10:35:08.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.3039999999999999e-06 2024-04-26T10:35:08.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133700+0000", 2024-04-26T10:35:08.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.0099999999999998e-06 2024-04-26T10:35:08.149 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.149 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.149 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.149 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133706+0000", 2024-04-26T10:35:08.149 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2700000000000004e-06 2024-04-26T10:35:08.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.150 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.150 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.150 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133735+0000", 2024-04-26T10:35:08.150 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9232000000000001e-05 2024-04-26T10:35:08.150 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.151 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.151 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.151 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.133751+0000", 2024-04-26T10:35:08.151 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.571e-05 2024-04-26T10:35:08.151 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.151 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.151 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.152 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.152 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.152 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:268889 5.c 5:3c4507fe:::benchmark_data_smithi043_45180_object134247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T10:35:08.152 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:08.134320+0000", 2024-04-26T10:35:08.152 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 0.00030661600000000001, 2024-04-26T10:35:08.152 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00045216100000000002, 2024-04-26T10:35:08.152 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.152 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:08.152 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.152 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.152 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.152 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 268889 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.134320+0000", 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.134320+0000", 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.153 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.134319+0000", 2024-04-26T10:35:08.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.134322+0000", 2024-04-26T10:35:08.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0639999999999998e-06 2024-04-26T10:35:08.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.154 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.154 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.154 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.134330+0000", 2024-04-26T10:35:08.154 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.6059999999999997e-06 2024-04-26T10:35:08.154 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.134335+0000", 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0350000000000001e-06 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.134383+0000", 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8575000000000002e-05 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:08.134525+0000", 2024-04-26T10:35:08.155 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014213299999999999 2024-04-26T10:35:08.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.156 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.156 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.156 INFO:teuthology.orchestra.run.smithi187.stdout: ], 2024-04-26T10:35:08.156 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 4 2024-04-26T10:35:08.156 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:08.157 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:35:08.203 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:08.202+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:08.277 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Removed 134639 objects 2024-04-26T10:35:08.277 INFO:tasks.radosbench.radosbench.0.smithi043.stdout:Clean up completed and total clean up time :49.849 2024-04-26T10:35:08.304 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:08.303+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:08.348 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:35:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:35:08.349 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:35:08.349 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:08.358 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:35:08.405 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:08.404+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:08.486 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:08.487 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:35:08.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:35:08.487 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:35:08.487 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.487 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:08.487 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:08.487 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.683390831, 2024-04-26T10:35:08.487 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:35:08.487 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.487 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.487 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.487 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.487 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.488 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.489 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.490 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:08.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:35:08.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:35:08.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:08.491 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:35:08.491 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:35:08.491 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.491 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.491 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.492 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.493 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.493 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:35:08.493 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:35:08.493 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.683389846, 2024-04-26T10:35:08.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:35:08.493 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.493 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.493 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.493 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.493 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.493 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:35:08.493 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:35:08.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.494 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:08.494 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.494 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.494 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.494 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.495 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.496 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.68332122299999, 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.497 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.498 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:35:08.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:35:08.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:35:08.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.500 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:35:08.500 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:35:08.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.500 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.500 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.501 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:35:08.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:35:08.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:35:08.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:35:08.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.502 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.502 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.502 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:35:08.502 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.683269443, 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.504 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:35:08.505 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:35:08.506 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:35:08.507 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.508 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.683209593, 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.509 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.510 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:35:08.511 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:35:08.512 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:35:08.513 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.681496889, 2024-04-26T10:35:08.514 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.515 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:35:08.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:35:08.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:35:08.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.516 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.516 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:35:08.516 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:35:08.516 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.516 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.517 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:35:08.518 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:35:08.519 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.68138182200001, 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.520 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.521 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:35:08.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:35:08.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:35:08.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:35:08.522 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.522 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.522 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.522 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:35:08.522 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:35:08.523 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.681288682, 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.524 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:35:08.525 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:35:08.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.526 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:35:08.526 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:35:08.526 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.526 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.526 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:35:08.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:35:08.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:35:08.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:35:08.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.527 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.527 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.527 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:35:08.527 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:35:08.527 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:35:08.528 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:35:08.529 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.681094522, 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.530 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.531 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.532 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.533 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:35:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:35:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:35:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:35:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.679887154, 2024-04-26T10:35:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:35:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.534 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.535 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:35:08.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:35:08.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:35:08.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.536 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.536 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:35:08.536 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:35:08.536 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.536 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:35:08.537 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.679078246, 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.538 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.539 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.539 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.539 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.539 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:35:08.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.539 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.539 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:35:08.539 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.539 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.539 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.539 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.540 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.541 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.542 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.543 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.678974708, 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.544 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.545 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.546 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:35:08.547 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:35:08.548 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.678897835, 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:35:08.549 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.550 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:35:08.551 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.552 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.553 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:35:08.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:35:08.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.554 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:35:08.554 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:35:08.554 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.554 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.554 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.555 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:35:08.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:35:08.555 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.555 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.555 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.555 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.555 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.555 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:35:08.555 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:08.555 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 100.678782451, 2024-04-26T10:35:08.555 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:35:08.555 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.555 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:08.556 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:08.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.556 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:08.556 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.556 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.556 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.556 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.557 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.558 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256890 5.6 5:6c163c2d:::benchmark_data_smithi043_45180_object122248:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7152343820000002, 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102475969, 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.559 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256890 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:08.560 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768827+0000", 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0320000000000002e-06 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768832+0000", 2024-04-26T10:35:08.561 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3190000000000002e-06 2024-04-26T10:35:08.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768837+0000", 2024-04-26T10:35:08.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9189999999999998e-06 2024-04-26T10:35:08.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.562 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.562 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.770074+0000", 2024-04-26T10:35:08.562 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001236429 2024-04-26T10:35:08.562 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.562 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.770195+0000", 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000120981 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.871197+0000", 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101002548 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.871232+0000", 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:35:08.563 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.564 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.564 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.871301+0000", 2024-04-26T10:35:08.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.97e-05 2024-04-26T10:35:08.564 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.564 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.564 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.564 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.564 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.564 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256897 5.6 5:68cfdf58:::benchmark_data_smithi043_45180_object122255:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:08.564 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:08.564 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7114173199999998, 2024-04-26T10:35:08.564 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10094767, 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256897 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.565 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:08.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:08.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.566 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.566 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.566 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.566 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772651+0000", 2024-04-26T10:35:08.566 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9919999999999996e-06 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772657+0000", 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3269999999999997e-06 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772663+0000", 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.054e-06 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.567 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774088+0000", 2024-04-26T10:35:08.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001424287 2024-04-26T10:35:08.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774200+0000", 2024-04-26T10:35:08.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011267100000000001 2024-04-26T10:35:08.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.568 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.568 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873457+0000", 2024-04-26T10:35:08.568 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.099256741999999995 2024-04-26T10:35:08.568 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.568 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873518+0000", 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.143e-05 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873590+0000", 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1641000000000001e-05 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.569 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256898 5.c 5:3707bdbe:::benchmark_data_smithi043_45180_object122256:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:08.570 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:08.570 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7113873220000002, 2024-04-26T10:35:08.570 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.097129550999999995, 2024-04-26T10:35:08.570 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.570 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.570 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.570 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.570 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.570 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256898 2024-04-26T10:35:08.570 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.570 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.570 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.570 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.571 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772675+0000", 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7089999999999998e-06 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772680+0000", 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6699999999999999e-06 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772685+0000", 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7700000000000001e-06 2024-04-26T10:35:08.572 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.773342+0000", 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00065647199999999996 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.773450+0000", 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010794999999999999 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869674+0000", 2024-04-26T10:35:08.573 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.096224133000000003 2024-04-26T10:35:08.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869722+0000", 2024-04-26T10:35:08.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8476999999999997e-05 2024-04-26T10:35:08.574 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.574 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.574 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.574 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869802+0000", 2024-04-26T10:35:08.574 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9741999999999996e-05 2024-04-26T10:35:08.574 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.574 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.574 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256899 5.6 5:6756e015:::benchmark_data_smithi043_45180_object122257:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.711369339, 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10100118399999999, 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256899 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.575 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:08.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:08.576 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.576 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.576 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.576 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.576 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772692+0000", 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3489999999999999e-06 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772697+0000", 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1270000000000002e-06 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.577 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772702+0000", 2024-04-26T10:35:08.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4780000000000002e-06 2024-04-26T10:35:08.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833268+0000", 2024-04-26T10:35:08.578 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.060566203999999998 2024-04-26T10:35:08.578 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.578 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.578 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.578 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833410+0000", 2024-04-26T10:35:08.579 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014150999999999999 2024-04-26T10:35:08.579 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.579 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.579 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873597+0000", 2024-04-26T10:35:08.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040187120999999999 2024-04-26T10:35:08.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873638+0000", 2024-04-26T10:35:08.583 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0988999999999997e-05 2024-04-26T10:35:08.583 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.583 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.583 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.583 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873692+0000", 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3866000000000002e-05 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256901 5.6 5:6ab61672:::benchmark_data_smithi043_45180_object122259:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.774982+0000", 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7090772560000005, 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.098805830999999997, 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:08.584 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256901 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774982+0000", 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774982+0000", 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.585 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774981+0000", 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774987+0000", 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3720000000000004e-06 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774997+0000", 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0193e-05 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.586 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775005+0000", 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9759999999999995e-06 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835531+0000", 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.060526475000000003 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835619+0000", 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7266000000000001e-05 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.587 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873697+0000", 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.038077932000000002 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873720+0000", 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3589999999999999e-05 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873788+0000", 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8089999999999994e-05 2024-04-26T10:35:08.588 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:256900 5.a e68/66 5:5f2e8890:::benchmark_data_smithi043_45180_object122258:head v 68'16240, mlcod=68'16238)", 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.775029+0000", 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 4.7090309699999997, 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.094889744999999998, 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775029+0000", 2024-04-26T10:35:08.589 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:08.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775029+0000", 2024-04-26T10:35:08.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:08.590 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.590 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.590 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:08.590 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775028+0000", 2024-04-26T10:35:08.590 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:08.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:08.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775037+0000", 2024-04-26T10:35:08.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:35:08.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.591 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:08.591 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775045+0000", 2024-04-26T10:35:08.591 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4549999999999998e-06 2024-04-26T10:35:08.591 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.591 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:08.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775051+0000", 2024-04-26T10:35:08.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.455e-06 2024-04-26T10:35:08.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:08.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775084+0000", 2024-04-26T10:35:08.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2563e-05 2024-04-26T10:35:08.592 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.592 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.592 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:08.592 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833084+0000", 2024-04-26T10:35:08.592 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.057999929999999998 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869885+0000", 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036800737 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869919+0000", 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3974999999999999e-05 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:08.593 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:08.595 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:08.593+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:08.595 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:35:08.696 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:08.695+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:08.698 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:35:08.723 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:35:08.723 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:35:08.723 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 0 2024-04-26T10:35:08.723 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:35:08.733 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:35:08.817 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:08.816+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:08.897 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:08.896+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:08.899 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:35:08.899 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:35:08.900 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:35:08.900 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:35:08.900 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:35:08.909 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:35:08.999 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:08.997+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:09.078 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:35:09.078 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:35:09.078 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:35:09.079 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:35:09.079 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.079 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:09.079 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:35:09.079 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 101.2757958, 2024-04-26T10:35:09.079 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:35:09.079 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.079 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.079 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.079 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.079 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.079 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.080 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.081 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:35:09.081 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:09.081 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.081 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.081 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.081 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:35:09.081 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:35:09.081 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.081 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.081 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.081 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:35:09.081 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:35:09.081 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.082 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.082 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.082 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:35:09.082 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:35:09.082 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.082 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.082 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.082 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:35:09.082 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:35:09.082 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.082 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.082 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.082 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.083 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.084 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:35:09.084 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:35:09.084 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.084 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.084 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.084 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:35:09.084 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:35:09.084 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.084 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.084 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.084 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:35:09.084 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:35:09.084 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 101.27496772000001, 2024-04-26T10:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.085 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.086 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:35:09.087 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.088 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.088 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.088 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:35:09.088 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:35:09.088 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.088 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.088 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.088 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:35:09.088 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:35:09.088 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.088 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.088 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.088 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:35:09.089 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:35:09.089 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.089 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.089 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.089 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:35:09.089 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:35:09.089 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.089 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.089 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.089 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:35:09.089 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:35:09.089 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.089 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.090 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.090 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:35:09.090 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:35:09.090 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.090 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.090 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.090 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:35:09.090 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:35:09.090 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.090 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.090 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.090 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:35:09.090 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:35:09.091 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.091 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.091 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.091 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.091 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.091 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:09.091 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:09.091 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 101.27403865700001, 2024-04-26T10:35:09.091 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:35:09.091 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.091 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.091 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.092 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.092 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.092 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:35:09.092 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.092 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.092 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.092 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.092 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:09.092 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.092 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.092 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.092 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.093 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.094 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.095 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.096 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 101.273353216, 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.097 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:35:09.098 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.099 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.100 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.101 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248225 5.a 5:51f133a7:::benchmark_data_smithi043_45180_object113583:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.102 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.672106+0000", 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.4036551270000004, 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0378550820000001, 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "reached pg", 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248225 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672106+0000", 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.103 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672106+0000", 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672105+0000", 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672110+0000", 2024-04-26T10:35:09.104 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0849999999999996e-06 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672120+0000", 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0068000000000001e-05 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672127+0000", 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4209999999999998e-06 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672158+0000", 2024-04-26T10:35:09.105 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0889999999999997e-05 2024-04-26T10:35:09.106 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.106 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.106 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.106 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672164+0000", 2024-04-26T10:35:09.106 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7049999999999996e-06 2024-04-26T10:35:09.106 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.106 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.106 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.106 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.700907+0000", 2024-04-26T10:35:09.106 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0287429509999999 2024-04-26T10:35:09.106 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.106 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.106 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for missing object", 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701040+0000", 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013340699999999999 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.709878+0000", 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0088376310000000003 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.709961+0000", 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2837000000000007e-05 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.107 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.108 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.108 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.108 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.108 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248226 5.a 5:5987dd37:::benchmark_data_smithi043_45180_object113584:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.108 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.672136+0000", 2024-04-26T10:35:09.108 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.4036250579999994, 2024-04-26T10:35:09.108 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0382583759999999, 2024-04-26T10:35:09.108 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.108 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "reached pg", 2024-04-26T10:35:09.108 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.108 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.108 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.108 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248226 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672136+0000", 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672136+0000", 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.109 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.110 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672135+0000", 2024-04-26T10:35:09.110 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.110 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.110 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.110 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.110 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672138+0000", 2024-04-26T10:35:09.110 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.475e-06 2024-04-26T10:35:09.110 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.110 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.110 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.110 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672144+0000", 2024-04-26T10:35:09.110 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6119999999999998e-06 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672149+0000", 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7479999999999999e-06 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672192+0000", 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3137999999999999e-05 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672201+0000", 2024-04-26T10:35:09.111 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7660000000000004e-06 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701238+0000", 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.029036914 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for missing object", 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701416+0000", 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00017760200000000001 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.112 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710326+0000", 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0089101230000000007 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710394+0000", 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8384000000000001e-05 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248238 5.a 5:5d4e64f8:::benchmark_data_smithi043_45180_object113596:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.675816+0000", 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3999449619999993, 2024-04-26T10:35:09.113 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0322745419999999, 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248238 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675816+0000", 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.114 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675816+0000", 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675815+0000", 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675819+0000", 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7809999999999999e-06 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.115 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675827+0000", 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675832+0000", 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5539999999999997e-06 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675870+0000", 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7645999999999998e-05 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.116 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675880+0000", 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0159e-05 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701454+0000", 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0255732449999999 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701552+0000", 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8480000000000006e-05 2024-04-26T10:35:09.117 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701638+0000", 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5971999999999996e-05 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.707916+0000", 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006278006 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.707990+0000", 2024-04-26T10:35:09.118 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4140999999999994e-05 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708026+0000", 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5422000000000001e-05 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708090+0000", 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4935000000000001e-05 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.119 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248273 5.a 5:59a40f70:::benchmark_data_smithi043_45180_object113631:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3852497790000005, 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.017694576, 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248273 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.120 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.121 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690513+0000", 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6759999999999999e-06 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690520+0000", 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3720000000000001e-06 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690525+0000", 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5840000000000002e-06 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.122 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.693881+0000", 2024-04-26T10:35:09.123 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003355406 2024-04-26T10:35:09.123 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.123 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.123 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.123 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.693887+0000", 2024-04-26T10:35:09.123 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:35:09.123 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.123 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.123 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.123 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.703149+0000", 2024-04-26T10:35:09.123 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.009261918 2024-04-26T10:35:09.123 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.703303+0000", 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015461000000000001 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.703447+0000", 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014344600000000001 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708098+0000", 2024-04-26T10:35:09.124 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0046506960000000002 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708129+0000", 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0981e-05 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708161+0000", 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2254e-05 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708206+0000", 2024-04-26T10:35:09.125 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4913999999999997e-05 2024-04-26T10:35:09.126 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.126 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.126 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.126 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.126 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.126 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248282 5.a 5:594072f3:::benchmark_data_smithi043_45180_object113640:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.126 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.692105+0000", 2024-04-26T10:35:09.126 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3836561990000007, 2024-04-26T10:35:09.126 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.01817673, 2024-04-26T10:35:09.126 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.126 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.126 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.126 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248282 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692105+0000", 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692105+0000", 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.127 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692104+0000", 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692109+0000", 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6469999999999997e-06 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692117+0000", 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8610000000000004e-06 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.128 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.129 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692124+0000", 2024-04-26T10:35:09.129 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5989999999999998e-06 2024-04-26T10:35:09.129 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.129 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.129 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.129 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.694096+0000", 2024-04-26T10:35:09.129 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001971946 2024-04-26T10:35:09.129 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.129 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.129 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.129 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.694106+0000", 2024-04-26T10:35:09.129 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0301e-05 2024-04-26T10:35:09.129 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.130 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.130 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.130 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.706437+0000", 2024-04-26T10:35:09.130 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.012330838 2024-04-26T10:35:09.130 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.130 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.130 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.130 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.706575+0000", 2024-04-26T10:35:09.130 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013838300000000001 2024-04-26T10:35:09.130 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.130 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.130 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.130 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.706699+0000", 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000123693 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710000+0000", 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003301137 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710152+0000", 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015147399999999999 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.131 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710199+0000", 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7338e-05 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710281+0000", 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2359000000000002e-05 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248291 5.a 5:5701fe08:::benchmark_data_smithi043_45180_object113649:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.696026+0000", 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3797352289999996, 2024-04-26T10:35:09.132 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0145436720000001, 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248291 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696026+0000", 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.133 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.134 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.134 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696026+0000", 2024-04-26T10:35:09.134 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.134 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.134 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.134 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.134 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696025+0000", 2024-04-26T10:35:09.134 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:09.134 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.134 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.134 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.134 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696029+0000", 2024-04-26T10:35:09.134 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0940000000000001e-06 2024-04-26T10:35:09.135 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.135 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.135 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.135 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696037+0000", 2024-04-26T10:35:09.135 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8199999999999997e-06 2024-04-26T10:35:09.135 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.135 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.135 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.135 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696044+0000", 2024-04-26T10:35:09.135 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.81e-06 2024-04-26T10:35:09.135 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.135 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.135 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.136 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696078+0000", 2024-04-26T10:35:09.136 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4748e-05 2024-04-26T10:35:09.136 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.136 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.136 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.136 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696091+0000", 2024-04-26T10:35:09.136 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2687999999999999e-05 2024-04-26T10:35:09.136 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.136 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.136 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.136 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708226+0000", 2024-04-26T10:35:09.136 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0121351000000001 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708304+0000", 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8147999999999998e-05 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708379+0000", 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4859999999999998e-05 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710441+0000", 2024-04-26T10:35:09.137 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020616290000000002 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710452+0000", 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0946e-05 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710497+0000", 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5022999999999999e-05 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.138 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710569+0000", 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2558000000000006e-05 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248296 5.a 5:5ecdda99:::benchmark_data_smithi043_45180_object113654:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3764005140000002, 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0170911979999999, 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.139 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248296 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.140 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.141 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:09.141 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:09.141 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699364+0000", 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4479999999999996e-06 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699371+0000", 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1500000000000002e-06 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699377+0000", 2024-04-26T10:35:09.142 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3240000000000002e-06 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699411+0000", 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4724999999999997e-05 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699417+0000", 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1020000000000002e-06 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710606+0000", 2024-04-26T10:35:09.143 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.011189033 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710697+0000", 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0779999999999995e-05 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710817+0000", 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012020500000000001 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716251+0000", 2024-04-26T10:35:09.144 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0054336439999999996 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716311+0000", 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9954000000000002e-05 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716368+0000", 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7362999999999999e-05 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716452+0000", 2024-04-26T10:35:09.145 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3191999999999999e-05 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248303 5.a 5:506f0e7a:::benchmark_data_smithi043_45180_object113661:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3757645039999993, 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0198339460000001, 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.146 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248303 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.147 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.148 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:09.148 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.148 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.148 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.148 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.148 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699999+0000", 2024-04-26T10:35:09.148 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.022e-06 2024-04-26T10:35:09.148 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.148 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.148 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.148 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700005+0000", 2024-04-26T10:35:09.148 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8889999999999999e-06 2024-04-26T10:35:09.148 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.149 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.149 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.149 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700008+0000", 2024-04-26T10:35:09.149 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6210000000000001e-06 2024-04-26T10:35:09.149 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.149 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.149 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.149 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700048+0000", 2024-04-26T10:35:09.149 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9756999999999999e-05 2024-04-26T10:35:09.149 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.149 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.149 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.149 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700062+0000", 2024-04-26T10:35:09.150 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4231e-05 2024-04-26T10:35:09.150 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.150 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.150 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.150 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.712399+0000", 2024-04-26T10:35:09.150 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0123362419999999 2024-04-26T10:35:09.150 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.150 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.150 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.150 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.712529+0000", 2024-04-26T10:35:09.150 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013045099999999999 2024-04-26T10:35:09.150 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.150 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.712624+0000", 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5027999999999999e-05 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.717948+0000", 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0053243220000000003 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719708+0000", 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017597750000000001 2024-04-26T10:35:09.151 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719745+0000", 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6989000000000001e-05 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719830+0000", 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5173000000000006e-05 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.152 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248310 5.a 5:503e2c49:::benchmark_data_smithi043_45180_object113668:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3717995439999999, 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.016056098, 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248310 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.153 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.154 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703965+0000", 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0280000000000002e-06 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703973+0000", 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5639999999999997e-06 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703980+0000", 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.392e-06 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.155 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.704020+0000", 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0516999999999998e-05 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.704031+0000", 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0317e-05 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.713657+0000", 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0096267210000001 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.156 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.157 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.713763+0000", 2024-04-26T10:35:09.157 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000105979 2024-04-26T10:35:09.157 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.157 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.157 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.157 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.713863+0000", 2024-04-26T10:35:09.157 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.9316999999999998e-05 2024-04-26T10:35:09.157 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.157 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.157 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.157 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.717956+0000", 2024-04-26T10:35:09.157 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0040931220000000003 2024-04-26T10:35:09.157 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719886+0000", 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019307829999999999 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719930+0000", 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3284000000000001e-05 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720017+0000", 2024-04-26T10:35:09.158 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7748000000000001e-05 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248320 5.a 5:5874efc7:::benchmark_data_smithi043_45180_object113678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3680555040000009, 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.012436549, 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.159 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248320 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.160 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707709+0000", 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8890000000000004e-06 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707719+0000", 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0477e-05 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.161 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707724+0000", 2024-04-26T10:35:09.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2449999999999998e-06 2024-04-26T10:35:09.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707761+0000", 2024-04-26T10:35:09.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6427000000000002e-05 2024-04-26T10:35:09.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.162 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.162 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.162 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707771+0000", 2024-04-26T10:35:09.162 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0487e-05 2024-04-26T10:35:09.162 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.714855+0000", 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0070835440000001 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.714982+0000", 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012729000000000001 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.715102+0000", 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000119912 2024-04-26T10:35:09.163 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719839+0000", 2024-04-26T10:35:09.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0047372320000000001 2024-04-26T10:35:09.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.164 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720062+0000", 2024-04-26T10:35:09.164 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00022245899999999999 2024-04-26T10:35:09.164 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.164 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.164 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720090+0000", 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8238e-05 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720142+0000", 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2055999999999998e-05 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248324 5.a 5:5546253c:::benchmark_data_smithi043_45180_object113682:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.709388+0000", 2024-04-26T10:35:09.165 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3663728749999997, 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.015645439, 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248324 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709388+0000", 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.166 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709388+0000", 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709387+0000", 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709391+0000", 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7290000000000002e-06 2024-04-26T10:35:09.167 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709405+0000", 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3799e-05 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709411+0000", 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5999999999999997e-06 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709451+0000", 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0450000000000001e-05 2024-04-26T10:35:09.168 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709461+0000", 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7210000000000006e-06 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716495+0000", 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.007034094 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716626+0000", 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013135600000000001 2024-04-26T10:35:09.169 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716737+0000", 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000111255 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720150+0000", 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0034123669999999999 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.724904+0000", 2024-04-26T10:35:09.170 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0047543280000000004 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.724950+0000", 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6007999999999997e-05 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725033+0000", 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3349000000000004e-05 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.171 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248333 5.a 5:5d7a6426:::benchmark_data_smithi043_45180_object113691:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3619296389999995, 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0113228000000001, 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248333 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.172 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.173 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713834+0000", 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6459999999999999e-06 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713840+0000", 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8699999999999997e-06 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713846+0000", 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3299999999999998e-06 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.174 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713873+0000", 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7606999999999998e-05 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713879+0000", 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.717990+0000", 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0041114769999999 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.175 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.718110+0000", 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012011299999999999 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.718219+0000", 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000109041 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.723401+0000", 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0051815380000000003 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.176 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725070+0000", 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016693490000000001 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725101+0000", 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0392e-05 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725154+0000", 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3319999999999998e-05 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.177 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248337 5.a 5:587d88db:::benchmark_data_smithi043_45180_object113695:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3603535999999998, 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0099158159999999, 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248337 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.178 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:09.179 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715411+0000", 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1080000000000003e-06 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715419+0000", 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2400000000000007e-06 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.180 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715424+0000", 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.164e-06 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715454+0000", 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9824000000000001e-05 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715461+0000", 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0269999999999998e-06 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720180+0000", 2024-04-26T10:35:09.181 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0047187930000001 2024-04-26T10:35:09.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720288+0000", 2024-04-26T10:35:09.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000108457 2024-04-26T10:35:09.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.182 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720390+0000", 2024-04-26T10:35:09.182 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010184200000000001 2024-04-26T10:35:09.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.182 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.182 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725046+0000", 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0046562849999999996 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725200+0000", 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000153969 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725245+0000", 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4660000000000003e-05 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.183 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725323+0000", 2024-04-26T10:35:09.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8164999999999994e-05 2024-04-26T10:35:09.184 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.184 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.184 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.184 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.184 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248343 5.a 5:55b0b6a3:::benchmark_data_smithi043_45180_object113701:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.184 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.719500+0000", 2024-04-26T10:35:09.184 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3562612170000001, 2024-04-26T10:35:09.184 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0085441959999999, 2024-04-26T10:35:09.184 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.184 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.184 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248343 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719500+0000", 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719500+0000", 2024-04-26T10:35:09.185 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719499+0000", 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719502+0000", 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5809999999999999e-06 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.186 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719509+0000", 2024-04-26T10:35:09.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7390000000000002e-06 2024-04-26T10:35:09.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719513+0000", 2024-04-26T10:35:09.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1230000000000002e-06 2024-04-26T10:35:09.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.187 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.187 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719543+0000", 2024-04-26T10:35:09.187 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0423999999999999e-05 2024-04-26T10:35:09.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.187 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719549+0000", 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3759999999999996e-06 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.721881+0000", 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.00233138 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.722010+0000", 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012923000000000001 2024-04-26T10:35:09.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.722132+0000", 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000121543 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725335+0000", 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003203895 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.727914+0000", 2024-04-26T10:35:09.189 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002578402 2024-04-26T10:35:09.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.727965+0000", 2024-04-26T10:35:09.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1479e-05 2024-04-26T10:35:09.190 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.190 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.190 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.190 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728044+0000", 2024-04-26T10:35:09.190 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8528000000000004e-05 2024-04-26T10:35:09.190 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.190 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.190 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.191 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.191 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248356 5.a 5:553dac03:::benchmark_data_smithi043_45180_object113714:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.191 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.736996+0000", 2024-04-26T10:35:09.191 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3387652540000001, 2024-04-26T10:35:09.191 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.99122183799999997, 2024-04-26T10:35:09.191 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.191 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.191 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.191 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.191 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.191 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248356 2024-04-26T10:35:09.191 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.192 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.736996+0000", 2024-04-26T10:35:09.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.192 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.736996+0000", 2024-04-26T10:35:09.192 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.192 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.192 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.736994+0000", 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999981 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737005+0000", 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.115e-05 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737033+0000", 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7832999999999999e-05 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.193 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737049+0000", 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5913000000000002e-05 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737133+0000", 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4550999999999997e-05 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737141+0000", 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2969999999999998e-06 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.194 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.723438+0000", 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.98629742600000003 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.723555+0000", 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000117014 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.723663+0000", 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010753599999999999 2024-04-26T10:35:09.195 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.727862+0000", 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041994609999999998 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728089+0000", 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00022692099999999999 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728137+0000", 2024-04-26T10:35:09.196 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7700000000000001e-05 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728217+0000", 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0828999999999995e-05 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248371 5.a 5:5dd6b787:::benchmark_data_smithi043_45180_object113729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.766367+0000", 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 9.3093943259999996, 2024-04-26T10:35:09.197 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.96392391399999999, 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248371 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766367+0000", 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.198 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766367+0000", 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766366+0000", 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766370+0000", 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3660000000000002e-06 2024-04-26T10:35:09.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:09.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766381+0000", 2024-04-26T10:35:09.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0314e-05 2024-04-26T10:35:09.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766403+0000", 2024-04-26T10:35:09.200 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2486000000000001e-05 2024-04-26T10:35:09.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.200 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.200 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.200 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766442+0000", 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8719e-05 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766449+0000", 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7100000000000007e-06 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725354+0000", 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.95890452100000001 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.201 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:09.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725444+0000", 2024-04-26T10:35:09.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9813000000000002e-05 2024-04-26T10:35:09.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:09.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725505+0000", 2024-04-26T10:35:09.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1198000000000006e-05 2024-04-26T10:35:09.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.202 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.202 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:09.202 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728230+0000", 2024-04-26T10:35:09.202 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027249589999999999 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.730217+0000", 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019874670000000001 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.730257+0000", 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9329000000000002e-05 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.730290+0000", 2024-04-26T10:35:09.203 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3726000000000002e-05 2024-04-26T10:35:09.204 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.204 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.204 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.204 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:09.204 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:09.204 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:35:09.205 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:35:09.206 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:09.203+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:09.306 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:09.304+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:09.342 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:09.342 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:35:09.342 INFO:teuthology.orchestra.run.smithi187.stdout: "num_ops": 0 2024-04-26T10:35:09.342 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:09.352 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:35:09.407 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:09.407+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:09.508 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:09.507+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:09.517 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:09.517 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [], 2024-04-26T10:35:09.518 INFO:teuthology.orchestra.run.smithi187.stdout: "complaint_time": 30, 2024-04-26T10:35:09.518 INFO:teuthology.orchestra.run.smithi187.stdout: "num_blocked_ops": 0 2024-04-26T10:35:09.518 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:09.527 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:35:09.531 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-04-26T10:35:09.531 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-04-26T10:35:09.610 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:09.609+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:09.656 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2024-04-26T10:35:09.656 INFO:teuthology.orchestra.run.smithi187.stdout: "size": 20, 2024-04-26T10:35:09.656 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 600, 2024-04-26T10:35:09.656 INFO:teuthology.orchestra.run.smithi187.stdout: "ops": [ 2024-04-26T10:35:09.656 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.656 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35801 5.5 5:a474ddc6:::benchmark_data_smithi043_45180_object35800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.852660817, 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105608069, 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35801 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.657 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:09.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.658 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.658 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.658 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:09.658 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.658 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800668+0000", 2024-04-26T10:35:09.659 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:09.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.659 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.659 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.659 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800701+0000", 2024-04-26T10:35:09.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3139000000000002e-05 2024-04-26T10:35:09.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800717+0000", 2024-04-26T10:35:09.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6226999999999999e-05 2024-04-26T10:35:09.660 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.660 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.660 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.660 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800726+0000", 2024-04-26T10:35:09.660 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.3420000000000008e-06 2024-04-26T10:35:09.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800775+0000", 2024-04-26T10:35:09.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9378000000000001e-05 2024-04-26T10:35:09.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.661 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.661 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.661 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800906+0000", 2024-04-26T10:35:09.661 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013108600000000001 2024-04-26T10:35:09.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:09.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801091+0000", 2024-04-26T10:35:09.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00018464100000000001 2024-04-26T10:35:09.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.662 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906179+0000", 2024-04-26T10:35:09.662 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105088267 2024-04-26T10:35:09.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.662 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.662 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906192+0000", 2024-04-26T10:35:09.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.3106e-05 2024-04-26T10:35:09.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.663 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.663 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.663 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906238+0000", 2024-04-26T10:35:09.663 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5782999999999999e-05 2024-04-26T10:35:09.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.664 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.664 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.664 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906277+0000", 2024-04-26T10:35:09.664 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9076000000000003e-05 2024-04-26T10:35:09.664 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.664 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.664 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.665 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.665 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35804 5.2 e22/16 5:43fc6004:::benchmark_data_smithi043_45180_object35803:head v 22'2277, mlcod=22'2274)", 2024-04-26T10:35:09.665 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:35:09.665 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.852659832, 2024-04-26T10:35:09.665 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105069224, 2024-04-26T10:35:09.665 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.666 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.666 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.666 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.666 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.666 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:35:09.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.667 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.667 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.667 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800670+0000", 2024-04-26T10:35:09.667 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.668 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.668 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.668 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800669+0000", 2024-04-26T10:35:09.668 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.669 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.669 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.669 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800697+0000", 2024-04-26T10:35:09.669 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7840000000000001e-05 2024-04-26T10:35:09.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800714+0000", 2024-04-26T10:35:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6475000000000001e-05 2024-04-26T10:35:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800721+0000", 2024-04-26T10:35:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.5650000000000004e-06 2024-04-26T10:35:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.670 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800997+0000", 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00027579500000000001 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801018+0000", 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0873000000000002e-05 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.004128484 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.671 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.672 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905739+0000", 2024-04-26T10:35:09.672 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100592848 2024-04-26T10:35:09.672 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.672 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.672 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.672 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.672 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35803 5.5 5:afbd9f39:::benchmark_data_smithi043_45180_object35802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:09.673 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:35:09.673 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.852591209, 2024-04-26T10:35:09.673 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107812461, 2024-04-26T10:35:09.673 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.673 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.673 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.674 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.674 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.674 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35803 2024-04-26T10:35:09.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.674 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.674 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:35:09.674 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.674 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.674 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800739+0000", 2024-04-26T10:35:09.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800738+0000", 2024-04-26T10:35:09.675 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.675 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.675 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.675 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.675 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800770+0000", 2024-04-26T10:35:09.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.1619999999999999e-05 2024-04-26T10:35:09.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.676 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.676 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.676 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800778+0000", 2024-04-26T10:35:09.676 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:35:09.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.677 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.677 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.677 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800784+0000", 2024-04-26T10:35:09.677 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.528e-06 2024-04-26T10:35:09.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.678 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.678 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802672+0000", 2024-04-26T10:35:09.678 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0018882040000000001 2024-04-26T10:35:09.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.678 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.679 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802784+0000", 2024-04-26T10:35:09.679 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000111912 2024-04-26T10:35:09.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.679 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.679 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:09.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802910+0000", 2024-04-26T10:35:09.680 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012627499999999999 2024-04-26T10:35:09.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.680 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.680 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.680 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908422+0000", 2024-04-26T10:35:09.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10551166400000001 2024-04-26T10:35:09.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.681 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.681 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.681 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908468+0000", 2024-04-26T10:35:09.681 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5649000000000003e-05 2024-04-26T10:35:09.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.682 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.682 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.682 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908513+0000", 2024-04-26T10:35:09.682 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:35:09.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.683 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.683 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.683 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908551+0000", 2024-04-26T10:35:09.683 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.8148999999999997e-05 2024-04-26T10:35:09.683 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.683 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.684 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.684 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.684 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35805 5.3 5:cb6ddeb4:::benchmark_data_smithi043_45180_object35804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:09.684 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:09.684 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.852539429, 2024-04-26T10:35:09.685 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10502381, 2024-04-26T10:35:09.685 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.685 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.685 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.685 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.685 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.686 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35805 2024-04-26T10:35:09.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.686 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.686 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.686 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.686 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:09.686 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:09.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.687 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.687 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800790+0000", 2024-04-26T10:35:09.687 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.687 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.687 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800815+0000", 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5162999999999999e-05 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800822+0000", 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800828+0000", 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6980000000000001e-06 2024-04-26T10:35:09.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800909+0000", 2024-04-26T10:35:09.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0673000000000005e-05 2024-04-26T10:35:09.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.689 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801033+0000", 2024-04-26T10:35:09.689 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012353700000000001 2024-04-26T10:35:09.689 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.689 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.689 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:09.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.801169+0000", 2024-04-26T10:35:09.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013598899999999999 2024-04-26T10:35:09.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804061+0000", 2024-04-26T10:35:09.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0028923619999999999 2024-04-26T10:35:09.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.690 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.690 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.690 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805146+0000", 2024-04-26T10:35:09.690 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0010851140000000001 2024-04-26T10:35:09.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905767+0000", 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10062138800000001 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905814+0000", 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6638999999999998e-05 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.691 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35806 5.5 5:aa17f05f:::benchmark_data_smithi043_45180_object35805:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.852479579, 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10777321500000001, 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35806 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.692 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:09.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:09.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.693 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.693 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800850+0000", 2024-04-26T10:35:09.693 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.693 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800875+0000", 2024-04-26T10:35:09.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5425000000000001e-05 2024-04-26T10:35:09.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800882+0000", 2024-04-26T10:35:09.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2409999999999998e-06 2024-04-26T10:35:09.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.694 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.694 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.694 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.800890+0000", 2024-04-26T10:35:09.694 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2699999999999999e-06 2024-04-26T10:35:09.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804512+0000", 2024-04-26T10:35:09.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0036222020000000001 2024-04-26T10:35:09.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.695 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.695 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804592+0000", 2024-04-26T10:35:09.695 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.0241000000000006e-05 2024-04-26T10:35:09.695 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.695 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804720+0000", 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012817699999999999 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908458+0000", 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103737713 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908558+0000", 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010010599999999999 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.696 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908598+0000", 2024-04-26T10:35:09.697 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.9622000000000001e-05 2024-04-26T10:35:09.697 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.697 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.697 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.697 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908623+0000", 2024-04-26T10:35:09.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5694000000000002e-05 2024-04-26T10:35:09.698 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.698 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.698 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.698 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.698 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.698 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35810 5.a 5:59d94c96:::benchmark_data_smithi043_45180_object35809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:09.698 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:35:09.698 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.85076687500001, 2024-04-26T10:35:09.698 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10547641200000001, 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35810 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.699 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802563+0000", 2024-04-26T10:35:09.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.700 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.700 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802561+0000", 2024-04-26T10:35:09.700 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999986 2024-04-26T10:35:09.700 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.700 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802592+0000", 2024-04-26T10:35:09.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.0979999999999998e-05 2024-04-26T10:35:09.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.701 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802612+0000", 2024-04-26T10:35:09.701 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0220999999999998e-05 2024-04-26T10:35:09.701 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.701 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.701 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802621+0000", 2024-04-26T10:35:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:35:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802666+0000", 2024-04-26T10:35:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5680999999999999e-05 2024-04-26T10:35:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802788+0000", 2024-04-26T10:35:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012176300000000001 2024-04-26T10:35:09.702 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:35:09.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802908+0000", 2024-04-26T10:35:09.703 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000119463 2024-04-26T10:35:09.703 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.703 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.703 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.703 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804694+0000", 2024-04-26T10:35:09.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001786429 2024-04-26T10:35:09.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.704 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.704 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907955+0000", 2024-04-26T10:35:09.704 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10326062699999999 2024-04-26T10:35:09.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.704 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908003+0000", 2024-04-26T10:35:09.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8350000000000003e-05 2024-04-26T10:35:09.705 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.705 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.705 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.705 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908039+0000", 2024-04-26T10:35:09.705 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.6239999999999999e-05 2024-04-26T10:35:09.706 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.706 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.706 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.706 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.706 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35809 5.e e22/16 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head v 22'2187, mlcod=22'2184)", 2024-04-26T10:35:09.706 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:35:09.707 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.85065180799999, 2024-04-26T10:35:09.707 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103030631, 2024-04-26T10:35:09.707 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.707 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.707 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.707 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.708 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:35:09.708 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.708 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.708 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.708 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802678+0000", 2024-04-26T10:35:09.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.709 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.709 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.709 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.709 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802677+0000", 2024-04-26T10:35:09.709 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.710 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.710 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802701+0000", 2024-04-26T10:35:09.710 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3193e-05 2024-04-26T10:35:09.710 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.710 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802706+0000", 2024-04-26T10:35:09.711 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:35:09.711 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.711 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.711 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.711 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802711+0000", 2024-04-26T10:35:09.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:35:09.712 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.712 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.712 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.712 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802816+0000", 2024-04-26T10:35:09.712 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000105009 2024-04-26T10:35:09.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.713 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.713 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.713 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802851+0000", 2024-04-26T10:35:09.713 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.5414999999999999e-05 2024-04-26T10:35:09.713 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.714 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805168+0000", 2024-04-26T10:35:09.714 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0023171160000000001 2024-04-26T10:35:09.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.714 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.714 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905709+0000", 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10054028800000001 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35812 5.6 5:6eb8ffe7:::benchmark_data_smithi043_45180_object35811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.85055866800001, 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103892578, 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.715 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35812 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802771+0000", 2024-04-26T10:35:09.716 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802770+0000", 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802934+0000", 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00016349800000000001 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.717 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802942+0000", 2024-04-26T10:35:09.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.2490000000000001e-06 2024-04-26T10:35:09.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802951+0000", 2024-04-26T10:35:09.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.8939999999999999e-06 2024-04-26T10:35:09.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.718 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.718 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.718 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803000+0000", 2024-04-26T10:35:09.718 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8942e-05 2024-04-26T10:35:09.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803139+0000", 2024-04-26T10:35:09.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013897399999999999 2024-04-26T10:35:09.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.719 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:09.719 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803264+0000", 2024-04-26T10:35:09.719 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012520399999999999 2024-04-26T10:35:09.719 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.719 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906244+0000", 2024-04-26T10:35:09.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102980215 2024-04-26T10:35:09.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.720 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906573+0000", 2024-04-26T10:35:09.720 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00032830000000000001 2024-04-26T10:35:09.720 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.720 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.720 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906622+0000", 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9100000000000001e-05 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906664+0000", 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.1891999999999998e-05 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:35811 5.8 e22/16 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head v 22'2239, mlcod=22'2237)", 2024-04-26T10:35:09.721 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:09.722 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.850364508, 2024-04-26T10:35:09.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103803487, 2024-04-26T10:35:09.722 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.722 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.722 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:09.722 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.722 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.722 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.722 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.722 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802965+0000", 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802992+0000", 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.6919000000000001e-05 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.723 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.802998+0000", 2024-04-26T10:35:09.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.2729999999999999e-06 2024-04-26T10:35:09.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803004+0000", 2024-04-26T10:35:09.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.857e-06 2024-04-26T10:35:09.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.724 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.724 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.724 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803078+0000", 2024-04-26T10:35:09.724 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4391e-05 2024-04-26T10:35:09.724 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.803097+0000", 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.8408999999999999e-05 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906739+0000", 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.103642531 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906769+0000", 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.9598999999999999e-05 2024-04-26T10:35:09.725 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35801 5.5 e22/16 ondisk, result = 0)", 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.84915714, 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102011832, 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.726 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804173+0000", 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804172+0000", 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.727 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804175+0000", 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7970000000000001e-06 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804179+0000", 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804183+0000", 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.14e-06 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.728 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906164+0000", 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101981588 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906173+0000", 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.6130000000000004e-06 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906184+0000", 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.1586999999999999e-05 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.729 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35813 5.a 5:5a23a5f1:::benchmark_data_smithi043_45180_object35812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.84834823200001, 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.105579311, 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35813 2024-04-26T10:35:09.730 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.731 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:35:09.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.731 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804981+0000", 2024-04-26T10:35:09.731 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.731 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.731 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.731 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.804976+0000", 2024-04-26T10:35:09.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999948 2024-04-26T10:35:09.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805043+0000", 2024-04-26T10:35:09.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.6482000000000005e-05 2024-04-26T10:35:09.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.732 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.732 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.732 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805060+0000", 2024-04-26T10:35:09.732 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.7509000000000001e-05 2024-04-26T10:35:09.732 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805065+0000", 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.2739999999999998e-06 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905722+0000", 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100656907 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905926+0000", 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00020393700000000001 2024-04-26T10:35:09.733 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 1", 2024-04-26T10:35:09.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:35:09.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00017630599999999999 2024-04-26T10:35:09.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.734 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910456+0000", 2024-04-26T10:35:09.734 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0043539800000000003 2024-04-26T10:35:09.734 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.734 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.734 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910501+0000", 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4294e-05 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910535+0000", 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4128000000000003e-05 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.910561+0000", 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.5930000000000001e-05 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.735 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35814 5.3 5:c2d39d25:::benchmark_data_smithi043_45180_object35813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.848244694, 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10434608300000001, 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35814 2024-04-26T10:35:09.736 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805085+0000", 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.737 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805084+0000", 2024-04-26T10:35:09.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805135+0000", 2024-04-26T10:35:09.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.0902999999999997e-05 2024-04-26T10:35:09.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.738 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.738 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805143+0000", 2024-04-26T10:35:09.738 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:35:09.738 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.738 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805154+0000", 2024-04-26T10:35:09.739 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0961000000000001e-05 2024-04-26T10:35:09.739 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.739 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.739 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.739 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905852+0000", 2024-04-26T10:35:09.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10069818 2024-04-26T10:35:09.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.740 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.740 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.740 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905973+0000", 2024-04-26T10:35:09.740 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000121462 2024-04-26T10:35:09.740 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:09.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906102+0000", 2024-04-26T10:35:09.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00012904299999999999 2024-04-26T10:35:09.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.741 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.741 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.741 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909347+0000", 2024-04-26T10:35:09.741 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.003244832 2024-04-26T10:35:09.741 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.742 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.742 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909356+0000", 2024-04-26T10:35:09.742 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.329e-06 2024-04-26T10:35:09.742 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.742 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909397+0000", 2024-04-26T10:35:09.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0652999999999999e-05 2024-04-26T10:35:09.743 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.743 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.743 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.743 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.909431+0000", 2024-04-26T10:35:09.743 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4010999999999997e-05 2024-04-26T10:35:09.743 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.743 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.743 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.744 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.744 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.744 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:35815 5.3 5:cc787887:::benchmark_data_smithi043_45180_object35814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:09.744 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:35:09.744 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.848167821, 2024-04-26T10:35:09.744 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.107405348, 2024-04-26T10:35:09.744 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.744 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.744 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.745 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.745 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.745 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 35815 2024-04-26T10:35:09.745 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.745 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.745 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.745 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:35:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805162+0000", 2024-04-26T10:35:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805161+0000", 2024-04-26T10:35:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.746 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805185+0000", 2024-04-26T10:35:09.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.4042000000000001e-05 2024-04-26T10:35:09.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.747 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.747 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.747 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905675+0000", 2024-04-26T10:35:09.747 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100489411 2024-04-26T10:35:09.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905691+0000", 2024-04-26T10:35:09.748 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.6243e-05 2024-04-26T10:35:09.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.748 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.748 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.748 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907876+0000", 2024-04-26T10:35:09.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0021847070000000001 2024-04-26T10:35:09.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.749 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.907998+0000", 2024-04-26T10:35:09.749 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000122106 2024-04-26T10:35:09.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.749 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.749 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "waiting for subops from 0", 2024-04-26T10:35:09.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.908132+0000", 2024-04-26T10:35:09.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00013465100000000001 2024-04-26T10:35:09.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.750 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.750 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:09.750 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912397+0000", 2024-04-26T10:35:09.750 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.0042646029999999996 2024-04-26T10:35:09.750 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912486+0000", 2024-04-26T10:35:09.751 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9044999999999999e-05 2024-04-26T10:35:09.751 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.751 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.751 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.751 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912533+0000", 2024-04-26T10:35:09.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.6527999999999999e-05 2024-04-26T10:35:09.752 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.752 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.752 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.752 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.912567+0000", 2024-04-26T10:35:09.752 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4622000000000002e-05 2024-04-26T10:35:09.752 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.752 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.752 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.753 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.753 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.753 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop_reply(client.4538.0:35812 5.6 e22/16 ondisk, result = 0)", 2024-04-26T10:35:09.753 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:09.753 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 101.84805243700001, 2024-04-26T10:35:09.753 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10097058, 2024-04-26T10:35:09.753 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.753 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "started", 2024-04-26T10:35:09.754 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.754 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:09.754 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.754 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.754 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.754 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:09.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.755 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.755 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805277+0000", 2024-04-26T10:35:09.755 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.755 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.755 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.805280+0000", 2024-04-26T10:35:09.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3900000000000002e-06 2024-04-26T10:35:09.756 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.756 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.756 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.756 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905665+0000", 2024-04-26T10:35:09.756 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.100385271 2024-04-26T10:35:09.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.757 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.905687+0000", 2024-04-26T10:35:09.757 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.2011e-05 2024-04-26T10:35:09.757 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.757 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.757 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906223+0000", 2024-04-26T10:35:09.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00053552999999999999 2024-04-26T10:35:09.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.758 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.758 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.758 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906239+0000", 2024-04-26T10:35:09.758 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.5783000000000001e-05 2024-04-26T10:35:09.758 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.759 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.759 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.759 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:33:27.906248+0000", 2024-04-26T10:35:09.759 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.1050000000000001e-06 2024-04-26T10:35:09.759 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.759 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.759 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.759 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.760 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.760 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256890 5.6 5:6c163c2d:::benchmark_data_smithi043_45180_object122248:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:09.760 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:09.760 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.884504368, 2024-04-26T10:35:09.760 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.102475969, 2024-04-26T10:35:09.760 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.760 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.760 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.760 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.761 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.761 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256890 2024-04-26T10:35:09.761 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.761 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.761 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.761 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.761 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:09.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.762 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.762 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:09.762 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.762 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.762 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768825+0000", 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768827+0000", 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.0320000000000002e-06 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768832+0000", 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3190000000000002e-06 2024-04-26T10:35:09.763 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.768837+0000", 2024-04-26T10:35:09.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.9189999999999998e-06 2024-04-26T10:35:09.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.764 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.764 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.764 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.770074+0000", 2024-04-26T10:35:09.764 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001236429 2024-04-26T10:35:09.764 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.770195+0000", 2024-04-26T10:35:09.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.000120981 2024-04-26T10:35:09.765 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.765 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.765 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.765 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.871197+0000", 2024-04-26T10:35:09.765 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.101002548 2024-04-26T10:35:09.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.871232+0000", 2024-04-26T10:35:09.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.4381999999999997e-05 2024-04-26T10:35:09.766 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.766 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.766 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.766 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.871301+0000", 2024-04-26T10:35:09.766 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.97e-05 2024-04-26T10:35:09.766 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.766 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.766 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256897 5.6 5:68cfdf58:::benchmark_data_smithi043_45180_object122255:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.8806873060000004, 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10094767, 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256897 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.767 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772642+0000", 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.768 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772651+0000", 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.9919999999999996e-06 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772657+0000", 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.3269999999999997e-06 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772663+0000", 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.054e-06 2024-04-26T10:35:09.769 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774088+0000", 2024-04-26T10:35:09.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.001424287 2024-04-26T10:35:09.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.770 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.770 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774200+0000", 2024-04-26T10:35:09.770 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00011267100000000001 2024-04-26T10:35:09.770 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.770 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873457+0000", 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.099256741999999995 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873518+0000", 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.143e-05 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873590+0000", 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.1641000000000001e-05 2024-04-26T10:35:09.771 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256898 5.c 5:3707bdbe:::benchmark_data_smithi043_45180_object122256:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.880657308, 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.097129550999999995, 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.772 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256898 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.773 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772672+0000", 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772675+0000", 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.7089999999999998e-06 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772680+0000", 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.6699999999999999e-06 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.774 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772685+0000", 2024-04-26T10:35:09.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.7700000000000001e-06 2024-04-26T10:35:09.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.773342+0000", 2024-04-26T10:35:09.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00065647199999999996 2024-04-26T10:35:09.775 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.775 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.775 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.775 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.773450+0000", 2024-04-26T10:35:09.775 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00010794999999999999 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869674+0000", 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.096224133000000003 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869722+0000", 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.8476999999999997e-05 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869802+0000", 2024-04-26T10:35:09.776 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9741999999999996e-05 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256899 5.6 5:6756e015:::benchmark_data_smithi043_45180_object122257:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.8806393249999998, 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.10100118399999999, 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.777 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256899 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.778 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772690+0000", 2024-04-26T10:35:09.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772692+0000", 2024-04-26T10:35:09.779 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3489999999999999e-06 2024-04-26T10:35:09.779 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.779 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.779 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.779 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772697+0000", 2024-04-26T10:35:09.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.1270000000000002e-06 2024-04-26T10:35:09.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.772702+0000", 2024-04-26T10:35:09.780 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.4780000000000002e-06 2024-04-26T10:35:09.780 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.780 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.780 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.780 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833268+0000", 2024-04-26T10:35:09.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.060566203999999998 2024-04-26T10:35:09.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833410+0000", 2024-04-26T10:35:09.781 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.00014150999999999999 2024-04-26T10:35:09.781 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.781 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.781 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.781 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873597+0000", 2024-04-26T10:35:09.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.040187120999999999 2024-04-26T10:35:09.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873638+0000", 2024-04-26T10:35:09.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4.0988999999999997e-05 2024-04-26T10:35:09.782 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.782 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.782 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.782 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873692+0000", 2024-04-26T10:35:09.782 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3866000000000002e-05 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_op(client.4538.0:256901 5.6 5:6ab61672:::benchmark_data_smithi043_45180_object122259:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.774982+0000", 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.8783472420000003, 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.098805830999999997, 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: "client_info": { 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: "client": "client.4538", 2024-04-26T10:35:09.783 INFO:teuthology.orchestra.run.smithi187.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: "tid": 256901 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774982+0000", 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774982+0000", 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.784 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774981+0000", 2024-04-26T10:35:09.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.999999 2024-04-26T10:35:09.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.785 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774987+0000", 2024-04-26T10:35:09.785 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 5.3720000000000004e-06 2024-04-26T10:35:09.785 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.785 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.785 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.774997+0000", 2024-04-26T10:35:09.786 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 1.0193e-05 2024-04-26T10:35:09.786 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.786 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.786 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.786 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775005+0000", 2024-04-26T10:35:09.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.9759999999999995e-06 2024-04-26T10:35:09.787 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.787 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.787 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.787 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835531+0000", 2024-04-26T10:35:09.787 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.060526475000000003 2024-04-26T10:35:09.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.835619+0000", 2024-04-26T10:35:09.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 8.7266000000000001e-05 2024-04-26T10:35:09.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "op_commit", 2024-04-26T10:35:09.788 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873697+0000", 2024-04-26T10:35:09.788 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.038077932000000002 2024-04-26T10:35:09.788 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.788 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.788 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873720+0000", 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 2.3589999999999999e-05 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.873788+0000", 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.8089999999999994e-05 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: "description": "osd_repop(client.4538.0:256900 5.a e68/66 5:5f2e8890:::benchmark_data_smithi043_45180_object122258:head v 68'16240, mlcod=68'16238)", 2024-04-26T10:35:09.789 INFO:teuthology.orchestra.run.smithi187.stdout: "initiated_at": "2024-04-26T10:35:03.775029+0000", 2024-04-26T10:35:09.790 INFO:teuthology.orchestra.run.smithi187.stdout: "age": 5.8783009560000004, 2024-04-26T10:35:09.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.094889744999999998, 2024-04-26T10:35:09.790 INFO:teuthology.orchestra.run.smithi187.stdout: "type_data": { 2024-04-26T10:35:09.790 INFO:teuthology.orchestra.run.smithi187.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:09.790 INFO:teuthology.orchestra.run.smithi187.stdout: "events": [ 2024-04-26T10:35:09.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "initiated", 2024-04-26T10:35:09.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775029+0000", 2024-04-26T10:35:09.790 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.790 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.790 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.790 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "throttled", 2024-04-26T10:35:09.790 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775029+0000", 2024-04-26T10:35:09.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0 2024-04-26T10:35:09.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "header_read", 2024-04-26T10:35:09.791 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775028+0000", 2024-04-26T10:35:09.791 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:09.791 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.791 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.791 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "all_read", 2024-04-26T10:35:09.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775037+0000", 2024-04-26T10:35:09.792 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:35:09.792 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.792 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.792 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "dispatched", 2024-04-26T10:35:09.792 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775045+0000", 2024-04-26T10:35:09.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 7.4549999999999998e-06 2024-04-26T10:35:09.793 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.793 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.793 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "queued_for_pg", 2024-04-26T10:35:09.793 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775051+0000", 2024-04-26T10:35:09.793 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 6.455e-06 2024-04-26T10:35:09.794 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.794 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.794 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "reached_pg", 2024-04-26T10:35:09.794 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.775084+0000", 2024-04-26T10:35:09.794 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.2563e-05 2024-04-26T10:35:09.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.795 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.795 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "started", 2024-04-26T10:35:09.795 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.833084+0000", 2024-04-26T10:35:09.795 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.057999929999999998 2024-04-26T10:35:09.795 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.796 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "commit_sent", 2024-04-26T10:35:09.796 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869885+0000", 2024-04-26T10:35:09.796 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 0.036800737 2024-04-26T10:35:09.796 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2024-04-26T10:35:09.796 INFO:teuthology.orchestra.run.smithi187.stdout: { 2024-04-26T10:35:09.797 INFO:teuthology.orchestra.run.smithi187.stdout: "event": "done", 2024-04-26T10:35:09.797 INFO:teuthology.orchestra.run.smithi187.stdout: "time": "2024-04-26T10:35:03.869919+0000", 2024-04-26T10:35:09.797 INFO:teuthology.orchestra.run.smithi187.stdout: "duration": 3.3974999999999999e-05 2024-04-26T10:35:09.797 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.797 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.797 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.798 INFO:teuthology.orchestra.run.smithi187.stdout: } 2024-04-26T10:35:09.798 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2024-04-26T10:35:09.798 INFO:teuthology.orchestra.run.smithi187.stdout:} 2024-04-26T10:35:09.800 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:09.799+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:09.802 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-26T10:35:09.802 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:35:09.901 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:09.898+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:09.943 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:35:09.943 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:35:09.943 INFO:teuthology.orchestra.run.smithi186.stdout: "num_ops": 0 2024-04-26T10:35:09.943 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:35:09.953 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:35:10.001 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:09.999+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:10.079 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:35:10.079 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [], 2024-04-26T10:35:10.079 INFO:teuthology.orchestra.run.smithi186.stdout: "complaint_time": 30, 2024-04-26T10:35:10.079 INFO:teuthology.orchestra.run.smithi186.stdout: "num_blocked_ops": 0 2024-04-26T10:35:10.079 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:35:10.089 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:35:10.093 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:35:10.102 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:10.100+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:10.202 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:10.201+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:10.217 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-26T10:35:10.217 INFO:teuthology.orchestra.run.smithi186.stdout: "size": 20, 2024-04-26T10:35:10.217 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 600, 2024-04-26T10:35:10.217 INFO:teuthology.orchestra.run.smithi186.stdout: "ops": [ 2024-04-26T10:35:10.217 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35802 5.0 5:02763e64:::benchmark_data_smithi043_45180_object35801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 102.4145271, 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.106340728, 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35802 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.218 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799965+0000", 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.799964+0000", 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.219 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800020+0000", 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5865000000000001e-05 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800031+0000", 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.1270000000000001e-05 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800041+0000", 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5400000000000001e-06 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.220 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800073+0000", 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1896000000000001e-05 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800171+0000", 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8140000000000006e-05 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800258+0000", 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7507000000000001e-05 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.221 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801671+0000", 2024-04-26T10:35:10.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001412466 2024-04-26T10:35:10.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906193+0000", 2024-04-26T10:35:10.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10452178600000001 2024-04-26T10:35:10.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.222 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.222 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.222 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906269+0000", 2024-04-26T10:35:10.222 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.6320000000000001e-05 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906306+0000", 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6828e-05 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35807 5.e 5:73e0ccf7:::benchmark_data_smithi043_45180_object35806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 102.41369902, 2024-04-26T10:35:10.223 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10548734899999999, 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35807 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.224 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800793+0000", 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800792+0000", 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800868+0000", 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.5325000000000001e-05 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.225 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.226 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800876+0000", 2024-04-26T10:35:10.226 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:35:10.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.226 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.226 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800880+0000", 2024-04-26T10:35:10.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.2370000000000003e-06 2024-04-26T10:35:10.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.227 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.800914+0000", 2024-04-26T10:35:10.227 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4384000000000001e-05 2024-04-26T10:35:10.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.227 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.227 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801037+0000", 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012326399999999999 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801175+0000", 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013742999999999999 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803127+0000", 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001951869 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.228 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906199+0000", 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.103071966 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906260+0000", 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.0819000000000002e-05 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906281+0000", 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.0999999999999999e-05 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.229 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35809 5.e 5:74a3bf18:::benchmark_data_smithi043_45180_object35808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 102.41276995699999, 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10464108900000001, 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35809 2024-04-26T10:35:10.230 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801722+0000", 2024-04-26T10:35:10.231 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801808+0000", 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.6007999999999994e-05 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801816+0000", 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.259e-06 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.801821+0000", 2024-04-26T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.198e-06 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802341+0000", 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00051957399999999997 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802420+0000", 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.9084000000000004e-05 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802501+0000", 2024-04-26T10:35:10.233 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.1712999999999995e-05 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.803402+0000", 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00090050999999999998 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906313+0000", 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10291111 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.234 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906342+0000", 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9218e-05 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906363+0000", 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.1081e-05 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:35811 5.8 5:10e0abd4:::benchmark_data_smithi043_45180_object35810:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 102.41208451599999, 2024-04-26T10:35:10.235 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10457264199999999, 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 35811 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.236 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802408+0000", 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802407+0000", 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802471+0000", 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3826999999999997e-05 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.237 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802481+0000", 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0173000000000001e-05 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802488+0000", 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4370000000000001e-06 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802523+0000", 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4665000000000001e-05 2024-04-26T10:35:10.238 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802643+0000", 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000120198 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.802773+0000", 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013042500000000001 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.804289+0000", 2024-04-26T10:35:10.239 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0015157359999999999 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906907+0000", 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.10261801600000001 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906949+0000", 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1520999999999998e-05 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.240 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:33:27.906980+0000", 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.1566000000000002e-05 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248225 5.a 5:51f133a7:::benchmark_data_smithi043_45180_object113583:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.672106+0000", 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.542386427, 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0378550820000001, 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "reached pg", 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.241 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.242 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248225 2024-04-26T10:35:10.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.242 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.242 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672106+0000", 2024-04-26T10:35:10.242 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.242 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.242 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.242 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672106+0000", 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672105+0000", 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672110+0000", 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.0849999999999996e-06 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.243 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672120+0000", 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0068000000000001e-05 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672127+0000", 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4209999999999998e-06 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672158+0000", 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0889999999999997e-05 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.244 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672164+0000", 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7049999999999996e-06 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.700907+0000", 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0287429509999999 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for missing object", 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701040+0000", 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013340699999999999 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.245 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.709878+0000", 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0088376310000000003 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.709961+0000", 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2837000000000007e-05 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248226 5.a 5:5987dd37:::benchmark_data_smithi043_45180_object113584:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.246 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.672136+0000", 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.542356357999999, 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0382583759999999, 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "reached pg", 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248226 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672136+0000", 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.247 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672136+0000", 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672135+0000", 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672138+0000", 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.475e-06 2024-04-26T10:35:10.248 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672144+0000", 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6119999999999998e-06 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672149+0000", 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7479999999999999e-06 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672192+0000", 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3137999999999999e-05 2024-04-26T10:35:10.249 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.672201+0000", 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7660000000000004e-06 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701238+0000", 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.029036914 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for missing object", 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701416+0000", 2024-04-26T10:35:10.250 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00017760200000000001 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710326+0000", 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0089101230000000007 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710394+0000", 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.8384000000000001e-05 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.251 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248238 5.a 5:5d4e64f8:::benchmark_data_smithi043_45180_object113596:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.675816+0000", 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.538676261999999, 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0322745419999999, 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248238 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675816+0000", 2024-04-26T10:35:10.252 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675816+0000", 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675815+0000", 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675819+0000", 2024-04-26T10:35:10.253 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7809999999999999e-06 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675827+0000", 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675832+0000", 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5539999999999997e-06 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.254 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675870+0000", 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7645999999999998e-05 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.675880+0000", 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0159e-05 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701454+0000", 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0255732449999999 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.255 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701552+0000", 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.8480000000000006e-05 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.701638+0000", 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5971999999999996e-05 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.707916+0000", 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.006278006 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.707990+0000", 2024-04-26T10:35:10.256 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4140999999999994e-05 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708026+0000", 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.5422000000000001e-05 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708090+0000", 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.4935000000000001e-05 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.257 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248273 5.a 5:59a40f70:::benchmark_data_smithi043_45180_object113631:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.523981079, 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.017694576, 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248273 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.258 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690511+0000", 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.259 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690513+0000", 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.6759999999999999e-06 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690520+0000", 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3720000000000001e-06 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.690525+0000", 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5840000000000002e-06 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.260 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.693881+0000", 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003355406 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.693887+0000", 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.703149+0000", 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.009261918 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.261 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.703303+0000", 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015461000000000001 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.703447+0000", 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00014344600000000001 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708098+0000", 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0046506960000000002 2024-04-26T10:35:10.262 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708129+0000", 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0981e-05 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708161+0000", 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.2254e-05 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708206+0000", 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4913999999999997e-05 2024-04-26T10:35:10.263 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248282 5.a 5:594072f3:::benchmark_data_smithi043_45180_object113640:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.692105+0000", 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.522387499000001, 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.01817673, 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248282 2024-04-26T10:35:10.264 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692105+0000", 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692105+0000", 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692104+0000", 2024-04-26T10:35:10.265 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692109+0000", 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6469999999999997e-06 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692117+0000", 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.8610000000000004e-06 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.692124+0000", 2024-04-26T10:35:10.266 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.5989999999999998e-06 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.694096+0000", 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.001971946 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.694106+0000", 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0301e-05 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.706437+0000", 2024-04-26T10:35:10.267 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.012330838 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.706575+0000", 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013838300000000001 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.706699+0000", 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000123693 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710000+0000", 2024-04-26T10:35:10.268 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003301137 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710152+0000", 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00015147399999999999 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710199+0000", 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7338e-05 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710281+0000", 2024-04-26T10:35:10.269 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2359000000000002e-05 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248291 5.a 5:5701fe08:::benchmark_data_smithi043_45180_object113649:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.696026+0000", 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.518466528999999, 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0145436720000001, 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.270 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248291 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696026+0000", 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696026+0000", 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.271 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696025+0000", 2024-04-26T10:35:10.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:10.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696029+0000", 2024-04-26T10:35:10.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0940000000000001e-06 2024-04-26T10:35:10.272 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.272 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.272 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.272 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696037+0000", 2024-04-26T10:35:10.272 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8199999999999997e-06 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696044+0000", 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.81e-06 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696078+0000", 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4748e-05 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.696091+0000", 2024-04-26T10:35:10.273 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.2687999999999999e-05 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708226+0000", 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0121351000000001 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708304+0000", 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8147999999999998e-05 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.274 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.708379+0000", 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.4859999999999998e-05 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710441+0000", 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0020616290000000002 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710452+0000", 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0946e-05 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.275 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710497+0000", 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.5022999999999999e-05 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710569+0000", 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2558000000000006e-05 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248296 5.a 5:5ecdda99:::benchmark_data_smithi043_45180_object113654:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:10.276 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.515131814, 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0170911979999999, 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248296 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.277 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699360+0000", 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699364+0000", 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4479999999999996e-06 2024-04-26T10:35:10.278 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699371+0000", 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.1500000000000002e-06 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699377+0000", 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3240000000000002e-06 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699411+0000", 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.4724999999999997e-05 2024-04-26T10:35:10.279 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699417+0000", 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1020000000000002e-06 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710606+0000", 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.011189033 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710697+0000", 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.0779999999999995e-05 2024-04-26T10:35:10.280 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.710817+0000", 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012020500000000001 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716251+0000", 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0054336439999999996 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716311+0000", 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.9954000000000002e-05 2024-04-26T10:35:10.281 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716368+0000", 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.7362999999999999e-05 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716452+0000", 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3191999999999999e-05 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.282 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248303 5.a 5:506f0e7a:::benchmark_data_smithi043_45180_object113661:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.283 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:10.283 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.514495803999999, 2024-04-26T10:35:10.283 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0198339460000001, 2024-04-26T10:35:10.283 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.283 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.283 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.283 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.283 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248303 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.284 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699996+0000", 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.699999+0000", 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.022e-06 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700005+0000", 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8889999999999999e-06 2024-04-26T10:35:10.285 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700008+0000", 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6210000000000001e-06 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700048+0000", 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9756999999999999e-05 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.700062+0000", 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.4231e-05 2024-04-26T10:35:10.286 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.712399+0000", 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0123362419999999 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.712529+0000", 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013045099999999999 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.712624+0000", 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.5027999999999999e-05 2024-04-26T10:35:10.287 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.717948+0000", 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0053243220000000003 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719708+0000", 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0017597750000000001 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719745+0000", 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6989000000000001e-05 2024-04-26T10:35:10.288 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719830+0000", 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5173000000000006e-05 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248310 5.a 5:503e2c49:::benchmark_data_smithi043_45180_object113668:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.510530844, 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.016056098, 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.289 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248310 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.290 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703961+0000", 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703965+0000", 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0280000000000002e-06 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.291 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703973+0000", 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.5639999999999997e-06 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.703980+0000", 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.392e-06 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.704020+0000", 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0516999999999998e-05 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.292 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.704031+0000", 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0317e-05 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.713657+0000", 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0096267210000001 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.713763+0000", 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000105979 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.293 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.713863+0000", 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.9316999999999998e-05 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.717956+0000", 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0040931220000000003 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719886+0000", 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019307829999999999 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.294 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719930+0000", 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3284000000000001e-05 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720017+0000", 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.7748000000000001e-05 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248320 5.a 5:5874efc7:::benchmark_data_smithi043_45180_object113678:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:10.295 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.506786804000001, 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.012436549, 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248320 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.296 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707705+0000", 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707709+0000", 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8890000000000004e-06 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.297 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707719+0000", 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0477e-05 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707724+0000", 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2449999999999998e-06 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707761+0000", 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6427000000000002e-05 2024-04-26T10:35:10.298 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.707771+0000", 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0487e-05 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.714855+0000", 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0070835440000001 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.714982+0000", 2024-04-26T10:35:10.299 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012729000000000001 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.715102+0000", 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000119912 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.719839+0000", 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0047372320000000001 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720062+0000", 2024-04-26T10:35:10.300 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00022245899999999999 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720090+0000", 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.8238e-05 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720142+0000", 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.2055999999999998e-05 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.301 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248324 5.a 5:5546253c:::benchmark_data_smithi043_45180_object113682:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.709388+0000", 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.505104175, 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.015645439, 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248324 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.302 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709388+0000", 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709388+0000", 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709387+0000", 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.303 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709391+0000", 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.7290000000000002e-06 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709405+0000", 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.3799e-05 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709411+0000", 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.5999999999999997e-06 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.304 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709451+0000", 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.0450000000000001e-05 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.709461+0000", 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 9.7210000000000006e-06 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716495+0000", 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.007034094 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.305 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716626+0000", 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00013135600000000001 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.716737+0000", 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000111255 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720150+0000", 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0034123669999999999 2024-04-26T10:35:10.306 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.724904+0000", 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0047543280000000004 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.724950+0000", 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.6007999999999997e-05 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725033+0000", 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.3349000000000004e-05 2024-04-26T10:35:10.307 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248333 5.a 5:5d7a6426:::benchmark_data_smithi043_45180_object113691:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.500660938999999, 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0113228000000001, 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248333 2024-04-26T10:35:10.308 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713831+0000", 2024-04-26T10:35:10.309 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713834+0000", 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.6459999999999999e-06 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713840+0000", 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.8699999999999997e-06 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.310 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713846+0000", 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3299999999999998e-06 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713873+0000", 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7606999999999998e-05 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.713879+0000", 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.6550000000000001e-06 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.311 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.717990+0000", 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0041114769999999 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.718110+0000", 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012011299999999999 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.718219+0000", 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000109041 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.312 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.723401+0000", 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0051815380000000003 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725070+0000", 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0016693490000000001 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725101+0000", 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0392e-05 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.313 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725154+0000", 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.3319999999999998e-05 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248337 5.a 5:587d88db:::benchmark_data_smithi043_45180_object113695:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.4990849, 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0099158159999999, 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.314 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248337 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.315 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715407+0000", 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.999999 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715411+0000", 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1080000000000003e-06 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715419+0000", 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.2400000000000007e-06 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.316 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715424+0000", 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.164e-06 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715454+0000", 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.9824000000000001e-05 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.715461+0000", 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.0269999999999998e-06 2024-04-26T10:35:10.317 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720180+0000", 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0047187930000001 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720288+0000", 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000108457 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.720390+0000", 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010184200000000001 2024-04-26T10:35:10.318 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725046+0000", 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0046562849999999996 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725200+0000", 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000153969 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725245+0000", 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.4660000000000003e-05 2024-04-26T10:35:10.319 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725323+0000", 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8164999999999994e-05 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248343 5.a 5:55b0b6a3:::benchmark_data_smithi043_45180_object113701:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.719500+0000", 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.494992517, 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0085441959999999, 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.320 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248343 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719500+0000", 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719500+0000", 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.321 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719499+0000", 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719502+0000", 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.5809999999999999e-06 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719509+0000", 2024-04-26T10:35:10.322 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.7390000000000002e-06 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719513+0000", 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.1230000000000002e-06 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719543+0000", 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.0423999999999999e-05 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.719549+0000", 2024-04-26T10:35:10.323 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.3759999999999996e-06 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.721881+0000", 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.00233138 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.722010+0000", 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00012923000000000001 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.722132+0000", 2024-04-26T10:35:10.324 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000121543 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725335+0000", 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.003203895 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.727914+0000", 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.002578402 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.325 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.727965+0000", 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 5.1479e-05 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728044+0000", 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.8528000000000004e-05 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248356 5.a 5:553dac03:::benchmark_data_smithi043_45180_object113714:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.736996+0000", 2024-04-26T10:35:10.326 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.477496554, 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.99122183799999997, 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248356 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.736996+0000", 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.327 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.736996+0000", 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.736994+0000", 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999981 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737005+0000", 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.115e-05 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.328 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737033+0000", 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.7832999999999999e-05 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737049+0000", 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.5913000000000002e-05 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737133+0000", 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.4550999999999997e-05 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.329 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.737141+0000", 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.2969999999999998e-06 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.723438+0000", 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.98629742600000003 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.723555+0000", 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.000117014 2024-04-26T10:35:10.330 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.723663+0000", 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00010753599999999999 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.727862+0000", 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0041994609999999998 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728089+0000", 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.00022692099999999999 2024-04-26T10:35:10.331 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728137+0000", 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.7700000000000001e-05 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728217+0000", 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.0828999999999995e-05 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.332 INFO:teuthology.orchestra.run.smithi186.stdout: "description": "osd_op(client.4538.0:248371 5.a 5:5dd6b787:::benchmark_data_smithi043_45180_object113729:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: "initiated_at": "2024-04-26T10:34:59.766367+0000", 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: "age": 10.448125625999999, 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.96392391399999999, 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: "type_data": { 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: "client_info": { 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: "client": "client.4538", 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: "client_addr": "172.21.15.43:0/55601946", 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: "tid": 248371 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: "events": [ 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "initiated", 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766367+0000", 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.333 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "throttled", 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766367+0000", 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "header_read", 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766366+0000", 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4294967295.9999995 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "all_read", 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766370+0000", 2024-04-26T10:35:10.334 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 4.3660000000000002e-06 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "dispatched", 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766381+0000", 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 1.0314e-05 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "queued_for_pg", 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766403+0000", 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 2.2486000000000001e-05 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766442+0000", 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.8719e-05 2024-04-26T10:35:10.335 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for peered", 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:34:59.766449+0000", 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 7.7100000000000007e-06 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "reached_pg", 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725354+0000", 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.95890452100000001 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "started", 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725444+0000", 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 8.9813000000000002e-05 2024-04-26T10:35:10.336 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "waiting for subops from 2", 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.725505+0000", 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 6.1198000000000006e-05 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "op_commit", 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.728230+0000", 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0027249589999999999 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.730217+0000", 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 0.0019874670000000001 2024-04-26T10:35:10.337 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "commit_sent", 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.730257+0000", 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.9329000000000002e-05 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: "event": "done", 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: "time": "2024-04-26T10:35:00.730290+0000", 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: "duration": 3.3726000000000002e-05 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-26T10:35:10.338 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-26T10:35:10.340 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:10.338+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:10.340 INFO:teuthology.orchestra.run.smithi043.stdout:osd.1: {} 2024-04-26T10:35:10.340 INFO:teuthology.orchestra.run.smithi043.stdout:osd.2: {} 2024-04-26T10:35:10.341 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:35:10.341 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:35:10.342 INFO:teuthology.orchestra.run.smithi043.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T10:35:10.342 INFO:teuthology.orchestra.run.smithi043.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:35:10.342 INFO:teuthology.orchestra.run.smithi043.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:35:10.342 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:35:10.440 INFO:tasks.ceph.osd.2.smithi187.stderr:2024-04-26T10:35:10.438+0000 7f6248498700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 41917) UID: 0 2024-04-26T10:35:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:10.480 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:35:10.542 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:10.539+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:10.642 INFO:tasks.ceph.osd.1.smithi186.stderr:2024-04-26T10:35:10.641+0000 7f728b134700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 41802) UID: 0 2024-04-26T10:35:10.646 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:10.646 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:10.656 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:35:10.695 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'unique_pool_0' removed 2024-04-26T10:35:10.709 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T10:35:10.719 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T10:35:10.819 INFO:teuthology.orchestra.run.smithi187.stdout:ERROR: (22) Invalid argument 2024-04-26T10:35:10.819 INFO:teuthology.orchestra.run.smithi187.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:35:11.698 INFO:tasks.thrashosds.thrasher:reviving osd 2024-04-26T10:35:11.699 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-04-26T10:35:11.699 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T10:35:11.699 INFO:teuthology.orchestra.console.smithi112:Power on 2024-04-26T10:35:11.699 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-26T10:35:11.725 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2024-04-26T10:35:11.725 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:35:11.752 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-04-26T10:35:11.804 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:35:12.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~23s 2024-04-26T10:35:12.703 INFO:teuthology.orchestra.run.smithi043.stderr:noscrub is unset 2024-04-26T10:35:12.717 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:35:13.709 INFO:teuthology.orchestra.run.smithi043.stderr:nodeep-scrub is unset 2024-04-26T10:35:15.754 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:35:15.864 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-04-26T10:35:15.965 INFO:teuthology.orchestra.console.smithi112:Power on completed 2024-04-26T10:35:16.066 DEBUG:teuthology.orchestra.console.smithi112:Waiting for login prompt 2024-04-26T10:35:16.066 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi112 2024-04-26T10:35:18.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~29s 2024-04-26T10:35:23.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-04-26T10:35:29.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~41s 2024-04-26T10:35:35.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~46s 2024-04-26T10:35:41.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~52s 2024-04-26T10:35:47.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~58s 2024-04-26T10:35:53.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~64s 2024-04-26T10:35:58.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2024-04-26T10:36:04.620 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~76s 2024-04-26T10:36:10.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~81s 2024-04-26T10:36:16.234 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~87s 2024-04-26T10:36:22.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~93s 2024-04-26T10:36:27.848 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2024-04-26T10:36:33.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2024-04-26T10:36:39.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~110s 2024-04-26T10:36:45.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~116s 2024-04-26T10:36:51.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~122s 2024-04-26T10:36:56.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~128s 2024-04-26T10:37:02.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~134s 2024-04-26T10:37:08.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~139s 2024-04-26T10:37:10.536 DEBUG:teuthology.orchestra.console.smithi112:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ct enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F CB 69 GUID: 00000000 0000 0000 0000 0CC47AD8A52C DHCP./                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.|  21.15.112 MAS : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.112 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:cb:69)... Configuring (net0 0c:c4:7a:8f:cb:69).... Configuring (net0 0c:c4:7a:8f:cb:69)..... Configuring (net0 0c:c4:7a:8f:cb:69)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (4.18.0-552.el8.x86_64) 8  CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8              The selected entry will be started automatically in 5s.   CentOS Stream (4.18.0-552.el8.x86_64) 8   CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 4.18.0-552.el8.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-21) (GCC)) #1 SMP Sun Apr 7 19:39:51 UTC 2024 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ea3fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f56000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.727 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78ea4 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34b91000-0x365c0fff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078ea3fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29138 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78ea4000-0x78f55fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f56000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228713 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1756624K/33437880K available (14339K kernel code, 5957K rwdata, 8568K rodata, 2820K init, 13792K bss, 935740K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 41053 entries in 161 pages [ 0.000000] ftrace: allocated 161 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013035] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014466] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32724efed25, max_idle_ns: 440795209572 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.45 BogoMIPS (lpj=3499727) [ 0.021001] pid_max: default: 32768 minimum: 301 [ 0.022022] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025020] LSM support for eBPF active [ 0.030407] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033678] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034075] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035071] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.036205] CPU0: Thermal monitoring enabled (TM1) [ 0.037055] process: using mwait in idle threads [ 0.038002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.039000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.040002] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.041001] Spectre V2 : Mitigation: Retpolines [ 0.042000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.044000] Speculative Store Bypass: Vulnerable [ 0.045004] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.046000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.058808] Freeing SMP alternatives memory: 36K [ 0.059187] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.162562] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.164096] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.165001] ... version: 3 [ 0.166000] ... bit width: 48 [ 0.167000] ... generic registers: 4 [ 0.168000] ... value mask: 0000ffffffffffff [ 0.169000] ... max period: 00007fffffffffff [ 0.170000] ... fixed-purpose events: 3 [ 0.171000] ... event mask: 000000070000000f [ 0.172028] rcu: Hierarchical SRCU implementation. [ 0.174051] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.175014] smp: Bringing up secondary CPUs ... [ 0.176068] x86: Booting SMP configuration: [ 0.177001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.180094] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.182000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.183001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.184089] #5 #6 #7 [ 0.185534] smp: Brought up 1 node, 8 CPUs [ 0.187000] smpboot: Max logical packages: 1 [ 0.188001] smpboot: Total of 8 processors activated (55995.63 BogoMIPS) [ 0.223314] node 0 deferred pages initialised in 33ms [ 0.229781] devtmpfs: initialized [ 0.230040] x86/mm: Memory block size: 128MB [ 0.233211] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.241085] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.251007] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.258056] pinctrl core: initialized pinctrl subsystem [ 0.264094] NET: Registered protocol family 16 [ 0.268077] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.275013] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.283009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.291019] audit: initializing netlink subsys (disabled) [ 0.297009] audit: type=2000 audit(1714127802.297:1): state=initialized audit_enabled=0 res=1 [ 0.305002] cpuidle: using governor menu [ 0.309030] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.317001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.323052] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.332001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.339013] PCI: Using configuration type 1 for base access [ 0.346028] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.353002] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.360023] cryptd: max_cpu_qlen set to 1000 [ 0.364046] ACPI: Added _OSI(Module Device) [ 0.368001] ACPI: Added _OSI(Processor Device) [ 0.373007] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.377001] ACPI: Added _OSI(Processor Aggregator Device) [ 0.407621] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.416486] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.426087] ACPI: Dynamic OEM Table Load: [ 0.444428] ACPI: Interpreter enabled [ 0.448010] ACPI: PM: (supports S0 S4 S5) [ 0.452000] ACPI: Using IOAPIC for interrupt routing [ 0.459316] HEST: Enabling Firmware First mode for corrected errors. [ 0.465074] HEST: Table parsing has been initialized. [ 0.470142] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 0.478003] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.487537] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.516637] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.522003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.533332] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.541497] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.549001] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.557030] PCI host bridge to bus 0000:ff [ 0.562001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.567009] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.573044] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.579026] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.585032] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.591033] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.597017] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.603031] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.609030] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.615032] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.621031] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.627031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.633030] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.639031] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.645031] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.651031] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.657026] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.663032] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.669030] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.675030] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.681022] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.687037] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.693060] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.700031] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.706035] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.712044] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.718042] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.724040] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.730033] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.736034] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.742041] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.748042] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.754043] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.760040] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.766032] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.772033] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.778024] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.784035] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.790040] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.796042] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.802042] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.808044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.814038] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.820025] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.826034] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.832036] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.838033] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.844033] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.851032] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.857036] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.863031] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.869031] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.875032] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.881023] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.887025] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.893033] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.900989] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.907002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.917141] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.925265] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.933001] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.941480] PCI host bridge to bus 0000:00 [ 0.946001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.952000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.959000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.967000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.974000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.981000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.989001] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.994023] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 1.000101] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.007042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.013086] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.019041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.025084] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.031024] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.037091] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.043007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.050080] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.056007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.063076] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.069007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.076077] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.082007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.089076] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.095007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.101064] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.108007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.114077] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.120007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.127076] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.133007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.140073] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.146068] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.152084] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.158057] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.164005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.171075] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.177158] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.183011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.188006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.194006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.200007] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.205006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.211006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.217029] pci 0000:00:11.4: PME# supported from D3hot [ 1.222073] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.228014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.235050] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.241089] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.247014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.254030] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.260065] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.266014] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.273051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.279070] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.285013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.291061] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.298070] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.304065] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.310076] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.316067] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.322078] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.328067] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.334081] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.340013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.347073] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.353074] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.359096] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.365010] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.371005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.376005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.382005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.387005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.393005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.399029] pci 0000:00:1f.2: PME# supported from D3hot [ 1.404057] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.410013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.417016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.423128] acpiphp: Slot [1] registered [ 1.427014] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.432114] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.438008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.445015] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.451004] pci 0000:02:00.0: enabling Extended Tags [ 1.456094] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.461003] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.468114] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.474010] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.482004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.487009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.494004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.501035] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.507017] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.515000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.525008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.532000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.542146] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.548009] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.556004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.561010] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.568004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.575033] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.581015] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.589000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.599008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.606001] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.617052] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.622002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.628001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.634002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.642031] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.647061] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.653065] pci 0000:05:00.0: enabling Extended Tags [ 1.658069] pci 0000:05:00.0: supports D1 D2 [ 1.663000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.669087] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.674002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.681002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.687040] pci_bus 0000:06: extended config space not accessible [ 1.693031] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.699022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.706012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.712012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.718081] pci 0000:06:00.0: supports D1 D2 [ 1.722000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.729108] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.734007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.740003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.747085] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.753017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.759018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.764009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.771077] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.777035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.784000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.794021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.802001] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.812094] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.818017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.824018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.830009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.836073] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.842035] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.850000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.860021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.867000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.877156] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.882002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.889002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.895003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.902701] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.909044] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.915032] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.921032] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.927031] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.933000] ACPI: PCI: Interrupt link LNKE disabled [ 1.938030] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.943000] ACPI: PCI: Interrupt link LNKF disabled [ 1.948030] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.954000] ACPI: PCI: Interrupt link LNKG disabled [ 1.959030] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.965000] ACPI: PCI: Interrupt link LNKH disabled [ 1.970210] iommu: Default domain type: Passthrough [ 1.975073] SCSI subsystem initialized [ 1.979017] ACPI: bus type USB registered [ 1.983011] usbcore: registered new interface driver usbfs [ 1.988005] usbcore: registered new interface driver hub [ 1.994006] usbcore: registered new device driver usb [ 1.999018] pps_core: LinuxPPS API ver. 1 registered [ 2.004000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.013003] PTP clock support registered [ 2.017015] EDAC MC: Ver: 3.0.0 [ 2.020108] PCI: Using ACPI for IRQ routing [ 2.029739] NetLabel: Initializing [ 2.033000] NetLabel: domain hash size = 128 [ 2.037000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.043010] NetLabel: unlabeled traffic allowed by default [ 2.049020] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.050000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.063001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.069000] vgaarb: loaded [ 2.072031] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.078001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.086019] clocksource: Switched to clocksource tsc-early [ 2.101571] VFS: Disk quotas dquot_6.6.0 [ 2.105502] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.112434] pnp: PnP ACPI init [ 2.115817] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.121737] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.127653] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.133564] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.139477] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.145388] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.151301] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.157904] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.164509] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.171114] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.177719] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.184325] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.190927] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.197691] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.203608] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.209519] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.215430] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.221341] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.227936] pnp: PnP ACPI: found 5 devices [ 2.237420] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.246322] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.257799] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.265617] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.270577] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.275533] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.282314] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.289875] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.297781] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.305425] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.313418] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.320976] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.328880] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.336526] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.344517] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.352075] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.359979] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.367625] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.375617] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.383175] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.391080] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.398724] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.406715] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.411674] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.417758] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.424535] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.432270] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.437232] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.442194] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.448282] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.455073] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.460290] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.466378] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.473167] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.480905] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.488731] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.496464] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.504290] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.509254] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.515341] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.522125] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.529859] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.538897] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.545066] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.551239] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.558104] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.564968] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.571832] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.578698] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.584955] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.590521] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.596777] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.603989] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.609554] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.615813] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.621376] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.627636] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.633198] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.639458] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.646772] NET: Registered protocol family 2 [ 2.651324] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.660585] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.669448] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.677849] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.685433] TCP: Hash tables configured (established 262144 bind 65536) [ 2.692154] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.699899] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.706911] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.714371] NET: Registered protocol family 1 [ 2.718726] NET: Registered protocol family 44 [ 2.723247] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.746126] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 15312 usecs [ 2.765121] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 11314 usecs [ 2.772526] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.778977] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.787355] Unpacking initramfs... [ 3.060757] Freeing initrd memory: 26816K [ 3.064838] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.071273] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.079191] ACPI: bus type thunderbolt registered [ 3.085484] Initialise system trusted keyrings [ 3.089928] Key type blacklist registered [ 3.093955] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.101931] zbud: loaded [ 3.104777] pstore: using deflate compression [ 3.109315] Platform Keyring initialized [ 3.151557] NET: Registered protocol family 38 [ 3.155998] Key type asymmetric registered [ 3.160095] Asymmetric key parser 'x509' registered [ 3.164966] Running certificate verification selftests [ 3.195299] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.206178] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.213603] io scheduler mq-deadline registered [ 3.218135] io scheduler kyber registered [ 3.222174] io scheduler bfq registered [ 3.226075] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.233283] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.239180] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.245079] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.250945] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.256815] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.262676] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.268543] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.275864] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.284226] ACPI: Power Button [PWRB] [ 3.287911] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.295320] ACPI: Power Button [PWRF] [ 3.300057] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.307564] pstore: Registered erst as persistent store backend [ 3.313574] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.340426] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.368353] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.376007] Non-volatile memory driver v1.3 [ 3.380585] rdac: device handler registered [ 3.384813] hp_sw: device handler registered [ 3.389078] emc: device handler registered [ 3.393209] alua: device handler registered [ 3.397458] libphy: Fixed MDIO Bus: probed [ 3.401686] usbcore: registered new interface driver usbserial_generic [ 3.401823] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.408210] usbserial: USB Serial support registered for generic [ 3.413471] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.419458] i8042: PNP: No PS/2 controller found. [ 3.426831] ehci-pci 0000:00:1d.0: debug port 2 [ 3.431536] mousedev: PS/2 mouse device common for all mice [ 3.439963] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.441692] rtc_cmos 00:00: RTC can wake from S4 [ 3.452045] rtc_cmos 00:00: registered as rtc0 [ 3.454031] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.456495] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.462249] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.478120] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.485329] usb usb1: Product: EHCI Host Controller [ 3.490200] usb usb1: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.496891] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.501569] intel_pstate: Intel P-state driver initializing [ 3.501654] hub 1-0:1.0: USB hub found [ 3.510929] hub 1-0:1.0: 2 ports detected [ 3.515334] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.515527] hid: raw HID events driver (C) Jiri Kosina [ 3.520636] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.525750] usbcore: registered new interface driver usbhid [ 3.534204] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.538686] usbhid: USB HID core driver [ 3.548016] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.548033] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.548079] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 3.548081] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.548105] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.548106] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.548107] usb usb2: Product: xHCI Host Controller [ 3.548108] usb usb2: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.548109] usb usb2: SerialNumber: 0000:00:14.0 [ 3.548201] hub 2-0:1.0: USB hub found [ 3.548225] hub 2-0:1.0: 15 ports detected [ 3.550618] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.550620] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.550621] usb usb3: Product: xHCI Host Controller [ 3.550622] usb usb3: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.550623] usb usb3: SerialNumber: 0000:00:14.0 [ 3.550714] hub 3-0:1.0: USB hub found [ 3.550728] hub 3-0:1.0: 6 ports detected [ 3.551754] drop_monitor: Initializing network drop monitor service [ 3.556961] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 3.562138] Initializing XFRM netlink socket [ 3.569517] ehci-pci 0000:00:1a.0: debug port 2 [ 3.575855] NET: Registered protocol family 10 [ 3.587985] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.591441] Segment Routing with IPv6 [ 3.603036] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.607451] NET: Registered protocol family 17 [ 3.611222] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.615363] mpls_gso: MPLS GSO support [ 3.623560] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.720308] usb usb4: Product: EHCI Host Controller [ 3.725179] usb usb4: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.731889] usb usb4: SerialNumber: 0000:00:1a.0 [ 3.73660] hub 4-0:1.0: USB hub found [ 3.740427] hub 4-0:1.0: 2 ports detected [ 3.740443] microcode: Microcode Update Driver: v2.2. [ 3.744555] resctrl: L3 allocation detected [ 3.753781] resctrl: L3 monitoring detected [ 3.757966] AVX2 version of gcm_enc/dec engaged. [ 3.762578] AES CTR mode by8 optimization enabled [ 3.777581] sched_clock: Marking stable (3777579217, 0)->(5650697277, -1873118060) [ 3.785220] registered taskstats version 1 [ 3.789475] Loading compiled-in X.509 certificates [ 3.794560] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: b8c8c7a1297a11ed2e36e7913cdfd6f59248d125' [ 3.805439] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.817278] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.827898] zswap: loaded using pool lzo/zbud [ 3.832301] page_owner is disabled [ 3.839229] Key type big_key registered [ 3.844782] Key type encrypted registered [ 3.848798] ima: No TPM chip found, activating TPM-bypass! [ 3.850032] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.854277] ima: Allocated hash algorithm: sha256 [ 3.860820] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.865529] ima: No architecture policies found [ 3.876678] evm: Initialising EVM extended attributes: [ 3.881813] evm: security.selinux [ 3.885123] evm: security.ima [ 3.888085] evm: security.capability [ 3.891656] evm: HMAC attrs: 0x1 [ 3.895137] rtc_cmos 00:00: setting system clock to 2024-04-26 10:36:48 UTC (1714127808) [ 3.904315] Freeing unused decrypted memory: 2028K [ 3.909432] Freeing unused kernel image (initmem) memory: 2820K [ 3.921063] Write protecting the kernel read-only data: 26624k [ 3.927257] Freeing unused kernel image (text/rodata gap) memory: 2016K [ 3.934119] Freeing unused kernel image (rodata/data gap) memory: 1672K [ 3.950351] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.984166] systemd[1]: Detected architecture x86-64. [ 3.989215] systemd[1]: Running in initial RAM disk. [ 3.994183] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 3.998228] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.008978] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.016592] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.024766] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.032127] hub 2-12:1.0: USB hub found [ 4.036028] hub 2-12:1.0: 4 ports detected [ 4.040156] hub 1-1:1.0: USB hub found [ 4.043997] hub 1-1:1.0: 8 ports detected Welcome to CentOS Stream 8 dracut-049-224.git20230330.el8 (Initramfs)! [ 4.058125] systemd[1]: Set hostname to . [ 4.094680] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 4.107188] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 4.119150] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 4.127072] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.129353] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.133301] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.141460] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.141561] systemd[1]: Listening on Journal Socket. [ 4.163547] clocksource: Switched to clocksource tsc [ OK [[ 4.168758] hub 4-1:1.0: USB hub found 0m] Listening on[ 4.173767] hub 4-1:1.0: 6 ports detected Journal Socket. [ 4.184082] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 4.195497] systemd[1]: Started Memstrack Anylazing Service. [ OK [[ 4.201233] fuse: init (API version 7.34) 0m] Started Memstrack Anylazing Service. Starting Setup Virtual Console... Starting Create list of required st…ce nodes for the current kernel... Starting Journal Service... [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... [ OK ] Reached target Slices. [ OK ] Reached target Timers. [ OK ] Started Journal Service. [ OK ] Started Load Kernel Modules. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... Startin[ 4.357525] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd g Apply Ker[ OK e Static Device[ OK ] Started Apply Kernel Variables. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File Sy[ 4.470354] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.478785] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.491617] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ 4.5hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.569838] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.582498] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ OK [[ 4.594199] dca service started, version 1.12.1 0m] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth Directory Watch. [[ 4.610257] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [0;32m OK [ 4.619239] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst ] Reached target[ 4.628768] igb: Intel(R) Gigabit Ethernet Network Driver Paths. [[0;3[ 4.634972] igb: Copyright (c) 2007-2014 Intel Corporation. 2m OK ] Re[ 4.643081] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 4.646373] scsi host0: ahci [ 4.649366] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 4.652382] scsi host1: ahci ached target Bas[ 4.658006] ACPI: bus type drm_connector registered [ 4.661060] scsi host2: ahci ic System. [ 4.670130] scsi host3: ahci [ 4.670177] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 34 [ 4.670184] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 [ 4.670189] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 [ 4.670195] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 34 [ 4.670256] nvme nvme0: pci function 0000:02:00.0 [ 4.670784] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.670788] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.672725] nvme nvme0: 8/0/0 default/read/poll queues [ 4.673457] nvme0n1: detected capacity change from 0 to 400088457216 [ 4.699357] scsi host4: ahci [ 4.705606] igb 0000:07:00.0: added PHC on eth0 [ 4.705634] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.705635] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a5:2c [ 4.705711] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.705712] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.761387] igb 0000:07:00.1: added PHC on eth1 [ 4.764444] scsi host5: ahci [ 4.771883] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.772009] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.772014] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.772031] ast 0000:06:00.0: [drm] Using analog VGA [ 4.772040] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.772171] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.776488] scsi host6: ahci [ 4.779276] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a5:2d [ 4.779371] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.786259] scsi host7: ahci [ 4.792681] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.798725] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.802884] scsi host8: ahci [ 4.850049] fbcon: astdrmfb (fb0) is primary device [ 4.850088] scsi host9: ahci [ 4.850119] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 45 [ 4.850122] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 45 [ 4.850124] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 45 [ 4.850126] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 45 [ 4.850128] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 45 [ 4.850129] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 45 [ 4.882957] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.899747] Console: switching to colour frame buffer device 128x48 [ 4.980648] ata3: SATA link down (SStatus 0 SControl 300) [ 4.983849] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 4.988836] ata1: SATA link down (SStatus 0 SControl 300) [ 5.012291] ata2: SATA link down (SStatus 0 SControl 300) [ 5.012322] ata4: SATA link down (SStatus 0 SControl 300) [ 5.156866] ata10: SATA link down (SStatus 0 SControl 300) [ 5.162368] ata9: SATA link down (SStatus 0 SControl 300) [ 5.167772] ata6: SATA link down (SStatus 0 SControl 300) [ 5.173179] ata7: SATA link down (SStatus 0 SControl 300) [ 5.178606] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.184795] ata8: SATA link down (SStatus 0 SControl 300) [ 5.190932] ata5.00: NCQ Send/Recv Log not supported [ 5.195903] ata5.00: ATA-9: M173, SN06, max 59] ata5.00: 195ulti 16: LBA48 NCQ (depth 32), AA [ 5.210717] ata5.00: NCQ Send/Recv Log not supported [ 5.215683] ata5.00: configured for UDMA/133 [ 5.220086] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.233961] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.242890] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.250547] sd 4:0:0:0: [sda] Write Protect is off [ 5.255399] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.279050] sda: sda1 [ 5.281646] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.804366] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.814642] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.823162] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.829336] ixgbe 0000:03:00.0: 0c:c4:7a:8f:cb:68 [ 5.837069] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.843694] libphy: ixgbe-mdio: probed [ 6.003177] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.013451] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.021957] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.029004] ixgbe 0000:03:00.1: 0c:c4:7a:8f:cb:69 [ 6.036709] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.043296] libphy: ixgbe-mdio: probed [ 6.047945] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.059294] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…ddf-553d-41ea-8bce-5708f99a0430... [ OK ] Started File System Check on /dev/d…36ddf-553d-41ea-8bce-5708f99a0430. Mounting /sysroot... [ 6.259133] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Starting Plymouth switch root service... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). Starting Setup Virtual Console... [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. Stopping udev Kernel Device Manager... [ OK ] Stopped target Local File Systems. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Swap. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped Load Kernel Modules. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.680081] printk: systemd: 10 output lines suppressed due to ratelimiting [ 7.288893] SELinux: policy capability network_peer_controls=1 [ 7.294810] SELinux: policy capability open_perms=1 [ 7.299772] SELinux: policy capability extended_socket_class=1 [ 7.305683] SELinux: policy capability always_check_network=0 [ 7.311507] SELinux: policy capability cgroup_seclabel=1 [ 7.316897] SELinux: policy capability nnp_nosuid_transition=1 [ 7.344125] audit: type=1403 audit(1714127811.948:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.345737] systemd[1]: Successfully loaded SELinux policy in 201.242ms. [ 7.437108] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.707ms. [ 7.451174] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.485091] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 8! [ 7.501394] systemd[1]: Set hostname to . [ 8.664497] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.670537] systemd[1]: Stopped Switch Root. [ OK [[ 8.675265] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 8.686824] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 8.697399] systemd[1]: Stopped Journal Service. [ OK [[ 8.703156] systemd[1]: Starting Journal Service... 0m] Stopped Jour[ 8.709008] systemd[1]: Reached target Swap. nal Service. Starting Journal Service... [ OK ] Reached target Swap. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Created slice User and Session Slice. [ OK ] Listening on udev Control Socket. [ OK ] Stopped Plymouth switch root service. Mounting Kernel Debug File System... [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Reached target Slices. Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Process Core Dump Socket. Starting Load Kernel Modules... Mounting Huge Pages File System... [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on udev Kernel Socket. Mounting POSIX Message Queue File System... [ OK ] Listening on initctl Compatibility Named Pipe. Starting udev Coldplug all Devices... [ [ 8.859264] EXT4-fs (sda1): re-mounted. Opts: (null) OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Created slice system-getty.slice. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. Starting Setup Virtual Console... Starting Remount Root and Kernel File Systems... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Create Static Device Nodes in /dev... Starting Load/Save Random Seed... [ OK ] Started udev Coldplug all Devices. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Load/Save Random Seed. [ 9.026835] device-mapper: uevent: version 1.0.3 [ 9.031573] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ 9.469778] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 9.484145] igb 0000:07:00.0: DCA enabled [ 9.488180] igb 0000:07:00.1: DCA enabled [ OK ] Started Import network configuration from in[ 9.496598] IPMI message handler: version 39.2 itramfs. Starting Create Volatile Files and Directories... [ 9.524572] ipmi device interface [ 9.533659] ipmi_si: IPMI System Interface driver [ 9.538386] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 9.544744] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 9.551983] ipmi_si: Adding SMBIOS-specified kcs state machine [ 9.557882] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 9.563967] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 9.572621] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 9.581322] ipmi_si: Adding ACPI-specified kcs state machine [ 9.587040] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 9.608177] power_meter ACPI000D:00: Found ACPI power meter. [ 9.613896] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 9.621351] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 9.622194] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 9.639163] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event activation on device 259:0... [ 9.680009] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 9.709454] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 9.714857] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 9.714859] RAPL PMU: hw unit of domain package 2^-14 Joules [ 9.714860] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 9.747428] iTCO_vendor_support: vendor-support=0 [ 9.754464] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 9.754552] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 9.754885] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ 9.783381] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 9.808240] ipmi_ssif: IPMI SSIF Interface driver [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting RPC Bind... Starting Security Auditing Service... [ OK ] Started LVM event activation on device 259:0. [ 9.998674] RPC: Registered named UNIX socket transport module. [ 10.004593] RPC: Registered udp transport module. [ 10.009298] RPC: Registered tcp transport module. [ 10.013992] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Started RPC Bind. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ 10.057548] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 10.068494] EDAC sbridge: Ver: 1.1.2 [ 10.098585] intel_rapl_common: Found RAPL domain package [ 10.103899] intel_rapl_common: Found RAPL domain dram [ 10.108954] intel_rapl_common: DRAM domain energy unit 15300pj [ 10.153544] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 10.161457] XFS (dm-4): Mounting V4 Filesystem [ 10.169941] XFS (dm-4): Ending clean mount [ OK ] Mounted /var/lib/ceph. [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Authorization Manager... [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... [ OK ] Started Machine Check Exception Logging Daemon. Starting Kernel Samepage Merging... [ OK ] Started irqbalance daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Reached target sshd-keygen.target. Starting Restore /run/initramfs on shutdown... Starting VDO volume services... Starting Login Service... [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting NTP client/server... [ OK ] Started Kernel Samepage Merging. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Login Service. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started NTP client/server. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target [ 12.274100] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready Remote File Systems. Starting Permit User Sessions... [ OK ] Started Authorization Manager. [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Job spooling tools. [ OK ] Started Network Manager Script Dispatcher Service. [ 12.333828] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.341467] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.399838] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.407255] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.449751] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 12.559970] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.567549] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.610621] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 12.719979] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ OK ] Started VDO volume services. [ 12.843166] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 13.039116] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.046968] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting /etc/rc.d/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.112 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' 172.21.15.112 '!=' '' ']' + set -e + '[' -n 172.21.15.112 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.112 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.112 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi112.front.sepia.ceph.com + '[' -n smithi112.front.sepia.ceph.com ']' + hostname smithi112.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi112 + echo smithi112 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.112 smithi112.front.sepia.ceph.com smithi112/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Terminate Plymouth Boot Screen... Starting Hold until boot process finishes up... Starting SETroubleshoot daemon for …cessing new SELinux denial logs... CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-26T10:37:10.537 DEBUG:teuthology.orchestra.console.smithi112:expect after: smithi112 login: 2024-04-26T10:37:10.590 DEBUG:teuthology.orchestra.console.smithi112:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ct enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F CB 69 GUID: 00000000 0000 0000 0000 0CC47AD8A52C DHCP./                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.|  21.15.112 MAS : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.112 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:cb:69)... Configuring (net0 0c:c4:7a:8f:cb:69).... Configuring (net0 0c:c4:7a:8f:cb:69)..... Configuring (net0 0c:c4:7a:8f:cb:69)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (4.18.0-552.el8.x86_64) 8  CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8              The selected entry will be started automatically in 5s.   CentOS Stream (4.18.0-552.el8.x86_64) 8   CentOS Stream (4.18.0-489.el8.x86_64) 8  CentOS Stream (4.18.0-348.el8.x86_64) 8  CentOS Stream (0-rescue-a1b29d6c289747bdb22930598d39874a) 8            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 4.18.0-552.el8.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-21) (GCC)) #1 SMP Sun Apr 7 19:39:51 UTC 2024 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ea3fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f56000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.727 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78ea4 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x34b91000-0x365c0fff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078ea3fff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29138 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78ea4000-0x78f55fff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f56000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228713 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-552.el8.x86_64 root=UUID=c5236ddf-553d-41ea-8bce-5708f99a0430 ro crashkernel=auto console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] software IO TLB: area num 8. [ 0.000000] Memory: 1756624K/33437880K available (14339K kernel code, 5957K rwdata, 8568K rodata, 2820K init, 13792K bss, 935740K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 41053 entries in 161 pages [ 0.000000] ftrace: allocated 161 pages with 3 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20220331 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001003] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005002] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013035] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014466] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32724efed25, max_idle_ns: 440795209572 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.45 BogoMIPS (lpj=3499727) [ 0.021001] pid_max: default: 32768 minimum: 301 [ 0.022022] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024004] SELinux: Initializing. [ 0.025020] LSM support for eBPF active [ 0.030407] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.033678] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.034075] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.035071] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.036205] CPU0: Thermal monitoring enabled (TM1) [ 0.037055] process: using mwait in idle threads [ 0.038002] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.039000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.040002] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.041001] Spectre V2 : Mitigation: Retpolines [ 0.042000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.043000] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 0.044000] Speculative Store Bypass: Vulnerable [ 0.045004] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.046000] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.047000] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.058808] Freeing SMP alternatives memory: 36K [ 0.059187] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.162562] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.164096] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.165001] ... version: 3 [ 0.166000] ... bit width: 48 [ 0.167000] ... generic registers: 4 [ 0.168000] ... value mask: 0000ffffffffffff [ 0.169000] ... max period: 00007fffffffffff [ 0.170000] ... fixed-purpose events: 3 [ 0.171000] ... event mask: 000000070000000f [ 0.172028] rcu: Hierarchical SRCU implementation. [ 0.174051] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.175014] smp: Bringing up secondary CPUs ... [ 0.176068] x86: Booting SMP configuration: [ 0.177001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.180094] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.182000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.183001] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 0.184089] #5 #6 #7 [ 0.185534] smp: Brought up 1 node, 8 CPUs [ 0.187000] smpboot: Max logical packages: 1 [ 0.188001] smpboot: Total of 8 processors activated (55995.63 BogoMIPS) [ 0.223314] node 0 deferred pages initialised in 33ms [ 0.229781] devtmpfs: initialized [ 0.230040] x86/mm: Memory block size: 128MB [ 0.233211] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.241085] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.251007] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.258056] pinctrl core: initialized pinctrl subsystem [ 0.264094] NET: Registered protocol family 16 [ 0.268077] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.275013] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.283009] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.291019] audit: initializing netlink subsys (disabled) [ 0.297009] audit: type=2000 audit(1714127802.297:1): state=initialized audit_enabled=0 res=1 [ 0.305002] cpuidle: using governor menu [ 0.309030] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.317001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.323052] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.332001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.339013] PCI: Using configuration type 1 for base access [ 0.346028] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.353002] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.360023] cryptd: max_cpu_qlen set to 1000 [ 0.364046] ACPI: Added _OSI(Module Device) [ 0.368001] ACPI: Added _OSI(Processor Device) [ 0.373007] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.377001] ACPI: Added _OSI(Processor Aggregator Device) [ 0.407621] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.416486] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.426087] ACPI: Dynamic OEM Table Load: [ 0.444428] ACPI: Interpreter enabled [ 0.448010] ACPI: PM: (supports S0 S4 S5) [ 0.452000] ACPI: Using IOAPIC for interrupt routing [ 0.459316] HEST: Enabling Firmware First mode for corrected errors. [ 0.465074] HEST: Table parsing has been initialized. [ 0.470142] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 0.478003] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.487537] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.516637] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.522003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.533332] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.541497] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.549001] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.557030] PCI host bridge to bus 0000:ff [ 0.562001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.567009] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.573044] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.579026] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.585032] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.591033] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.597017] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.603031] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.609030] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.615032] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.621031] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.627031] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.633030] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.639031] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.645031] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.651031] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.657026] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.663032] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.669030] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.675030] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.681022] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.687037] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.693060] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.700031] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.706035] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.712044] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.718042] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.724040] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.730033] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.736034] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.742041] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.748042] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.754043] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.760040] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.766032] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.772033] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.778024] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.784035] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.790040] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.796042] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.802042] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.808044] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.814038] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.820025] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.826034] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.832036] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.838033] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.844033] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.851032] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.857036] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.863031] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.869031] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.875032] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.881023] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.887025] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.893033] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.900989] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.907002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.917141] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.925265] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.933001] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.941480] PCI host bridge to bus 0000:00 [ 0.946001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.952000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.959000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.967000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.974000] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.981000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.989001] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.994023] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 1.000101] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 1.007042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.013086] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 1.019041] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.025084] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 1.031024] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.037091] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 1.043007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.050080] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 1.056007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 1.063076] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 1.069007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 1.076077] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 1.082007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 1.089076] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 1.095007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.101064] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 1.108007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 1.114077] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 1.120007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 1.127076] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 1.133007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 1.140073] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 1.146068] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 1.152084] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 1.158057] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 1.164005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 1.171075] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 1.177158] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 1.183011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 1.188006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 1.194006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 1.200007] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 1.205006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 1.211006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 1.217029] pci 0000:00:11.4: PME# supported from D3hot [ 1.222073] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 1.228014] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 1.235050] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.241089] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 1.247014] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 1.254030] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.260065] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 1.266014] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 1.273051] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.279070] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 1.285013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 1.291061] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.298070] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 1.304065] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.310076] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 1.316067] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.322078] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 1.328067] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.334081] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 1.340013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 1.347073] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.353074] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 1.359096] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 1.365010] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 1.371005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 1.376005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 1.382005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 1.387005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 1.393005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 1.399029] pci 0000:00:1f.2: PME# supported from D3hot [ 1.404057] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 1.410013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 1.417016] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 1.423128] acpiphp: Slot [1] registered [ 1.427014] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.432114] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 1.438008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 1.445015] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 1.451004] pci 0000:02:00.0: enabling Extended Tags [ 1.456094] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.461003] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.468114] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 1.474010] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.482004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 1.487009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.494004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 1.501035] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.507017] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.515000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.525008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.532000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.542146] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 1.548009] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.556004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 1.561010] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.568004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 1.575033] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.581015] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.589000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 1.599008] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.606001] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 1.617052] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.622002] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.628001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.634002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.642031] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.647061] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 1.653065] pci 0000:05:00.0: enabling Extended Tags [ 1.658069] pci 0000:05:00.0: supports D1 D2 [ 1.663000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.669087] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.674002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.681002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.687040] pci_bus 0000:06: extended config space not accessible [ 1.693031] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 1.699022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 1.706012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 1.712012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 1.718081] pci 0000:06:00.0: supports D1 D2 [ 1.722000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.729108] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.734007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.740003] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.747085] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 1.753017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 1.759018] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 1.764009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 1.771077] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.777035] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.784000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.794021] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.802001] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.812094] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 1.818017] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 1.824018] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 1.830009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 1.836073] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.842035] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 1.850000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 1.860021] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 1.867000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 1.877156] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.882002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.889002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.895003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.902701] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.909044] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.915032] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.921032] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.927031] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.933000] ACPI: PCI: Interrupt link LNKE disabled [ 1.938030] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.943000] ACPI: PCI: Interrupt link LNKF disabled [ 1.948030] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.954000] ACPI: PCI: Interrupt link LNKG disabled [ 1.959030] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.965000] ACPI: PCI: Interrupt link LNKH disabled [ 1.970210] iommu: Default domain type: Passthrough [ 1.975073] SCSI subsystem initialized [ 1.979017] ACPI: bus type USB registered [ 1.983011] usbcore: registered new interface driver usbfs [ 1.988005] usbcore: registered new interface driver hub [ 1.994006] usbcore: registered new device driver usb [ 1.999018] pps_core: LinuxPPS API ver. 1 registered [ 2.004000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.013003] PTP clock support registered [ 2.017015] EDAC MC: Ver: 3.0.0 [ 2.020108] PCI: Using ACPI for IRQ routing [ 2.029739] NetLabel: Initializing [ 2.033000] NetLabel: domain hash size = 128 [ 2.037000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.043010] NetLabel: unlabeled traffic allowed by default [ 2.049020] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.050000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.063001] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.069000] vgaarb: loaded [ 2.072031] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.078001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.086019] clocksource: Switched to clocksource tsc-early [ 2.101571] VFS: Disk quotas dquot_6.6.0 [ 2.105502] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.112434] pnp: PnP ACPI init [ 2.115817] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.121737] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.127653] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.133564] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.139477] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.145388] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.151301] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.157904] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.164509] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.171114] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.177719] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.184325] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.190927] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.197691] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.203608] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.209519] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.215430] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.221341] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.227936] pnp: PnP ACPI: found 5 devices [ 2.237420] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 2.246322] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 2.257799] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 2.265617] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.270577] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.275533] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.282314] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.289875] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.297781] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.305425] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.313418] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.320976] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.328880] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.336526] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.344517] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.352075] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.359979] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.367625] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.375617] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 2.383175] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 2.391080] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 2.398724] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 2.406715] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.411674] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.417758] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.424535] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.432270] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.437232] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.442194] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.448282] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.455073] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.460290] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.466378] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.473167] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 2.480905] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 2.488731] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 2.496464] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 2.504290] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.509254] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.515341] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.522125] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 2.529859] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 2.538897] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 2.545066] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 2.551239] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.558104] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 2.564968] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 2.571832] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 2.578698] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 2.584955] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 2.590521] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 2.596777] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.603989] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 2.609554] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.615813] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 2.621376] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 2.627636] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 2.633198] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 2.639458] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 2.646772] NET: Registered protocol family 2 [ 2.651324] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.660585] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 2.669448] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 2.677849] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 2.685433] TCP: Hash tables configured (established 262144 bind 65536) [ 2.692154] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 2.699899] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.706911] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 2.714371] NET: Registered protocol family 1 [ 2.718726] NET: Registered protocol family 44 [ 2.723247] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 2.746126] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x627 took 15312 usecs [ 2.765121] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x627 took 11314 usecs [ 2.772526] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 2.778977] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.787355] Unpacking initramfs... [ 3.060757] Freeing initrd memory: 26816K [ 3.064838] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.071273] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 3.079191] ACPI: bus type thunderbolt registered [ 3.085484] Initialise system trusted keyrings [ 3.089928] Key type blacklist registered [ 3.093955] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.101931] zbud: loaded [ 3.104777] pstore: using deflate compression [ 3.109315] Platform Keyring initialized [ 3.151557] NET: Registered protocol family 38 [ 3.155998] Key type asymmetric registered [ 3.160095] Asymmetric key parser 'x509' registered [ 3.164966] Running certificate verification selftests [ 3.195299] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 3.206178] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 3.213603] io scheduler mq-deadline registered [ 3.218135] io scheduler kyber registered [ 3.222174] io scheduler bfq registered [ 3.226075] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 3.233283] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.239180] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.245079] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.250945] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.256815] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.262676] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.268543] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.275864] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.284226] ACPI: Power Button [PWRB] [ 3.287911] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.295320] ACPI: Power Button [PWRF] [ 3.300057] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.307564] pstore: Registered erst as persistent store backend [ 3.313574] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 3.340426] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.368353] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.376007] Non-volatile memory driver v1.3 [ 3.380585] rdac: device handler registered [ 3.384813] hp_sw: device handler registered [ 3.389078] emc: device handler registered [ 3.393209] alua: device handler registered [ 3.397458] libphy: Fixed MDIO Bus: probed [ 3.401686] usbcore: registered new interface driver usbserial_generic [ 3.401823] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.408210] usbserial: USB Serial support registered for generic [ 3.413471] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 3.419458] i8042: PNP: No PS/2 controller found. [ 3.426831] ehci-pci 0000:00:1d.0: debug port 2 [ 3.431536] mousedev: PS/2 mouse device common for all mice [ 3.439963] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.441692] rtc_cmos 00:00: RTC can wake from S4 [ 3.452045] rtc_cmos 00:00: registered as rtc0 [ 3.454031] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.456495] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 3.462249] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.478120] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.485329] usb usb1: Product: EHCI Host Controller [ 3.490200] usb usb1: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.496891] usb usb1: SerialNumber: 0000:00:1d.0 [ 3.501569] intel_pstate: Intel P-state driver initializing [ 3.501654] hub 1-0:1.0: USB hub found [ 3.510929] hub 1-0:1.0: 2 ports detected [ 3.515334] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.515527] hid: raw HID events driver (C) Jiri Kosina [ 3.520636] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 3.525750] usbcore: registered new interface driver usbhid [ 3.534204] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 3.538686] usbhid: USB HID core driver [ 3.548016] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.548033] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 3.548079] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 3.548081] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 3.548105] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.548106] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.548107] usb usb2: Product: xHCI Host Controller [ 3.548108] usb usb2: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.548109] usb usb2: SerialNumber: 0000:00:14.0 [ 3.548201] hub 2-0:1.0: USB hub found [ 3.548225] hub 2-0:1.0: 15 ports detected [ 3.550618] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 3.550620] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.550621] usb usb3: Product: xHCI Host Controller [ 3.550622] usb usb3: Manufacturer: Linux 4.18.0-552.el8.x86_64 xhci-hcd [ 3.550623] usb usb3: SerialNumber: 0000:00:14.0 [ 3.550714] hub 3-0:1.0: USB hub found [ 3.550728] hub 3-0:1.0: 6 ports detected [ 3.551754] drop_monitor: Initializing network drop monitor service [ 3.556961] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 3.562138] Initializing XFRM netlink socket [ 3.569517] ehci-pci 0000:00:1a.0: debug port 2 [ 3.575855] NET: Registered protocol family 10 [ 3.587985] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.591441] Segment Routing with IPv6 [ 3.603036] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.607451] NET: Registered protocol family 17 [ 3.611222] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 3.615363] mpls_gso: MPLS GSO support [ 3.623560] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.720308] usb usb4: Product: EHCI Host Controller [ 3.725179] usb usb4: Manufacturer: Linux 4.18.0-552.el8.x86_64 ehci_hcd [ 3.731889] usb usb4: SerialNumber: 0000:00:1a.0 [ 3.73660] hub 4-0:1.0: USB hub found [ 3.740427] hub 4-0:1.0: 2 ports detected [ 3.740443] microcode: Microcode Update Driver: v2.2. [ 3.744555] resctrl: L3 allocation detected [ 3.753781] resctrl: L3 monitoring detected [ 3.757966] AVX2 version of gcm_enc/dec engaged. [ 3.762578] AES CTR mode by8 optimization enabled [ 3.777581] sched_clock: Marking stable (3777579217, 0)->(5650697277, -1873118060) [ 3.785220] registered taskstats version 1 [ 3.789475] Loading compiled-in X.509 certificates [ 3.794560] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: b8c8c7a1297a11ed2e36e7913cdfd6f59248d125' [ 3.805439] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 3.817278] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 3.827898] zswap: loaded using pool lzo/zbud [ 3.832301] page_owner is disabled [ 3.839229] Key type big_key registered [ 3.844782] Key type encrypted registered [ 3.848798] ima: No TPM chip found, activating TPM-bypass! [ 3.850032] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 3.854277] ima: Allocated hash algorithm: sha256 [ 3.860820] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 3.865529] ima: No architecture policies found [ 3.876678] evm: Initialising EVM extended attributes: [ 3.881813] evm: security.selinux [ 3.885123] evm: security.ima [ 3.888085] evm: security.capability [ 3.891656] evm: HMAC attrs: 0x1 [ 3.895137] rtc_cmos 00:00: setting system clock to 2024-04-26 10:36:48 UTC (1714127808) [ 3.904315] Freeing unused decrypted memory: 2028K [ 3.909432] Freeing unused kernel image (initmem) memory: 2820K [ 3.921063] Write protecting the kernel read-only data: 26624k [ 3.927257] Freeing unused kernel image (text/rodata gap) memory: 2016K [ 3.934119] Freeing unused kernel image (rodata/data gap) memory: 1672K [ 3.950351] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 3.984166] systemd[1]: Detected architecture x86-64. [ 3.989215] systemd[1]: Running in initial RAM disk. [ 3.994183] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 3.998228] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 4.008978] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.016592] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.024766] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.032127] hub 2-12:1.0: USB hub found [ 4.036028] hub 2-12:1.0: 4 ports detected [ 4.040156] hub 1-1:1.0: USB hub found [ 4.043997] hub 1-1:1.0: 8 ports detected Welcome to CentOS Stream 8 dracut-049-224.git20230330.el8 (Initramfs)! [ 4.058125] systemd[1]: Set hostname to . [ 4.094680] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 4.107188] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 4.119150] systemd[1]: Reached target Swap. [ OK ] Reached target Swap. [ 4.127072] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.129353] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.133301] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.141460] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.141561] systemd[1]: Listening on Journal Socket. [ 4.163547] clocksource: Switched to clocksource tsc [ OK [[ 4.168758] hub 4-1:1.0: USB hub found 0m] Listening on[ 4.173767] hub 4-1:1.0: 6 ports detected Journal Socket. [ 4.184082] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 4.195497] systemd[1]: Started Memstrack Anylazing Service. [ OK [[ 4.201233] fuse: init (API version 7.34) 0m] Started Memstrack Anylazing Service. Starting Setup Virtual Console... Starting Create list of required st…ce nodes for the current kernel... Starting Journal Service... [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Local File Systems. Starting Create Volatile Files and Directories... [ OK ] Reached target Slices. [ OK ] Reached target Timers. [ OK ] Started Journal Service. [ OK ] Started Load Kernel Modules. [ OK ] Started Setup Virtual Console. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Create Volatile Files and Directories. Starting Create Static Device Nodes in /dev... Starting dracut cmdline hook... Startin[ 4.357525] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd g Apply Ker[ OK e Static Device[ OK ] Started Apply Kernel Variables. [ OK ] Started dracut cmdline hook. Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File Sy[ 4.470354] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 4.478785] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.491617] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ OK ] Started udev Coldplug all Devices. [ OK ] Reached target System Initialization. Starting dracut initqueue hook... Starting Show Plymouth Boot Screen... [ 4.5hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 4.569838] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 4.582498] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ OK [[ 4.594199] dca service started, version 1.12.1 0m] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password Requests to Plymouth Directory Watch. [[ 4.610257] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [0;32m OK [ 4.619239] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst ] Reached target[ 4.628768] igb: Intel(R) Gigabit Ethernet Network Driver Paths. [[0;3[ 4.634972] igb: Copyright (c) 2007-2014 Intel Corporation. 2m OK ] Re[ 4.643081] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 4.646373] scsi host0: ahci [ 4.649366] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 4.652382] scsi host1: ahci ached target Bas[ 4.658006] ACPI: bus type drm_connector registered [ 4.661060] scsi host2: ahci ic System. [ 4.670130] scsi host3: ahci [ 4.670177] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 34 [ 4.670184] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 [ 4.670189] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 [ 4.670195] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 34 [ 4.670256] nvme nvme0: pci function 0000:02:00.0 [ 4.670784] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 4.670788] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.672725] nvme nvme0: 8/0/0 default/read/poll queues [ 4.673457] nvme0n1: detected capacity change from 0 to 400088457216 [ 4.699357] scsi host4: ahci [ 4.705606] igb 0000:07:00.0: added PHC on eth0 [ 4.705634] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 4.705635] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a5:2c [ 4.705711] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 4.705712] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.761387] igb 0000:07:00.1: added PHC on eth1 [ 4.764444] scsi host5: ahci [ 4.771883] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 4.772009] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 4.772014] ast 0000:06:00.0: [drm] AST 2400 detected [ 4.772031] ast 0000:06:00.0: [drm] Using analog VGA [ 4.772040] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 4.772171] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 4.776488] scsi host6: ahci [ 4.779276] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a5:2d [ 4.779371] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 4.786259] scsi host7: ahci [ 4.792681] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 4.798725] igb 0000:07:00.1 eno2: renamed from eth1 [ 4.802884] scsi host8: ahci [ 4.850049] fbcon: astdrmfb (fb0) is primary device [ 4.850088] scsi host9: ahci [ 4.850119] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 45 [ 4.850122] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 45 [ 4.850124] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 45 [ 4.850126] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 45 [ 4.850128] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 45 [ 4.850129] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 45 [ 4.882957] igb 0000:07:00.0 eno1: renamed from eth0 [ 4.899747] Console: switching to colour frame buffer device 128x48 [ 4.980648] ata3: SATA link down (SStatus 0 SControl 300) [ 4.983849] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 4.988836] ata1: SATA link down (SStatus 0 SControl 300) [ 5.012291] ata2: SATA link down (SStatus 0 SControl 300) [ 5.012322] ata4: SATA link down (SStatus 0 SControl 300) [ 5.156866] ata10: SATA link down (SStatus 0 SControl 300) [ 5.162368] ata9: SATA link down (SStatus 0 SControl 300) [ 5.167772] ata6: SATA link down (SStatus 0 SControl 300) [ 5.173179] ata7: SATA link down (SStatus 0 SControl 300) [ 5.178606] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.184795] ata8: SATA link down (SStatus 0 SControl 300) [ 5.190932] ata5.00: NCQ Send/Recv Log not supported [ 5.195903] ata5.00: ATA-9: M173, SN06, max 59] ata5.00: 195ulti 16: LBA48 NCQ (depth 32), AA [ 5.210717] ata5.00: NCQ Send/Recv Log not supported [ 5.215683] ata5.00: configured for UDMA/133 [ 5.220086] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.233961] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.242890] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.250547] sd 4:0:0:0: [sda] Write Protect is off [ 5.255399] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.279050] sda: sda1 [ 5.281646] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 5.804366] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 5.814642] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 5.823162] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 5.829336] ixgbe 0000:03:00.0: 0c:c4:7a:8f:cb:68 [ 5.837069] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 5.843694] libphy: ixgbe-mdio: probed [ 6.003177] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.013451] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.021957] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.029004] ixgbe 0000:03:00.1: 0c:c4:7a:8f:cb:69 [ 6.036709] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.043296] libphy: ixgbe-mdio: probed [ 6.047945] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 6.059294] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…ddf-553d-41ea-8bce-5708f99a0430... [ OK ] Started File System Check on /dev/d…36ddf-553d-41ea-8bce-5708f99a0430. Mounting /sysroot... [ 6.259133] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... Starting Plymouth switch root service... [ OK ] Stopped target Timers. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). Starting Setup Virtual Console... [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target System Initialization. [ OK ] Stopped Create Volatile Files and Directories. Stopping udev Kernel Device Manager... [ OK ] Stopped target Local File Systems. [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Swap. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped udev Coldplug all Devices. [ OK ] Stopped Load Kernel Modules. [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 6.680081] printk: systemd: 10 output lines suppressed due to ratelimiting [ 7.288893] SELinux: policy capability network_peer_controls=1 [ 7.294810] SELinux: policy capability open_perms=1 [ 7.299772] SELinux: policy capability extended_socket_class=1 [ 7.305683] SELinux: policy capability always_check_network=0 [ 7.311507] SELinux: policy capability cgroup_seclabel=1 [ 7.316897] SELinux: policy capability nnp_nosuid_transition=1 [ 7.344125] audit: type=1403 audit(1714127811.948:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 7.345737] systemd[1]: Successfully loaded SELinux policy in 201.242ms. [ 7.437108] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.707ms. [ 7.451174] systemd[1]: systemd 239 (239-75.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 7.485091] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 8! [ 7.501394] systemd[1]: Set hostname to . [ 8.664497] systemd[1]: initrd-switch-root.service: Succeeded. [ 8.670537] systemd[1]: Stopped Switch Root. [ OK [[ 8.675265] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 8.686824] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 8.697399] systemd[1]: Stopped Journal Service. [ OK [[ 8.703156] systemd[1]: Starting Journal Service... 0m] Stopped Jour[ 8.709008] systemd[1]: Reached target Swap. nal Service. Starting Journal Service... [ OK ] Reached target Swap. [ OK ] Created slice system-sshd\x2dkeygen.slice. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Created slice User and Session Slice. [ OK ] Listening on udev Control Socket. [ OK ] Stopped Plymouth switch root service. Mounting Kernel Debug File System... [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Reached target Slices. Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Process Core Dump Socket. Starting Load Kernel Modules... Mounting Huge Pages File System... [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Created slice system-serial\x2dgetty.slice. [ OK ] Listening on udev Kernel Socket. Mounting POSIX Message Queue File System... [ OK ] Listening on initctl Compatibility Named Pipe. Starting udev Coldplug all Devices... [ [ 8.859264] EXT4-fs (sda1): re-mounted. Opts: (null) OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. [ OK ] Created slice system-getty.slice. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd Root File System. [ OK ] Stopped target Initrd File Systems. Starting Setup Virtual Console... Starting Remount Root and Kernel File Systems... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at once. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Remount Root and Kernel File Systems. Starting Flush Journal to Persistent Storage... Starting Create Static Device Nodes in /dev... Starting Load/Save Random Seed... [ OK ] Started udev Coldplug all Devices. [ OK ] Started Flush Journal to Persistent Storage. [ OK ] Started Load/Save Random Seed. [ 9.026835] device-mapper: uevent: version 1.0.3 [ 9.031573] device-mapper: ioctl: 4.46.0-ioctl (2022-02-22) initialised: dm-devel@redhat.com [ OK ] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ 9.469778] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 9.484145] igb 0000:07:00.0: DCA enabled [ 9.488180] igb 0000:07:00.1: DCA enabled [ OK ] Started Import network configuration from in[ 9.496598] IPMI message handler: version 39.2 itramfs. Starting Create Volatile Files and Directories... [ 9.524572] ipmi device interface [ 9.533659] ipmi_si: IPMI System Interface driver [ 9.538386] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 9.544744] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 9.551983] ipmi_si: Adding SMBIOS-specified kcs state machine [ 9.557882] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 9.563967] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 9.572621] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 9.581322] ipmi_si: Adding ACPI-specified kcs state machine [ 9.587040] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 9.608177] power_meter ACPI000D:00: Found ACPI power meter. [ 9.613896] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 9.621351] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 9.622194] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 9.639163] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event activation on device 259:0... [ 9.680009] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 9.709454] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 9.714857] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 9.714859] RAPL PMU: hw unit of domain package 2^-14 Joules [ 9.714860] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 9.747428] iTCO_vendor_support: vendor-support=0 [ 9.754464] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 9.754552] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 9.754885] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) [ 9.783381] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 9.808240] ipmi_ssif: IPMI SSIF Interface driver [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started Create Volatile Files and Directories. Mounting RPC Pipe File System... Starting RPC Bind... Starting Security Auditing Service... [ OK ] Started LVM event activation on device 259:0. [ 9.998674] RPC: Registered named UNIX socket transport module. [ 10.004593] RPC: Registered udp transport module. [ 10.009298] RPC: Registered tcp transport module. [ 10.013992] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Started RPC Bind. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ 10.057548] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 10.068494] EDAC sbridge: Ver: 1.1.2 [ 10.098585] intel_rapl_common: Found RAPL domain package [ 10.103899] intel_rapl_common: Found RAPL domain dram [ 10.108954] intel_rapl_common: DRAM domain energy unit 15300pj [ 10.153544] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 10.161457] XFS (dm-4): Mounting V4 Filesystem [ 10.169941] XFS (dm-4): Ending clean mount [ OK ] Mounted /var/lib/ceph. [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting Authorization Manager... [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... [ OK ] Started Machine Check Exception Logging Daemon. Starting Kernel Samepage Merging... [ OK ] Started irqbalance daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Reached target sshd-keygen.target. Starting Restore /run/initramfs on shutdown... Starting VDO volume services... Starting Login Service... [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timers. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... Starting NTP client/server... [ OK ] Started Kernel Samepage Merging. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Login Service. [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started NTP client/server. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... Starting GSSAPI Proxy Daemon... Starting Hostname Service... [ OK ] Started OpenSSH server daemon. [ OK ] Started Hostname Service. Starting Network Manager Script Dispatcher Service... [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target [ 12.274100] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready Remote File Systems. Starting Permit User Sessions... [ OK ] Started Authorization Manager. [ OK ] Started Permit User Sessions. [ OK ] Started Command Scheduler. [ OK ] Started Job spooling tools. [ OK ] Started Network Manager Script Dispatcher Service. [ 12.333828] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 12.341467] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.399838] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 12.407255] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.449751] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 12.559970] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 12.567549] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 12.610621] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 12.719979] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ OK ] Started VDO volume services. [ 12.843166] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ 13.039116] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 13.046968] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting /etc/rc.d/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting System Logging Service... Starting Notify NFS peers of a restart... Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.112 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' 172.21.15.112 '!=' '' ']' + set -e + '[' -n 172.21.15.112 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.112 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.112 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi112.front.sepia.ceph.com + '[' -n smithi112.front.sepia.ceph.com ']' + hostname smithi112.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi112 + echo smithi112 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.112 smithi112.front.sepia.ceph.com smithi112/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Terminate Plymouth Boot Screen... Starting Hold until boot process finishes up... Starting SETroubleshoot daemon for …cessing new SELinux denial logs... CentOS Stream 8 Kernel 4.18.0-552.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi112 login: [disconnect] 2024-04-26T10:37:10.692 INFO:teuthology.misc:Re-opening connections... 2024-04-26T10:37:10.692 INFO:teuthology.misc:trying to connect to ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T10:37:10.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T10:37:10.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:37:11.220 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-04-26T10:37:11.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-26T10:37:11.910 DEBUG:teuthology.misc:waited 1.218315839767456 2024-04-26T10:37:12.911 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T10:37:12.911 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi112.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-04-26T10:37:12.911 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T10:37:13.015 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:37:13.056 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T10:37:13.056 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T10:37:13.099 INFO:tasks.ceph.osd.0:Started 2024-04-26T10:37:13.100 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:37:13.240 INFO:teuthology.orchestra.run.smithi112.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-26T10:37:13.242 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T10:37:13.243 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-26T10:37:13.972 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:37:13.970+0000 7fd16c194800 -1 Falling back to public interface 2024-04-26T10:37:14.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-26T10:37:18.244 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:37:18.368 INFO:teuthology.orchestra.run.smithi112.stderr:no valid command found; 10 closest matches: 2024-04-26T10:37:18.368 INFO:teuthology.orchestra.run.smithi112.stderr:0 2024-04-26T10:37:18.368 INFO:teuthology.orchestra.run.smithi112.stderr:1 2024-04-26T10:37:18.368 INFO:teuthology.orchestra.run.smithi112.stderr:2 2024-04-26T10:37:18.368 INFO:teuthology.orchestra.run.smithi112.stderr:abort 2024-04-26T10:37:18.368 INFO:teuthology.orchestra.run.smithi112.stderr:assert 2024-04-26T10:37:18.368 INFO:teuthology.orchestra.run.smithi112.stderr:bluefs debug_inject_read_zeros 2024-04-26T10:37:18.368 INFO:teuthology.orchestra.run.smithi112.stderr:bluefs files list 2024-04-26T10:37:18.368 INFO:teuthology.orchestra.run.smithi112.stderr:bluefs stats 2024-04-26T10:37:18.369 INFO:teuthology.orchestra.run.smithi112.stderr:bluestore allocator dump block 2024-04-26T10:37:18.369 INFO:teuthology.orchestra.run.smithi112.stderr:bluestore allocator fragmentation block 2024-04-26T10:37:18.369 INFO:teuthology.orchestra.run.smithi112.stderr:admin_socket: invalid command 2024-04-26T10:37:18.370 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T10:37:18.371 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-26T10:37:20.984 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:37:20.982+0000 7fd16c194800 -1 osd.0 58 log_to_monitors true 2024-04-26T10:37:21.263 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-04-26T10:37:21.262+0000 7fd15810f700 -1 osd.0 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T10:37:23.372 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:37:23.500 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-04-26T10:37:23.500 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-04-26T10:37:23.500 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-04-26T10:37:23.500 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-04-26T10:37:23.514 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T10:37:23.667 INFO:teuthology.orchestra.run.smithi043.stdout:mon.a: {} 2024-04-26T10:37:23.677 INFO:teuthology.orchestra.run.smithi043.stdout:mon.b: {} 2024-04-26T10:37:23.686 INFO:teuthology.orchestra.run.smithi043.stdout:mon.c: {} 2024-04-26T10:37:23.687 INFO:teuthology.orchestra.run.smithi043.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:37:23.688 INFO:teuthology.orchestra.run.smithi043.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:37:23.688 INFO:teuthology.orchestra.run.smithi043.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:37:23.699 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T10:37:24.265 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T10:37:24.278 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T10:37:25.272 INFO:teuthology.orchestra.run.smithi043.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T10:37:25.286 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T10:37:26.278 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T10:37:26.292 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T10:37:27.283 INFO:teuthology.orchestra.run.smithi043.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T10:37:27.297 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T10:37:28.285 INFO:teuthology.orchestra.run.smithi043.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T10:37:28.298 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T10:37:29.289 INFO:teuthology.orchestra.run.smithi043.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T10:37:29.303 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T10:37:29.303 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T10:37:29.303 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T10:37:29.303 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T10:37:29.303 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T10:37:29.304 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:37:29.652 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:37:29.652 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":82,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:37:29.279779+0000","last_up_change":"2024-04-26T10:37:22.247952+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:32:49.859710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:32:50.968196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":58,"up_from":75,"up_thru":75,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":6175},{"type":"v1","addr":"172.21.15.112:6801","nonce":6175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":6175},{"type":"v1","addr":"172.21.15.112:6803","nonce":6175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":6175},{"type":"v1","addr":"172.21.15.112:6807","nonce":6175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":6175},{"type":"v1","addr":"172.21.15.112:6805","nonce":6175}]},"public_addr":"172.21.15.112:6801/6175","cluster_addr":"172.21.15.112:6803/6175","heartbeat_back_addr":"172.21.15.112:6807/6175","heartbeat_front_addr":"172.21.15.112:6805/6175","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":58},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:37:29.667 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T10:37:29.667 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:37:30.006 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:37:30.006 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":82,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:37:29.279779+0000","last_up_change":"2024-04-26T10:37:22.247952+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:32:49.859710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:32:50.968196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":58,"up_from":75,"up_thru":75,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":6175},{"type":"v1","addr":"172.21.15.112:6801","nonce":6175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":6175},{"type":"v1","addr":"172.21.15.112:6803","nonce":6175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":6175},{"type":"v1","addr":"172.21.15.112:6807","nonce":6175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":6175},{"type":"v1","addr":"172.21.15.112:6805","nonce":6175}]},"public_addr":"172.21.15.112:6801/6175","cluster_addr":"172.21.15.112:6803/6175","heartbeat_back_addr":"172.21.15.112:6807/6175","heartbeat_front_addr":"172.21.15.112:6805/6175","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":58},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:37:30.021 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T10:37:30.021 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T10:37:30.022 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T10:37:30.195 INFO:teuthology.orchestra.run.smithi043.stdout:34359738429 2024-04-26T10:37:30.196 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T10:37:30.197 INFO:teuthology.orchestra.run.smithi043.stdout:34359738428 2024-04-26T10:37:30.197 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T10:37:30.199 INFO:teuthology.orchestra.run.smithi043.stdout:322122547203 2024-04-26T10:37:30.199 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T10:37:30.553 INFO:teuthology.orchestra.run.smithi043.stdout:34359738427 2024-04-26T10:37:30.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738427 for osd.2 2024-04-26T10:37:30.586 INFO:teuthology.orchestra.run.smithi043.stdout:322122547202 2024-04-26T10:37:30.589 INFO:teuthology.orchestra.run.smithi043.stdout:34359738426 2024-04-26T10:37:30.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 322122547203 got 322122547202 for osd.0 2024-04-26T10:37:30.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738428 got 34359738426 for osd.1 2024-04-26T10:37:31.568 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T10:37:31.602 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T10:37:31.606 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T10:37:31.944 INFO:teuthology.orchestra.run.smithi043.stdout:34359738429 2024-04-26T10:37:31.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738429 for osd.2 2024-04-26T10:37:31.958 DEBUG:teuthology.parallel:result is None 2024-04-26T10:37:31.973 INFO:teuthology.orchestra.run.smithi043.stdout:34359738428 2024-04-26T10:37:31.980 INFO:teuthology.orchestra.run.smithi043.stdout:322122547203 2024-04-26T10:37:31.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738428 got 34359738428 for osd.1 2024-04-26T10:37:31.989 DEBUG:teuthology.parallel:result is None 2024-04-26T10:37:31.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 322122547203 got 322122547203 for osd.0 2024-04-26T10:37:31.996 DEBUG:teuthology.parallel:result is None 2024-04-26T10:37:31.996 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T10:37:31.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:37:32.381 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:37:32.384 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:37:32.393 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-04-26T10:37:31.058160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":592134,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":651228,"kb_used_data":3876,"kb_used_omap":10,"kb_used_meta":647285,"kb_avail":282464292,"statfs":{"total":289910292480,"available":289243435008,"internally_reserved":0,"allocated":3969024,"data_stored":2255848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10299,"internal_metadata":662820805},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.788044"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280471+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:37:27.280471+0000","last_peered":"2024-04-26T10:37:27.280471+0000","last_clean":"2024-04-26T10:37:27.280471+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:37:27.280471+0000","last_undegraded":"2024-04-26T10:37:27.280471+0000","last_fullsized":"2024-04-26T10:37:27.280471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:26.964955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280495+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:37:27.280495+0000","last_peered":"2024-04-26T10:37:27.280495+0000","last_clean":"2024-04-26T10:37:27.280495+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:37:27.280495+0000","last_undegraded":"2024-04-26T10:37:27.280495+0000","last_fullsized":"2024-04-26T10:37:27.280495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278894+0000","last_change":"2024-04-26T10:37:23.274531+0000","last_active":"2024-04-26T10:37:28.278894+0000","last_peered":"2024-04-26T10:37:28.278894+0000","last_clean":"2024-04-26T10:37:28.278894+0000","last_became_active":"2024-04-26T10:37:23.272107+0000","last_became_peered":"2024-04-26T10:37:23.272107+0000","last_unstale":"2024-04-26T10:37:28.278894+0000","last_undegraded":"2024-04-26T10:37:28.278894+0000","last_fullsized":"2024-04-26T10:37:28.278894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:36.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278352+0000","last_change":"2024-04-26T10:37:23.271611+0000","last_active":"2024-04-26T10:37:28.278352+0000","last_peered":"2024-04-26T10:37:28.278352+0000","last_clean":"2024-04-26T10:37:28.278352+0000","last_became_active":"2024-04-26T10:37:23.269752+0000","last_became_peered":"2024-04-26T10:37:23.269752+0000","last_unstale":"2024-04-26T10:37:28.278352+0000","last_undegraded":"2024-04-26T10:37:28.278352+0000","last_fullsized":"2024-04-26T10:37:28.278352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:17.370231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279559+0000","last_change":"2024-04-26T10:34:14.507618+0000","last_active":"2024-04-26T10:37:27.279559+0000","last_peered":"2024-04-26T10:37:27.279559+0000","last_clean":"2024-04-26T10:37:27.279559+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:37:27.279559+0000","last_undegraded":"2024-04-26T10:37:27.279559+0000","last_fullsized":"2024-04-26T10:37:27.279559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:27.721106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278624+0000","last_change":"2024-04-26T10:37:23.271901+0000","last_active":"2024-04-26T10:37:28.278624+0000","last_peered":"2024-04-26T10:37:28.278624+0000","last_clean":"2024-04-26T10:37:28.278624+0000","last_became_active":"2024-04-26T10:37:23.270593+0000","last_became_peered":"2024-04-26T10:37:23.270593+0000","last_unstale":"2024-04-26T10:37:28.278624+0000","last_undegraded":"2024-04-26T10:37:28.278624+0000","last_fullsized":"2024-04-26T10:37:28.278624+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.909979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278139+0000","last_change":"2024-04-26T10:37:23.271640+0000","last_active":"2024-04-26T10:37:28.278139+0000","last_peered":"2024-04-26T10:37:28.278139+0000","last_clean":"2024-04-26T10:37:28.278139+0000","last_became_active":"2024-04-26T10:37:23.270393+0000","last_became_peered":"2024-04-26T10:37:23.270393+0000","last_unstale":"2024-04-26T10:37:28.278139+0000","last_undegraded":"2024-04-26T10:37:28.278139+0000","last_fullsized":"2024-04-26T10:37:28.278139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:30.161615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.277990+0000","last_change":"2024-04-26T10:37:23.268381+0000","last_active":"2024-04-26T10:37:28.277990+0000","last_peered":"2024-04-26T10:37:28.277990+0000","last_clean":"2024-04-26T10:37:28.277990+0000","last_became_active":"2024-04-26T10:37:23.267296+0000","last_became_peered":"2024-04-26T10:37:23.267296+0000","last_unstale":"2024-04-26T10:37:28.277990+0000","last_undegraded":"2024-04-26T10:37:28.277990+0000","last_fullsized":"2024-04-26T10:37:28.277990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:09.197024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282256+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:37:28.282256+0000","last_peered":"2024-04-26T10:37:28.282256+0000","last_clean":"2024-04-26T10:37:28.282256+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:37:28.282256+0000","last_undegraded":"2024-04-26T10:37:28.282256+0000","last_fullsized":"2024-04-26T10:37:28.282256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280306+0000","last_change":"2024-04-26T10:34:14.507265+0000","last_active":"2024-04-26T10:37:27.280306+0000","last_peered":"2024-04-26T10:37:27.280306+0000","last_clean":"2024-04-26T10:37:27.280306+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:37:27.280306+0000","last_undegraded":"2024-04-26T10:37:27.280306+0000","last_fullsized":"2024-04-26T10:37:27.280306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:07.268421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278994+0000","last_change":"2024-04-26T10:37:23.275734+0000","last_active":"2024-04-26T10:37:28.278994+0000","last_peered":"2024-04-26T10:37:28.278994+0000","last_clean":"2024-04-26T10:37:28.278994+0000","last_became_active":"2024-04-26T10:37:23.273996+0000","last_became_peered":"2024-04-26T10:37:23.273996+0000","last_unstale":"2024-04-26T10:37:28.278994+0000","last_undegraded":"2024-04-26T10:37:28.278994+0000","last_fullsized":"2024-04-26T10:37:28.278994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:19.909745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280151+0000","last_change":"2024-04-26T10:37:23.274459+0000","last_active":"2024-04-26T10:37:27.280151+0000","last_peered":"2024-04-26T10:37:27.280151+0000","last_clean":"2024-04-26T10:37:27.280151+0000","last_became_active":"2024-04-26T10:37:23.273290+0000","last_became_peered":"2024-04-26T10:37:23.273290+0000","last_unstale":"2024-04-26T10:37:27.280151+0000","last_undegraded":"2024-04-26T10:37:27.280151+0000","last_fullsized":"2024-04-26T10:37:27.280151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:48.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279837+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:37:27.279837+0000","last_peered":"2024-04-26T10:37:27.279837+0000","last_clean":"2024-04-26T10:37:27.279837+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:37:27.279837+0000","last_undegraded":"2024-04-26T10:37:27.279837+0000","last_fullsized":"2024-04-26T10:37:27.279837+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:03.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278723+0000","last_change":"2024-04-26T10:37:23.271722+0000","last_active":"2024-04-26T10:37:28.278723+0000","last_peered":"2024-04-26T10:37:28.278723+0000","last_clean":"2024-04-26T10:37:28.278723+0000","last_became_active":"2024-04-26T10:37:23.269722+0000","last_became_peered":"2024-04-26T10:37:23.269722+0000","last_unstale":"2024-04-26T10:37:28.278723+0000","last_undegraded":"2024-04-26T10:37:28.278723+0000","last_fullsized":"2024-04-26T10:37:28.278723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:22.768002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278663+0000","last_change":"2024-04-26T10:37:23.271761+0000","last_active":"2024-04-26T10:37:28.278663+0000","last_peered":"2024-04-26T10:37:28.278663+0000","last_clean":"2024-04-26T10:37:28.278663+0000","last_became_active":"2024-04-26T10:37:23.270852+0000","last_became_peered":"2024-04-26T10:37:23.270852+0000","last_unstale":"2024-04-26T10:37:28.278663+0000","last_undegraded":"2024-04-26T10:37:28.278663+0000","last_fullsized":"2024-04-26T10:37:28.278663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:17.289523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278631+0000","last_change":"2024-04-26T10:37:23.270523+0000","last_active":"2024-04-26T10:37:28.278631+0000","last_peered":"2024-04-26T10:37:28.278631+0000","last_clean":"2024-04-26T10:37:28.278631+0000","last_became_active":"2024-04-26T10:37:23.268640+0000","last_became_peered":"2024-04-26T10:37:23.268640+0000","last_unstale":"2024-04-26T10:37:28.278631+0000","last_undegraded":"2024-04-26T10:37:28.278631+0000","last_fullsized":"2024-04-26T10:37:28.278631+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:45.353248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284300+0000","last_change":"2024-04-26T10:37:28.282247+0000","last_active":"2024-04-26T10:37:29.284300+0000","last_peered":"2024-04-26T10:37:29.284300+0000","last_clean":"2024-04-26T10:37:29.284300+0000","last_became_active":"2024-04-26T10:37:28.281510+0000","last_became_peered":"2024-04-26T10:37:28.281510+0000","last_unstale":"2024-04-26T10:37:29.284300+0000","last_undegraded":"2024-04-26T10:37:29.284300+0000","last_fullsized":"2024-04-26T10:37:29.284300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:37.366727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280445+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:37:27.280445+0000","last_peered":"2024-04-26T10:37:27.280445+0000","last_clean":"2024-04-26T10:37:27.280445+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:37:27.280445+0000","last_undegraded":"2024-04-26T10:37:27.280445+0000","last_fullsized":"2024-04-26T10:37:27.280445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.343269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281607+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:37:28.281607+0000","last_peered":"2024-04-26T10:37:28.281607+0000","last_clean":"2024-04-26T10:37:28.281607+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:37:28.281607+0000","last_undegraded":"2024-04-26T10:37:28.281607+0000","last_fullsized":"2024-04-26T10:37:28.281607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278862+0000","last_change":"2024-04-26T10:37:23.273700+0000","last_active":"2024-04-26T10:37:28.278862+0000","last_peered":"2024-04-26T10:37:28.278862+0000","last_clean":"2024-04-26T10:37:28.278862+0000","last_became_active":"2024-04-26T10:37:23.272964+0000","last_became_peered":"2024-04-26T10:37:23.272964+0000","last_unstale":"2024-04-26T10:37:28.278862+0000","last_undegraded":"2024-04-26T10:37:28.278862+0000","last_fullsized":"2024-04-26T10:37:28.278862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:49.013542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278797+0000","last_change":"2024-04-26T10:37:23.274112+0000","last_active":"2024-04-26T10:37:28.278797+0000","last_peered":"2024-04-26T10:37:28.278797+0000","last_clean":"2024-04-26T10:37:28.278797+0000","last_became_active":"2024-04-26T10:37:23.271967+0000","last_became_peered":"2024-04-26T10:37:23.271967+0000","last_unstale":"2024-04-26T10:37:28.278797+0000","last_undegraded":"2024-04-26T10:37:28.278797+0000","last_fullsized":"2024-04-26T10:37:28.278797+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:35.182239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279897+0000","last_change":"2024-04-26T10:37:23.268432+0000","last_active":"2024-04-26T10:37:27.279897+0000","last_peered":"2024-04-26T10:37:27.279897+0000","last_clean":"2024-04-26T10:37:27.279897+0000","last_became_active":"2024-04-26T10:37:23.267766+0000","last_became_peered":"2024-04-26T10:37:23.267766+0000","last_unstale":"2024-04-26T10:37:27.279897+0000","last_undegraded":"2024-04-26T10:37:27.279897+0000","last_fullsized":"2024-04-26T10:37:27.279897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:46.203749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280877+0000","last_change":"2024-04-26T10:37:23.270217+0000","last_active":"2024-04-26T10:37:28.280877+0000","last_peered":"2024-04-26T10:37:28.280877+0000","last_clean":"2024-04-26T10:37:28.280877+0000","last_became_active":"2024-04-26T10:37:23.269861+0000","last_became_peered":"2024-04-26T10:37:23.269861+0000","last_unstale":"2024-04-26T10:37:28.280877+0000","last_undegraded":"2024-04-26T10:37:28.280877+0000","last_fullsized":"2024-04-26T10:37:28.280877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:39.366800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279815+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:37:27.279815+0000","last_peered":"2024-04-26T10:37:27.279815+0000","last_clean":"2024-04-26T10:37:27.279815+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:37:27.279815+0000","last_undegraded":"2024-04-26T10:37:27.279815+0000","last_fullsized":"2024-04-26T10:37:27.279815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280420+0000","last_change":"2024-04-26T10:37:23.272702+0000","last_active":"2024-04-26T10:37:27.280420+0000","last_peered":"2024-04-26T10:37:27.280420+0000","last_clean":"2024-04-26T10:37:27.280420+0000","last_became_active":"2024-04-26T10:37:23.272218+0000","last_became_peered":"2024-04-26T10:37:23.272218+0000","last_unstale":"2024-04-26T10:37:27.280420+0000","last_undegraded":"2024-04-26T10:37:27.280420+0000","last_fullsized":"2024-04-26T10:37:27.280420+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:01.008010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282600+0000","last_change":"2024-04-26T10:37:23.271247+0000","last_active":"2024-04-26T10:37:28.282600+0000","last_peered":"2024-04-26T10:37:28.282600+0000","last_clean":"2024-04-26T10:37:28.282600+0000","last_became_active":"2024-04-26T10:37:23.270919+0000","last_became_peered":"2024-04-26T10:37:23.270919+0000","last_unstale":"2024-04-26T10:37:28.282600+0000","last_undegraded":"2024-04-26T10:37:28.282600+0000","last_fullsized":"2024-04-26T10:37:28.282600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:18.340235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279085+0000","last_change":"2024-04-26T10:37:23.275081+0000","last_active":"2024-04-26T10:37:28.279085+0000","last_peered":"2024-04-26T10:37:28.279085+0000","last_clean":"2024-04-26T10:37:28.279085+0000","last_became_active":"2024-04-26T10:37:23.273821+0000","last_became_peered":"2024-04-26T10:37:23.273821+0000","last_unstale":"2024-04-26T10:37:28.279085+0000","last_undegraded":"2024-04-26T10:37:28.279085+0000","last_fullsized":"2024-04-26T10:37:28.279085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:39.585583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279903+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:37:27.279903+0000","last_peered":"2024-04-26T10:37:27.279903+0000","last_clean":"2024-04-26T10:37:27.279903+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:37:27.279903+0000","last_undegraded":"2024-04-26T10:37:27.279903+0000","last_fullsized":"2024-04-26T10:37:27.279903+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280754+0000","last_change":"2024-04-26T10:37:23.273494+0000","last_active":"2024-04-26T10:37:27.280754+0000","last_peered":"2024-04-26T10:37:27.280754+0000","last_clean":"2024-04-26T10:37:27.280754+0000","last_became_active":"2024-04-26T10:37:23.272837+0000","last_became_peered":"2024-04-26T10:37:23.272837+0000","last_unstale":"2024-04-26T10:37:27.280754+0000","last_undegraded":"2024-04-26T10:37:27.280754+0000","last_fullsized":"2024-04-26T10:37:27.280754+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:41.090971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280871+0000","last_change":"2024-04-26T10:37:23.269480+0000","last_active":"2024-04-26T10:37:28.280871+0000","last_peered":"2024-04-26T10:37:28.280871+0000","last_clean":"2024-04-26T10:37:28.280871+0000","last_became_active":"2024-04-26T10:37:23.269197+0000","last_became_peered":"2024-04-26T10:37:23.269197+0000","last_unstale":"2024-04-26T10:37:28.280871+0000","last_undegraded":"2024-04-26T10:37:28.280871+0000","last_fullsized":"2024-04-26T10:37:28.280871+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:37.936936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.284041+0000","last_change":"2024-04-26T10:37:28.283688+0000","last_active":"2024-04-26T10:37:28.284041+0000","last_peered":"2024-04-26T10:37:28.284041+0000","last_clean":"2024-04-26T10:37:28.284041+0000","last_became_active":"2024-04-26T10:37:28.283421+0000","last_became_peered":"2024-04-26T10:37:28.283421+0000","last_unstale":"2024-04-26T10:37:28.284041+0000","last_undegraded":"2024-04-26T10:37:28.284041+0000","last_fullsized":"2024-04-26T10:37:28.284041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:49.619896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280536+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:37:28.280536+0000","last_peered":"2024-04-26T10:37:28.280536+0000","last_clean":"2024-04-26T10:37:28.280536+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:37:28.280536+0000","last_undegraded":"2024-04-26T10:37:28.280536+0000","last_fullsized":"2024-04-26T10:37:28.280536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:19.856062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280679+0000","last_change":"2024-04-26T10:37:23.273035+0000","last_active":"2024-04-26T10:37:27.280679+0000","last_peered":"2024-04-26T10:37:27.280679+0000","last_clean":"2024-04-26T10:37:27.280679+0000","last_became_active":"2024-04-26T10:37:23.272666+0000","last_became_peered":"2024-04-26T10:37:23.272666+0000","last_unstale":"2024-04-26T10:37:27.280679+0000","last_undegraded":"2024-04-26T10:37:27.280679+0000","last_fullsized":"2024-04-26T10:37:27.280679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:37.560011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282711+0000","last_change":"2024-04-26T10:37:23.271100+0000","last_active":"2024-04-26T10:37:28.282711+0000","last_peered":"2024-04-26T10:37:28.282711+0000","last_clean":"2024-04-26T10:37:28.282711+0000","last_became_active":"2024-04-26T10:37:23.270725+0000","last_became_peered":"2024-04-26T10:37:23.270725+0000","last_unstale":"2024-04-26T10:37:28.282711+0000","last_undegraded":"2024-04-26T10:37:28.282711+0000","last_fullsized":"2024-04-26T10:37:28.282711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:27.315487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280408+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:37:28.280408+0000","last_peered":"2024-04-26T10:37:28.280408+0000","last_clean":"2024-04-26T10:37:28.280408+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:37:28.280408+0000","last_undegraded":"2024-04-26T10:37:28.280408+0000","last_fullsized":"2024-04-26T10:37:28.280408+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:04.852453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278996+0000","last_change":"2024-04-26T10:37:23.269851+0000","last_active":"2024-04-26T10:37:28.278996+0000","last_peered":"2024-04-26T10:37:28.278996+0000","last_clean":"2024-04-26T10:37:28.278996+0000","last_became_active":"2024-04-26T10:37:23.269371+0000","last_became_peered":"2024-04-26T10:37:23.269371+0000","last_unstale":"2024-04-26T10:37:28.278996+0000","last_undegraded":"2024-04-26T10:37:28.278996+0000","last_fullsized":"2024-04-26T10:37:28.278996+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:45.005775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280987+0000","last_change":"2024-04-26T10:37:23.269749+0000","last_active":"2024-04-26T10:37:28.280987+0000","last_peered":"2024-04-26T10:37:28.280987+0000","last_clean":"2024-04-26T10:37:28.280987+0000","last_became_active":"2024-04-26T10:37:23.269344+0000","last_became_peered":"2024-04-26T10:37:23.269344+0000","last_unstale":"2024-04-26T10:37:28.280987+0000","last_undegraded":"2024-04-26T10:37:28.280987+0000","last_fullsized":"2024-04-26T10:37:28.280987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:02.488934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280474+0000","last_change":"2024-04-26T10:37:23.273205+0000","last_active":"2024-04-26T10:37:27.280474+0000","last_peered":"2024-04-26T10:37:27.280474+0000","last_clean":"2024-04-26T10:37:27.280474+0000","last_became_active":"2024-04-26T10:37:23.272731+0000","last_became_peered":"2024-04-26T10:37:23.272731+0000","last_unstale":"2024-04-26T10:37:27.280474+0000","last_undegraded":"2024-04-26T10:37:27.280474+0000","last_fullsized":"2024-04-26T10:37:27.280474+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:01.502486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280869+0000","last_change":"2024-04-26T10:34:14.509381+0000","last_active":"2024-04-26T10:37:28.280869+0000","last_peered":"2024-04-26T10:37:28.280869+0000","last_clean":"2024-04-26T10:37:28.280869+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:37:28.280869+0000","last_undegraded":"2024-04-26T10:37:28.280869+0000","last_fullsized":"2024-04-26T10:37:28.280869+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:05.841519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278712+0000","last_change":"2024-04-26T10:37:23.272627+0000","last_active":"2024-04-26T10:37:28.278712+0000","last_peered":"2024-04-26T10:37:28.278712+0000","last_clean":"2024-04-26T10:37:28.278712+0000","last_became_active":"2024-04-26T10:37:23.269968+0000","last_became_peered":"2024-04-26T10:37:23.269968+0000","last_unstale":"2024-04-26T10:37:28.278712+0000","last_undegraded":"2024-04-26T10:37:28.278712+0000","last_fullsized":"2024-04-26T10:37:28.278712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:30.387833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278915+0000","last_change":"2024-04-26T10:37:23.274880+0000","last_active":"2024-04-26T10:37:28.278915+0000","last_peered":"2024-04-26T10:37:28.278915+0000","last_clean":"2024-04-26T10:37:28.278915+0000","last_became_active":"2024-04-26T10:37:23.274045+0000","last_became_peered":"2024-04-26T10:37:23.274045+0000","last_unstale":"2024-04-26T10:37:28.278915+0000","last_undegraded":"2024-04-26T10:37:28.278915+0000","last_fullsized":"2024-04-26T10:37:28.278915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:40.208538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278315+0000","last_change":"2024-04-26T10:37:23.273798+0000","last_active":"2024-04-26T10:37:28.278315+0000","last_peered":"2024-04-26T10:37:28.278315+0000","last_clean":"2024-04-26T10:37:28.278315+0000","last_became_active":"2024-04-26T10:37:23.269775+0000","last_became_peered":"2024-04-26T10:37:23.269775+0000","last_unstale":"2024-04-26T10:37:28.278315+0000","last_undegraded":"2024-04-26T10:37:28.278315+0000","last_fullsized":"2024-04-26T10:37:28.278315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:12.757286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280347+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:37:27.280347+0000","last_peered":"2024-04-26T10:37:27.280347+0000","last_clean":"2024-04-26T10:37:27.280347+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:37:27.280347+0000","last_undegraded":"2024-04-26T10:37:27.280347+0000","last_fullsized":"2024-04-26T10:37:27.280347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:02.872251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280994+0000","last_change":"2024-04-26T10:37:23.270164+0000","last_active":"2024-04-26T10:37:28.280994+0000","last_peered":"2024-04-26T10:37:28.280994+0000","last_clean":"2024-04-26T10:37:28.280994+0000","last_became_active":"2024-04-26T10:37:23.269537+0000","last_became_peered":"2024-04-26T10:37:23.269537+0000","last_unstale":"2024-04-26T10:37:28.280994+0000","last_undegraded":"2024-04-26T10:37:28.280994+0000","last_fullsized":"2024-04-26T10:37:28.280994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:01.680925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280201+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:37:27.280201+0000","last_peered":"2024-04-26T10:37:27.280201+0000","last_clean":"2024-04-26T10:37:27.280201+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:37:27.280201+0000","last_undegraded":"2024-04-26T10:37:27.280201+0000","last_fullsized":"2024-04-26T10:37:27.280201+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:43.500342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279316+0000","last_change":"2024-04-26T10:37:23.268114+0000","last_active":"2024-04-26T10:37:27.279316+0000","last_peered":"2024-04-26T10:37:27.279316+0000","last_clean":"2024-04-26T10:37:27.279316+0000","last_became_active":"2024-04-26T10:37:23.267121+0000","last_became_peered":"2024-04-26T10:37:23.267121+0000","last_unstale":"2024-04-26T10:37:27.279316+0000","last_undegraded":"2024-04-26T10:37:27.279316+0000","last_fullsized":"2024-04-26T10:37:27.279316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:02.467933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282886+0000","last_change":"2024-04-26T10:37:28.282100+0000","last_active":"2024-04-26T10:37:28.282886+0000","last_peered":"2024-04-26T10:37:28.282886+0000","last_clean":"2024-04-26T10:37:28.282886+0000","last_became_active":"2024-04-26T10:37:28.281512+0000","last_became_peered":"2024-04-26T10:37:28.281512+0000","last_unstale":"2024-04-26T10:37:28.282886+0000","last_undegraded":"2024-04-26T10:37:28.282886+0000","last_fullsized":"2024-04-26T10:37:28.282886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.432394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278274+0000","last_change":"2024-04-26T10:37:23.268184+0000","last_active":"2024-04-26T10:37:28.278274+0000","last_peered":"2024-04-26T10:37:28.278274+0000","last_clean":"2024-04-26T10:37:28.278274+0000","last_became_active":"2024-04-26T10:37:23.266377+0000","last_became_peered":"2024-04-26T10:37:23.266377+0000","last_unstale":"2024-04-26T10:37:28.278274+0000","last_undegraded":"2024-04-26T10:37:28.278274+0000","last_fullsized":"2024-04-26T10:37:28.278274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:30.680130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282822+0000","last_change":"2024-04-26T10:37:23.272074+0000","last_active":"2024-04-26T10:37:28.282822+0000","last_peered":"2024-04-26T10:37:28.282822+0000","last_clean":"2024-04-26T10:37:28.282822+0000","last_became_active":"2024-04-26T10:37:23.271752+0000","last_became_peered":"2024-04-26T10:37:23.271752+0000","last_unstale":"2024-04-26T10:37:28.282822+0000","last_undegraded":"2024-04-26T10:37:28.282822+0000","last_fullsized":"2024-04-26T10:37:28.282822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:49.465872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279270+0000","last_change":"2024-04-26T10:37:23.273840+0000","last_active":"2024-04-26T10:37:28.279270+0000","last_peered":"2024-04-26T10:37:28.279270+0000","last_clean":"2024-04-26T10:37:28.279270+0000","last_became_active":"2024-04-26T10:37:23.272156+0000","last_became_peered":"2024-04-26T10:37:23.272156+0000","last_unstale":"2024-04-26T10:37:28.279270+0000","last_undegraded":"2024-04-26T10:37:28.279270+0000","last_fullsized":"2024-04-26T10:37:28.279270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:37.470181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279506+0000","last_change":"2024-04-26T10:37:23.268011+0000","last_active":"2024-04-26T10:37:27.279506+0000","last_peered":"2024-04-26T10:37:27.279506+0000","last_clean":"2024-04-26T10:37:27.279506+0000","last_became_active":"2024-04-26T10:37:23.267717+0000","last_became_peered":"2024-04-26T10:37:23.267717+0000","last_unstale":"2024-04-26T10:37:27.279506+0000","last_undegraded":"2024-04-26T10:37:27.279506+0000","last_fullsized":"2024-04-26T10:37:27.279506+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:51.923777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280555+0000","last_change":"2024-04-26T10:37:23.273179+0000","last_active":"2024-04-26T10:37:27.280555+0000","last_peered":"2024-04-26T10:37:27.280555+0000","last_clean":"2024-04-26T10:37:27.280555+0000","last_became_active":"2024-04-26T10:37:23.272260+0000","last_became_peered":"2024-04-26T10:37:23.272260+0000","last_unstale":"2024-04-26T10:37:27.280555+0000","last_undegraded":"2024-04-26T10:37:27.280555+0000","last_fullsized":"2024-04-26T10:37:27.280555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.097396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279635+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:37:27.279635+0000","last_peered":"2024-04-26T10:37:27.279635+0000","last_clean":"2024-04-26T10:37:27.279635+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:37:27.279635+0000","last_undegraded":"2024-04-26T10:37:27.279635+0000","last_fullsized":"2024-04-26T10:37:27.279635+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:12.954308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278652+0000","last_change":"2024-04-26T10:37:23.269836+0000","last_active":"2024-04-26T10:37:28.278652+0000","last_peered":"2024-04-26T10:37:28.278652+0000","last_clean":"2024-04-26T10:37:28.278652+0000","last_became_active":"2024-04-26T10:37:23.268441+0000","last_became_peered":"2024-04-26T10:37:23.268441+0000","last_unstale":"2024-04-26T10:37:28.278652+0000","last_undegraded":"2024-04-26T10:37:28.278652+0000","last_fullsized":"2024-04-26T10:37:28.278652+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:09.971337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278371+0000","last_change":"2024-04-26T10:37:23.270851+0000","last_active":"2024-04-26T10:37:28.278371+0000","last_peered":"2024-04-26T10:37:28.278371+0000","last_clean":"2024-04-26T10:37:28.278371+0000","last_became_active":"2024-04-26T10:37:23.268451+0000","last_became_peered":"2024-04-26T10:37:23.268451+0000","last_unstale":"2024-04-26T10:37:28.278371+0000","last_undegraded":"2024-04-26T10:37:28.278371+0000","last_fullsized":"2024-04-26T10:37:28.278371+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:48.226025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278899+0000","last_change":"2024-04-26T10:37:23.273635+0000","last_active":"2024-04-26T10:37:28.278899+0000","last_peered":"2024-04-26T10:37:28.278899+0000","last_clean":"2024-04-26T10:37:28.278899+0000","last_became_active":"2024-04-26T10:37:23.272938+0000","last_became_peered":"2024-04-26T10:37:23.272938+0000","last_unstale":"2024-04-26T10:37:28.278899+0000","last_undegraded":"2024-04-26T10:37:28.278899+0000","last_fullsized":"2024-04-26T10:37:28.278899+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:05.613682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281241+0000","last_change":"2024-04-26T10:37:23.277366+0000","last_active":"2024-04-26T10:37:28.281241+0000","last_peered":"2024-04-26T10:37:28.281241+0000","last_clean":"2024-04-26T10:37:28.281241+0000","last_became_active":"2024-04-26T10:37:23.276957+0000","last_became_peered":"2024-04-26T10:37:23.276957+0000","last_unstale":"2024-04-26T10:37:28.281241+0000","last_undegraded":"2024-04-26T10:37:28.281241+0000","last_fullsized":"2024-04-26T10:37:28.281241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:33.029508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281114+0000","last_change":"2024-04-26T10:37:23.277440+0000","last_active":"2024-04-26T10:37:28.281114+0000","last_peered":"2024-04-26T10:37:28.281114+0000","last_clean":"2024-04-26T10:37:28.281114+0000","last_became_active":"2024-04-26T10:37:23.277037+0000","last_became_peered":"2024-04-26T10:37:23.277037+0000","last_unstale":"2024-04-26T10:37:28.281114+0000","last_undegraded":"2024-04-26T10:37:28.281114+0000","last_fullsized":"2024-04-26T10:37:28.281114+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:39.705318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278295+0000","last_change":"2024-04-26T10:37:23.270454+0000","last_active":"2024-04-26T10:37:28.278295+0000","last_peered":"2024-04-26T10:37:28.278295+0000","last_clean":"2024-04-26T10:37:28.278295+0000","last_became_active":"2024-04-26T10:37:23.269473+0000","last_became_peered":"2024-04-26T10:37:23.269473+0000","last_unstale":"2024-04-26T10:37:28.278295+0000","last_undegraded":"2024-04-26T10:37:28.278295+0000","last_fullsized":"2024-04-26T10:37:28.278295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:51.049298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278233+0000","last_change":"2024-04-26T10:37:23.267503+0000","last_active":"2024-04-26T10:37:28.278233+0000","last_peered":"2024-04-26T10:37:28.278233+0000","last_clean":"2024-04-26T10:37:28.278233+0000","last_became_active":"2024-04-26T10:37:23.267235+0000","last_became_peered":"2024-04-26T10:37:23.267235+0000","last_unstale":"2024-04-26T10:37:28.278233+0000","last_undegraded":"2024-04-26T10:37:28.278233+0000","last_fullsized":"2024-04-26T10:37:28.278233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:44.951919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278983+0000","last_change":"2024-04-26T10:37:23.274693+0000","last_active":"2024-04-26T10:37:28.278983+0000","last_peered":"2024-04-26T10:37:28.278983+0000","last_clean":"2024-04-26T10:37:28.278983+0000","last_became_active":"2024-04-26T10:37:23.272111+0000","last_became_peered":"2024-04-26T10:37:23.272111+0000","last_unstale":"2024-04-26T10:37:28.278983+0000","last_undegraded":"2024-04-26T10:37:28.278983+0000","last_fullsized":"2024-04-26T10:37:28.278983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:49.690746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280094+0000","last_change":"2024-04-26T10:37:23.274381+0000","last_active":"2024-04-26T10:37:27.280094+0000","last_peered":"2024-04-26T10:37:27.280094+0000","last_clean":"2024-04-26T10:37:27.280094+0000","last_became_active":"2024-04-26T10:37:23.273867+0000","last_became_peered":"2024-04-26T10:37:23.273867+0000","last_unstale":"2024-04-26T10:37:27.280094+0000","last_undegraded":"2024-04-26T10:37:27.280094+0000","last_fullsized":"2024-04-26T10:37:27.280094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:05.525071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279020+0000","last_change":"2024-04-26T10:37:23.273539+0000","last_active":"2024-04-26T10:37:28.279020+0000","last_peered":"2024-04-26T10:37:28.279020+0000","last_clean":"2024-04-26T10:37:28.279020+0000","last_became_active":"2024-04-26T10:37:23.272569+0000","last_became_peered":"2024-04-26T10:37:23.272569+0000","last_unstale":"2024-04-26T10:37:28.279020+0000","last_undegraded":"2024-04-26T10:37:28.279020+0000","last_fullsized":"2024-04-26T10:37:28.279020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:40.584797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279341+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:37:27.279341+0000","last_peered":"2024-04-26T10:37:27.279341+0000","last_clean":"2024-04-26T10:37:27.279341+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:37:27.279341+0000","last_undegraded":"2024-04-26T10:37:27.279341+0000","last_fullsized":"2024-04-26T10:37:27.279341+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:35.111495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282520+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:37:28.282520+0000","last_peered":"2024-04-26T10:37:28.282520+0000","last_clean":"2024-04-26T10:37:28.282520+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:37:28.282520+0000","last_undegraded":"2024-04-26T10:37:28.282520+0000","last_fullsized":"2024-04-26T10:37:28.282520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284088+0000","last_change":"2024-04-26T10:37:28.282767+0000","last_active":"2024-04-26T10:37:29.284088+0000","last_peered":"2024-04-26T10:37:29.284088+0000","last_clean":"2024-04-26T10:37:29.284088+0000","last_became_active":"2024-04-26T10:37:28.282419+0000","last_became_peered":"2024-04-26T10:37:28.282419+0000","last_unstale":"2024-04-26T10:37:29.284088+0000","last_undegraded":"2024-04-26T10:37:29.284088+0000","last_fullsized":"2024-04-26T10:37:29.284088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:44.531133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278848+0000","last_change":"2024-04-26T10:37:23.274843+0000","last_active":"2024-04-26T10:37:28.278848+0000","last_peered":"2024-04-26T10:37:28.278848+0000","last_clean":"2024-04-26T10:37:28.278848+0000","last_became_active":"2024-04-26T10:37:23.273114+0000","last_became_peered":"2024-04-26T10:37:23.273114+0000","last_unstale":"2024-04-26T10:37:28.278848+0000","last_undegraded":"2024-04-26T10:37:28.278848+0000","last_fullsized":"2024-04-26T10:37:28.278848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:33.001910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279711+0000","last_change":"2024-04-26T10:37:23.268149+0000","last_active":"2024-04-26T10:37:27.279711+0000","last_peered":"2024-04-26T10:37:27.279711+0000","last_clean":"2024-04-26T10:37:27.279711+0000","last_became_active":"2024-04-26T10:37:23.267319+0000","last_became_peered":"2024-04-26T10:37:23.267319+0000","last_unstale":"2024-04-26T10:37:27.279711+0000","last_undegraded":"2024-04-26T10:37:27.279711+0000","last_fullsized":"2024-04-26T10:37:27.279711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:36.211011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278094+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:28.278094+0000","last_peered":"2024-04-26T10:37:28.278094+0000","last_clean":"2024-04-26T10:37:28.278094+0000","last_became_active":"2024-04-26T10:37:23.266332+0000","last_became_peered":"2024-04-26T10:37:23.266332+0000","last_unstale":"2024-04-26T10:37:28.278094+0000","last_undegraded":"2024-04-26T10:37:28.278094+0000","last_fullsized":"2024-04-26T10:37:28.278094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:26.218509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278389+0000","last_change":"2024-04-26T10:37:23.272871+0000","last_active":"2024-04-26T10:37:28.278389+0000","last_peered":"2024-04-26T10:37:28.278389+0000","last_clean":"2024-04-26T10:37:28.278389+0000","last_became_active":"2024-04-26T10:37:23.269657+0000","last_became_peered":"2024-04-26T10:37:23.269657+0000","last_unstale":"2024-04-26T10:37:28.278389+0000","last_undegraded":"2024-04-26T10:37:28.278389+0000","last_fullsized":"2024-04-26T10:37:28.278389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:38.769793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281666+0000","last_change":"2024-04-26T10:34:14.513348+0000","last_active":"2024-04-26T10:37:28.281666+0000","last_peered":"2024-04-26T10:37:28.281666+0000","last_clean":"2024-04-26T10:37:28.281666+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:37:28.281666+0000","last_undegraded":"2024-04-26T10:37:28.281666+0000","last_fullsized":"2024-04-26T10:37:28.281666+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:21.161769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280745+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:37:28.280745+0000","last_peered":"2024-04-26T10:37:28.280745+0000","last_clean":"2024-04-26T10:37:28.280745+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:37:28.280745+0000","last_undegraded":"2024-04-26T10:37:28.280745+0000","last_fullsized":"2024-04-26T10:37:28.280745+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279603+0000","last_change":"2024-04-26T10:37:23.267893+0000","last_active":"2024-04-26T10:37:27.279603+0000","last_peered":"2024-04-26T10:37:27.279603+0000","last_clean":"2024-04-26T10:37:27.279603+0000","last_became_active":"2024-04-26T10:37:23.267595+0000","last_became_peered":"2024-04-26T10:37:23.267595+0000","last_unstale":"2024-04-26T10:37:27.279603+0000","last_undegraded":"2024-04-26T10:37:27.279603+0000","last_fullsized":"2024-04-26T10:37:27.279603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:34.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282762+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:37:28.282762+0000","last_peered":"2024-04-26T10:37:28.282762+0000","last_clean":"2024-04-26T10:37:28.282762+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:37:28.282762+0000","last_undegraded":"2024-04-26T10:37:28.282762+0000","last_fullsized":"2024-04-26T10:37:28.282762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:57.803542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278274+0000","last_change":"2024-04-26T10:37:23.273754+0000","last_active":"2024-04-26T10:37:28.278274+0000","last_peered":"2024-04-26T10:37:28.278274+0000","last_clean":"2024-04-26T10:37:28.278274+0000","last_became_active":"2024-04-26T10:37:23.270451+0000","last_became_peered":"2024-04-26T10:37:23.270451+0000","last_unstale":"2024-04-26T10:37:28.278274+0000","last_undegraded":"2024-04-26T10:37:28.278274+0000","last_fullsized":"2024-04-26T10:37:28.278274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:03.023862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":300,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278550+0000","last_change":"2024-04-26T10:37:23.269600+0000","last_active":"2024-04-26T10:37:28.278550+0000","last_peered":"2024-04-26T10:37:28.278550+0000","last_clean":"2024-04-26T10:37:28.278550+0000","last_became_active":"2024-04-26T10:37:23.268665+0000","last_became_peered":"2024-04-26T10:37:23.268665+0000","last_unstale":"2024-04-26T10:37:28.278550+0000","last_undegraded":"2024-04-26T10:37:28.278550+0000","last_fullsized":"2024-04-26T10:37:28.278550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:27.734866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280817+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:37:28.280817+0000","last_peered":"2024-04-26T10:37:28.280817+0000","last_clean":"2024-04-26T10:37:28.280817+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:37:28.280817+0000","last_undegraded":"2024-04-26T10:37:28.280817+0000","last_fullsized":"2024-04-26T10:37:28.280817+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278725+0000","last_change":"2024-04-26T10:37:23.271849+0000","last_active":"2024-04-26T10:37:28.278725+0000","last_peered":"2024-04-26T10:37:28.278725+0000","last_clean":"2024-04-26T10:37:28.278725+0000","last_became_active":"2024-04-26T10:37:23.269736+0000","last_became_peered":"2024-04-26T10:37:23.269736+0000","last_unstale":"2024-04-26T10:37:28.278725+0000","last_undegraded":"2024-04-26T10:37:28.278725+0000","last_fullsized":"2024-04-26T10:37:28.278725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.639109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278343+0000","last_change":"2024-04-26T10:37:23.266348+0000","last_active":"2024-04-26T10:37:28.278343+0000","last_peered":"2024-04-26T10:37:28.278343+0000","last_clean":"2024-04-26T10:37:28.278343+0000","last_became_active":"2024-04-26T10:37:23.265317+0000","last_became_peered":"2024-04-26T10:37:23.265317+0000","last_unstale":"2024-04-26T10:37:28.278343+0000","last_undegraded":"2024-04-26T10:37:28.278343+0000","last_fullsized":"2024-04-26T10:37:28.278343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:13.956142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280740+0000","last_change":"2024-04-26T10:37:23.276509+0000","last_active":"2024-04-26T10:37:28.280740+0000","last_peered":"2024-04-26T10:37:28.280740+0000","last_clean":"2024-04-26T10:37:28.280740+0000","last_became_active":"2024-04-26T10:37:23.276151+0000","last_became_peered":"2024-04-26T10:37:23.276151+0000","last_unstale":"2024-04-26T10:37:28.280740+0000","last_undegraded":"2024-04-26T10:37:28.280740+0000","last_fullsized":"2024-04-26T10:37:28.280740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:30.924727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280594+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:37:27.280594+0000","last_peered":"2024-04-26T10:37:27.280594+0000","last_clean":"2024-04-26T10:37:27.280594+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:37:27.280594+0000","last_undegraded":"2024-04-26T10:37:27.280594+0000","last_fullsized":"2024-04-26T10:37:27.280594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280625+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:37:27.280625+0000","last_peered":"2024-04-26T10:37:27.280625+0000","last_clean":"2024-04-26T10:37:27.280625+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:37:27.280625+0000","last_undegraded":"2024-04-26T10:37:27.280625+0000","last_fullsized":"2024-04-26T10:37:27.280625+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282126+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:37:28.282126+0000","last_peered":"2024-04-26T10:37:28.282126+0000","last_clean":"2024-04-26T10:37:28.282126+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:37:28.282126+0000","last_undegraded":"2024-04-26T10:37:28.282126+0000","last_fullsized":"2024-04-26T10:37:28.282126+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:21.048381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280027+0000","last_change":"2024-04-26T10:37:23.277636+0000","last_active":"2024-04-26T10:37:27.280027+0000","last_peered":"2024-04-26T10:37:27.280027+0000","last_clean":"2024-04-26T10:37:27.280027+0000","last_became_active":"2024-04-26T10:37:23.277309+0000","last_became_peered":"2024-04-26T10:37:23.277309+0000","last_unstale":"2024-04-26T10:37:27.280027+0000","last_undegraded":"2024-04-26T10:37:27.280027+0000","last_fullsized":"2024-04-26T10:37:27.280027+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:00.429064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282446+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:37:28.282446+0000","last_peered":"2024-04-26T10:37:28.282446+0000","last_clean":"2024-04-26T10:37:28.282446+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:37:28.282446+0000","last_undegraded":"2024-04-26T10:37:28.282446+0000","last_fullsized":"2024-04-26T10:37:28.282446+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282702+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:37:28.282702+0000","last_peered":"2024-04-26T10:37:28.282702+0000","last_clean":"2024-04-26T10:37:28.282702+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:37:28.282702+0000","last_undegraded":"2024-04-26T10:37:28.282702+0000","last_fullsized":"2024-04-26T10:37:28.282702+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.172123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.283483+0000","last_change":"2024-04-26T10:37:28.282300+0000","last_active":"2024-04-26T10:37:28.283483+0000","last_peered":"2024-04-26T10:37:28.283483+0000","last_clean":"2024-04-26T10:37:28.283483+0000","last_became_active":"2024-04-26T10:37:28.281669+0000","last_became_peered":"2024-04-26T10:37:28.281669+0000","last_unstale":"2024-04-26T10:37:28.283483+0000","last_undegraded":"2024-04-26T10:37:28.283483+0000","last_fullsized":"2024-04-26T10:37:28.283483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:23.776919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279088+0000","last_change":"2024-04-26T10:37:23.269479+0000","last_active":"2024-04-26T10:37:28.279088+0000","last_peered":"2024-04-26T10:37:28.279088+0000","last_clean":"2024-04-26T10:37:28.279088+0000","last_became_active":"2024-04-26T10:37:23.268673+0000","last_became_peered":"2024-04-26T10:37:23.268673+0000","last_unstale":"2024-04-26T10:37:28.279088+0000","last_undegraded":"2024-04-26T10:37:28.279088+0000","last_fullsized":"2024-04-26T10:37:28.279088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:52.269482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282451+0000","last_change":"2024-04-26T10:37:23.277426+0000","last_active":"2024-04-26T10:37:28.282451+0000","last_peered":"2024-04-26T10:37:28.282451+0000","last_clean":"2024-04-26T10:37:28.282451+0000","last_became_active":"2024-04-26T10:37:23.277001+0000","last_became_peered":"2024-04-26T10:37:23.277001+0000","last_unstale":"2024-04-26T10:37:28.282451+0000","last_undegraded":"2024-04-26T10:37:28.282451+0000","last_fullsized":"2024-04-26T10:37:28.282451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:38.308038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279463+0000","last_change":"2024-04-26T10:37:23.267342+0000","last_active":"2024-04-26T10:37:27.279463+0000","last_peered":"2024-04-26T10:37:27.279463+0000","last_clean":"2024-04-26T10:37:27.279463+0000","last_became_active":"2024-04-26T10:37:23.266912+0000","last_became_peered":"2024-04-26T10:37:23.266912+0000","last_unstale":"2024-04-26T10:37:27.279463+0000","last_undegraded":"2024-04-26T10:37:27.279463+0000","last_fullsized":"2024-04-26T10:37:27.279463+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:28.070169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279987+0000","last_change":"2024-04-26T10:37:23.277620+0000","last_active":"2024-04-26T10:37:27.279987+0000","last_peered":"2024-04-26T10:37:27.279987+0000","last_clean":"2024-04-26T10:37:27.279987+0000","last_became_active":"2024-04-26T10:37:23.277303+0000","last_became_peered":"2024-04-26T10:37:23.277303+0000","last_unstale":"2024-04-26T10:37:27.279987+0000","last_undegraded":"2024-04-26T10:37:27.279987+0000","last_fullsized":"2024-04-26T10:37:27.279987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:57.292594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280339+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:37:27.280339+0000","last_peered":"2024-04-26T10:37:27.280339+0000","last_clean":"2024-04-26T10:37:27.280339+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:37:27.280339+0000","last_undegraded":"2024-04-26T10:37:27.280339+0000","last_fullsized":"2024-04-26T10:37:27.280339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278431+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:28.278431+0000","last_peered":"2024-04-26T10:37:28.278431+0000","last_clean":"2024-04-26T10:37:28.278431+0000","last_became_active":"2024-04-26T10:37:23.266295+0000","last_became_peered":"2024-04-26T10:37:23.266295+0000","last_unstale":"2024-04-26T10:37:28.278431+0000","last_undegraded":"2024-04-26T10:37:28.278431+0000","last_fullsized":"2024-04-26T10:37:28.278431+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:19.026704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278934+0000","last_change":"2024-04-26T10:37:23.274686+0000","last_active":"2024-04-26T10:37:28.278934+0000","last_peered":"2024-04-26T10:37:28.278934+0000","last_clean":"2024-04-26T10:37:28.278934+0000","last_became_active":"2024-04-26T10:37:23.272039+0000","last_became_peered":"2024-04-26T10:37:23.272039+0000","last_unstale":"2024-04-26T10:37:28.278934+0000","last_undegraded":"2024-04-26T10:37:28.278934+0000","last_fullsized":"2024-04-26T10:37:28.278934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:42.152908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280761+0000","last_change":"2024-04-26T10:37:23.273723+0000","last_active":"2024-04-26T10:37:27.280761+0000","last_peered":"2024-04-26T10:37:27.280761+0000","last_clean":"2024-04-26T10:37:27.280761+0000","last_became_active":"2024-04-26T10:37:23.273253+0000","last_became_peered":"2024-04-26T10:37:23.273253+0000","last_unstale":"2024-04-26T10:37:27.280761+0000","last_undegraded":"2024-04-26T10:37:27.280761+0000","last_fullsized":"2024-04-26T10:37:27.280761+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:30.644188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278246+0000","last_change":"2024-04-26T10:37:23.267726+0000","last_active":"2024-04-26T10:37:28.278246+0000","last_peered":"2024-04-26T10:37:28.278246+0000","last_clean":"2024-04-26T10:37:28.278246+0000","last_became_active":"2024-04-26T10:37:23.267434+0000","last_became_peered":"2024-04-26T10:37:23.267434+0000","last_unstale":"2024-04-26T10:37:28.278246+0000","last_undegraded":"2024-04-26T10:37:28.278246+0000","last_fullsized":"2024-04-26T10:37:28.278246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:43.219752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282593+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:37:28.282593+0000","last_peered":"2024-04-26T10:37:28.282593+0000","last_clean":"2024-04-26T10:37:28.282593+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:37:28.282593+0000","last_undegraded":"2024-04-26T10:37:28.282593+0000","last_fullsized":"2024-04-26T10:37:28.282593+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280206+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:37:27.280206+0000","last_peered":"2024-04-26T10:37:27.280206+0000","last_clean":"2024-04-26T10:37:27.280206+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:37:27.280206+0000","last_undegraded":"2024-04-26T10:37:27.280206+0000","last_fullsized":"2024-04-26T10:37:27.280206+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282593+0000","last_change":"2024-04-26T10:37:23.272052+0000","last_active":"2024-04-26T10:37:28.282593+0000","last_peered":"2024-04-26T10:37:28.282593+0000","last_clean":"2024-04-26T10:37:28.282593+0000","last_became_active":"2024-04-26T10:37:23.271663+0000","last_became_peered":"2024-04-26T10:37:23.271663+0000","last_unstale":"2024-04-26T10:37:28.282593+0000","last_undegraded":"2024-04-26T10:37:28.282593+0000","last_fullsized":"2024-04-26T10:37:28.282593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:31.778313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278501+0000","last_change":"2024-04-26T10:37:23.268370+0000","last_active":"2024-04-26T10:37:28.278501+0000","last_peered":"2024-04-26T10:37:28.278501+0000","last_clean":"2024-04-26T10:37:28.278501+0000","last_became_active":"2024-04-26T10:37:23.266624+0000","last_became_peered":"2024-04-26T10:37:23.266624+0000","last_unstale":"2024-04-26T10:37:28.278501+0000","last_undegraded":"2024-04-26T10:37:28.278501+0000","last_fullsized":"2024-04-26T10:37:28.278501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:42.205710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278444+0000","last_change":"2024-04-26T10:37:23.267652+0000","last_active":"2024-04-26T10:37:28.278444+0000","last_peered":"2024-04-26T10:37:28.278444+0000","last_clean":"2024-04-26T10:37:28.278444+0000","last_became_active":"2024-04-26T10:37:23.266063+0000","last_became_peered":"2024-04-26T10:37:23.266063+0000","last_unstale":"2024-04-26T10:37:28.278444+0000","last_undegraded":"2024-04-26T10:37:28.278444+0000","last_fullsized":"2024-04-26T10:37:28.278444+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:23.209788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283546+0000","last_change":"2024-04-26T10:37:28.282145+0000","last_active":"2024-04-26T10:37:29.283546+0000","last_peered":"2024-04-26T10:37:29.283546+0000","last_clean":"2024-04-26T10:37:29.283546+0000","last_became_active":"2024-04-26T10:37:28.281541+0000","last_became_peered":"2024-04-26T10:37:28.281541+0000","last_unstale":"2024-04-26T10:37:29.283546+0000","last_undegraded":"2024-04-26T10:37:29.283546+0000","last_fullsized":"2024-04-26T10:37:29.283546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:55.649460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279988+0000","last_change":"2024-04-26T10:37:23.268479+0000","last_active":"2024-04-26T10:37:27.279988+0000","last_peered":"2024-04-26T10:37:27.279988+0000","last_clean":"2024-04-26T10:37:27.279988+0000","last_became_active":"2024-04-26T10:37:23.267644+0000","last_became_peered":"2024-04-26T10:37:23.267644+0000","last_unstale":"2024-04-26T10:37:27.279988+0000","last_undegraded":"2024-04-26T10:37:27.279988+0000","last_fullsized":"2024-04-26T10:37:27.279988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:47.606620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281350+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:37:28.281350+0000","last_peered":"2024-04-26T10:37:28.281350+0000","last_clean":"2024-04-26T10:37:28.281350+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:37:28.281350+0000","last_undegraded":"2024-04-26T10:37:28.281350+0000","last_fullsized":"2024-04-26T10:37:28.281350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.021846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279979+0000","last_change":"2024-04-26T10:37:23.274199+0000","last_active":"2024-04-26T10:37:27.279979+0000","last_peered":"2024-04-26T10:37:27.279979+0000","last_clean":"2024-04-26T10:37:27.279979+0000","last_became_active":"2024-04-26T10:37:23.273023+0000","last_became_peered":"2024-04-26T10:37:23.273023+0000","last_unstale":"2024-04-26T10:37:27.279979+0000","last_undegraded":"2024-04-26T10:37:27.279979+0000","last_fullsized":"2024-04-26T10:37:27.279979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:55.142124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1766,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":338840,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":94033000,"statfs":{"total":96636764160,"available":96289792000,"internally_reserved":0,"allocated":917504,"data_stored":359527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346028486},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55000000000000004}]},{"osd":1,"last update":"Fri Apr 26 10:36:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.38100000000000001},"min":{"1min":0.36399999999999999,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.56799999999999995,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.63800000000000001,"15min":0.496},"min":{"1min":0.373,"5min":0.19,"15min":0.19},"max":{"1min":0.59699999999999998,"5min":12.206,"15min":12.206},"last":0.47899999999999998}]}]},{"osd":0,"up_from":75,"seq":322122547203,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55024,"kb_used_data":1500,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94316816,"statfs":{"total":96636764160,"available":96580419584,"internally_reserved":0,"allocated":1536000,"data_stored":951641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7111,"internal_metadata":54780985},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257364,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":255870,"kb_avail":94114476,"statfs":{"total":96636764160,"available":96373223424,"internally_reserved":0,"allocated":1515520,"data_stored":944680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262011334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Apr 26 10:36:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.42199999999999999,"15min":0.35599999999999998},"min":{"1min":0.307,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.59199999999999997,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.503},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48199999999999998,"15min":0.45200000000000001},"min":{"1min":0.27600000000000002,"5min":0.183,"15min":0.183},"max":{"1min":0.60699999999999998,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:37:32.398 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:37:32.778 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:37:32.779 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:37:32.789 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-04-26T10:37:31.058160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":592134,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":651228,"kb_used_data":3876,"kb_used_omap":10,"kb_used_meta":647285,"kb_avail":282464292,"statfs":{"total":289910292480,"available":289243435008,"internally_reserved":0,"allocated":3969024,"data_stored":2255848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10299,"internal_metadata":662820805},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.788044"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280471+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:37:27.280471+0000","last_peered":"2024-04-26T10:37:27.280471+0000","last_clean":"2024-04-26T10:37:27.280471+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:37:27.280471+0000","last_undegraded":"2024-04-26T10:37:27.280471+0000","last_fullsized":"2024-04-26T10:37:27.280471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:26.964955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280495+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:37:27.280495+0000","last_peered":"2024-04-26T10:37:27.280495+0000","last_clean":"2024-04-26T10:37:27.280495+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:37:27.280495+0000","last_undegraded":"2024-04-26T10:37:27.280495+0000","last_fullsized":"2024-04-26T10:37:27.280495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278894+0000","last_change":"2024-04-26T10:37:23.274531+0000","last_active":"2024-04-26T10:37:28.278894+0000","last_peered":"2024-04-26T10:37:28.278894+0000","last_clean":"2024-04-26T10:37:28.278894+0000","last_became_active":"2024-04-26T10:37:23.272107+0000","last_became_peered":"2024-04-26T10:37:23.272107+0000","last_unstale":"2024-04-26T10:37:28.278894+0000","last_undegraded":"2024-04-26T10:37:28.278894+0000","last_fullsized":"2024-04-26T10:37:28.278894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:36.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278352+0000","last_change":"2024-04-26T10:37:23.271611+0000","last_active":"2024-04-26T10:37:28.278352+0000","last_peered":"2024-04-26T10:37:28.278352+0000","last_clean":"2024-04-26T10:37:28.278352+0000","last_became_active":"2024-04-26T10:37:23.269752+0000","last_became_peered":"2024-04-26T10:37:23.269752+0000","last_unstale":"2024-04-26T10:37:28.278352+0000","last_undegraded":"2024-04-26T10:37:28.278352+0000","last_fullsized":"2024-04-26T10:37:28.278352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:17.370231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279559+0000","last_change":"2024-04-26T10:34:14.507618+0000","last_active":"2024-04-26T10:37:27.279559+0000","last_peered":"2024-04-26T10:37:27.279559+0000","last_clean":"2024-04-26T10:37:27.279559+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:37:27.279559+0000","last_undegraded":"2024-04-26T10:37:27.279559+0000","last_fullsized":"2024-04-26T10:37:27.279559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:27.721106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278624+0000","last_change":"2024-04-26T10:37:23.271901+0000","last_active":"2024-04-26T10:37:28.278624+0000","last_peered":"2024-04-26T10:37:28.278624+0000","last_clean":"2024-04-26T10:37:28.278624+0000","last_became_active":"2024-04-26T10:37:23.270593+0000","last_became_peered":"2024-04-26T10:37:23.270593+0000","last_unstale":"2024-04-26T10:37:28.278624+0000","last_undegraded":"2024-04-26T10:37:28.278624+0000","last_fullsized":"2024-04-26T10:37:28.278624+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.909979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278139+0000","last_change":"2024-04-26T10:37:23.271640+0000","last_active":"2024-04-26T10:37:28.278139+0000","last_peered":"2024-04-26T10:37:28.278139+0000","last_clean":"2024-04-26T10:37:28.278139+0000","last_became_active":"2024-04-26T10:37:23.270393+0000","last_became_peered":"2024-04-26T10:37:23.270393+0000","last_unstale":"2024-04-26T10:37:28.278139+0000","last_undegraded":"2024-04-26T10:37:28.278139+0000","last_fullsized":"2024-04-26T10:37:28.278139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:30.161615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.277990+0000","last_change":"2024-04-26T10:37:23.268381+0000","last_active":"2024-04-26T10:37:28.277990+0000","last_peered":"2024-04-26T10:37:28.277990+0000","last_clean":"2024-04-26T10:37:28.277990+0000","last_became_active":"2024-04-26T10:37:23.267296+0000","last_became_peered":"2024-04-26T10:37:23.267296+0000","last_unstale":"2024-04-26T10:37:28.277990+0000","last_undegraded":"2024-04-26T10:37:28.277990+0000","last_fullsized":"2024-04-26T10:37:28.277990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:09.197024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282256+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:37:28.282256+0000","last_peered":"2024-04-26T10:37:28.282256+0000","last_clean":"2024-04-26T10:37:28.282256+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:37:28.282256+0000","last_undegraded":"2024-04-26T10:37:28.282256+0000","last_fullsized":"2024-04-26T10:37:28.282256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280306+0000","last_change":"2024-04-26T10:34:14.507265+0000","last_active":"2024-04-26T10:37:27.280306+0000","last_peered":"2024-04-26T10:37:27.280306+0000","last_clean":"2024-04-26T10:37:27.280306+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:37:27.280306+0000","last_undegraded":"2024-04-26T10:37:27.280306+0000","last_fullsized":"2024-04-26T10:37:27.280306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:07.268421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278994+0000","last_change":"2024-04-26T10:37:23.275734+0000","last_active":"2024-04-26T10:37:28.278994+0000","last_peered":"2024-04-26T10:37:28.278994+0000","last_clean":"2024-04-26T10:37:28.278994+0000","last_became_active":"2024-04-26T10:37:23.273996+0000","last_became_peered":"2024-04-26T10:37:23.273996+0000","last_unstale":"2024-04-26T10:37:28.278994+0000","last_undegraded":"2024-04-26T10:37:28.278994+0000","last_fullsized":"2024-04-26T10:37:28.278994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:19.909745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280151+0000","last_change":"2024-04-26T10:37:23.274459+0000","last_active":"2024-04-26T10:37:27.280151+0000","last_peered":"2024-04-26T10:37:27.280151+0000","last_clean":"2024-04-26T10:37:27.280151+0000","last_became_active":"2024-04-26T10:37:23.273290+0000","last_became_peered":"2024-04-26T10:37:23.273290+0000","last_unstale":"2024-04-26T10:37:27.280151+0000","last_undegraded":"2024-04-26T10:37:27.280151+0000","last_fullsized":"2024-04-26T10:37:27.280151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:48.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279837+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:37:27.279837+0000","last_peered":"2024-04-26T10:37:27.279837+0000","last_clean":"2024-04-26T10:37:27.279837+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:37:27.279837+0000","last_undegraded":"2024-04-26T10:37:27.279837+0000","last_fullsized":"2024-04-26T10:37:27.279837+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:03.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278723+0000","last_change":"2024-04-26T10:37:23.271722+0000","last_active":"2024-04-26T10:37:28.278723+0000","last_peered":"2024-04-26T10:37:28.278723+0000","last_clean":"2024-04-26T10:37:28.278723+0000","last_became_active":"2024-04-26T10:37:23.269722+0000","last_became_peered":"2024-04-26T10:37:23.269722+0000","last_unstale":"2024-04-26T10:37:28.278723+0000","last_undegraded":"2024-04-26T10:37:28.278723+0000","last_fullsized":"2024-04-26T10:37:28.278723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:22.768002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278663+0000","last_change":"2024-04-26T10:37:23.271761+0000","last_active":"2024-04-26T10:37:28.278663+0000","last_peered":"2024-04-26T10:37:28.278663+0000","last_clean":"2024-04-26T10:37:28.278663+0000","last_became_active":"2024-04-26T10:37:23.270852+0000","last_became_peered":"2024-04-26T10:37:23.270852+0000","last_unstale":"2024-04-26T10:37:28.278663+0000","last_undegraded":"2024-04-26T10:37:28.278663+0000","last_fullsized":"2024-04-26T10:37:28.278663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:17.289523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278631+0000","last_change":"2024-04-26T10:37:23.270523+0000","last_active":"2024-04-26T10:37:28.278631+0000","last_peered":"2024-04-26T10:37:28.278631+0000","last_clean":"2024-04-26T10:37:28.278631+0000","last_became_active":"2024-04-26T10:37:23.268640+0000","last_became_peered":"2024-04-26T10:37:23.268640+0000","last_unstale":"2024-04-26T10:37:28.278631+0000","last_undegraded":"2024-04-26T10:37:28.278631+0000","last_fullsized":"2024-04-26T10:37:28.278631+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:45.353248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284300+0000","last_change":"2024-04-26T10:37:28.282247+0000","last_active":"2024-04-26T10:37:29.284300+0000","last_peered":"2024-04-26T10:37:29.284300+0000","last_clean":"2024-04-26T10:37:29.284300+0000","last_became_active":"2024-04-26T10:37:28.281510+0000","last_became_peered":"2024-04-26T10:37:28.281510+0000","last_unstale":"2024-04-26T10:37:29.284300+0000","last_undegraded":"2024-04-26T10:37:29.284300+0000","last_fullsized":"2024-04-26T10:37:29.284300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:37.366727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280445+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:37:27.280445+0000","last_peered":"2024-04-26T10:37:27.280445+0000","last_clean":"2024-04-26T10:37:27.280445+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:37:27.280445+0000","last_undegraded":"2024-04-26T10:37:27.280445+0000","last_fullsized":"2024-04-26T10:37:27.280445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.343269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281607+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:37:28.281607+0000","last_peered":"2024-04-26T10:37:28.281607+0000","last_clean":"2024-04-26T10:37:28.281607+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:37:28.281607+0000","last_undegraded":"2024-04-26T10:37:28.281607+0000","last_fullsized":"2024-04-26T10:37:28.281607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278862+0000","last_change":"2024-04-26T10:37:23.273700+0000","last_active":"2024-04-26T10:37:28.278862+0000","last_peered":"2024-04-26T10:37:28.278862+0000","last_clean":"2024-04-26T10:37:28.278862+0000","last_became_active":"2024-04-26T10:37:23.272964+0000","last_became_peered":"2024-04-26T10:37:23.272964+0000","last_unstale":"2024-04-26T10:37:28.278862+0000","last_undegraded":"2024-04-26T10:37:28.278862+0000","last_fullsized":"2024-04-26T10:37:28.278862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:49.013542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278797+0000","last_change":"2024-04-26T10:37:23.274112+0000","last_active":"2024-04-26T10:37:28.278797+0000","last_peered":"2024-04-26T10:37:28.278797+0000","last_clean":"2024-04-26T10:37:28.278797+0000","last_became_active":"2024-04-26T10:37:23.271967+0000","last_became_peered":"2024-04-26T10:37:23.271967+0000","last_unstale":"2024-04-26T10:37:28.278797+0000","last_undegraded":"2024-04-26T10:37:28.278797+0000","last_fullsized":"2024-04-26T10:37:28.278797+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:35.182239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279897+0000","last_change":"2024-04-26T10:37:23.268432+0000","last_active":"2024-04-26T10:37:27.279897+0000","last_peered":"2024-04-26T10:37:27.279897+0000","last_clean":"2024-04-26T10:37:27.279897+0000","last_became_active":"2024-04-26T10:37:23.267766+0000","last_became_peered":"2024-04-26T10:37:23.267766+0000","last_unstale":"2024-04-26T10:37:27.279897+0000","last_undegraded":"2024-04-26T10:37:27.279897+0000","last_fullsized":"2024-04-26T10:37:27.279897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:46.203749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280877+0000","last_change":"2024-04-26T10:37:23.270217+0000","last_active":"2024-04-26T10:37:28.280877+0000","last_peered":"2024-04-26T10:37:28.280877+0000","last_clean":"2024-04-26T10:37:28.280877+0000","last_became_active":"2024-04-26T10:37:23.269861+0000","last_became_peered":"2024-04-26T10:37:23.269861+0000","last_unstale":"2024-04-26T10:37:28.280877+0000","last_undegraded":"2024-04-26T10:37:28.280877+0000","last_fullsized":"2024-04-26T10:37:28.280877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:39.366800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279815+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:37:27.279815+0000","last_peered":"2024-04-26T10:37:27.279815+0000","last_clean":"2024-04-26T10:37:27.279815+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:37:27.279815+0000","last_undegraded":"2024-04-26T10:37:27.279815+0000","last_fullsized":"2024-04-26T10:37:27.279815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280420+0000","last_change":"2024-04-26T10:37:23.272702+0000","last_active":"2024-04-26T10:37:27.280420+0000","last_peered":"2024-04-26T10:37:27.280420+0000","last_clean":"2024-04-26T10:37:27.280420+0000","last_became_active":"2024-04-26T10:37:23.272218+0000","last_became_peered":"2024-04-26T10:37:23.272218+0000","last_unstale":"2024-04-26T10:37:27.280420+0000","last_undegraded":"2024-04-26T10:37:27.280420+0000","last_fullsized":"2024-04-26T10:37:27.280420+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:01.008010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282600+0000","last_change":"2024-04-26T10:37:23.271247+0000","last_active":"2024-04-26T10:37:28.282600+0000","last_peered":"2024-04-26T10:37:28.282600+0000","last_clean":"2024-04-26T10:37:28.282600+0000","last_became_active":"2024-04-26T10:37:23.270919+0000","last_became_peered":"2024-04-26T10:37:23.270919+0000","last_unstale":"2024-04-26T10:37:28.282600+0000","last_undegraded":"2024-04-26T10:37:28.282600+0000","last_fullsized":"2024-04-26T10:37:28.282600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:18.340235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279085+0000","last_change":"2024-04-26T10:37:23.275081+0000","last_active":"2024-04-26T10:37:28.279085+0000","last_peered":"2024-04-26T10:37:28.279085+0000","last_clean":"2024-04-26T10:37:28.279085+0000","last_became_active":"2024-04-26T10:37:23.273821+0000","last_became_peered":"2024-04-26T10:37:23.273821+0000","last_unstale":"2024-04-26T10:37:28.279085+0000","last_undegraded":"2024-04-26T10:37:28.279085+0000","last_fullsized":"2024-04-26T10:37:28.279085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:39.585583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279903+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:37:27.279903+0000","last_peered":"2024-04-26T10:37:27.279903+0000","last_clean":"2024-04-26T10:37:27.279903+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:37:27.279903+0000","last_undegraded":"2024-04-26T10:37:27.279903+0000","last_fullsized":"2024-04-26T10:37:27.279903+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280754+0000","last_change":"2024-04-26T10:37:23.273494+0000","last_active":"2024-04-26T10:37:27.280754+0000","last_peered":"2024-04-26T10:37:27.280754+0000","last_clean":"2024-04-26T10:37:27.280754+0000","last_became_active":"2024-04-26T10:37:23.272837+0000","last_became_peered":"2024-04-26T10:37:23.272837+0000","last_unstale":"2024-04-26T10:37:27.280754+0000","last_undegraded":"2024-04-26T10:37:27.280754+0000","last_fullsized":"2024-04-26T10:37:27.280754+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:41.090971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280871+0000","last_change":"2024-04-26T10:37:23.269480+0000","last_active":"2024-04-26T10:37:28.280871+0000","last_peered":"2024-04-26T10:37:28.280871+0000","last_clean":"2024-04-26T10:37:28.280871+0000","last_became_active":"2024-04-26T10:37:23.269197+0000","last_became_peered":"2024-04-26T10:37:23.269197+0000","last_unstale":"2024-04-26T10:37:28.280871+0000","last_undegraded":"2024-04-26T10:37:28.280871+0000","last_fullsized":"2024-04-26T10:37:28.280871+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:37.936936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.284041+0000","last_change":"2024-04-26T10:37:28.283688+0000","last_active":"2024-04-26T10:37:28.284041+0000","last_peered":"2024-04-26T10:37:28.284041+0000","last_clean":"2024-04-26T10:37:28.284041+0000","last_became_active":"2024-04-26T10:37:28.283421+0000","last_became_peered":"2024-04-26T10:37:28.283421+0000","last_unstale":"2024-04-26T10:37:28.284041+0000","last_undegraded":"2024-04-26T10:37:28.284041+0000","last_fullsized":"2024-04-26T10:37:28.284041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:49.619896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280536+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:37:28.280536+0000","last_peered":"2024-04-26T10:37:28.280536+0000","last_clean":"2024-04-26T10:37:28.280536+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:37:28.280536+0000","last_undegraded":"2024-04-26T10:37:28.280536+0000","last_fullsized":"2024-04-26T10:37:28.280536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:19.856062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280679+0000","last_change":"2024-04-26T10:37:23.273035+0000","last_active":"2024-04-26T10:37:27.280679+0000","last_peered":"2024-04-26T10:37:27.280679+0000","last_clean":"2024-04-26T10:37:27.280679+0000","last_became_active":"2024-04-26T10:37:23.272666+0000","last_became_peered":"2024-04-26T10:37:23.272666+0000","last_unstale":"2024-04-26T10:37:27.280679+0000","last_undegraded":"2024-04-26T10:37:27.280679+0000","last_fullsized":"2024-04-26T10:37:27.280679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:37.560011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282711+0000","last_change":"2024-04-26T10:37:23.271100+0000","last_active":"2024-04-26T10:37:28.282711+0000","last_peered":"2024-04-26T10:37:28.282711+0000","last_clean":"2024-04-26T10:37:28.282711+0000","last_became_active":"2024-04-26T10:37:23.270725+0000","last_became_peered":"2024-04-26T10:37:23.270725+0000","last_unstale":"2024-04-26T10:37:28.282711+0000","last_undegraded":"2024-04-26T10:37:28.282711+0000","last_fullsized":"2024-04-26T10:37:28.282711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:27.315487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280408+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:37:28.280408+0000","last_peered":"2024-04-26T10:37:28.280408+0000","last_clean":"2024-04-26T10:37:28.280408+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:37:28.280408+0000","last_undegraded":"2024-04-26T10:37:28.280408+0000","last_fullsized":"2024-04-26T10:37:28.280408+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:04.852453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278996+0000","last_change":"2024-04-26T10:37:23.269851+0000","last_active":"2024-04-26T10:37:28.278996+0000","last_peered":"2024-04-26T10:37:28.278996+0000","last_clean":"2024-04-26T10:37:28.278996+0000","last_became_active":"2024-04-26T10:37:23.269371+0000","last_became_peered":"2024-04-26T10:37:23.269371+0000","last_unstale":"2024-04-26T10:37:28.278996+0000","last_undegraded":"2024-04-26T10:37:28.278996+0000","last_fullsized":"2024-04-26T10:37:28.278996+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:45.005775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280987+0000","last_change":"2024-04-26T10:37:23.269749+0000","last_active":"2024-04-26T10:37:28.280987+0000","last_peered":"2024-04-26T10:37:28.280987+0000","last_clean":"2024-04-26T10:37:28.280987+0000","last_became_active":"2024-04-26T10:37:23.269344+0000","last_became_peered":"2024-04-26T10:37:23.269344+0000","last_unstale":"2024-04-26T10:37:28.280987+0000","last_undegraded":"2024-04-26T10:37:28.280987+0000","last_fullsized":"2024-04-26T10:37:28.280987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:02.488934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280474+0000","last_change":"2024-04-26T10:37:23.273205+0000","last_active":"2024-04-26T10:37:27.280474+0000","last_peered":"2024-04-26T10:37:27.280474+0000","last_clean":"2024-04-26T10:37:27.280474+0000","last_became_active":"2024-04-26T10:37:23.272731+0000","last_became_peered":"2024-04-26T10:37:23.272731+0000","last_unstale":"2024-04-26T10:37:27.280474+0000","last_undegraded":"2024-04-26T10:37:27.280474+0000","last_fullsized":"2024-04-26T10:37:27.280474+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:01.502486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280869+0000","last_change":"2024-04-26T10:34:14.509381+0000","last_active":"2024-04-26T10:37:28.280869+0000","last_peered":"2024-04-26T10:37:28.280869+0000","last_clean":"2024-04-26T10:37:28.280869+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:37:28.280869+0000","last_undegraded":"2024-04-26T10:37:28.280869+0000","last_fullsized":"2024-04-26T10:37:28.280869+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:05.841519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278712+0000","last_change":"2024-04-26T10:37:23.272627+0000","last_active":"2024-04-26T10:37:28.278712+0000","last_peered":"2024-04-26T10:37:28.278712+0000","last_clean":"2024-04-26T10:37:28.278712+0000","last_became_active":"2024-04-26T10:37:23.269968+0000","last_became_peered":"2024-04-26T10:37:23.269968+0000","last_unstale":"2024-04-26T10:37:28.278712+0000","last_undegraded":"2024-04-26T10:37:28.278712+0000","last_fullsized":"2024-04-26T10:37:28.278712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:30.387833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278915+0000","last_change":"2024-04-26T10:37:23.274880+0000","last_active":"2024-04-26T10:37:28.278915+0000","last_peered":"2024-04-26T10:37:28.278915+0000","last_clean":"2024-04-26T10:37:28.278915+0000","last_became_active":"2024-04-26T10:37:23.274045+0000","last_became_peered":"2024-04-26T10:37:23.274045+0000","last_unstale":"2024-04-26T10:37:28.278915+0000","last_undegraded":"2024-04-26T10:37:28.278915+0000","last_fullsized":"2024-04-26T10:37:28.278915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:40.208538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278315+0000","last_change":"2024-04-26T10:37:23.273798+0000","last_active":"2024-04-26T10:37:28.278315+0000","last_peered":"2024-04-26T10:37:28.278315+0000","last_clean":"2024-04-26T10:37:28.278315+0000","last_became_active":"2024-04-26T10:37:23.269775+0000","last_became_peered":"2024-04-26T10:37:23.269775+0000","last_unstale":"2024-04-26T10:37:28.278315+0000","last_undegraded":"2024-04-26T10:37:28.278315+0000","last_fullsized":"2024-04-26T10:37:28.278315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:12.757286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280347+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:37:27.280347+0000","last_peered":"2024-04-26T10:37:27.280347+0000","last_clean":"2024-04-26T10:37:27.280347+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:37:27.280347+0000","last_undegraded":"2024-04-26T10:37:27.280347+0000","last_fullsized":"2024-04-26T10:37:27.280347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:02.872251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280994+0000","last_change":"2024-04-26T10:37:23.270164+0000","last_active":"2024-04-26T10:37:28.280994+0000","last_peered":"2024-04-26T10:37:28.280994+0000","last_clean":"2024-04-26T10:37:28.280994+0000","last_became_active":"2024-04-26T10:37:23.269537+0000","last_became_peered":"2024-04-26T10:37:23.269537+0000","last_unstale":"2024-04-26T10:37:28.280994+0000","last_undegraded":"2024-04-26T10:37:28.280994+0000","last_fullsized":"2024-04-26T10:37:28.280994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:01.680925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280201+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:37:27.280201+0000","last_peered":"2024-04-26T10:37:27.280201+0000","last_clean":"2024-04-26T10:37:27.280201+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:37:27.280201+0000","last_undegraded":"2024-04-26T10:37:27.280201+0000","last_fullsized":"2024-04-26T10:37:27.280201+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:43.500342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279316+0000","last_change":"2024-04-26T10:37:23.268114+0000","last_active":"2024-04-26T10:37:27.279316+0000","last_peered":"2024-04-26T10:37:27.279316+0000","last_clean":"2024-04-26T10:37:27.279316+0000","last_became_active":"2024-04-26T10:37:23.267121+0000","last_became_peered":"2024-04-26T10:37:23.267121+0000","last_unstale":"2024-04-26T10:37:27.279316+0000","last_undegraded":"2024-04-26T10:37:27.279316+0000","last_fullsized":"2024-04-26T10:37:27.279316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:02.467933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282886+0000","last_change":"2024-04-26T10:37:28.282100+0000","last_active":"2024-04-26T10:37:28.282886+0000","last_peered":"2024-04-26T10:37:28.282886+0000","last_clean":"2024-04-26T10:37:28.282886+0000","last_became_active":"2024-04-26T10:37:28.281512+0000","last_became_peered":"2024-04-26T10:37:28.281512+0000","last_unstale":"2024-04-26T10:37:28.282886+0000","last_undegraded":"2024-04-26T10:37:28.282886+0000","last_fullsized":"2024-04-26T10:37:28.282886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.432394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278274+0000","last_change":"2024-04-26T10:37:23.268184+0000","last_active":"2024-04-26T10:37:28.278274+0000","last_peered":"2024-04-26T10:37:28.278274+0000","last_clean":"2024-04-26T10:37:28.278274+0000","last_became_active":"2024-04-26T10:37:23.266377+0000","last_became_peered":"2024-04-26T10:37:23.266377+0000","last_unstale":"2024-04-26T10:37:28.278274+0000","last_undegraded":"2024-04-26T10:37:28.278274+0000","last_fullsized":"2024-04-26T10:37:28.278274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:30.680130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282822+0000","last_change":"2024-04-26T10:37:23.272074+0000","last_active":"2024-04-26T10:37:28.282822+0000","last_peered":"2024-04-26T10:37:28.282822+0000","last_clean":"2024-04-26T10:37:28.282822+0000","last_became_active":"2024-04-26T10:37:23.271752+0000","last_became_peered":"2024-04-26T10:37:23.271752+0000","last_unstale":"2024-04-26T10:37:28.282822+0000","last_undegraded":"2024-04-26T10:37:28.282822+0000","last_fullsized":"2024-04-26T10:37:28.282822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:49.465872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279270+0000","last_change":"2024-04-26T10:37:23.273840+0000","last_active":"2024-04-26T10:37:28.279270+0000","last_peered":"2024-04-26T10:37:28.279270+0000","last_clean":"2024-04-26T10:37:28.279270+0000","last_became_active":"2024-04-26T10:37:23.272156+0000","last_became_peered":"2024-04-26T10:37:23.272156+0000","last_unstale":"2024-04-26T10:37:28.279270+0000","last_undegraded":"2024-04-26T10:37:28.279270+0000","last_fullsized":"2024-04-26T10:37:28.279270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:37.470181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279506+0000","last_change":"2024-04-26T10:37:23.268011+0000","last_active":"2024-04-26T10:37:27.279506+0000","last_peered":"2024-04-26T10:37:27.279506+0000","last_clean":"2024-04-26T10:37:27.279506+0000","last_became_active":"2024-04-26T10:37:23.267717+0000","last_became_peered":"2024-04-26T10:37:23.267717+0000","last_unstale":"2024-04-26T10:37:27.279506+0000","last_undegraded":"2024-04-26T10:37:27.279506+0000","last_fullsized":"2024-04-26T10:37:27.279506+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:51.923777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280555+0000","last_change":"2024-04-26T10:37:23.273179+0000","last_active":"2024-04-26T10:37:27.280555+0000","last_peered":"2024-04-26T10:37:27.280555+0000","last_clean":"2024-04-26T10:37:27.280555+0000","last_became_active":"2024-04-26T10:37:23.272260+0000","last_became_peered":"2024-04-26T10:37:23.272260+0000","last_unstale":"2024-04-26T10:37:27.280555+0000","last_undegraded":"2024-04-26T10:37:27.280555+0000","last_fullsized":"2024-04-26T10:37:27.280555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.097396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279635+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:37:27.279635+0000","last_peered":"2024-04-26T10:37:27.279635+0000","last_clean":"2024-04-26T10:37:27.279635+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:37:27.279635+0000","last_undegraded":"2024-04-26T10:37:27.279635+0000","last_fullsized":"2024-04-26T10:37:27.279635+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:12.954308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278652+0000","last_change":"2024-04-26T10:37:23.269836+0000","last_active":"2024-04-26T10:37:28.278652+0000","last_peered":"2024-04-26T10:37:28.278652+0000","last_clean":"2024-04-26T10:37:28.278652+0000","last_became_active":"2024-04-26T10:37:23.268441+0000","last_became_peered":"2024-04-26T10:37:23.268441+0000","last_unstale":"2024-04-26T10:37:28.278652+0000","last_undegraded":"2024-04-26T10:37:28.278652+0000","last_fullsized":"2024-04-26T10:37:28.278652+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:09.971337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278371+0000","last_change":"2024-04-26T10:37:23.270851+0000","last_active":"2024-04-26T10:37:28.278371+0000","last_peered":"2024-04-26T10:37:28.278371+0000","last_clean":"2024-04-26T10:37:28.278371+0000","last_became_active":"2024-04-26T10:37:23.268451+0000","last_became_peered":"2024-04-26T10:37:23.268451+0000","last_unstale":"2024-04-26T10:37:28.278371+0000","last_undegraded":"2024-04-26T10:37:28.278371+0000","last_fullsized":"2024-04-26T10:37:28.278371+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:48.226025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278899+0000","last_change":"2024-04-26T10:37:23.273635+0000","last_active":"2024-04-26T10:37:28.278899+0000","last_peered":"2024-04-26T10:37:28.278899+0000","last_clean":"2024-04-26T10:37:28.278899+0000","last_became_active":"2024-04-26T10:37:23.272938+0000","last_became_peered":"2024-04-26T10:37:23.272938+0000","last_unstale":"2024-04-26T10:37:28.278899+0000","last_undegraded":"2024-04-26T10:37:28.278899+0000","last_fullsized":"2024-04-26T10:37:28.278899+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:05.613682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281241+0000","last_change":"2024-04-26T10:37:23.277366+0000","last_active":"2024-04-26T10:37:28.281241+0000","last_peered":"2024-04-26T10:37:28.281241+0000","last_clean":"2024-04-26T10:37:28.281241+0000","last_became_active":"2024-04-26T10:37:23.276957+0000","last_became_peered":"2024-04-26T10:37:23.276957+0000","last_unstale":"2024-04-26T10:37:28.281241+0000","last_undegraded":"2024-04-26T10:37:28.281241+0000","last_fullsized":"2024-04-26T10:37:28.281241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:33.029508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281114+0000","last_change":"2024-04-26T10:37:23.277440+0000","last_active":"2024-04-26T10:37:28.281114+0000","last_peered":"2024-04-26T10:37:28.281114+0000","last_clean":"2024-04-26T10:37:28.281114+0000","last_became_active":"2024-04-26T10:37:23.277037+0000","last_became_peered":"2024-04-26T10:37:23.277037+0000","last_unstale":"2024-04-26T10:37:28.281114+0000","last_undegraded":"2024-04-26T10:37:28.281114+0000","last_fullsized":"2024-04-26T10:37:28.281114+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:39.705318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278295+0000","last_change":"2024-04-26T10:37:23.270454+0000","last_active":"2024-04-26T10:37:28.278295+0000","last_peered":"2024-04-26T10:37:28.278295+0000","last_clean":"2024-04-26T10:37:28.278295+0000","last_became_active":"2024-04-26T10:37:23.269473+0000","last_became_peered":"2024-04-26T10:37:23.269473+0000","last_unstale":"2024-04-26T10:37:28.278295+0000","last_undegraded":"2024-04-26T10:37:28.278295+0000","last_fullsized":"2024-04-26T10:37:28.278295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:51.049298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278233+0000","last_change":"2024-04-26T10:37:23.267503+0000","last_active":"2024-04-26T10:37:28.278233+0000","last_peered":"2024-04-26T10:37:28.278233+0000","last_clean":"2024-04-26T10:37:28.278233+0000","last_became_active":"2024-04-26T10:37:23.267235+0000","last_became_peered":"2024-04-26T10:37:23.267235+0000","last_unstale":"2024-04-26T10:37:28.278233+0000","last_undegraded":"2024-04-26T10:37:28.278233+0000","last_fullsized":"2024-04-26T10:37:28.278233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:44.951919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278983+0000","last_change":"2024-04-26T10:37:23.274693+0000","last_active":"2024-04-26T10:37:28.278983+0000","last_peered":"2024-04-26T10:37:28.278983+0000","last_clean":"2024-04-26T10:37:28.278983+0000","last_became_active":"2024-04-26T10:37:23.272111+0000","last_became_peered":"2024-04-26T10:37:23.272111+0000","last_unstale":"2024-04-26T10:37:28.278983+0000","last_undegraded":"2024-04-26T10:37:28.278983+0000","last_fullsized":"2024-04-26T10:37:28.278983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:49.690746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280094+0000","last_change":"2024-04-26T10:37:23.274381+0000","last_active":"2024-04-26T10:37:27.280094+0000","last_peered":"2024-04-26T10:37:27.280094+0000","last_clean":"2024-04-26T10:37:27.280094+0000","last_became_active":"2024-04-26T10:37:23.273867+0000","last_became_peered":"2024-04-26T10:37:23.273867+0000","last_unstale":"2024-04-26T10:37:27.280094+0000","last_undegraded":"2024-04-26T10:37:27.280094+0000","last_fullsized":"2024-04-26T10:37:27.280094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:05.525071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279020+0000","last_change":"2024-04-26T10:37:23.273539+0000","last_active":"2024-04-26T10:37:28.279020+0000","last_peered":"2024-04-26T10:37:28.279020+0000","last_clean":"2024-04-26T10:37:28.279020+0000","last_became_active":"2024-04-26T10:37:23.272569+0000","last_became_peered":"2024-04-26T10:37:23.272569+0000","last_unstale":"2024-04-26T10:37:28.279020+0000","last_undegraded":"2024-04-26T10:37:28.279020+0000","last_fullsized":"2024-04-26T10:37:28.279020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:40.584797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279341+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:37:27.279341+0000","last_peered":"2024-04-26T10:37:27.279341+0000","last_clean":"2024-04-26T10:37:27.279341+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:37:27.279341+0000","last_undegraded":"2024-04-26T10:37:27.279341+0000","last_fullsized":"2024-04-26T10:37:27.279341+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:35.111495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282520+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:37:28.282520+0000","last_peered":"2024-04-26T10:37:28.282520+0000","last_clean":"2024-04-26T10:37:28.282520+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:37:28.282520+0000","last_undegraded":"2024-04-26T10:37:28.282520+0000","last_fullsized":"2024-04-26T10:37:28.282520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284088+0000","last_change":"2024-04-26T10:37:28.282767+0000","last_active":"2024-04-26T10:37:29.284088+0000","last_peered":"2024-04-26T10:37:29.284088+0000","last_clean":"2024-04-26T10:37:29.284088+0000","last_became_active":"2024-04-26T10:37:28.282419+0000","last_became_peered":"2024-04-26T10:37:28.282419+0000","last_unstale":"2024-04-26T10:37:29.284088+0000","last_undegraded":"2024-04-26T10:37:29.284088+0000","last_fullsized":"2024-04-26T10:37:29.284088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:44.531133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278848+0000","last_change":"2024-04-26T10:37:23.274843+0000","last_active":"2024-04-26T10:37:28.278848+0000","last_peered":"2024-04-26T10:37:28.278848+0000","last_clean":"2024-04-26T10:37:28.278848+0000","last_became_active":"2024-04-26T10:37:23.273114+0000","last_became_peered":"2024-04-26T10:37:23.273114+0000","last_unstale":"2024-04-26T10:37:28.278848+0000","last_undegraded":"2024-04-26T10:37:28.278848+0000","last_fullsized":"2024-04-26T10:37:28.278848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:33.001910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279711+0000","last_change":"2024-04-26T10:37:23.268149+0000","last_active":"2024-04-26T10:37:27.279711+0000","last_peered":"2024-04-26T10:37:27.279711+0000","last_clean":"2024-04-26T10:37:27.279711+0000","last_became_active":"2024-04-26T10:37:23.267319+0000","last_became_peered":"2024-04-26T10:37:23.267319+0000","last_unstale":"2024-04-26T10:37:27.279711+0000","last_undegraded":"2024-04-26T10:37:27.279711+0000","last_fullsized":"2024-04-26T10:37:27.279711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:36.211011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278094+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:28.278094+0000","last_peered":"2024-04-26T10:37:28.278094+0000","last_clean":"2024-04-26T10:37:28.278094+0000","last_became_active":"2024-04-26T10:37:23.266332+0000","last_became_peered":"2024-04-26T10:37:23.266332+0000","last_unstale":"2024-04-26T10:37:28.278094+0000","last_undegraded":"2024-04-26T10:37:28.278094+0000","last_fullsized":"2024-04-26T10:37:28.278094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:26.218509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278389+0000","last_change":"2024-04-26T10:37:23.272871+0000","last_active":"2024-04-26T10:37:28.278389+0000","last_peered":"2024-04-26T10:37:28.278389+0000","last_clean":"2024-04-26T10:37:28.278389+0000","last_became_active":"2024-04-26T10:37:23.269657+0000","last_became_peered":"2024-04-26T10:37:23.269657+0000","last_unstale":"2024-04-26T10:37:28.278389+0000","last_undegraded":"2024-04-26T10:37:28.278389+0000","last_fullsized":"2024-04-26T10:37:28.278389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:38.769793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281666+0000","last_change":"2024-04-26T10:34:14.513348+0000","last_active":"2024-04-26T10:37:28.281666+0000","last_peered":"2024-04-26T10:37:28.281666+0000","last_clean":"2024-04-26T10:37:28.281666+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:37:28.281666+0000","last_undegraded":"2024-04-26T10:37:28.281666+0000","last_fullsized":"2024-04-26T10:37:28.281666+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:21.161769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280745+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:37:28.280745+0000","last_peered":"2024-04-26T10:37:28.280745+0000","last_clean":"2024-04-26T10:37:28.280745+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:37:28.280745+0000","last_undegraded":"2024-04-26T10:37:28.280745+0000","last_fullsized":"2024-04-26T10:37:28.280745+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279603+0000","last_change":"2024-04-26T10:37:23.267893+0000","last_active":"2024-04-26T10:37:27.279603+0000","last_peered":"2024-04-26T10:37:27.279603+0000","last_clean":"2024-04-26T10:37:27.279603+0000","last_became_active":"2024-04-26T10:37:23.267595+0000","last_became_peered":"2024-04-26T10:37:23.267595+0000","last_unstale":"2024-04-26T10:37:27.279603+0000","last_undegraded":"2024-04-26T10:37:27.279603+0000","last_fullsized":"2024-04-26T10:37:27.279603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:34.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282762+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:37:28.282762+0000","last_peered":"2024-04-26T10:37:28.282762+0000","last_clean":"2024-04-26T10:37:28.282762+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:37:28.282762+0000","last_undegraded":"2024-04-26T10:37:28.282762+0000","last_fullsized":"2024-04-26T10:37:28.282762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:57.803542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278274+0000","last_change":"2024-04-26T10:37:23.273754+0000","last_active":"2024-04-26T10:37:28.278274+0000","last_peered":"2024-04-26T10:37:28.278274+0000","last_clean":"2024-04-26T10:37:28.278274+0000","last_became_active":"2024-04-26T10:37:23.270451+0000","last_became_peered":"2024-04-26T10:37:23.270451+0000","last_unstale":"2024-04-26T10:37:28.278274+0000","last_undegraded":"2024-04-26T10:37:28.278274+0000","last_fullsized":"2024-04-26T10:37:28.278274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:03.023862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":300,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278550+0000","last_change":"2024-04-26T10:37:23.269600+0000","last_active":"2024-04-26T10:37:28.278550+0000","last_peered":"2024-04-26T10:37:28.278550+0000","last_clean":"2024-04-26T10:37:28.278550+0000","last_became_active":"2024-04-26T10:37:23.268665+0000","last_became_peered":"2024-04-26T10:37:23.268665+0000","last_unstale":"2024-04-26T10:37:28.278550+0000","last_undegraded":"2024-04-26T10:37:28.278550+0000","last_fullsized":"2024-04-26T10:37:28.278550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:27.734866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280817+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:37:28.280817+0000","last_peered":"2024-04-26T10:37:28.280817+0000","last_clean":"2024-04-26T10:37:28.280817+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:37:28.280817+0000","last_undegraded":"2024-04-26T10:37:28.280817+0000","last_fullsized":"2024-04-26T10:37:28.280817+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278725+0000","last_change":"2024-04-26T10:37:23.271849+0000","last_active":"2024-04-26T10:37:28.278725+0000","last_peered":"2024-04-26T10:37:28.278725+0000","last_clean":"2024-04-26T10:37:28.278725+0000","last_became_active":"2024-04-26T10:37:23.269736+0000","last_became_peered":"2024-04-26T10:37:23.269736+0000","last_unstale":"2024-04-26T10:37:28.278725+0000","last_undegraded":"2024-04-26T10:37:28.278725+0000","last_fullsized":"2024-04-26T10:37:28.278725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.639109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278343+0000","last_change":"2024-04-26T10:37:23.266348+0000","last_active":"2024-04-26T10:37:28.278343+0000","last_peered":"2024-04-26T10:37:28.278343+0000","last_clean":"2024-04-26T10:37:28.278343+0000","last_became_active":"2024-04-26T10:37:23.265317+0000","last_became_peered":"2024-04-26T10:37:23.265317+0000","last_unstale":"2024-04-26T10:37:28.278343+0000","last_undegraded":"2024-04-26T10:37:28.278343+0000","last_fullsized":"2024-04-26T10:37:28.278343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:13.956142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280740+0000","last_change":"2024-04-26T10:37:23.276509+0000","last_active":"2024-04-26T10:37:28.280740+0000","last_peered":"2024-04-26T10:37:28.280740+0000","last_clean":"2024-04-26T10:37:28.280740+0000","last_became_active":"2024-04-26T10:37:23.276151+0000","last_became_peered":"2024-04-26T10:37:23.276151+0000","last_unstale":"2024-04-26T10:37:28.280740+0000","last_undegraded":"2024-04-26T10:37:28.280740+0000","last_fullsized":"2024-04-26T10:37:28.280740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:30.924727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280594+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:37:27.280594+0000","last_peered":"2024-04-26T10:37:27.280594+0000","last_clean":"2024-04-26T10:37:27.280594+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:37:27.280594+0000","last_undegraded":"2024-04-26T10:37:27.280594+0000","last_fullsized":"2024-04-26T10:37:27.280594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280625+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:37:27.280625+0000","last_peered":"2024-04-26T10:37:27.280625+0000","last_clean":"2024-04-26T10:37:27.280625+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:37:27.280625+0000","last_undegraded":"2024-04-26T10:37:27.280625+0000","last_fullsized":"2024-04-26T10:37:27.280625+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282126+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:37:28.282126+0000","last_peered":"2024-04-26T10:37:28.282126+0000","last_clean":"2024-04-26T10:37:28.282126+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:37:28.282126+0000","last_undegraded":"2024-04-26T10:37:28.282126+0000","last_fullsized":"2024-04-26T10:37:28.282126+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:21.048381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280027+0000","last_change":"2024-04-26T10:37:23.277636+0000","last_active":"2024-04-26T10:37:27.280027+0000","last_peered":"2024-04-26T10:37:27.280027+0000","last_clean":"2024-04-26T10:37:27.280027+0000","last_became_active":"2024-04-26T10:37:23.277309+0000","last_became_peered":"2024-04-26T10:37:23.277309+0000","last_unstale":"2024-04-26T10:37:27.280027+0000","last_undegraded":"2024-04-26T10:37:27.280027+0000","last_fullsized":"2024-04-26T10:37:27.280027+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:00.429064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282446+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:37:28.282446+0000","last_peered":"2024-04-26T10:37:28.282446+0000","last_clean":"2024-04-26T10:37:28.282446+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:37:28.282446+0000","last_undegraded":"2024-04-26T10:37:28.282446+0000","last_fullsized":"2024-04-26T10:37:28.282446+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282702+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:37:28.282702+0000","last_peered":"2024-04-26T10:37:28.282702+0000","last_clean":"2024-04-26T10:37:28.282702+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:37:28.282702+0000","last_undegraded":"2024-04-26T10:37:28.282702+0000","last_fullsized":"2024-04-26T10:37:28.282702+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.172123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.283483+0000","last_change":"2024-04-26T10:37:28.282300+0000","last_active":"2024-04-26T10:37:28.283483+0000","last_peered":"2024-04-26T10:37:28.283483+0000","last_clean":"2024-04-26T10:37:28.283483+0000","last_became_active":"2024-04-26T10:37:28.281669+0000","last_became_peered":"2024-04-26T10:37:28.281669+0000","last_unstale":"2024-04-26T10:37:28.283483+0000","last_undegraded":"2024-04-26T10:37:28.283483+0000","last_fullsized":"2024-04-26T10:37:28.283483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:23.776919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279088+0000","last_change":"2024-04-26T10:37:23.269479+0000","last_active":"2024-04-26T10:37:28.279088+0000","last_peered":"2024-04-26T10:37:28.279088+0000","last_clean":"2024-04-26T10:37:28.279088+0000","last_became_active":"2024-04-26T10:37:23.268673+0000","last_became_peered":"2024-04-26T10:37:23.268673+0000","last_unstale":"2024-04-26T10:37:28.279088+0000","last_undegraded":"2024-04-26T10:37:28.279088+0000","last_fullsized":"2024-04-26T10:37:28.279088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:52.269482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282451+0000","last_change":"2024-04-26T10:37:23.277426+0000","last_active":"2024-04-26T10:37:28.282451+0000","last_peered":"2024-04-26T10:37:28.282451+0000","last_clean":"2024-04-26T10:37:28.282451+0000","last_became_active":"2024-04-26T10:37:23.277001+0000","last_became_peered":"2024-04-26T10:37:23.277001+0000","last_unstale":"2024-04-26T10:37:28.282451+0000","last_undegraded":"2024-04-26T10:37:28.282451+0000","last_fullsized":"2024-04-26T10:37:28.282451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:38.308038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279463+0000","last_change":"2024-04-26T10:37:23.267342+0000","last_active":"2024-04-26T10:37:27.279463+0000","last_peered":"2024-04-26T10:37:27.279463+0000","last_clean":"2024-04-26T10:37:27.279463+0000","last_became_active":"2024-04-26T10:37:23.266912+0000","last_became_peered":"2024-04-26T10:37:23.266912+0000","last_unstale":"2024-04-26T10:37:27.279463+0000","last_undegraded":"2024-04-26T10:37:27.279463+0000","last_fullsized":"2024-04-26T10:37:27.279463+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:28.070169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279987+0000","last_change":"2024-04-26T10:37:23.277620+0000","last_active":"2024-04-26T10:37:27.279987+0000","last_peered":"2024-04-26T10:37:27.279987+0000","last_clean":"2024-04-26T10:37:27.279987+0000","last_became_active":"2024-04-26T10:37:23.277303+0000","last_became_peered":"2024-04-26T10:37:23.277303+0000","last_unstale":"2024-04-26T10:37:27.279987+0000","last_undegraded":"2024-04-26T10:37:27.279987+0000","last_fullsized":"2024-04-26T10:37:27.279987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:57.292594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280339+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:37:27.280339+0000","last_peered":"2024-04-26T10:37:27.280339+0000","last_clean":"2024-04-26T10:37:27.280339+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:37:27.280339+0000","last_undegraded":"2024-04-26T10:37:27.280339+0000","last_fullsized":"2024-04-26T10:37:27.280339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278431+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:28.278431+0000","last_peered":"2024-04-26T10:37:28.278431+0000","last_clean":"2024-04-26T10:37:28.278431+0000","last_became_active":"2024-04-26T10:37:23.266295+0000","last_became_peered":"2024-04-26T10:37:23.266295+0000","last_unstale":"2024-04-26T10:37:28.278431+0000","last_undegraded":"2024-04-26T10:37:28.278431+0000","last_fullsized":"2024-04-26T10:37:28.278431+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:19.026704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278934+0000","last_change":"2024-04-26T10:37:23.274686+0000","last_active":"2024-04-26T10:37:28.278934+0000","last_peered":"2024-04-26T10:37:28.278934+0000","last_clean":"2024-04-26T10:37:28.278934+0000","last_became_active":"2024-04-26T10:37:23.272039+0000","last_became_peered":"2024-04-26T10:37:23.272039+0000","last_unstale":"2024-04-26T10:37:28.278934+0000","last_undegraded":"2024-04-26T10:37:28.278934+0000","last_fullsized":"2024-04-26T10:37:28.278934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:42.152908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280761+0000","last_change":"2024-04-26T10:37:23.273723+0000","last_active":"2024-04-26T10:37:27.280761+0000","last_peered":"2024-04-26T10:37:27.280761+0000","last_clean":"2024-04-26T10:37:27.280761+0000","last_became_active":"2024-04-26T10:37:23.273253+0000","last_became_peered":"2024-04-26T10:37:23.273253+0000","last_unstale":"2024-04-26T10:37:27.280761+0000","last_undegraded":"2024-04-26T10:37:27.280761+0000","last_fullsized":"2024-04-26T10:37:27.280761+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:30.644188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278246+0000","last_change":"2024-04-26T10:37:23.267726+0000","last_active":"2024-04-26T10:37:28.278246+0000","last_peered":"2024-04-26T10:37:28.278246+0000","last_clean":"2024-04-26T10:37:28.278246+0000","last_became_active":"2024-04-26T10:37:23.267434+0000","last_became_peered":"2024-04-26T10:37:23.267434+0000","last_unstale":"2024-04-26T10:37:28.278246+0000","last_undegraded":"2024-04-26T10:37:28.278246+0000","last_fullsized":"2024-04-26T10:37:28.278246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:43.219752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282593+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:37:28.282593+0000","last_peered":"2024-04-26T10:37:28.282593+0000","last_clean":"2024-04-26T10:37:28.282593+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:37:28.282593+0000","last_undegraded":"2024-04-26T10:37:28.282593+0000","last_fullsized":"2024-04-26T10:37:28.282593+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280206+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:37:27.280206+0000","last_peered":"2024-04-26T10:37:27.280206+0000","last_clean":"2024-04-26T10:37:27.280206+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:37:27.280206+0000","last_undegraded":"2024-04-26T10:37:27.280206+0000","last_fullsized":"2024-04-26T10:37:27.280206+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282593+0000","last_change":"2024-04-26T10:37:23.272052+0000","last_active":"2024-04-26T10:37:28.282593+0000","last_peered":"2024-04-26T10:37:28.282593+0000","last_clean":"2024-04-26T10:37:28.282593+0000","last_became_active":"2024-04-26T10:37:23.271663+0000","last_became_peered":"2024-04-26T10:37:23.271663+0000","last_unstale":"2024-04-26T10:37:28.282593+0000","last_undegraded":"2024-04-26T10:37:28.282593+0000","last_fullsized":"2024-04-26T10:37:28.282593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:31.778313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278501+0000","last_change":"2024-04-26T10:37:23.268370+0000","last_active":"2024-04-26T10:37:28.278501+0000","last_peered":"2024-04-26T10:37:28.278501+0000","last_clean":"2024-04-26T10:37:28.278501+0000","last_became_active":"2024-04-26T10:37:23.266624+0000","last_became_peered":"2024-04-26T10:37:23.266624+0000","last_unstale":"2024-04-26T10:37:28.278501+0000","last_undegraded":"2024-04-26T10:37:28.278501+0000","last_fullsized":"2024-04-26T10:37:28.278501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:42.205710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278444+0000","last_change":"2024-04-26T10:37:23.267652+0000","last_active":"2024-04-26T10:37:28.278444+0000","last_peered":"2024-04-26T10:37:28.278444+0000","last_clean":"2024-04-26T10:37:28.278444+0000","last_became_active":"2024-04-26T10:37:23.266063+0000","last_became_peered":"2024-04-26T10:37:23.266063+0000","last_unstale":"2024-04-26T10:37:28.278444+0000","last_undegraded":"2024-04-26T10:37:28.278444+0000","last_fullsized":"2024-04-26T10:37:28.278444+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:23.209788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283546+0000","last_change":"2024-04-26T10:37:28.282145+0000","last_active":"2024-04-26T10:37:29.283546+0000","last_peered":"2024-04-26T10:37:29.283546+0000","last_clean":"2024-04-26T10:37:29.283546+0000","last_became_active":"2024-04-26T10:37:28.281541+0000","last_became_peered":"2024-04-26T10:37:28.281541+0000","last_unstale":"2024-04-26T10:37:29.283546+0000","last_undegraded":"2024-04-26T10:37:29.283546+0000","last_fullsized":"2024-04-26T10:37:29.283546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:55.649460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279988+0000","last_change":"2024-04-26T10:37:23.268479+0000","last_active":"2024-04-26T10:37:27.279988+0000","last_peered":"2024-04-26T10:37:27.279988+0000","last_clean":"2024-04-26T10:37:27.279988+0000","last_became_active":"2024-04-26T10:37:23.267644+0000","last_became_peered":"2024-04-26T10:37:23.267644+0000","last_unstale":"2024-04-26T10:37:27.279988+0000","last_undegraded":"2024-04-26T10:37:27.279988+0000","last_fullsized":"2024-04-26T10:37:27.279988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:47.606620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281350+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:37:28.281350+0000","last_peered":"2024-04-26T10:37:28.281350+0000","last_clean":"2024-04-26T10:37:28.281350+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:37:28.281350+0000","last_undegraded":"2024-04-26T10:37:28.281350+0000","last_fullsized":"2024-04-26T10:37:28.281350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.021846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279979+0000","last_change":"2024-04-26T10:37:23.274199+0000","last_active":"2024-04-26T10:37:27.279979+0000","last_peered":"2024-04-26T10:37:27.279979+0000","last_clean":"2024-04-26T10:37:27.279979+0000","last_became_active":"2024-04-26T10:37:23.273023+0000","last_became_peered":"2024-04-26T10:37:23.273023+0000","last_unstale":"2024-04-26T10:37:27.279979+0000","last_undegraded":"2024-04-26T10:37:27.279979+0000","last_fullsized":"2024-04-26T10:37:27.279979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:55.142124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1766,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":338840,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":94033000,"statfs":{"total":96636764160,"available":96289792000,"internally_reserved":0,"allocated":917504,"data_stored":359527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346028486},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55000000000000004}]},{"osd":1,"last update":"Fri Apr 26 10:36:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.38100000000000001},"min":{"1min":0.36399999999999999,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.56799999999999995,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.63800000000000001,"15min":0.496},"min":{"1min":0.373,"5min":0.19,"15min":0.19},"max":{"1min":0.59699999999999998,"5min":12.206,"15min":12.206},"last":0.47899999999999998}]}]},{"osd":0,"up_from":75,"seq":322122547203,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55024,"kb_used_data":1500,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94316816,"statfs":{"total":96636764160,"available":96580419584,"internally_reserved":0,"allocated":1536000,"data_stored":951641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7111,"internal_metadata":54780985},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257364,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":255870,"kb_avail":94114476,"statfs":{"total":96636764160,"available":96373223424,"internally_reserved":0,"allocated":1515520,"data_stored":944680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262011334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Apr 26 10:36:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.42199999999999999,"15min":0.35599999999999998},"min":{"1min":0.307,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.59199999999999997,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.503},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48199999999999998,"15min":0.45200000000000001},"min":{"1min":0.27600000000000002,"5min":0.183,"15min":0.183},"max":{"1min":0.60699999999999998,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:37:32.794 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T10:37:32.795 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T10:37:33.194 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T10:37:33.205 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T10:37:33.206 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:37:33.550 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:37:33.551 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:37:33.562 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-04-26T10:37:33.058790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":592134,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":651228,"kb_used_data":3876,"kb_used_omap":10,"kb_used_meta":647285,"kb_avail":282464292,"statfs":{"total":289910292480,"available":289243435008,"internally_reserved":0,"allocated":3969024,"data_stored":2255848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10299,"internal_metadata":662820805},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001391"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280471+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:37:27.280471+0000","last_peered":"2024-04-26T10:37:27.280471+0000","last_clean":"2024-04-26T10:37:27.280471+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:37:27.280471+0000","last_undegraded":"2024-04-26T10:37:27.280471+0000","last_fullsized":"2024-04-26T10:37:27.280471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:26.964955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280495+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:37:27.280495+0000","last_peered":"2024-04-26T10:37:27.280495+0000","last_clean":"2024-04-26T10:37:27.280495+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:37:27.280495+0000","last_undegraded":"2024-04-26T10:37:27.280495+0000","last_fullsized":"2024-04-26T10:37:27.280495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278894+0000","last_change":"2024-04-26T10:37:23.274531+0000","last_active":"2024-04-26T10:37:28.278894+0000","last_peered":"2024-04-26T10:37:28.278894+0000","last_clean":"2024-04-26T10:37:28.278894+0000","last_became_active":"2024-04-26T10:37:23.272107+0000","last_became_peered":"2024-04-26T10:37:23.272107+0000","last_unstale":"2024-04-26T10:37:28.278894+0000","last_undegraded":"2024-04-26T10:37:28.278894+0000","last_fullsized":"2024-04-26T10:37:28.278894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:36.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278352+0000","last_change":"2024-04-26T10:37:23.271611+0000","last_active":"2024-04-26T10:37:28.278352+0000","last_peered":"2024-04-26T10:37:28.278352+0000","last_clean":"2024-04-26T10:37:28.278352+0000","last_became_active":"2024-04-26T10:37:23.269752+0000","last_became_peered":"2024-04-26T10:37:23.269752+0000","last_unstale":"2024-04-26T10:37:28.278352+0000","last_undegraded":"2024-04-26T10:37:28.278352+0000","last_fullsized":"2024-04-26T10:37:28.278352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:17.370231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279559+0000","last_change":"2024-04-26T10:34:14.507618+0000","last_active":"2024-04-26T10:37:27.279559+0000","last_peered":"2024-04-26T10:37:27.279559+0000","last_clean":"2024-04-26T10:37:27.279559+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:37:27.279559+0000","last_undegraded":"2024-04-26T10:37:27.279559+0000","last_fullsized":"2024-04-26T10:37:27.279559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:27.721106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278624+0000","last_change":"2024-04-26T10:37:23.271901+0000","last_active":"2024-04-26T10:37:28.278624+0000","last_peered":"2024-04-26T10:37:28.278624+0000","last_clean":"2024-04-26T10:37:28.278624+0000","last_became_active":"2024-04-26T10:37:23.270593+0000","last_became_peered":"2024-04-26T10:37:23.270593+0000","last_unstale":"2024-04-26T10:37:28.278624+0000","last_undegraded":"2024-04-26T10:37:28.278624+0000","last_fullsized":"2024-04-26T10:37:28.278624+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.909979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278139+0000","last_change":"2024-04-26T10:37:23.271640+0000","last_active":"2024-04-26T10:37:28.278139+0000","last_peered":"2024-04-26T10:37:28.278139+0000","last_clean":"2024-04-26T10:37:28.278139+0000","last_became_active":"2024-04-26T10:37:23.270393+0000","last_became_peered":"2024-04-26T10:37:23.270393+0000","last_unstale":"2024-04-26T10:37:28.278139+0000","last_undegraded":"2024-04-26T10:37:28.278139+0000","last_fullsized":"2024-04-26T10:37:28.278139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:30.161615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.277990+0000","last_change":"2024-04-26T10:37:23.268381+0000","last_active":"2024-04-26T10:37:28.277990+0000","last_peered":"2024-04-26T10:37:28.277990+0000","last_clean":"2024-04-26T10:37:28.277990+0000","last_became_active":"2024-04-26T10:37:23.267296+0000","last_became_peered":"2024-04-26T10:37:23.267296+0000","last_unstale":"2024-04-26T10:37:28.277990+0000","last_undegraded":"2024-04-26T10:37:28.277990+0000","last_fullsized":"2024-04-26T10:37:28.277990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:09.197024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282256+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:37:28.282256+0000","last_peered":"2024-04-26T10:37:28.282256+0000","last_clean":"2024-04-26T10:37:28.282256+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:37:28.282256+0000","last_undegraded":"2024-04-26T10:37:28.282256+0000","last_fullsized":"2024-04-26T10:37:28.282256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280306+0000","last_change":"2024-04-26T10:34:14.507265+0000","last_active":"2024-04-26T10:37:27.280306+0000","last_peered":"2024-04-26T10:37:27.280306+0000","last_clean":"2024-04-26T10:37:27.280306+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:37:27.280306+0000","last_undegraded":"2024-04-26T10:37:27.280306+0000","last_fullsized":"2024-04-26T10:37:27.280306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:07.268421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278994+0000","last_change":"2024-04-26T10:37:23.275734+0000","last_active":"2024-04-26T10:37:28.278994+0000","last_peered":"2024-04-26T10:37:28.278994+0000","last_clean":"2024-04-26T10:37:28.278994+0000","last_became_active":"2024-04-26T10:37:23.273996+0000","last_became_peered":"2024-04-26T10:37:23.273996+0000","last_unstale":"2024-04-26T10:37:28.278994+0000","last_undegraded":"2024-04-26T10:37:28.278994+0000","last_fullsized":"2024-04-26T10:37:28.278994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:19.909745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280151+0000","last_change":"2024-04-26T10:37:23.274459+0000","last_active":"2024-04-26T10:37:27.280151+0000","last_peered":"2024-04-26T10:37:27.280151+0000","last_clean":"2024-04-26T10:37:27.280151+0000","last_became_active":"2024-04-26T10:37:23.273290+0000","last_became_peered":"2024-04-26T10:37:23.273290+0000","last_unstale":"2024-04-26T10:37:27.280151+0000","last_undegraded":"2024-04-26T10:37:27.280151+0000","last_fullsized":"2024-04-26T10:37:27.280151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:48.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279837+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:37:27.279837+0000","last_peered":"2024-04-26T10:37:27.279837+0000","last_clean":"2024-04-26T10:37:27.279837+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:37:27.279837+0000","last_undegraded":"2024-04-26T10:37:27.279837+0000","last_fullsized":"2024-04-26T10:37:27.279837+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:03.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278723+0000","last_change":"2024-04-26T10:37:23.271722+0000","last_active":"2024-04-26T10:37:28.278723+0000","last_peered":"2024-04-26T10:37:28.278723+0000","last_clean":"2024-04-26T10:37:28.278723+0000","last_became_active":"2024-04-26T10:37:23.269722+0000","last_became_peered":"2024-04-26T10:37:23.269722+0000","last_unstale":"2024-04-26T10:37:28.278723+0000","last_undegraded":"2024-04-26T10:37:28.278723+0000","last_fullsized":"2024-04-26T10:37:28.278723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:22.768002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278663+0000","last_change":"2024-04-26T10:37:23.271761+0000","last_active":"2024-04-26T10:37:28.278663+0000","last_peered":"2024-04-26T10:37:28.278663+0000","last_clean":"2024-04-26T10:37:28.278663+0000","last_became_active":"2024-04-26T10:37:23.270852+0000","last_became_peered":"2024-04-26T10:37:23.270852+0000","last_unstale":"2024-04-26T10:37:28.278663+0000","last_undegraded":"2024-04-26T10:37:28.278663+0000","last_fullsized":"2024-04-26T10:37:28.278663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:17.289523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278631+0000","last_change":"2024-04-26T10:37:23.270523+0000","last_active":"2024-04-26T10:37:28.278631+0000","last_peered":"2024-04-26T10:37:28.278631+0000","last_clean":"2024-04-26T10:37:28.278631+0000","last_became_active":"2024-04-26T10:37:23.268640+0000","last_became_peered":"2024-04-26T10:37:23.268640+0000","last_unstale":"2024-04-26T10:37:28.278631+0000","last_undegraded":"2024-04-26T10:37:28.278631+0000","last_fullsized":"2024-04-26T10:37:28.278631+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:45.353248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284300+0000","last_change":"2024-04-26T10:37:28.282247+0000","last_active":"2024-04-26T10:37:29.284300+0000","last_peered":"2024-04-26T10:37:29.284300+0000","last_clean":"2024-04-26T10:37:29.284300+0000","last_became_active":"2024-04-26T10:37:28.281510+0000","last_became_peered":"2024-04-26T10:37:28.281510+0000","last_unstale":"2024-04-26T10:37:29.284300+0000","last_undegraded":"2024-04-26T10:37:29.284300+0000","last_fullsized":"2024-04-26T10:37:29.284300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:37.366727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280445+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:37:27.280445+0000","last_peered":"2024-04-26T10:37:27.280445+0000","last_clean":"2024-04-26T10:37:27.280445+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:37:27.280445+0000","last_undegraded":"2024-04-26T10:37:27.280445+0000","last_fullsized":"2024-04-26T10:37:27.280445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.343269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281607+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:37:28.281607+0000","last_peered":"2024-04-26T10:37:28.281607+0000","last_clean":"2024-04-26T10:37:28.281607+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:37:28.281607+0000","last_undegraded":"2024-04-26T10:37:28.281607+0000","last_fullsized":"2024-04-26T10:37:28.281607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278862+0000","last_change":"2024-04-26T10:37:23.273700+0000","last_active":"2024-04-26T10:37:28.278862+0000","last_peered":"2024-04-26T10:37:28.278862+0000","last_clean":"2024-04-26T10:37:28.278862+0000","last_became_active":"2024-04-26T10:37:23.272964+0000","last_became_peered":"2024-04-26T10:37:23.272964+0000","last_unstale":"2024-04-26T10:37:28.278862+0000","last_undegraded":"2024-04-26T10:37:28.278862+0000","last_fullsized":"2024-04-26T10:37:28.278862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:49.013542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278797+0000","last_change":"2024-04-26T10:37:23.274112+0000","last_active":"2024-04-26T10:37:28.278797+0000","last_peered":"2024-04-26T10:37:28.278797+0000","last_clean":"2024-04-26T10:37:28.278797+0000","last_became_active":"2024-04-26T10:37:23.271967+0000","last_became_peered":"2024-04-26T10:37:23.271967+0000","last_unstale":"2024-04-26T10:37:28.278797+0000","last_undegraded":"2024-04-26T10:37:28.278797+0000","last_fullsized":"2024-04-26T10:37:28.278797+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:35.182239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279897+0000","last_change":"2024-04-26T10:37:23.268432+0000","last_active":"2024-04-26T10:37:27.279897+0000","last_peered":"2024-04-26T10:37:27.279897+0000","last_clean":"2024-04-26T10:37:27.279897+0000","last_became_active":"2024-04-26T10:37:23.267766+0000","last_became_peered":"2024-04-26T10:37:23.267766+0000","last_unstale":"2024-04-26T10:37:27.279897+0000","last_undegraded":"2024-04-26T10:37:27.279897+0000","last_fullsized":"2024-04-26T10:37:27.279897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:46.203749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280877+0000","last_change":"2024-04-26T10:37:23.270217+0000","last_active":"2024-04-26T10:37:28.280877+0000","last_peered":"2024-04-26T10:37:28.280877+0000","last_clean":"2024-04-26T10:37:28.280877+0000","last_became_active":"2024-04-26T10:37:23.269861+0000","last_became_peered":"2024-04-26T10:37:23.269861+0000","last_unstale":"2024-04-26T10:37:28.280877+0000","last_undegraded":"2024-04-26T10:37:28.280877+0000","last_fullsized":"2024-04-26T10:37:28.280877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:39.366800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279815+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:37:27.279815+0000","last_peered":"2024-04-26T10:37:27.279815+0000","last_clean":"2024-04-26T10:37:27.279815+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:37:27.279815+0000","last_undegraded":"2024-04-26T10:37:27.279815+0000","last_fullsized":"2024-04-26T10:37:27.279815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280420+0000","last_change":"2024-04-26T10:37:23.272702+0000","last_active":"2024-04-26T10:37:27.280420+0000","last_peered":"2024-04-26T10:37:27.280420+0000","last_clean":"2024-04-26T10:37:27.280420+0000","last_became_active":"2024-04-26T10:37:23.272218+0000","last_became_peered":"2024-04-26T10:37:23.272218+0000","last_unstale":"2024-04-26T10:37:27.280420+0000","last_undegraded":"2024-04-26T10:37:27.280420+0000","last_fullsized":"2024-04-26T10:37:27.280420+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:01.008010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282600+0000","last_change":"2024-04-26T10:37:23.271247+0000","last_active":"2024-04-26T10:37:28.282600+0000","last_peered":"2024-04-26T10:37:28.282600+0000","last_clean":"2024-04-26T10:37:28.282600+0000","last_became_active":"2024-04-26T10:37:23.270919+0000","last_became_peered":"2024-04-26T10:37:23.270919+0000","last_unstale":"2024-04-26T10:37:28.282600+0000","last_undegraded":"2024-04-26T10:37:28.282600+0000","last_fullsized":"2024-04-26T10:37:28.282600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:18.340235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279085+0000","last_change":"2024-04-26T10:37:23.275081+0000","last_active":"2024-04-26T10:37:28.279085+0000","last_peered":"2024-04-26T10:37:28.279085+0000","last_clean":"2024-04-26T10:37:28.279085+0000","last_became_active":"2024-04-26T10:37:23.273821+0000","last_became_peered":"2024-04-26T10:37:23.273821+0000","last_unstale":"2024-04-26T10:37:28.279085+0000","last_undegraded":"2024-04-26T10:37:28.279085+0000","last_fullsized":"2024-04-26T10:37:28.279085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:39.585583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279903+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:37:27.279903+0000","last_peered":"2024-04-26T10:37:27.279903+0000","last_clean":"2024-04-26T10:37:27.279903+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:37:27.279903+0000","last_undegraded":"2024-04-26T10:37:27.279903+0000","last_fullsized":"2024-04-26T10:37:27.279903+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280754+0000","last_change":"2024-04-26T10:37:23.273494+0000","last_active":"2024-04-26T10:37:27.280754+0000","last_peered":"2024-04-26T10:37:27.280754+0000","last_clean":"2024-04-26T10:37:27.280754+0000","last_became_active":"2024-04-26T10:37:23.272837+0000","last_became_peered":"2024-04-26T10:37:23.272837+0000","last_unstale":"2024-04-26T10:37:27.280754+0000","last_undegraded":"2024-04-26T10:37:27.280754+0000","last_fullsized":"2024-04-26T10:37:27.280754+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:41.090971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280871+0000","last_change":"2024-04-26T10:37:23.269480+0000","last_active":"2024-04-26T10:37:28.280871+0000","last_peered":"2024-04-26T10:37:28.280871+0000","last_clean":"2024-04-26T10:37:28.280871+0000","last_became_active":"2024-04-26T10:37:23.269197+0000","last_became_peered":"2024-04-26T10:37:23.269197+0000","last_unstale":"2024-04-26T10:37:28.280871+0000","last_undegraded":"2024-04-26T10:37:28.280871+0000","last_fullsized":"2024-04-26T10:37:28.280871+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:37.936936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.284041+0000","last_change":"2024-04-26T10:37:28.283688+0000","last_active":"2024-04-26T10:37:28.284041+0000","last_peered":"2024-04-26T10:37:28.284041+0000","last_clean":"2024-04-26T10:37:28.284041+0000","last_became_active":"2024-04-26T10:37:28.283421+0000","last_became_peered":"2024-04-26T10:37:28.283421+0000","last_unstale":"2024-04-26T10:37:28.284041+0000","last_undegraded":"2024-04-26T10:37:28.284041+0000","last_fullsized":"2024-04-26T10:37:28.284041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:49.619896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280536+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:37:28.280536+0000","last_peered":"2024-04-26T10:37:28.280536+0000","last_clean":"2024-04-26T10:37:28.280536+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:37:28.280536+0000","last_undegraded":"2024-04-26T10:37:28.280536+0000","last_fullsized":"2024-04-26T10:37:28.280536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:19.856062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280679+0000","last_change":"2024-04-26T10:37:23.273035+0000","last_active":"2024-04-26T10:37:27.280679+0000","last_peered":"2024-04-26T10:37:27.280679+0000","last_clean":"2024-04-26T10:37:27.280679+0000","last_became_active":"2024-04-26T10:37:23.272666+0000","last_became_peered":"2024-04-26T10:37:23.272666+0000","last_unstale":"2024-04-26T10:37:27.280679+0000","last_undegraded":"2024-04-26T10:37:27.280679+0000","last_fullsized":"2024-04-26T10:37:27.280679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:37.560011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282711+0000","last_change":"2024-04-26T10:37:23.271100+0000","last_active":"2024-04-26T10:37:28.282711+0000","last_peered":"2024-04-26T10:37:28.282711+0000","last_clean":"2024-04-26T10:37:28.282711+0000","last_became_active":"2024-04-26T10:37:23.270725+0000","last_became_peered":"2024-04-26T10:37:23.270725+0000","last_unstale":"2024-04-26T10:37:28.282711+0000","last_undegraded":"2024-04-26T10:37:28.282711+0000","last_fullsized":"2024-04-26T10:37:28.282711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:27.315487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280408+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:37:28.280408+0000","last_peered":"2024-04-26T10:37:28.280408+0000","last_clean":"2024-04-26T10:37:28.280408+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:37:28.280408+0000","last_undegraded":"2024-04-26T10:37:28.280408+0000","last_fullsized":"2024-04-26T10:37:28.280408+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:04.852453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278996+0000","last_change":"2024-04-26T10:37:23.269851+0000","last_active":"2024-04-26T10:37:28.278996+0000","last_peered":"2024-04-26T10:37:28.278996+0000","last_clean":"2024-04-26T10:37:28.278996+0000","last_became_active":"2024-04-26T10:37:23.269371+0000","last_became_peered":"2024-04-26T10:37:23.269371+0000","last_unstale":"2024-04-26T10:37:28.278996+0000","last_undegraded":"2024-04-26T10:37:28.278996+0000","last_fullsized":"2024-04-26T10:37:28.278996+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:45.005775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280987+0000","last_change":"2024-04-26T10:37:23.269749+0000","last_active":"2024-04-26T10:37:28.280987+0000","last_peered":"2024-04-26T10:37:28.280987+0000","last_clean":"2024-04-26T10:37:28.280987+0000","last_became_active":"2024-04-26T10:37:23.269344+0000","last_became_peered":"2024-04-26T10:37:23.269344+0000","last_unstale":"2024-04-26T10:37:28.280987+0000","last_undegraded":"2024-04-26T10:37:28.280987+0000","last_fullsized":"2024-04-26T10:37:28.280987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:02.488934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280474+0000","last_change":"2024-04-26T10:37:23.273205+0000","last_active":"2024-04-26T10:37:27.280474+0000","last_peered":"2024-04-26T10:37:27.280474+0000","last_clean":"2024-04-26T10:37:27.280474+0000","last_became_active":"2024-04-26T10:37:23.272731+0000","last_became_peered":"2024-04-26T10:37:23.272731+0000","last_unstale":"2024-04-26T10:37:27.280474+0000","last_undegraded":"2024-04-26T10:37:27.280474+0000","last_fullsized":"2024-04-26T10:37:27.280474+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:01.502486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280869+0000","last_change":"2024-04-26T10:34:14.509381+0000","last_active":"2024-04-26T10:37:28.280869+0000","last_peered":"2024-04-26T10:37:28.280869+0000","last_clean":"2024-04-26T10:37:28.280869+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:37:28.280869+0000","last_undegraded":"2024-04-26T10:37:28.280869+0000","last_fullsized":"2024-04-26T10:37:28.280869+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:05.841519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278712+0000","last_change":"2024-04-26T10:37:23.272627+0000","last_active":"2024-04-26T10:37:28.278712+0000","last_peered":"2024-04-26T10:37:28.278712+0000","last_clean":"2024-04-26T10:37:28.278712+0000","last_became_active":"2024-04-26T10:37:23.269968+0000","last_became_peered":"2024-04-26T10:37:23.269968+0000","last_unstale":"2024-04-26T10:37:28.278712+0000","last_undegraded":"2024-04-26T10:37:28.278712+0000","last_fullsized":"2024-04-26T10:37:28.278712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:30.387833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278915+0000","last_change":"2024-04-26T10:37:23.274880+0000","last_active":"2024-04-26T10:37:28.278915+0000","last_peered":"2024-04-26T10:37:28.278915+0000","last_clean":"2024-04-26T10:37:28.278915+0000","last_became_active":"2024-04-26T10:37:23.274045+0000","last_became_peered":"2024-04-26T10:37:23.274045+0000","last_unstale":"2024-04-26T10:37:28.278915+0000","last_undegraded":"2024-04-26T10:37:28.278915+0000","last_fullsized":"2024-04-26T10:37:28.278915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:40.208538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278315+0000","last_change":"2024-04-26T10:37:23.273798+0000","last_active":"2024-04-26T10:37:28.278315+0000","last_peered":"2024-04-26T10:37:28.278315+0000","last_clean":"2024-04-26T10:37:28.278315+0000","last_became_active":"2024-04-26T10:37:23.269775+0000","last_became_peered":"2024-04-26T10:37:23.269775+0000","last_unstale":"2024-04-26T10:37:28.278315+0000","last_undegraded":"2024-04-26T10:37:28.278315+0000","last_fullsized":"2024-04-26T10:37:28.278315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:12.757286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280347+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:37:27.280347+0000","last_peered":"2024-04-26T10:37:27.280347+0000","last_clean":"2024-04-26T10:37:27.280347+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:37:27.280347+0000","last_undegraded":"2024-04-26T10:37:27.280347+0000","last_fullsized":"2024-04-26T10:37:27.280347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:02.872251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280994+0000","last_change":"2024-04-26T10:37:23.270164+0000","last_active":"2024-04-26T10:37:28.280994+0000","last_peered":"2024-04-26T10:37:28.280994+0000","last_clean":"2024-04-26T10:37:28.280994+0000","last_became_active":"2024-04-26T10:37:23.269537+0000","last_became_peered":"2024-04-26T10:37:23.269537+0000","last_unstale":"2024-04-26T10:37:28.280994+0000","last_undegraded":"2024-04-26T10:37:28.280994+0000","last_fullsized":"2024-04-26T10:37:28.280994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:01.680925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280201+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:37:27.280201+0000","last_peered":"2024-04-26T10:37:27.280201+0000","last_clean":"2024-04-26T10:37:27.280201+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:37:27.280201+0000","last_undegraded":"2024-04-26T10:37:27.280201+0000","last_fullsized":"2024-04-26T10:37:27.280201+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:43.500342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279316+0000","last_change":"2024-04-26T10:37:23.268114+0000","last_active":"2024-04-26T10:37:27.279316+0000","last_peered":"2024-04-26T10:37:27.279316+0000","last_clean":"2024-04-26T10:37:27.279316+0000","last_became_active":"2024-04-26T10:37:23.267121+0000","last_became_peered":"2024-04-26T10:37:23.267121+0000","last_unstale":"2024-04-26T10:37:27.279316+0000","last_undegraded":"2024-04-26T10:37:27.279316+0000","last_fullsized":"2024-04-26T10:37:27.279316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:02.467933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282886+0000","last_change":"2024-04-26T10:37:28.282100+0000","last_active":"2024-04-26T10:37:28.282886+0000","last_peered":"2024-04-26T10:37:28.282886+0000","last_clean":"2024-04-26T10:37:28.282886+0000","last_became_active":"2024-04-26T10:37:28.281512+0000","last_became_peered":"2024-04-26T10:37:28.281512+0000","last_unstale":"2024-04-26T10:37:28.282886+0000","last_undegraded":"2024-04-26T10:37:28.282886+0000","last_fullsized":"2024-04-26T10:37:28.282886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.432394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278274+0000","last_change":"2024-04-26T10:37:23.268184+0000","last_active":"2024-04-26T10:37:28.278274+0000","last_peered":"2024-04-26T10:37:28.278274+0000","last_clean":"2024-04-26T10:37:28.278274+0000","last_became_active":"2024-04-26T10:37:23.266377+0000","last_became_peered":"2024-04-26T10:37:23.266377+0000","last_unstale":"2024-04-26T10:37:28.278274+0000","last_undegraded":"2024-04-26T10:37:28.278274+0000","last_fullsized":"2024-04-26T10:37:28.278274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:30.680130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282822+0000","last_change":"2024-04-26T10:37:23.272074+0000","last_active":"2024-04-26T10:37:28.282822+0000","last_peered":"2024-04-26T10:37:28.282822+0000","last_clean":"2024-04-26T10:37:28.282822+0000","last_became_active":"2024-04-26T10:37:23.271752+0000","last_became_peered":"2024-04-26T10:37:23.271752+0000","last_unstale":"2024-04-26T10:37:28.282822+0000","last_undegraded":"2024-04-26T10:37:28.282822+0000","last_fullsized":"2024-04-26T10:37:28.282822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:49.465872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279270+0000","last_change":"2024-04-26T10:37:23.273840+0000","last_active":"2024-04-26T10:37:28.279270+0000","last_peered":"2024-04-26T10:37:28.279270+0000","last_clean":"2024-04-26T10:37:28.279270+0000","last_became_active":"2024-04-26T10:37:23.272156+0000","last_became_peered":"2024-04-26T10:37:23.272156+0000","last_unstale":"2024-04-26T10:37:28.279270+0000","last_undegraded":"2024-04-26T10:37:28.279270+0000","last_fullsized":"2024-04-26T10:37:28.279270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:37.470181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279506+0000","last_change":"2024-04-26T10:37:23.268011+0000","last_active":"2024-04-26T10:37:27.279506+0000","last_peered":"2024-04-26T10:37:27.279506+0000","last_clean":"2024-04-26T10:37:27.279506+0000","last_became_active":"2024-04-26T10:37:23.267717+0000","last_became_peered":"2024-04-26T10:37:23.267717+0000","last_unstale":"2024-04-26T10:37:27.279506+0000","last_undegraded":"2024-04-26T10:37:27.279506+0000","last_fullsized":"2024-04-26T10:37:27.279506+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:51.923777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280555+0000","last_change":"2024-04-26T10:37:23.273179+0000","last_active":"2024-04-26T10:37:27.280555+0000","last_peered":"2024-04-26T10:37:27.280555+0000","last_clean":"2024-04-26T10:37:27.280555+0000","last_became_active":"2024-04-26T10:37:23.272260+0000","last_became_peered":"2024-04-26T10:37:23.272260+0000","last_unstale":"2024-04-26T10:37:27.280555+0000","last_undegraded":"2024-04-26T10:37:27.280555+0000","last_fullsized":"2024-04-26T10:37:27.280555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.097396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279635+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:37:27.279635+0000","last_peered":"2024-04-26T10:37:27.279635+0000","last_clean":"2024-04-26T10:37:27.279635+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:37:27.279635+0000","last_undegraded":"2024-04-26T10:37:27.279635+0000","last_fullsized":"2024-04-26T10:37:27.279635+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:12.954308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278652+0000","last_change":"2024-04-26T10:37:23.269836+0000","last_active":"2024-04-26T10:37:28.278652+0000","last_peered":"2024-04-26T10:37:28.278652+0000","last_clean":"2024-04-26T10:37:28.278652+0000","last_became_active":"2024-04-26T10:37:23.268441+0000","last_became_peered":"2024-04-26T10:37:23.268441+0000","last_unstale":"2024-04-26T10:37:28.278652+0000","last_undegraded":"2024-04-26T10:37:28.278652+0000","last_fullsized":"2024-04-26T10:37:28.278652+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:09.971337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278371+0000","last_change":"2024-04-26T10:37:23.270851+0000","last_active":"2024-04-26T10:37:28.278371+0000","last_peered":"2024-04-26T10:37:28.278371+0000","last_clean":"2024-04-26T10:37:28.278371+0000","last_became_active":"2024-04-26T10:37:23.268451+0000","last_became_peered":"2024-04-26T10:37:23.268451+0000","last_unstale":"2024-04-26T10:37:28.278371+0000","last_undegraded":"2024-04-26T10:37:28.278371+0000","last_fullsized":"2024-04-26T10:37:28.278371+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:48.226025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278899+0000","last_change":"2024-04-26T10:37:23.273635+0000","last_active":"2024-04-26T10:37:28.278899+0000","last_peered":"2024-04-26T10:37:28.278899+0000","last_clean":"2024-04-26T10:37:28.278899+0000","last_became_active":"2024-04-26T10:37:23.272938+0000","last_became_peered":"2024-04-26T10:37:23.272938+0000","last_unstale":"2024-04-26T10:37:28.278899+0000","last_undegraded":"2024-04-26T10:37:28.278899+0000","last_fullsized":"2024-04-26T10:37:28.278899+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:05.613682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281241+0000","last_change":"2024-04-26T10:37:23.277366+0000","last_active":"2024-04-26T10:37:28.281241+0000","last_peered":"2024-04-26T10:37:28.281241+0000","last_clean":"2024-04-26T10:37:28.281241+0000","last_became_active":"2024-04-26T10:37:23.276957+0000","last_became_peered":"2024-04-26T10:37:23.276957+0000","last_unstale":"2024-04-26T10:37:28.281241+0000","last_undegraded":"2024-04-26T10:37:28.281241+0000","last_fullsized":"2024-04-26T10:37:28.281241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:33.029508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281114+0000","last_change":"2024-04-26T10:37:23.277440+0000","last_active":"2024-04-26T10:37:28.281114+0000","last_peered":"2024-04-26T10:37:28.281114+0000","last_clean":"2024-04-26T10:37:28.281114+0000","last_became_active":"2024-04-26T10:37:23.277037+0000","last_became_peered":"2024-04-26T10:37:23.277037+0000","last_unstale":"2024-04-26T10:37:28.281114+0000","last_undegraded":"2024-04-26T10:37:28.281114+0000","last_fullsized":"2024-04-26T10:37:28.281114+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:39.705318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278295+0000","last_change":"2024-04-26T10:37:23.270454+0000","last_active":"2024-04-26T10:37:28.278295+0000","last_peered":"2024-04-26T10:37:28.278295+0000","last_clean":"2024-04-26T10:37:28.278295+0000","last_became_active":"2024-04-26T10:37:23.269473+0000","last_became_peered":"2024-04-26T10:37:23.269473+0000","last_unstale":"2024-04-26T10:37:28.278295+0000","last_undegraded":"2024-04-26T10:37:28.278295+0000","last_fullsized":"2024-04-26T10:37:28.278295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:51.049298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278233+0000","last_change":"2024-04-26T10:37:23.267503+0000","last_active":"2024-04-26T10:37:28.278233+0000","last_peered":"2024-04-26T10:37:28.278233+0000","last_clean":"2024-04-26T10:37:28.278233+0000","last_became_active":"2024-04-26T10:37:23.267235+0000","last_became_peered":"2024-04-26T10:37:23.267235+0000","last_unstale":"2024-04-26T10:37:28.278233+0000","last_undegraded":"2024-04-26T10:37:28.278233+0000","last_fullsized":"2024-04-26T10:37:28.278233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:44.951919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278983+0000","last_change":"2024-04-26T10:37:23.274693+0000","last_active":"2024-04-26T10:37:28.278983+0000","last_peered":"2024-04-26T10:37:28.278983+0000","last_clean":"2024-04-26T10:37:28.278983+0000","last_became_active":"2024-04-26T10:37:23.272111+0000","last_became_peered":"2024-04-26T10:37:23.272111+0000","last_unstale":"2024-04-26T10:37:28.278983+0000","last_undegraded":"2024-04-26T10:37:28.278983+0000","last_fullsized":"2024-04-26T10:37:28.278983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:49.690746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280094+0000","last_change":"2024-04-26T10:37:23.274381+0000","last_active":"2024-04-26T10:37:27.280094+0000","last_peered":"2024-04-26T10:37:27.280094+0000","last_clean":"2024-04-26T10:37:27.280094+0000","last_became_active":"2024-04-26T10:37:23.273867+0000","last_became_peered":"2024-04-26T10:37:23.273867+0000","last_unstale":"2024-04-26T10:37:27.280094+0000","last_undegraded":"2024-04-26T10:37:27.280094+0000","last_fullsized":"2024-04-26T10:37:27.280094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:05.525071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279020+0000","last_change":"2024-04-26T10:37:23.273539+0000","last_active":"2024-04-26T10:37:28.279020+0000","last_peered":"2024-04-26T10:37:28.279020+0000","last_clean":"2024-04-26T10:37:28.279020+0000","last_became_active":"2024-04-26T10:37:23.272569+0000","last_became_peered":"2024-04-26T10:37:23.272569+0000","last_unstale":"2024-04-26T10:37:28.279020+0000","last_undegraded":"2024-04-26T10:37:28.279020+0000","last_fullsized":"2024-04-26T10:37:28.279020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:40.584797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279341+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:37:27.279341+0000","last_peered":"2024-04-26T10:37:27.279341+0000","last_clean":"2024-04-26T10:37:27.279341+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:37:27.279341+0000","last_undegraded":"2024-04-26T10:37:27.279341+0000","last_fullsized":"2024-04-26T10:37:27.279341+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:35.111495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282520+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:37:28.282520+0000","last_peered":"2024-04-26T10:37:28.282520+0000","last_clean":"2024-04-26T10:37:28.282520+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:37:28.282520+0000","last_undegraded":"2024-04-26T10:37:28.282520+0000","last_fullsized":"2024-04-26T10:37:28.282520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284088+0000","last_change":"2024-04-26T10:37:28.282767+0000","last_active":"2024-04-26T10:37:29.284088+0000","last_peered":"2024-04-26T10:37:29.284088+0000","last_clean":"2024-04-26T10:37:29.284088+0000","last_became_active":"2024-04-26T10:37:28.282419+0000","last_became_peered":"2024-04-26T10:37:28.282419+0000","last_unstale":"2024-04-26T10:37:29.284088+0000","last_undegraded":"2024-04-26T10:37:29.284088+0000","last_fullsized":"2024-04-26T10:37:29.284088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:44.531133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278848+0000","last_change":"2024-04-26T10:37:23.274843+0000","last_active":"2024-04-26T10:37:28.278848+0000","last_peered":"2024-04-26T10:37:28.278848+0000","last_clean":"2024-04-26T10:37:28.278848+0000","last_became_active":"2024-04-26T10:37:23.273114+0000","last_became_peered":"2024-04-26T10:37:23.273114+0000","last_unstale":"2024-04-26T10:37:28.278848+0000","last_undegraded":"2024-04-26T10:37:28.278848+0000","last_fullsized":"2024-04-26T10:37:28.278848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:33.001910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279711+0000","last_change":"2024-04-26T10:37:23.268149+0000","last_active":"2024-04-26T10:37:27.279711+0000","last_peered":"2024-04-26T10:37:27.279711+0000","last_clean":"2024-04-26T10:37:27.279711+0000","last_became_active":"2024-04-26T10:37:23.267319+0000","last_became_peered":"2024-04-26T10:37:23.267319+0000","last_unstale":"2024-04-26T10:37:27.279711+0000","last_undegraded":"2024-04-26T10:37:27.279711+0000","last_fullsized":"2024-04-26T10:37:27.279711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:36.211011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278094+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:28.278094+0000","last_peered":"2024-04-26T10:37:28.278094+0000","last_clean":"2024-04-26T10:37:28.278094+0000","last_became_active":"2024-04-26T10:37:23.266332+0000","last_became_peered":"2024-04-26T10:37:23.266332+0000","last_unstale":"2024-04-26T10:37:28.278094+0000","last_undegraded":"2024-04-26T10:37:28.278094+0000","last_fullsized":"2024-04-26T10:37:28.278094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:26.218509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278389+0000","last_change":"2024-04-26T10:37:23.272871+0000","last_active":"2024-04-26T10:37:28.278389+0000","last_peered":"2024-04-26T10:37:28.278389+0000","last_clean":"2024-04-26T10:37:28.278389+0000","last_became_active":"2024-04-26T10:37:23.269657+0000","last_became_peered":"2024-04-26T10:37:23.269657+0000","last_unstale":"2024-04-26T10:37:28.278389+0000","last_undegraded":"2024-04-26T10:37:28.278389+0000","last_fullsized":"2024-04-26T10:37:28.278389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:38.769793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281666+0000","last_change":"2024-04-26T10:34:14.513348+0000","last_active":"2024-04-26T10:37:28.281666+0000","last_peered":"2024-04-26T10:37:28.281666+0000","last_clean":"2024-04-26T10:37:28.281666+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:37:28.281666+0000","last_undegraded":"2024-04-26T10:37:28.281666+0000","last_fullsized":"2024-04-26T10:37:28.281666+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:21.161769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280745+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:37:28.280745+0000","last_peered":"2024-04-26T10:37:28.280745+0000","last_clean":"2024-04-26T10:37:28.280745+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:37:28.280745+0000","last_undegraded":"2024-04-26T10:37:28.280745+0000","last_fullsized":"2024-04-26T10:37:28.280745+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279603+0000","last_change":"2024-04-26T10:37:23.267893+0000","last_active":"2024-04-26T10:37:27.279603+0000","last_peered":"2024-04-26T10:37:27.279603+0000","last_clean":"2024-04-26T10:37:27.279603+0000","last_became_active":"2024-04-26T10:37:23.267595+0000","last_became_peered":"2024-04-26T10:37:23.267595+0000","last_unstale":"2024-04-26T10:37:27.279603+0000","last_undegraded":"2024-04-26T10:37:27.279603+0000","last_fullsized":"2024-04-26T10:37:27.279603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:34.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282762+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:37:28.282762+0000","last_peered":"2024-04-26T10:37:28.282762+0000","last_clean":"2024-04-26T10:37:28.282762+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:37:28.282762+0000","last_undegraded":"2024-04-26T10:37:28.282762+0000","last_fullsized":"2024-04-26T10:37:28.282762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:57.803542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278274+0000","last_change":"2024-04-26T10:37:23.273754+0000","last_active":"2024-04-26T10:37:28.278274+0000","last_peered":"2024-04-26T10:37:28.278274+0000","last_clean":"2024-04-26T10:37:28.278274+0000","last_became_active":"2024-04-26T10:37:23.270451+0000","last_became_peered":"2024-04-26T10:37:23.270451+0000","last_unstale":"2024-04-26T10:37:28.278274+0000","last_undegraded":"2024-04-26T10:37:28.278274+0000","last_fullsized":"2024-04-26T10:37:28.278274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:03.023862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":300,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278550+0000","last_change":"2024-04-26T10:37:23.269600+0000","last_active":"2024-04-26T10:37:28.278550+0000","last_peered":"2024-04-26T10:37:28.278550+0000","last_clean":"2024-04-26T10:37:28.278550+0000","last_became_active":"2024-04-26T10:37:23.268665+0000","last_became_peered":"2024-04-26T10:37:23.268665+0000","last_unstale":"2024-04-26T10:37:28.278550+0000","last_undegraded":"2024-04-26T10:37:28.278550+0000","last_fullsized":"2024-04-26T10:37:28.278550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:27.734866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280817+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:37:28.280817+0000","last_peered":"2024-04-26T10:37:28.280817+0000","last_clean":"2024-04-26T10:37:28.280817+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:37:28.280817+0000","last_undegraded":"2024-04-26T10:37:28.280817+0000","last_fullsized":"2024-04-26T10:37:28.280817+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278725+0000","last_change":"2024-04-26T10:37:23.271849+0000","last_active":"2024-04-26T10:37:28.278725+0000","last_peered":"2024-04-26T10:37:28.278725+0000","last_clean":"2024-04-26T10:37:28.278725+0000","last_became_active":"2024-04-26T10:37:23.269736+0000","last_became_peered":"2024-04-26T10:37:23.269736+0000","last_unstale":"2024-04-26T10:37:28.278725+0000","last_undegraded":"2024-04-26T10:37:28.278725+0000","last_fullsized":"2024-04-26T10:37:28.278725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.639109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278343+0000","last_change":"2024-04-26T10:37:23.266348+0000","last_active":"2024-04-26T10:37:28.278343+0000","last_peered":"2024-04-26T10:37:28.278343+0000","last_clean":"2024-04-26T10:37:28.278343+0000","last_became_active":"2024-04-26T10:37:23.265317+0000","last_became_peered":"2024-04-26T10:37:23.265317+0000","last_unstale":"2024-04-26T10:37:28.278343+0000","last_undegraded":"2024-04-26T10:37:28.278343+0000","last_fullsized":"2024-04-26T10:37:28.278343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:13.956142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280740+0000","last_change":"2024-04-26T10:37:23.276509+0000","last_active":"2024-04-26T10:37:28.280740+0000","last_peered":"2024-04-26T10:37:28.280740+0000","last_clean":"2024-04-26T10:37:28.280740+0000","last_became_active":"2024-04-26T10:37:23.276151+0000","last_became_peered":"2024-04-26T10:37:23.276151+0000","last_unstale":"2024-04-26T10:37:28.280740+0000","last_undegraded":"2024-04-26T10:37:28.280740+0000","last_fullsized":"2024-04-26T10:37:28.280740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:30.924727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280594+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:37:27.280594+0000","last_peered":"2024-04-26T10:37:27.280594+0000","last_clean":"2024-04-26T10:37:27.280594+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:37:27.280594+0000","last_undegraded":"2024-04-26T10:37:27.280594+0000","last_fullsized":"2024-04-26T10:37:27.280594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280625+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:37:27.280625+0000","last_peered":"2024-04-26T10:37:27.280625+0000","last_clean":"2024-04-26T10:37:27.280625+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:37:27.280625+0000","last_undegraded":"2024-04-26T10:37:27.280625+0000","last_fullsized":"2024-04-26T10:37:27.280625+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282126+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:37:28.282126+0000","last_peered":"2024-04-26T10:37:28.282126+0000","last_clean":"2024-04-26T10:37:28.282126+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:37:28.282126+0000","last_undegraded":"2024-04-26T10:37:28.282126+0000","last_fullsized":"2024-04-26T10:37:28.282126+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:21.048381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280027+0000","last_change":"2024-04-26T10:37:23.277636+0000","last_active":"2024-04-26T10:37:27.280027+0000","last_peered":"2024-04-26T10:37:27.280027+0000","last_clean":"2024-04-26T10:37:27.280027+0000","last_became_active":"2024-04-26T10:37:23.277309+0000","last_became_peered":"2024-04-26T10:37:23.277309+0000","last_unstale":"2024-04-26T10:37:27.280027+0000","last_undegraded":"2024-04-26T10:37:27.280027+0000","last_fullsized":"2024-04-26T10:37:27.280027+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:00.429064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282446+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:37:28.282446+0000","last_peered":"2024-04-26T10:37:28.282446+0000","last_clean":"2024-04-26T10:37:28.282446+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:37:28.282446+0000","last_undegraded":"2024-04-26T10:37:28.282446+0000","last_fullsized":"2024-04-26T10:37:28.282446+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282702+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:37:28.282702+0000","last_peered":"2024-04-26T10:37:28.282702+0000","last_clean":"2024-04-26T10:37:28.282702+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:37:28.282702+0000","last_undegraded":"2024-04-26T10:37:28.282702+0000","last_fullsized":"2024-04-26T10:37:28.282702+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.172123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.283483+0000","last_change":"2024-04-26T10:37:28.282300+0000","last_active":"2024-04-26T10:37:28.283483+0000","last_peered":"2024-04-26T10:37:28.283483+0000","last_clean":"2024-04-26T10:37:28.283483+0000","last_became_active":"2024-04-26T10:37:28.281669+0000","last_became_peered":"2024-04-26T10:37:28.281669+0000","last_unstale":"2024-04-26T10:37:28.283483+0000","last_undegraded":"2024-04-26T10:37:28.283483+0000","last_fullsized":"2024-04-26T10:37:28.283483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:23.776919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279088+0000","last_change":"2024-04-26T10:37:23.269479+0000","last_active":"2024-04-26T10:37:28.279088+0000","last_peered":"2024-04-26T10:37:28.279088+0000","last_clean":"2024-04-26T10:37:28.279088+0000","last_became_active":"2024-04-26T10:37:23.268673+0000","last_became_peered":"2024-04-26T10:37:23.268673+0000","last_unstale":"2024-04-26T10:37:28.279088+0000","last_undegraded":"2024-04-26T10:37:28.279088+0000","last_fullsized":"2024-04-26T10:37:28.279088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:52.269482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282451+0000","last_change":"2024-04-26T10:37:23.277426+0000","last_active":"2024-04-26T10:37:28.282451+0000","last_peered":"2024-04-26T10:37:28.282451+0000","last_clean":"2024-04-26T10:37:28.282451+0000","last_became_active":"2024-04-26T10:37:23.277001+0000","last_became_peered":"2024-04-26T10:37:23.277001+0000","last_unstale":"2024-04-26T10:37:28.282451+0000","last_undegraded":"2024-04-26T10:37:28.282451+0000","last_fullsized":"2024-04-26T10:37:28.282451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:38.308038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279463+0000","last_change":"2024-04-26T10:37:23.267342+0000","last_active":"2024-04-26T10:37:27.279463+0000","last_peered":"2024-04-26T10:37:27.279463+0000","last_clean":"2024-04-26T10:37:27.279463+0000","last_became_active":"2024-04-26T10:37:23.266912+0000","last_became_peered":"2024-04-26T10:37:23.266912+0000","last_unstale":"2024-04-26T10:37:27.279463+0000","last_undegraded":"2024-04-26T10:37:27.279463+0000","last_fullsized":"2024-04-26T10:37:27.279463+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:28.070169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279987+0000","last_change":"2024-04-26T10:37:23.277620+0000","last_active":"2024-04-26T10:37:27.279987+0000","last_peered":"2024-04-26T10:37:27.279987+0000","last_clean":"2024-04-26T10:37:27.279987+0000","last_became_active":"2024-04-26T10:37:23.277303+0000","last_became_peered":"2024-04-26T10:37:23.277303+0000","last_unstale":"2024-04-26T10:37:27.279987+0000","last_undegraded":"2024-04-26T10:37:27.279987+0000","last_fullsized":"2024-04-26T10:37:27.279987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:57.292594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280339+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:37:27.280339+0000","last_peered":"2024-04-26T10:37:27.280339+0000","last_clean":"2024-04-26T10:37:27.280339+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:37:27.280339+0000","last_undegraded":"2024-04-26T10:37:27.280339+0000","last_fullsized":"2024-04-26T10:37:27.280339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278431+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:28.278431+0000","last_peered":"2024-04-26T10:37:28.278431+0000","last_clean":"2024-04-26T10:37:28.278431+0000","last_became_active":"2024-04-26T10:37:23.266295+0000","last_became_peered":"2024-04-26T10:37:23.266295+0000","last_unstale":"2024-04-26T10:37:28.278431+0000","last_undegraded":"2024-04-26T10:37:28.278431+0000","last_fullsized":"2024-04-26T10:37:28.278431+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:19.026704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278934+0000","last_change":"2024-04-26T10:37:23.274686+0000","last_active":"2024-04-26T10:37:28.278934+0000","last_peered":"2024-04-26T10:37:28.278934+0000","last_clean":"2024-04-26T10:37:28.278934+0000","last_became_active":"2024-04-26T10:37:23.272039+0000","last_became_peered":"2024-04-26T10:37:23.272039+0000","last_unstale":"2024-04-26T10:37:28.278934+0000","last_undegraded":"2024-04-26T10:37:28.278934+0000","last_fullsized":"2024-04-26T10:37:28.278934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:42.152908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280761+0000","last_change":"2024-04-26T10:37:23.273723+0000","last_active":"2024-04-26T10:37:27.280761+0000","last_peered":"2024-04-26T10:37:27.280761+0000","last_clean":"2024-04-26T10:37:27.280761+0000","last_became_active":"2024-04-26T10:37:23.273253+0000","last_became_peered":"2024-04-26T10:37:23.273253+0000","last_unstale":"2024-04-26T10:37:27.280761+0000","last_undegraded":"2024-04-26T10:37:27.280761+0000","last_fullsized":"2024-04-26T10:37:27.280761+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:30.644188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278246+0000","last_change":"2024-04-26T10:37:23.267726+0000","last_active":"2024-04-26T10:37:28.278246+0000","last_peered":"2024-04-26T10:37:28.278246+0000","last_clean":"2024-04-26T10:37:28.278246+0000","last_became_active":"2024-04-26T10:37:23.267434+0000","last_became_peered":"2024-04-26T10:37:23.267434+0000","last_unstale":"2024-04-26T10:37:28.278246+0000","last_undegraded":"2024-04-26T10:37:28.278246+0000","last_fullsized":"2024-04-26T10:37:28.278246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:43.219752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282593+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:37:28.282593+0000","last_peered":"2024-04-26T10:37:28.282593+0000","last_clean":"2024-04-26T10:37:28.282593+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:37:28.282593+0000","last_undegraded":"2024-04-26T10:37:28.282593+0000","last_fullsized":"2024-04-26T10:37:28.282593+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280206+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:37:27.280206+0000","last_peered":"2024-04-26T10:37:27.280206+0000","last_clean":"2024-04-26T10:37:27.280206+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:37:27.280206+0000","last_undegraded":"2024-04-26T10:37:27.280206+0000","last_fullsized":"2024-04-26T10:37:27.280206+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282593+0000","last_change":"2024-04-26T10:37:23.272052+0000","last_active":"2024-04-26T10:37:28.282593+0000","last_peered":"2024-04-26T10:37:28.282593+0000","last_clean":"2024-04-26T10:37:28.282593+0000","last_became_active":"2024-04-26T10:37:23.271663+0000","last_became_peered":"2024-04-26T10:37:23.271663+0000","last_unstale":"2024-04-26T10:37:28.282593+0000","last_undegraded":"2024-04-26T10:37:28.282593+0000","last_fullsized":"2024-04-26T10:37:28.282593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:31.778313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278501+0000","last_change":"2024-04-26T10:37:23.268370+0000","last_active":"2024-04-26T10:37:28.278501+0000","last_peered":"2024-04-26T10:37:28.278501+0000","last_clean":"2024-04-26T10:37:28.278501+0000","last_became_active":"2024-04-26T10:37:23.266624+0000","last_became_peered":"2024-04-26T10:37:23.266624+0000","last_unstale":"2024-04-26T10:37:28.278501+0000","last_undegraded":"2024-04-26T10:37:28.278501+0000","last_fullsized":"2024-04-26T10:37:28.278501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:42.205710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278444+0000","last_change":"2024-04-26T10:37:23.267652+0000","last_active":"2024-04-26T10:37:28.278444+0000","last_peered":"2024-04-26T10:37:28.278444+0000","last_clean":"2024-04-26T10:37:28.278444+0000","last_became_active":"2024-04-26T10:37:23.266063+0000","last_became_peered":"2024-04-26T10:37:23.266063+0000","last_unstale":"2024-04-26T10:37:28.278444+0000","last_undegraded":"2024-04-26T10:37:28.278444+0000","last_fullsized":"2024-04-26T10:37:28.278444+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:23.209788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283546+0000","last_change":"2024-04-26T10:37:28.282145+0000","last_active":"2024-04-26T10:37:29.283546+0000","last_peered":"2024-04-26T10:37:29.283546+0000","last_clean":"2024-04-26T10:37:29.283546+0000","last_became_active":"2024-04-26T10:37:28.281541+0000","last_became_peered":"2024-04-26T10:37:28.281541+0000","last_unstale":"2024-04-26T10:37:29.283546+0000","last_undegraded":"2024-04-26T10:37:29.283546+0000","last_fullsized":"2024-04-26T10:37:29.283546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:55.649460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279988+0000","last_change":"2024-04-26T10:37:23.268479+0000","last_active":"2024-04-26T10:37:27.279988+0000","last_peered":"2024-04-26T10:37:27.279988+0000","last_clean":"2024-04-26T10:37:27.279988+0000","last_became_active":"2024-04-26T10:37:23.267644+0000","last_became_peered":"2024-04-26T10:37:23.267644+0000","last_unstale":"2024-04-26T10:37:27.279988+0000","last_undegraded":"2024-04-26T10:37:27.279988+0000","last_fullsized":"2024-04-26T10:37:27.279988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:47.606620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281350+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:37:28.281350+0000","last_peered":"2024-04-26T10:37:28.281350+0000","last_clean":"2024-04-26T10:37:28.281350+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:37:28.281350+0000","last_undegraded":"2024-04-26T10:37:28.281350+0000","last_fullsized":"2024-04-26T10:37:28.281350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.021846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279979+0000","last_change":"2024-04-26T10:37:23.274199+0000","last_active":"2024-04-26T10:37:27.279979+0000","last_peered":"2024-04-26T10:37:27.279979+0000","last_clean":"2024-04-26T10:37:27.279979+0000","last_became_active":"2024-04-26T10:37:23.273023+0000","last_became_peered":"2024-04-26T10:37:23.273023+0000","last_unstale":"2024-04-26T10:37:27.279979+0000","last_undegraded":"2024-04-26T10:37:27.279979+0000","last_fullsized":"2024-04-26T10:37:27.279979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:55.142124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1766,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":338840,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":94033000,"statfs":{"total":96636764160,"available":96289792000,"internally_reserved":0,"allocated":917504,"data_stored":359527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346028486},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55000000000000004}]},{"osd":1,"last update":"Fri Apr 26 10:36:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.38100000000000001},"min":{"1min":0.36399999999999999,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.56799999999999995,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.63800000000000001,"15min":0.496},"min":{"1min":0.373,"5min":0.19,"15min":0.19},"max":{"1min":0.59699999999999998,"5min":12.206,"15min":12.206},"last":0.47899999999999998}]}]},{"osd":0,"up_from":75,"seq":322122547204,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55024,"kb_used_data":1500,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94316816,"statfs":{"total":96636764160,"available":96580419584,"internally_reserved":0,"allocated":1536000,"data_stored":951641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7111,"internal_metadata":54780985},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257364,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":255870,"kb_avail":94114476,"statfs":{"total":96636764160,"available":96373223424,"internally_reserved":0,"allocated":1515520,"data_stored":944680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262011334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Apr 26 10:36:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.42199999999999999,"15min":0.35599999999999998},"min":{"1min":0.307,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.59199999999999997,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.503},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48199999999999998,"15min":0.45200000000000001},"min":{"1min":0.27600000000000002,"5min":0.183,"15min":0.183},"max":{"1min":0.60699999999999998,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:37:33.569 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:37:33.944 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:37:33.945 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:37:33.958 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-04-26T10:37:33.058790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":592134,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":651228,"kb_used_data":3876,"kb_used_omap":10,"kb_used_meta":647285,"kb_avail":282464292,"statfs":{"total":289910292480,"available":289243435008,"internally_reserved":0,"allocated":3969024,"data_stored":2255848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10299,"internal_metadata":662820805},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001391"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280471+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:37:27.280471+0000","last_peered":"2024-04-26T10:37:27.280471+0000","last_clean":"2024-04-26T10:37:27.280471+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:37:27.280471+0000","last_undegraded":"2024-04-26T10:37:27.280471+0000","last_fullsized":"2024-04-26T10:37:27.280471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:26.964955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280495+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:37:27.280495+0000","last_peered":"2024-04-26T10:37:27.280495+0000","last_clean":"2024-04-26T10:37:27.280495+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:37:27.280495+0000","last_undegraded":"2024-04-26T10:37:27.280495+0000","last_fullsized":"2024-04-26T10:37:27.280495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278894+0000","last_change":"2024-04-26T10:37:23.274531+0000","last_active":"2024-04-26T10:37:28.278894+0000","last_peered":"2024-04-26T10:37:28.278894+0000","last_clean":"2024-04-26T10:37:28.278894+0000","last_became_active":"2024-04-26T10:37:23.272107+0000","last_became_peered":"2024-04-26T10:37:23.272107+0000","last_unstale":"2024-04-26T10:37:28.278894+0000","last_undegraded":"2024-04-26T10:37:28.278894+0000","last_fullsized":"2024-04-26T10:37:28.278894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:36.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278352+0000","last_change":"2024-04-26T10:37:23.271611+0000","last_active":"2024-04-26T10:37:28.278352+0000","last_peered":"2024-04-26T10:37:28.278352+0000","last_clean":"2024-04-26T10:37:28.278352+0000","last_became_active":"2024-04-26T10:37:23.269752+0000","last_became_peered":"2024-04-26T10:37:23.269752+0000","last_unstale":"2024-04-26T10:37:28.278352+0000","last_undegraded":"2024-04-26T10:37:28.278352+0000","last_fullsized":"2024-04-26T10:37:28.278352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:17.370231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279559+0000","last_change":"2024-04-26T10:34:14.507618+0000","last_active":"2024-04-26T10:37:27.279559+0000","last_peered":"2024-04-26T10:37:27.279559+0000","last_clean":"2024-04-26T10:37:27.279559+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:37:27.279559+0000","last_undegraded":"2024-04-26T10:37:27.279559+0000","last_fullsized":"2024-04-26T10:37:27.279559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:27.721106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278624+0000","last_change":"2024-04-26T10:37:23.271901+0000","last_active":"2024-04-26T10:37:28.278624+0000","last_peered":"2024-04-26T10:37:28.278624+0000","last_clean":"2024-04-26T10:37:28.278624+0000","last_became_active":"2024-04-26T10:37:23.270593+0000","last_became_peered":"2024-04-26T10:37:23.270593+0000","last_unstale":"2024-04-26T10:37:28.278624+0000","last_undegraded":"2024-04-26T10:37:28.278624+0000","last_fullsized":"2024-04-26T10:37:28.278624+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.909979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278139+0000","last_change":"2024-04-26T10:37:23.271640+0000","last_active":"2024-04-26T10:37:28.278139+0000","last_peered":"2024-04-26T10:37:28.278139+0000","last_clean":"2024-04-26T10:37:28.278139+0000","last_became_active":"2024-04-26T10:37:23.270393+0000","last_became_peered":"2024-04-26T10:37:23.270393+0000","last_unstale":"2024-04-26T10:37:28.278139+0000","last_undegraded":"2024-04-26T10:37:28.278139+0000","last_fullsized":"2024-04-26T10:37:28.278139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:30.161615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.277990+0000","last_change":"2024-04-26T10:37:23.268381+0000","last_active":"2024-04-26T10:37:28.277990+0000","last_peered":"2024-04-26T10:37:28.277990+0000","last_clean":"2024-04-26T10:37:28.277990+0000","last_became_active":"2024-04-26T10:37:23.267296+0000","last_became_peered":"2024-04-26T10:37:23.267296+0000","last_unstale":"2024-04-26T10:37:28.277990+0000","last_undegraded":"2024-04-26T10:37:28.277990+0000","last_fullsized":"2024-04-26T10:37:28.277990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:09.197024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282256+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:37:28.282256+0000","last_peered":"2024-04-26T10:37:28.282256+0000","last_clean":"2024-04-26T10:37:28.282256+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:37:28.282256+0000","last_undegraded":"2024-04-26T10:37:28.282256+0000","last_fullsized":"2024-04-26T10:37:28.282256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280306+0000","last_change":"2024-04-26T10:34:14.507265+0000","last_active":"2024-04-26T10:37:27.280306+0000","last_peered":"2024-04-26T10:37:27.280306+0000","last_clean":"2024-04-26T10:37:27.280306+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:37:27.280306+0000","last_undegraded":"2024-04-26T10:37:27.280306+0000","last_fullsized":"2024-04-26T10:37:27.280306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:07.268421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278994+0000","last_change":"2024-04-26T10:37:23.275734+0000","last_active":"2024-04-26T10:37:28.278994+0000","last_peered":"2024-04-26T10:37:28.278994+0000","last_clean":"2024-04-26T10:37:28.278994+0000","last_became_active":"2024-04-26T10:37:23.273996+0000","last_became_peered":"2024-04-26T10:37:23.273996+0000","last_unstale":"2024-04-26T10:37:28.278994+0000","last_undegraded":"2024-04-26T10:37:28.278994+0000","last_fullsized":"2024-04-26T10:37:28.278994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:19.909745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280151+0000","last_change":"2024-04-26T10:37:23.274459+0000","last_active":"2024-04-26T10:37:27.280151+0000","last_peered":"2024-04-26T10:37:27.280151+0000","last_clean":"2024-04-26T10:37:27.280151+0000","last_became_active":"2024-04-26T10:37:23.273290+0000","last_became_peered":"2024-04-26T10:37:23.273290+0000","last_unstale":"2024-04-26T10:37:27.280151+0000","last_undegraded":"2024-04-26T10:37:27.280151+0000","last_fullsized":"2024-04-26T10:37:27.280151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:48.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279837+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:37:27.279837+0000","last_peered":"2024-04-26T10:37:27.279837+0000","last_clean":"2024-04-26T10:37:27.279837+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:37:27.279837+0000","last_undegraded":"2024-04-26T10:37:27.279837+0000","last_fullsized":"2024-04-26T10:37:27.279837+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:03.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278723+0000","last_change":"2024-04-26T10:37:23.271722+0000","last_active":"2024-04-26T10:37:28.278723+0000","last_peered":"2024-04-26T10:37:28.278723+0000","last_clean":"2024-04-26T10:37:28.278723+0000","last_became_active":"2024-04-26T10:37:23.269722+0000","last_became_peered":"2024-04-26T10:37:23.269722+0000","last_unstale":"2024-04-26T10:37:28.278723+0000","last_undegraded":"2024-04-26T10:37:28.278723+0000","last_fullsized":"2024-04-26T10:37:28.278723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:22.768002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278663+0000","last_change":"2024-04-26T10:37:23.271761+0000","last_active":"2024-04-26T10:37:28.278663+0000","last_peered":"2024-04-26T10:37:28.278663+0000","last_clean":"2024-04-26T10:37:28.278663+0000","last_became_active":"2024-04-26T10:37:23.270852+0000","last_became_peered":"2024-04-26T10:37:23.270852+0000","last_unstale":"2024-04-26T10:37:28.278663+0000","last_undegraded":"2024-04-26T10:37:28.278663+0000","last_fullsized":"2024-04-26T10:37:28.278663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:17.289523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278631+0000","last_change":"2024-04-26T10:37:23.270523+0000","last_active":"2024-04-26T10:37:28.278631+0000","last_peered":"2024-04-26T10:37:28.278631+0000","last_clean":"2024-04-26T10:37:28.278631+0000","last_became_active":"2024-04-26T10:37:23.268640+0000","last_became_peered":"2024-04-26T10:37:23.268640+0000","last_unstale":"2024-04-26T10:37:28.278631+0000","last_undegraded":"2024-04-26T10:37:28.278631+0000","last_fullsized":"2024-04-26T10:37:28.278631+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:45.353248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284300+0000","last_change":"2024-04-26T10:37:28.282247+0000","last_active":"2024-04-26T10:37:29.284300+0000","last_peered":"2024-04-26T10:37:29.284300+0000","last_clean":"2024-04-26T10:37:29.284300+0000","last_became_active":"2024-04-26T10:37:28.281510+0000","last_became_peered":"2024-04-26T10:37:28.281510+0000","last_unstale":"2024-04-26T10:37:29.284300+0000","last_undegraded":"2024-04-26T10:37:29.284300+0000","last_fullsized":"2024-04-26T10:37:29.284300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:37.366727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280445+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:37:27.280445+0000","last_peered":"2024-04-26T10:37:27.280445+0000","last_clean":"2024-04-26T10:37:27.280445+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:37:27.280445+0000","last_undegraded":"2024-04-26T10:37:27.280445+0000","last_fullsized":"2024-04-26T10:37:27.280445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.343269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281607+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:37:28.281607+0000","last_peered":"2024-04-26T10:37:28.281607+0000","last_clean":"2024-04-26T10:37:28.281607+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:37:28.281607+0000","last_undegraded":"2024-04-26T10:37:28.281607+0000","last_fullsized":"2024-04-26T10:37:28.281607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278862+0000","last_change":"2024-04-26T10:37:23.273700+0000","last_active":"2024-04-26T10:37:28.278862+0000","last_peered":"2024-04-26T10:37:28.278862+0000","last_clean":"2024-04-26T10:37:28.278862+0000","last_became_active":"2024-04-26T10:37:23.272964+0000","last_became_peered":"2024-04-26T10:37:23.272964+0000","last_unstale":"2024-04-26T10:37:28.278862+0000","last_undegraded":"2024-04-26T10:37:28.278862+0000","last_fullsized":"2024-04-26T10:37:28.278862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:49.013542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278797+0000","last_change":"2024-04-26T10:37:23.274112+0000","last_active":"2024-04-26T10:37:28.278797+0000","last_peered":"2024-04-26T10:37:28.278797+0000","last_clean":"2024-04-26T10:37:28.278797+0000","last_became_active":"2024-04-26T10:37:23.271967+0000","last_became_peered":"2024-04-26T10:37:23.271967+0000","last_unstale":"2024-04-26T10:37:28.278797+0000","last_undegraded":"2024-04-26T10:37:28.278797+0000","last_fullsized":"2024-04-26T10:37:28.278797+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:35.182239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279897+0000","last_change":"2024-04-26T10:37:23.268432+0000","last_active":"2024-04-26T10:37:27.279897+0000","last_peered":"2024-04-26T10:37:27.279897+0000","last_clean":"2024-04-26T10:37:27.279897+0000","last_became_active":"2024-04-26T10:37:23.267766+0000","last_became_peered":"2024-04-26T10:37:23.267766+0000","last_unstale":"2024-04-26T10:37:27.279897+0000","last_undegraded":"2024-04-26T10:37:27.279897+0000","last_fullsized":"2024-04-26T10:37:27.279897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:46.203749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280877+0000","last_change":"2024-04-26T10:37:23.270217+0000","last_active":"2024-04-26T10:37:28.280877+0000","last_peered":"2024-04-26T10:37:28.280877+0000","last_clean":"2024-04-26T10:37:28.280877+0000","last_became_active":"2024-04-26T10:37:23.269861+0000","last_became_peered":"2024-04-26T10:37:23.269861+0000","last_unstale":"2024-04-26T10:37:28.280877+0000","last_undegraded":"2024-04-26T10:37:28.280877+0000","last_fullsized":"2024-04-26T10:37:28.280877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:39.366800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279815+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:37:27.279815+0000","last_peered":"2024-04-26T10:37:27.279815+0000","last_clean":"2024-04-26T10:37:27.279815+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:37:27.279815+0000","last_undegraded":"2024-04-26T10:37:27.279815+0000","last_fullsized":"2024-04-26T10:37:27.279815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280420+0000","last_change":"2024-04-26T10:37:23.272702+0000","last_active":"2024-04-26T10:37:27.280420+0000","last_peered":"2024-04-26T10:37:27.280420+0000","last_clean":"2024-04-26T10:37:27.280420+0000","last_became_active":"2024-04-26T10:37:23.272218+0000","last_became_peered":"2024-04-26T10:37:23.272218+0000","last_unstale":"2024-04-26T10:37:27.280420+0000","last_undegraded":"2024-04-26T10:37:27.280420+0000","last_fullsized":"2024-04-26T10:37:27.280420+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:01.008010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282600+0000","last_change":"2024-04-26T10:37:23.271247+0000","last_active":"2024-04-26T10:37:28.282600+0000","last_peered":"2024-04-26T10:37:28.282600+0000","last_clean":"2024-04-26T10:37:28.282600+0000","last_became_active":"2024-04-26T10:37:23.270919+0000","last_became_peered":"2024-04-26T10:37:23.270919+0000","last_unstale":"2024-04-26T10:37:28.282600+0000","last_undegraded":"2024-04-26T10:37:28.282600+0000","last_fullsized":"2024-04-26T10:37:28.282600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:18.340235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279085+0000","last_change":"2024-04-26T10:37:23.275081+0000","last_active":"2024-04-26T10:37:28.279085+0000","last_peered":"2024-04-26T10:37:28.279085+0000","last_clean":"2024-04-26T10:37:28.279085+0000","last_became_active":"2024-04-26T10:37:23.273821+0000","last_became_peered":"2024-04-26T10:37:23.273821+0000","last_unstale":"2024-04-26T10:37:28.279085+0000","last_undegraded":"2024-04-26T10:37:28.279085+0000","last_fullsized":"2024-04-26T10:37:28.279085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:39.585583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279903+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:37:27.279903+0000","last_peered":"2024-04-26T10:37:27.279903+0000","last_clean":"2024-04-26T10:37:27.279903+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:37:27.279903+0000","last_undegraded":"2024-04-26T10:37:27.279903+0000","last_fullsized":"2024-04-26T10:37:27.279903+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280754+0000","last_change":"2024-04-26T10:37:23.273494+0000","last_active":"2024-04-26T10:37:27.280754+0000","last_peered":"2024-04-26T10:37:27.280754+0000","last_clean":"2024-04-26T10:37:27.280754+0000","last_became_active":"2024-04-26T10:37:23.272837+0000","last_became_peered":"2024-04-26T10:37:23.272837+0000","last_unstale":"2024-04-26T10:37:27.280754+0000","last_undegraded":"2024-04-26T10:37:27.280754+0000","last_fullsized":"2024-04-26T10:37:27.280754+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:41.090971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280871+0000","last_change":"2024-04-26T10:37:23.269480+0000","last_active":"2024-04-26T10:37:28.280871+0000","last_peered":"2024-04-26T10:37:28.280871+0000","last_clean":"2024-04-26T10:37:28.280871+0000","last_became_active":"2024-04-26T10:37:23.269197+0000","last_became_peered":"2024-04-26T10:37:23.269197+0000","last_unstale":"2024-04-26T10:37:28.280871+0000","last_undegraded":"2024-04-26T10:37:28.280871+0000","last_fullsized":"2024-04-26T10:37:28.280871+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:37.936936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.284041+0000","last_change":"2024-04-26T10:37:28.283688+0000","last_active":"2024-04-26T10:37:28.284041+0000","last_peered":"2024-04-26T10:37:28.284041+0000","last_clean":"2024-04-26T10:37:28.284041+0000","last_became_active":"2024-04-26T10:37:28.283421+0000","last_became_peered":"2024-04-26T10:37:28.283421+0000","last_unstale":"2024-04-26T10:37:28.284041+0000","last_undegraded":"2024-04-26T10:37:28.284041+0000","last_fullsized":"2024-04-26T10:37:28.284041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:49.619896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280536+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:37:28.280536+0000","last_peered":"2024-04-26T10:37:28.280536+0000","last_clean":"2024-04-26T10:37:28.280536+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:37:28.280536+0000","last_undegraded":"2024-04-26T10:37:28.280536+0000","last_fullsized":"2024-04-26T10:37:28.280536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:19.856062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280679+0000","last_change":"2024-04-26T10:37:23.273035+0000","last_active":"2024-04-26T10:37:27.280679+0000","last_peered":"2024-04-26T10:37:27.280679+0000","last_clean":"2024-04-26T10:37:27.280679+0000","last_became_active":"2024-04-26T10:37:23.272666+0000","last_became_peered":"2024-04-26T10:37:23.272666+0000","last_unstale":"2024-04-26T10:37:27.280679+0000","last_undegraded":"2024-04-26T10:37:27.280679+0000","last_fullsized":"2024-04-26T10:37:27.280679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:37.560011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282711+0000","last_change":"2024-04-26T10:37:23.271100+0000","last_active":"2024-04-26T10:37:28.282711+0000","last_peered":"2024-04-26T10:37:28.282711+0000","last_clean":"2024-04-26T10:37:28.282711+0000","last_became_active":"2024-04-26T10:37:23.270725+0000","last_became_peered":"2024-04-26T10:37:23.270725+0000","last_unstale":"2024-04-26T10:37:28.282711+0000","last_undegraded":"2024-04-26T10:37:28.282711+0000","last_fullsized":"2024-04-26T10:37:28.282711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:27.315487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280408+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:37:28.280408+0000","last_peered":"2024-04-26T10:37:28.280408+0000","last_clean":"2024-04-26T10:37:28.280408+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:37:28.280408+0000","last_undegraded":"2024-04-26T10:37:28.280408+0000","last_fullsized":"2024-04-26T10:37:28.280408+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:04.852453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278996+0000","last_change":"2024-04-26T10:37:23.269851+0000","last_active":"2024-04-26T10:37:28.278996+0000","last_peered":"2024-04-26T10:37:28.278996+0000","last_clean":"2024-04-26T10:37:28.278996+0000","last_became_active":"2024-04-26T10:37:23.269371+0000","last_became_peered":"2024-04-26T10:37:23.269371+0000","last_unstale":"2024-04-26T10:37:28.278996+0000","last_undegraded":"2024-04-26T10:37:28.278996+0000","last_fullsized":"2024-04-26T10:37:28.278996+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:45.005775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280987+0000","last_change":"2024-04-26T10:37:23.269749+0000","last_active":"2024-04-26T10:37:28.280987+0000","last_peered":"2024-04-26T10:37:28.280987+0000","last_clean":"2024-04-26T10:37:28.280987+0000","last_became_active":"2024-04-26T10:37:23.269344+0000","last_became_peered":"2024-04-26T10:37:23.269344+0000","last_unstale":"2024-04-26T10:37:28.280987+0000","last_undegraded":"2024-04-26T10:37:28.280987+0000","last_fullsized":"2024-04-26T10:37:28.280987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:02.488934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280474+0000","last_change":"2024-04-26T10:37:23.273205+0000","last_active":"2024-04-26T10:37:27.280474+0000","last_peered":"2024-04-26T10:37:27.280474+0000","last_clean":"2024-04-26T10:37:27.280474+0000","last_became_active":"2024-04-26T10:37:23.272731+0000","last_became_peered":"2024-04-26T10:37:23.272731+0000","last_unstale":"2024-04-26T10:37:27.280474+0000","last_undegraded":"2024-04-26T10:37:27.280474+0000","last_fullsized":"2024-04-26T10:37:27.280474+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:01.502486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280869+0000","last_change":"2024-04-26T10:34:14.509381+0000","last_active":"2024-04-26T10:37:28.280869+0000","last_peered":"2024-04-26T10:37:28.280869+0000","last_clean":"2024-04-26T10:37:28.280869+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:37:28.280869+0000","last_undegraded":"2024-04-26T10:37:28.280869+0000","last_fullsized":"2024-04-26T10:37:28.280869+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:05.841519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278712+0000","last_change":"2024-04-26T10:37:23.272627+0000","last_active":"2024-04-26T10:37:28.278712+0000","last_peered":"2024-04-26T10:37:28.278712+0000","last_clean":"2024-04-26T10:37:28.278712+0000","last_became_active":"2024-04-26T10:37:23.269968+0000","last_became_peered":"2024-04-26T10:37:23.269968+0000","last_unstale":"2024-04-26T10:37:28.278712+0000","last_undegraded":"2024-04-26T10:37:28.278712+0000","last_fullsized":"2024-04-26T10:37:28.278712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:30.387833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278915+0000","last_change":"2024-04-26T10:37:23.274880+0000","last_active":"2024-04-26T10:37:28.278915+0000","last_peered":"2024-04-26T10:37:28.278915+0000","last_clean":"2024-04-26T10:37:28.278915+0000","last_became_active":"2024-04-26T10:37:23.274045+0000","last_became_peered":"2024-04-26T10:37:23.274045+0000","last_unstale":"2024-04-26T10:37:28.278915+0000","last_undegraded":"2024-04-26T10:37:28.278915+0000","last_fullsized":"2024-04-26T10:37:28.278915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:40.208538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278315+0000","last_change":"2024-04-26T10:37:23.273798+0000","last_active":"2024-04-26T10:37:28.278315+0000","last_peered":"2024-04-26T10:37:28.278315+0000","last_clean":"2024-04-26T10:37:28.278315+0000","last_became_active":"2024-04-26T10:37:23.269775+0000","last_became_peered":"2024-04-26T10:37:23.269775+0000","last_unstale":"2024-04-26T10:37:28.278315+0000","last_undegraded":"2024-04-26T10:37:28.278315+0000","last_fullsized":"2024-04-26T10:37:28.278315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:12.757286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280347+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:37:27.280347+0000","last_peered":"2024-04-26T10:37:27.280347+0000","last_clean":"2024-04-26T10:37:27.280347+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:37:27.280347+0000","last_undegraded":"2024-04-26T10:37:27.280347+0000","last_fullsized":"2024-04-26T10:37:27.280347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:02.872251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280994+0000","last_change":"2024-04-26T10:37:23.270164+0000","last_active":"2024-04-26T10:37:28.280994+0000","last_peered":"2024-04-26T10:37:28.280994+0000","last_clean":"2024-04-26T10:37:28.280994+0000","last_became_active":"2024-04-26T10:37:23.269537+0000","last_became_peered":"2024-04-26T10:37:23.269537+0000","last_unstale":"2024-04-26T10:37:28.280994+0000","last_undegraded":"2024-04-26T10:37:28.280994+0000","last_fullsized":"2024-04-26T10:37:28.280994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:01.680925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280201+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:37:27.280201+0000","last_peered":"2024-04-26T10:37:27.280201+0000","last_clean":"2024-04-26T10:37:27.280201+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:37:27.280201+0000","last_undegraded":"2024-04-26T10:37:27.280201+0000","last_fullsized":"2024-04-26T10:37:27.280201+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:43.500342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279316+0000","last_change":"2024-04-26T10:37:23.268114+0000","last_active":"2024-04-26T10:37:27.279316+0000","last_peered":"2024-04-26T10:37:27.279316+0000","last_clean":"2024-04-26T10:37:27.279316+0000","last_became_active":"2024-04-26T10:37:23.267121+0000","last_became_peered":"2024-04-26T10:37:23.267121+0000","last_unstale":"2024-04-26T10:37:27.279316+0000","last_undegraded":"2024-04-26T10:37:27.279316+0000","last_fullsized":"2024-04-26T10:37:27.279316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:02.467933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282886+0000","last_change":"2024-04-26T10:37:28.282100+0000","last_active":"2024-04-26T10:37:28.282886+0000","last_peered":"2024-04-26T10:37:28.282886+0000","last_clean":"2024-04-26T10:37:28.282886+0000","last_became_active":"2024-04-26T10:37:28.281512+0000","last_became_peered":"2024-04-26T10:37:28.281512+0000","last_unstale":"2024-04-26T10:37:28.282886+0000","last_undegraded":"2024-04-26T10:37:28.282886+0000","last_fullsized":"2024-04-26T10:37:28.282886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.432394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278274+0000","last_change":"2024-04-26T10:37:23.268184+0000","last_active":"2024-04-26T10:37:28.278274+0000","last_peered":"2024-04-26T10:37:28.278274+0000","last_clean":"2024-04-26T10:37:28.278274+0000","last_became_active":"2024-04-26T10:37:23.266377+0000","last_became_peered":"2024-04-26T10:37:23.266377+0000","last_unstale":"2024-04-26T10:37:28.278274+0000","last_undegraded":"2024-04-26T10:37:28.278274+0000","last_fullsized":"2024-04-26T10:37:28.278274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:30.680130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282822+0000","last_change":"2024-04-26T10:37:23.272074+0000","last_active":"2024-04-26T10:37:28.282822+0000","last_peered":"2024-04-26T10:37:28.282822+0000","last_clean":"2024-04-26T10:37:28.282822+0000","last_became_active":"2024-04-26T10:37:23.271752+0000","last_became_peered":"2024-04-26T10:37:23.271752+0000","last_unstale":"2024-04-26T10:37:28.282822+0000","last_undegraded":"2024-04-26T10:37:28.282822+0000","last_fullsized":"2024-04-26T10:37:28.282822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:49.465872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279270+0000","last_change":"2024-04-26T10:37:23.273840+0000","last_active":"2024-04-26T10:37:28.279270+0000","last_peered":"2024-04-26T10:37:28.279270+0000","last_clean":"2024-04-26T10:37:28.279270+0000","last_became_active":"2024-04-26T10:37:23.272156+0000","last_became_peered":"2024-04-26T10:37:23.272156+0000","last_unstale":"2024-04-26T10:37:28.279270+0000","last_undegraded":"2024-04-26T10:37:28.279270+0000","last_fullsized":"2024-04-26T10:37:28.279270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:37.470181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279506+0000","last_change":"2024-04-26T10:37:23.268011+0000","last_active":"2024-04-26T10:37:27.279506+0000","last_peered":"2024-04-26T10:37:27.279506+0000","last_clean":"2024-04-26T10:37:27.279506+0000","last_became_active":"2024-04-26T10:37:23.267717+0000","last_became_peered":"2024-04-26T10:37:23.267717+0000","last_unstale":"2024-04-26T10:37:27.279506+0000","last_undegraded":"2024-04-26T10:37:27.279506+0000","last_fullsized":"2024-04-26T10:37:27.279506+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:51.923777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280555+0000","last_change":"2024-04-26T10:37:23.273179+0000","last_active":"2024-04-26T10:37:27.280555+0000","last_peered":"2024-04-26T10:37:27.280555+0000","last_clean":"2024-04-26T10:37:27.280555+0000","last_became_active":"2024-04-26T10:37:23.272260+0000","last_became_peered":"2024-04-26T10:37:23.272260+0000","last_unstale":"2024-04-26T10:37:27.280555+0000","last_undegraded":"2024-04-26T10:37:27.280555+0000","last_fullsized":"2024-04-26T10:37:27.280555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.097396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279635+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:37:27.279635+0000","last_peered":"2024-04-26T10:37:27.279635+0000","last_clean":"2024-04-26T10:37:27.279635+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:37:27.279635+0000","last_undegraded":"2024-04-26T10:37:27.279635+0000","last_fullsized":"2024-04-26T10:37:27.279635+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:12.954308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278652+0000","last_change":"2024-04-26T10:37:23.269836+0000","last_active":"2024-04-26T10:37:28.278652+0000","last_peered":"2024-04-26T10:37:28.278652+0000","last_clean":"2024-04-26T10:37:28.278652+0000","last_became_active":"2024-04-26T10:37:23.268441+0000","last_became_peered":"2024-04-26T10:37:23.268441+0000","last_unstale":"2024-04-26T10:37:28.278652+0000","last_undegraded":"2024-04-26T10:37:28.278652+0000","last_fullsized":"2024-04-26T10:37:28.278652+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:09.971337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278371+0000","last_change":"2024-04-26T10:37:23.270851+0000","last_active":"2024-04-26T10:37:28.278371+0000","last_peered":"2024-04-26T10:37:28.278371+0000","last_clean":"2024-04-26T10:37:28.278371+0000","last_became_active":"2024-04-26T10:37:23.268451+0000","last_became_peered":"2024-04-26T10:37:23.268451+0000","last_unstale":"2024-04-26T10:37:28.278371+0000","last_undegraded":"2024-04-26T10:37:28.278371+0000","last_fullsized":"2024-04-26T10:37:28.278371+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:48.226025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278899+0000","last_change":"2024-04-26T10:37:23.273635+0000","last_active":"2024-04-26T10:37:28.278899+0000","last_peered":"2024-04-26T10:37:28.278899+0000","last_clean":"2024-04-26T10:37:28.278899+0000","last_became_active":"2024-04-26T10:37:23.272938+0000","last_became_peered":"2024-04-26T10:37:23.272938+0000","last_unstale":"2024-04-26T10:37:28.278899+0000","last_undegraded":"2024-04-26T10:37:28.278899+0000","last_fullsized":"2024-04-26T10:37:28.278899+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:05.613682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281241+0000","last_change":"2024-04-26T10:37:23.277366+0000","last_active":"2024-04-26T10:37:28.281241+0000","last_peered":"2024-04-26T10:37:28.281241+0000","last_clean":"2024-04-26T10:37:28.281241+0000","last_became_active":"2024-04-26T10:37:23.276957+0000","last_became_peered":"2024-04-26T10:37:23.276957+0000","last_unstale":"2024-04-26T10:37:28.281241+0000","last_undegraded":"2024-04-26T10:37:28.281241+0000","last_fullsized":"2024-04-26T10:37:28.281241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:33.029508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281114+0000","last_change":"2024-04-26T10:37:23.277440+0000","last_active":"2024-04-26T10:37:28.281114+0000","last_peered":"2024-04-26T10:37:28.281114+0000","last_clean":"2024-04-26T10:37:28.281114+0000","last_became_active":"2024-04-26T10:37:23.277037+0000","last_became_peered":"2024-04-26T10:37:23.277037+0000","last_unstale":"2024-04-26T10:37:28.281114+0000","last_undegraded":"2024-04-26T10:37:28.281114+0000","last_fullsized":"2024-04-26T10:37:28.281114+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:39.705318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278295+0000","last_change":"2024-04-26T10:37:23.270454+0000","last_active":"2024-04-26T10:37:28.278295+0000","last_peered":"2024-04-26T10:37:28.278295+0000","last_clean":"2024-04-26T10:37:28.278295+0000","last_became_active":"2024-04-26T10:37:23.269473+0000","last_became_peered":"2024-04-26T10:37:23.269473+0000","last_unstale":"2024-04-26T10:37:28.278295+0000","last_undegraded":"2024-04-26T10:37:28.278295+0000","last_fullsized":"2024-04-26T10:37:28.278295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:51.049298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278233+0000","last_change":"2024-04-26T10:37:23.267503+0000","last_active":"2024-04-26T10:37:28.278233+0000","last_peered":"2024-04-26T10:37:28.278233+0000","last_clean":"2024-04-26T10:37:28.278233+0000","last_became_active":"2024-04-26T10:37:23.267235+0000","last_became_peered":"2024-04-26T10:37:23.267235+0000","last_unstale":"2024-04-26T10:37:28.278233+0000","last_undegraded":"2024-04-26T10:37:28.278233+0000","last_fullsized":"2024-04-26T10:37:28.278233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:44.951919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278983+0000","last_change":"2024-04-26T10:37:23.274693+0000","last_active":"2024-04-26T10:37:28.278983+0000","last_peered":"2024-04-26T10:37:28.278983+0000","last_clean":"2024-04-26T10:37:28.278983+0000","last_became_active":"2024-04-26T10:37:23.272111+0000","last_became_peered":"2024-04-26T10:37:23.272111+0000","last_unstale":"2024-04-26T10:37:28.278983+0000","last_undegraded":"2024-04-26T10:37:28.278983+0000","last_fullsized":"2024-04-26T10:37:28.278983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:49.690746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280094+0000","last_change":"2024-04-26T10:37:23.274381+0000","last_active":"2024-04-26T10:37:27.280094+0000","last_peered":"2024-04-26T10:37:27.280094+0000","last_clean":"2024-04-26T10:37:27.280094+0000","last_became_active":"2024-04-26T10:37:23.273867+0000","last_became_peered":"2024-04-26T10:37:23.273867+0000","last_unstale":"2024-04-26T10:37:27.280094+0000","last_undegraded":"2024-04-26T10:37:27.280094+0000","last_fullsized":"2024-04-26T10:37:27.280094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:05.525071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279020+0000","last_change":"2024-04-26T10:37:23.273539+0000","last_active":"2024-04-26T10:37:28.279020+0000","last_peered":"2024-04-26T10:37:28.279020+0000","last_clean":"2024-04-26T10:37:28.279020+0000","last_became_active":"2024-04-26T10:37:23.272569+0000","last_became_peered":"2024-04-26T10:37:23.272569+0000","last_unstale":"2024-04-26T10:37:28.279020+0000","last_undegraded":"2024-04-26T10:37:28.279020+0000","last_fullsized":"2024-04-26T10:37:28.279020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:40.584797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279341+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:37:27.279341+0000","last_peered":"2024-04-26T10:37:27.279341+0000","last_clean":"2024-04-26T10:37:27.279341+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:37:27.279341+0000","last_undegraded":"2024-04-26T10:37:27.279341+0000","last_fullsized":"2024-04-26T10:37:27.279341+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:35.111495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282520+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:37:28.282520+0000","last_peered":"2024-04-26T10:37:28.282520+0000","last_clean":"2024-04-26T10:37:28.282520+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:37:28.282520+0000","last_undegraded":"2024-04-26T10:37:28.282520+0000","last_fullsized":"2024-04-26T10:37:28.282520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284088+0000","last_change":"2024-04-26T10:37:28.282767+0000","last_active":"2024-04-26T10:37:29.284088+0000","last_peered":"2024-04-26T10:37:29.284088+0000","last_clean":"2024-04-26T10:37:29.284088+0000","last_became_active":"2024-04-26T10:37:28.282419+0000","last_became_peered":"2024-04-26T10:37:28.282419+0000","last_unstale":"2024-04-26T10:37:29.284088+0000","last_undegraded":"2024-04-26T10:37:29.284088+0000","last_fullsized":"2024-04-26T10:37:29.284088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:44.531133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278848+0000","last_change":"2024-04-26T10:37:23.274843+0000","last_active":"2024-04-26T10:37:28.278848+0000","last_peered":"2024-04-26T10:37:28.278848+0000","last_clean":"2024-04-26T10:37:28.278848+0000","last_became_active":"2024-04-26T10:37:23.273114+0000","last_became_peered":"2024-04-26T10:37:23.273114+0000","last_unstale":"2024-04-26T10:37:28.278848+0000","last_undegraded":"2024-04-26T10:37:28.278848+0000","last_fullsized":"2024-04-26T10:37:28.278848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:33.001910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279711+0000","last_change":"2024-04-26T10:37:23.268149+0000","last_active":"2024-04-26T10:37:27.279711+0000","last_peered":"2024-04-26T10:37:27.279711+0000","last_clean":"2024-04-26T10:37:27.279711+0000","last_became_active":"2024-04-26T10:37:23.267319+0000","last_became_peered":"2024-04-26T10:37:23.267319+0000","last_unstale":"2024-04-26T10:37:27.279711+0000","last_undegraded":"2024-04-26T10:37:27.279711+0000","last_fullsized":"2024-04-26T10:37:27.279711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:36.211011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278094+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:28.278094+0000","last_peered":"2024-04-26T10:37:28.278094+0000","last_clean":"2024-04-26T10:37:28.278094+0000","last_became_active":"2024-04-26T10:37:23.266332+0000","last_became_peered":"2024-04-26T10:37:23.266332+0000","last_unstale":"2024-04-26T10:37:28.278094+0000","last_undegraded":"2024-04-26T10:37:28.278094+0000","last_fullsized":"2024-04-26T10:37:28.278094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:26.218509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278389+0000","last_change":"2024-04-26T10:37:23.272871+0000","last_active":"2024-04-26T10:37:28.278389+0000","last_peered":"2024-04-26T10:37:28.278389+0000","last_clean":"2024-04-26T10:37:28.278389+0000","last_became_active":"2024-04-26T10:37:23.269657+0000","last_became_peered":"2024-04-26T10:37:23.269657+0000","last_unstale":"2024-04-26T10:37:28.278389+0000","last_undegraded":"2024-04-26T10:37:28.278389+0000","last_fullsized":"2024-04-26T10:37:28.278389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:38.769793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281666+0000","last_change":"2024-04-26T10:34:14.513348+0000","last_active":"2024-04-26T10:37:28.281666+0000","last_peered":"2024-04-26T10:37:28.281666+0000","last_clean":"2024-04-26T10:37:28.281666+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:37:28.281666+0000","last_undegraded":"2024-04-26T10:37:28.281666+0000","last_fullsized":"2024-04-26T10:37:28.281666+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:21.161769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280745+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:37:28.280745+0000","last_peered":"2024-04-26T10:37:28.280745+0000","last_clean":"2024-04-26T10:37:28.280745+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:37:28.280745+0000","last_undegraded":"2024-04-26T10:37:28.280745+0000","last_fullsized":"2024-04-26T10:37:28.280745+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279603+0000","last_change":"2024-04-26T10:37:23.267893+0000","last_active":"2024-04-26T10:37:27.279603+0000","last_peered":"2024-04-26T10:37:27.279603+0000","last_clean":"2024-04-26T10:37:27.279603+0000","last_became_active":"2024-04-26T10:37:23.267595+0000","last_became_peered":"2024-04-26T10:37:23.267595+0000","last_unstale":"2024-04-26T10:37:27.279603+0000","last_undegraded":"2024-04-26T10:37:27.279603+0000","last_fullsized":"2024-04-26T10:37:27.279603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:34.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282762+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:37:28.282762+0000","last_peered":"2024-04-26T10:37:28.282762+0000","last_clean":"2024-04-26T10:37:28.282762+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:37:28.282762+0000","last_undegraded":"2024-04-26T10:37:28.282762+0000","last_fullsized":"2024-04-26T10:37:28.282762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:57.803542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278274+0000","last_change":"2024-04-26T10:37:23.273754+0000","last_active":"2024-04-26T10:37:28.278274+0000","last_peered":"2024-04-26T10:37:28.278274+0000","last_clean":"2024-04-26T10:37:28.278274+0000","last_became_active":"2024-04-26T10:37:23.270451+0000","last_became_peered":"2024-04-26T10:37:23.270451+0000","last_unstale":"2024-04-26T10:37:28.278274+0000","last_undegraded":"2024-04-26T10:37:28.278274+0000","last_fullsized":"2024-04-26T10:37:28.278274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:03.023862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":300,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278550+0000","last_change":"2024-04-26T10:37:23.269600+0000","last_active":"2024-04-26T10:37:28.278550+0000","last_peered":"2024-04-26T10:37:28.278550+0000","last_clean":"2024-04-26T10:37:28.278550+0000","last_became_active":"2024-04-26T10:37:23.268665+0000","last_became_peered":"2024-04-26T10:37:23.268665+0000","last_unstale":"2024-04-26T10:37:28.278550+0000","last_undegraded":"2024-04-26T10:37:28.278550+0000","last_fullsized":"2024-04-26T10:37:28.278550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:27.734866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280817+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:37:28.280817+0000","last_peered":"2024-04-26T10:37:28.280817+0000","last_clean":"2024-04-26T10:37:28.280817+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:37:28.280817+0000","last_undegraded":"2024-04-26T10:37:28.280817+0000","last_fullsized":"2024-04-26T10:37:28.280817+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278725+0000","last_change":"2024-04-26T10:37:23.271849+0000","last_active":"2024-04-26T10:37:28.278725+0000","last_peered":"2024-04-26T10:37:28.278725+0000","last_clean":"2024-04-26T10:37:28.278725+0000","last_became_active":"2024-04-26T10:37:23.269736+0000","last_became_peered":"2024-04-26T10:37:23.269736+0000","last_unstale":"2024-04-26T10:37:28.278725+0000","last_undegraded":"2024-04-26T10:37:28.278725+0000","last_fullsized":"2024-04-26T10:37:28.278725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.639109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278343+0000","last_change":"2024-04-26T10:37:23.266348+0000","last_active":"2024-04-26T10:37:28.278343+0000","last_peered":"2024-04-26T10:37:28.278343+0000","last_clean":"2024-04-26T10:37:28.278343+0000","last_became_active":"2024-04-26T10:37:23.265317+0000","last_became_peered":"2024-04-26T10:37:23.265317+0000","last_unstale":"2024-04-26T10:37:28.278343+0000","last_undegraded":"2024-04-26T10:37:28.278343+0000","last_fullsized":"2024-04-26T10:37:28.278343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:13.956142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280740+0000","last_change":"2024-04-26T10:37:23.276509+0000","last_active":"2024-04-26T10:37:28.280740+0000","last_peered":"2024-04-26T10:37:28.280740+0000","last_clean":"2024-04-26T10:37:28.280740+0000","last_became_active":"2024-04-26T10:37:23.276151+0000","last_became_peered":"2024-04-26T10:37:23.276151+0000","last_unstale":"2024-04-26T10:37:28.280740+0000","last_undegraded":"2024-04-26T10:37:28.280740+0000","last_fullsized":"2024-04-26T10:37:28.280740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:30.924727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280594+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:37:27.280594+0000","last_peered":"2024-04-26T10:37:27.280594+0000","last_clean":"2024-04-26T10:37:27.280594+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:37:27.280594+0000","last_undegraded":"2024-04-26T10:37:27.280594+0000","last_fullsized":"2024-04-26T10:37:27.280594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280625+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:37:27.280625+0000","last_peered":"2024-04-26T10:37:27.280625+0000","last_clean":"2024-04-26T10:37:27.280625+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:37:27.280625+0000","last_undegraded":"2024-04-26T10:37:27.280625+0000","last_fullsized":"2024-04-26T10:37:27.280625+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282126+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:37:28.282126+0000","last_peered":"2024-04-26T10:37:28.282126+0000","last_clean":"2024-04-26T10:37:28.282126+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:37:28.282126+0000","last_undegraded":"2024-04-26T10:37:28.282126+0000","last_fullsized":"2024-04-26T10:37:28.282126+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:21.048381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280027+0000","last_change":"2024-04-26T10:37:23.277636+0000","last_active":"2024-04-26T10:37:27.280027+0000","last_peered":"2024-04-26T10:37:27.280027+0000","last_clean":"2024-04-26T10:37:27.280027+0000","last_became_active":"2024-04-26T10:37:23.277309+0000","last_became_peered":"2024-04-26T10:37:23.277309+0000","last_unstale":"2024-04-26T10:37:27.280027+0000","last_undegraded":"2024-04-26T10:37:27.280027+0000","last_fullsized":"2024-04-26T10:37:27.280027+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:00.429064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282446+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:37:28.282446+0000","last_peered":"2024-04-26T10:37:28.282446+0000","last_clean":"2024-04-26T10:37:28.282446+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:37:28.282446+0000","last_undegraded":"2024-04-26T10:37:28.282446+0000","last_fullsized":"2024-04-26T10:37:28.282446+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282702+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:37:28.282702+0000","last_peered":"2024-04-26T10:37:28.282702+0000","last_clean":"2024-04-26T10:37:28.282702+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:37:28.282702+0000","last_undegraded":"2024-04-26T10:37:28.282702+0000","last_fullsized":"2024-04-26T10:37:28.282702+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.172123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.283483+0000","last_change":"2024-04-26T10:37:28.282300+0000","last_active":"2024-04-26T10:37:28.283483+0000","last_peered":"2024-04-26T10:37:28.283483+0000","last_clean":"2024-04-26T10:37:28.283483+0000","last_became_active":"2024-04-26T10:37:28.281669+0000","last_became_peered":"2024-04-26T10:37:28.281669+0000","last_unstale":"2024-04-26T10:37:28.283483+0000","last_undegraded":"2024-04-26T10:37:28.283483+0000","last_fullsized":"2024-04-26T10:37:28.283483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:23.776919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279088+0000","last_change":"2024-04-26T10:37:23.269479+0000","last_active":"2024-04-26T10:37:28.279088+0000","last_peered":"2024-04-26T10:37:28.279088+0000","last_clean":"2024-04-26T10:37:28.279088+0000","last_became_active":"2024-04-26T10:37:23.268673+0000","last_became_peered":"2024-04-26T10:37:23.268673+0000","last_unstale":"2024-04-26T10:37:28.279088+0000","last_undegraded":"2024-04-26T10:37:28.279088+0000","last_fullsized":"2024-04-26T10:37:28.279088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:52.269482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282451+0000","last_change":"2024-04-26T10:37:23.277426+0000","last_active":"2024-04-26T10:37:28.282451+0000","last_peered":"2024-04-26T10:37:28.282451+0000","last_clean":"2024-04-26T10:37:28.282451+0000","last_became_active":"2024-04-26T10:37:23.277001+0000","last_became_peered":"2024-04-26T10:37:23.277001+0000","last_unstale":"2024-04-26T10:37:28.282451+0000","last_undegraded":"2024-04-26T10:37:28.282451+0000","last_fullsized":"2024-04-26T10:37:28.282451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:38.308038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279463+0000","last_change":"2024-04-26T10:37:23.267342+0000","last_active":"2024-04-26T10:37:27.279463+0000","last_peered":"2024-04-26T10:37:27.279463+0000","last_clean":"2024-04-26T10:37:27.279463+0000","last_became_active":"2024-04-26T10:37:23.266912+0000","last_became_peered":"2024-04-26T10:37:23.266912+0000","last_unstale":"2024-04-26T10:37:27.279463+0000","last_undegraded":"2024-04-26T10:37:27.279463+0000","last_fullsized":"2024-04-26T10:37:27.279463+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:28.070169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279987+0000","last_change":"2024-04-26T10:37:23.277620+0000","last_active":"2024-04-26T10:37:27.279987+0000","last_peered":"2024-04-26T10:37:27.279987+0000","last_clean":"2024-04-26T10:37:27.279987+0000","last_became_active":"2024-04-26T10:37:23.277303+0000","last_became_peered":"2024-04-26T10:37:23.277303+0000","last_unstale":"2024-04-26T10:37:27.279987+0000","last_undegraded":"2024-04-26T10:37:27.279987+0000","last_fullsized":"2024-04-26T10:37:27.279987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:57.292594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280339+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:37:27.280339+0000","last_peered":"2024-04-26T10:37:27.280339+0000","last_clean":"2024-04-26T10:37:27.280339+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:37:27.280339+0000","last_undegraded":"2024-04-26T10:37:27.280339+0000","last_fullsized":"2024-04-26T10:37:27.280339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278431+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:28.278431+0000","last_peered":"2024-04-26T10:37:28.278431+0000","last_clean":"2024-04-26T10:37:28.278431+0000","last_became_active":"2024-04-26T10:37:23.266295+0000","last_became_peered":"2024-04-26T10:37:23.266295+0000","last_unstale":"2024-04-26T10:37:28.278431+0000","last_undegraded":"2024-04-26T10:37:28.278431+0000","last_fullsized":"2024-04-26T10:37:28.278431+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:19.026704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278934+0000","last_change":"2024-04-26T10:37:23.274686+0000","last_active":"2024-04-26T10:37:28.278934+0000","last_peered":"2024-04-26T10:37:28.278934+0000","last_clean":"2024-04-26T10:37:28.278934+0000","last_became_active":"2024-04-26T10:37:23.272039+0000","last_became_peered":"2024-04-26T10:37:23.272039+0000","last_unstale":"2024-04-26T10:37:28.278934+0000","last_undegraded":"2024-04-26T10:37:28.278934+0000","last_fullsized":"2024-04-26T10:37:28.278934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:42.152908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280761+0000","last_change":"2024-04-26T10:37:23.273723+0000","last_active":"2024-04-26T10:37:27.280761+0000","last_peered":"2024-04-26T10:37:27.280761+0000","last_clean":"2024-04-26T10:37:27.280761+0000","last_became_active":"2024-04-26T10:37:23.273253+0000","last_became_peered":"2024-04-26T10:37:23.273253+0000","last_unstale":"2024-04-26T10:37:27.280761+0000","last_undegraded":"2024-04-26T10:37:27.280761+0000","last_fullsized":"2024-04-26T10:37:27.280761+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:30.644188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278246+0000","last_change":"2024-04-26T10:37:23.267726+0000","last_active":"2024-04-26T10:37:28.278246+0000","last_peered":"2024-04-26T10:37:28.278246+0000","last_clean":"2024-04-26T10:37:28.278246+0000","last_became_active":"2024-04-26T10:37:23.267434+0000","last_became_peered":"2024-04-26T10:37:23.267434+0000","last_unstale":"2024-04-26T10:37:28.278246+0000","last_undegraded":"2024-04-26T10:37:28.278246+0000","last_fullsized":"2024-04-26T10:37:28.278246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:43.219752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282593+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:37:28.282593+0000","last_peered":"2024-04-26T10:37:28.282593+0000","last_clean":"2024-04-26T10:37:28.282593+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:37:28.282593+0000","last_undegraded":"2024-04-26T10:37:28.282593+0000","last_fullsized":"2024-04-26T10:37:28.282593+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280206+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:37:27.280206+0000","last_peered":"2024-04-26T10:37:27.280206+0000","last_clean":"2024-04-26T10:37:27.280206+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:37:27.280206+0000","last_undegraded":"2024-04-26T10:37:27.280206+0000","last_fullsized":"2024-04-26T10:37:27.280206+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282593+0000","last_change":"2024-04-26T10:37:23.272052+0000","last_active":"2024-04-26T10:37:28.282593+0000","last_peered":"2024-04-26T10:37:28.282593+0000","last_clean":"2024-04-26T10:37:28.282593+0000","last_became_active":"2024-04-26T10:37:23.271663+0000","last_became_peered":"2024-04-26T10:37:23.271663+0000","last_unstale":"2024-04-26T10:37:28.282593+0000","last_undegraded":"2024-04-26T10:37:28.282593+0000","last_fullsized":"2024-04-26T10:37:28.282593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:31.778313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278501+0000","last_change":"2024-04-26T10:37:23.268370+0000","last_active":"2024-04-26T10:37:28.278501+0000","last_peered":"2024-04-26T10:37:28.278501+0000","last_clean":"2024-04-26T10:37:28.278501+0000","last_became_active":"2024-04-26T10:37:23.266624+0000","last_became_peered":"2024-04-26T10:37:23.266624+0000","last_unstale":"2024-04-26T10:37:28.278501+0000","last_undegraded":"2024-04-26T10:37:28.278501+0000","last_fullsized":"2024-04-26T10:37:28.278501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:42.205710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278444+0000","last_change":"2024-04-26T10:37:23.267652+0000","last_active":"2024-04-26T10:37:28.278444+0000","last_peered":"2024-04-26T10:37:28.278444+0000","last_clean":"2024-04-26T10:37:28.278444+0000","last_became_active":"2024-04-26T10:37:23.266063+0000","last_became_peered":"2024-04-26T10:37:23.266063+0000","last_unstale":"2024-04-26T10:37:28.278444+0000","last_undegraded":"2024-04-26T10:37:28.278444+0000","last_fullsized":"2024-04-26T10:37:28.278444+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:23.209788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283546+0000","last_change":"2024-04-26T10:37:28.282145+0000","last_active":"2024-04-26T10:37:29.283546+0000","last_peered":"2024-04-26T10:37:29.283546+0000","last_clean":"2024-04-26T10:37:29.283546+0000","last_became_active":"2024-04-26T10:37:28.281541+0000","last_became_peered":"2024-04-26T10:37:28.281541+0000","last_unstale":"2024-04-26T10:37:29.283546+0000","last_undegraded":"2024-04-26T10:37:29.283546+0000","last_fullsized":"2024-04-26T10:37:29.283546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:55.649460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279988+0000","last_change":"2024-04-26T10:37:23.268479+0000","last_active":"2024-04-26T10:37:27.279988+0000","last_peered":"2024-04-26T10:37:27.279988+0000","last_clean":"2024-04-26T10:37:27.279988+0000","last_became_active":"2024-04-26T10:37:23.267644+0000","last_became_peered":"2024-04-26T10:37:23.267644+0000","last_unstale":"2024-04-26T10:37:27.279988+0000","last_undegraded":"2024-04-26T10:37:27.279988+0000","last_fullsized":"2024-04-26T10:37:27.279988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:47.606620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281350+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:37:28.281350+0000","last_peered":"2024-04-26T10:37:28.281350+0000","last_clean":"2024-04-26T10:37:28.281350+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:37:28.281350+0000","last_undegraded":"2024-04-26T10:37:28.281350+0000","last_fullsized":"2024-04-26T10:37:28.281350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.021846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279979+0000","last_change":"2024-04-26T10:37:23.274199+0000","last_active":"2024-04-26T10:37:27.279979+0000","last_peered":"2024-04-26T10:37:27.279979+0000","last_clean":"2024-04-26T10:37:27.279979+0000","last_became_active":"2024-04-26T10:37:23.273023+0000","last_became_peered":"2024-04-26T10:37:23.273023+0000","last_unstale":"2024-04-26T10:37:27.279979+0000","last_undegraded":"2024-04-26T10:37:27.279979+0000","last_fullsized":"2024-04-26T10:37:27.279979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:55.142124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1766,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":338840,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":94033000,"statfs":{"total":96636764160,"available":96289792000,"internally_reserved":0,"allocated":917504,"data_stored":359527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346028486},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55000000000000004}]},{"osd":1,"last update":"Fri Apr 26 10:36:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.38100000000000001},"min":{"1min":0.36399999999999999,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.56799999999999995,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.63800000000000001,"15min":0.496},"min":{"1min":0.373,"5min":0.19,"15min":0.19},"max":{"1min":0.59699999999999998,"5min":12.206,"15min":12.206},"last":0.47899999999999998}]}]},{"osd":0,"up_from":75,"seq":322122547204,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55024,"kb_used_data":1500,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94316816,"statfs":{"total":96636764160,"available":96580419584,"internally_reserved":0,"allocated":1536000,"data_stored":951641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7111,"internal_metadata":54780985},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257364,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":255870,"kb_avail":94114476,"statfs":{"total":96636764160,"available":96373223424,"internally_reserved":0,"allocated":1515520,"data_stored":944680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262011334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Apr 26 10:36:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.42199999999999999,"15min":0.35599999999999998},"min":{"1min":0.307,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.59199999999999997,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.503},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48199999999999998,"15min":0.45200000000000001},"min":{"1min":0.27600000000000002,"5min":0.183,"15min":0.183},"max":{"1min":0.60699999999999998,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:37:33.964 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T10:37:33.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:37:34.342 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:37:34.344 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:37:34.356 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-04-26T10:37:33.058790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":592134,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":651228,"kb_used_data":3876,"kb_used_omap":10,"kb_used_meta":647285,"kb_avail":282464292,"statfs":{"total":289910292480,"available":289243435008,"internally_reserved":0,"allocated":3969024,"data_stored":2255848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10299,"internal_metadata":662820805},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001391"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280471+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:37:27.280471+0000","last_peered":"2024-04-26T10:37:27.280471+0000","last_clean":"2024-04-26T10:37:27.280471+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:37:27.280471+0000","last_undegraded":"2024-04-26T10:37:27.280471+0000","last_fullsized":"2024-04-26T10:37:27.280471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:26.964955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280495+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:37:27.280495+0000","last_peered":"2024-04-26T10:37:27.280495+0000","last_clean":"2024-04-26T10:37:27.280495+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:37:27.280495+0000","last_undegraded":"2024-04-26T10:37:27.280495+0000","last_fullsized":"2024-04-26T10:37:27.280495+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278894+0000","last_change":"2024-04-26T10:37:23.274531+0000","last_active":"2024-04-26T10:37:28.278894+0000","last_peered":"2024-04-26T10:37:28.278894+0000","last_clean":"2024-04-26T10:37:28.278894+0000","last_became_active":"2024-04-26T10:37:23.272107+0000","last_became_peered":"2024-04-26T10:37:23.272107+0000","last_unstale":"2024-04-26T10:37:28.278894+0000","last_undegraded":"2024-04-26T10:37:28.278894+0000","last_fullsized":"2024-04-26T10:37:28.278894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:36.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278352+0000","last_change":"2024-04-26T10:37:23.271611+0000","last_active":"2024-04-26T10:37:28.278352+0000","last_peered":"2024-04-26T10:37:28.278352+0000","last_clean":"2024-04-26T10:37:28.278352+0000","last_became_active":"2024-04-26T10:37:23.269752+0000","last_became_peered":"2024-04-26T10:37:23.269752+0000","last_unstale":"2024-04-26T10:37:28.278352+0000","last_undegraded":"2024-04-26T10:37:28.278352+0000","last_fullsized":"2024-04-26T10:37:28.278352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:17.370231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279559+0000","last_change":"2024-04-26T10:34:14.507618+0000","last_active":"2024-04-26T10:37:27.279559+0000","last_peered":"2024-04-26T10:37:27.279559+0000","last_clean":"2024-04-26T10:37:27.279559+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:37:27.279559+0000","last_undegraded":"2024-04-26T10:37:27.279559+0000","last_fullsized":"2024-04-26T10:37:27.279559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:27.721106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278624+0000","last_change":"2024-04-26T10:37:23.271901+0000","last_active":"2024-04-26T10:37:28.278624+0000","last_peered":"2024-04-26T10:37:28.278624+0000","last_clean":"2024-04-26T10:37:28.278624+0000","last_became_active":"2024-04-26T10:37:23.270593+0000","last_became_peered":"2024-04-26T10:37:23.270593+0000","last_unstale":"2024-04-26T10:37:28.278624+0000","last_undegraded":"2024-04-26T10:37:28.278624+0000","last_fullsized":"2024-04-26T10:37:28.278624+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.909979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278139+0000","last_change":"2024-04-26T10:37:23.271640+0000","last_active":"2024-04-26T10:37:28.278139+0000","last_peered":"2024-04-26T10:37:28.278139+0000","last_clean":"2024-04-26T10:37:28.278139+0000","last_became_active":"2024-04-26T10:37:23.270393+0000","last_became_peered":"2024-04-26T10:37:23.270393+0000","last_unstale":"2024-04-26T10:37:28.278139+0000","last_undegraded":"2024-04-26T10:37:28.278139+0000","last_fullsized":"2024-04-26T10:37:28.278139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:30.161615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.277990+0000","last_change":"2024-04-26T10:37:23.268381+0000","last_active":"2024-04-26T10:37:28.277990+0000","last_peered":"2024-04-26T10:37:28.277990+0000","last_clean":"2024-04-26T10:37:28.277990+0000","last_became_active":"2024-04-26T10:37:23.267296+0000","last_became_peered":"2024-04-26T10:37:23.267296+0000","last_unstale":"2024-04-26T10:37:28.277990+0000","last_undegraded":"2024-04-26T10:37:28.277990+0000","last_fullsized":"2024-04-26T10:37:28.277990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:09.197024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282256+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:37:28.282256+0000","last_peered":"2024-04-26T10:37:28.282256+0000","last_clean":"2024-04-26T10:37:28.282256+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:37:28.282256+0000","last_undegraded":"2024-04-26T10:37:28.282256+0000","last_fullsized":"2024-04-26T10:37:28.282256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280306+0000","last_change":"2024-04-26T10:34:14.507265+0000","last_active":"2024-04-26T10:37:27.280306+0000","last_peered":"2024-04-26T10:37:27.280306+0000","last_clean":"2024-04-26T10:37:27.280306+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:37:27.280306+0000","last_undegraded":"2024-04-26T10:37:27.280306+0000","last_fullsized":"2024-04-26T10:37:27.280306+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:07.268421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278994+0000","last_change":"2024-04-26T10:37:23.275734+0000","last_active":"2024-04-26T10:37:28.278994+0000","last_peered":"2024-04-26T10:37:28.278994+0000","last_clean":"2024-04-26T10:37:28.278994+0000","last_became_active":"2024-04-26T10:37:23.273996+0000","last_became_peered":"2024-04-26T10:37:23.273996+0000","last_unstale":"2024-04-26T10:37:28.278994+0000","last_undegraded":"2024-04-26T10:37:28.278994+0000","last_fullsized":"2024-04-26T10:37:28.278994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:19.909745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280151+0000","last_change":"2024-04-26T10:37:23.274459+0000","last_active":"2024-04-26T10:37:27.280151+0000","last_peered":"2024-04-26T10:37:27.280151+0000","last_clean":"2024-04-26T10:37:27.280151+0000","last_became_active":"2024-04-26T10:37:23.273290+0000","last_became_peered":"2024-04-26T10:37:23.273290+0000","last_unstale":"2024-04-26T10:37:27.280151+0000","last_undegraded":"2024-04-26T10:37:27.280151+0000","last_fullsized":"2024-04-26T10:37:27.280151+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:48.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279837+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:37:27.279837+0000","last_peered":"2024-04-26T10:37:27.279837+0000","last_clean":"2024-04-26T10:37:27.279837+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:37:27.279837+0000","last_undegraded":"2024-04-26T10:37:27.279837+0000","last_fullsized":"2024-04-26T10:37:27.279837+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:03.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278723+0000","last_change":"2024-04-26T10:37:23.271722+0000","last_active":"2024-04-26T10:37:28.278723+0000","last_peered":"2024-04-26T10:37:28.278723+0000","last_clean":"2024-04-26T10:37:28.278723+0000","last_became_active":"2024-04-26T10:37:23.269722+0000","last_became_peered":"2024-04-26T10:37:23.269722+0000","last_unstale":"2024-04-26T10:37:28.278723+0000","last_undegraded":"2024-04-26T10:37:28.278723+0000","last_fullsized":"2024-04-26T10:37:28.278723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:22.768002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278663+0000","last_change":"2024-04-26T10:37:23.271761+0000","last_active":"2024-04-26T10:37:28.278663+0000","last_peered":"2024-04-26T10:37:28.278663+0000","last_clean":"2024-04-26T10:37:28.278663+0000","last_became_active":"2024-04-26T10:37:23.270852+0000","last_became_peered":"2024-04-26T10:37:23.270852+0000","last_unstale":"2024-04-26T10:37:28.278663+0000","last_undegraded":"2024-04-26T10:37:28.278663+0000","last_fullsized":"2024-04-26T10:37:28.278663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:17.289523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278631+0000","last_change":"2024-04-26T10:37:23.270523+0000","last_active":"2024-04-26T10:37:28.278631+0000","last_peered":"2024-04-26T10:37:28.278631+0000","last_clean":"2024-04-26T10:37:28.278631+0000","last_became_active":"2024-04-26T10:37:23.268640+0000","last_became_peered":"2024-04-26T10:37:23.268640+0000","last_unstale":"2024-04-26T10:37:28.278631+0000","last_undegraded":"2024-04-26T10:37:28.278631+0000","last_fullsized":"2024-04-26T10:37:28.278631+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:45.353248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284300+0000","last_change":"2024-04-26T10:37:28.282247+0000","last_active":"2024-04-26T10:37:29.284300+0000","last_peered":"2024-04-26T10:37:29.284300+0000","last_clean":"2024-04-26T10:37:29.284300+0000","last_became_active":"2024-04-26T10:37:28.281510+0000","last_became_peered":"2024-04-26T10:37:28.281510+0000","last_unstale":"2024-04-26T10:37:29.284300+0000","last_undegraded":"2024-04-26T10:37:29.284300+0000","last_fullsized":"2024-04-26T10:37:29.284300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:37.366727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280445+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:37:27.280445+0000","last_peered":"2024-04-26T10:37:27.280445+0000","last_clean":"2024-04-26T10:37:27.280445+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:37:27.280445+0000","last_undegraded":"2024-04-26T10:37:27.280445+0000","last_fullsized":"2024-04-26T10:37:27.280445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.343269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281607+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:37:28.281607+0000","last_peered":"2024-04-26T10:37:28.281607+0000","last_clean":"2024-04-26T10:37:28.281607+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:37:28.281607+0000","last_undegraded":"2024-04-26T10:37:28.281607+0000","last_fullsized":"2024-04-26T10:37:28.281607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278862+0000","last_change":"2024-04-26T10:37:23.273700+0000","last_active":"2024-04-26T10:37:28.278862+0000","last_peered":"2024-04-26T10:37:28.278862+0000","last_clean":"2024-04-26T10:37:28.278862+0000","last_became_active":"2024-04-26T10:37:23.272964+0000","last_became_peered":"2024-04-26T10:37:23.272964+0000","last_unstale":"2024-04-26T10:37:28.278862+0000","last_undegraded":"2024-04-26T10:37:28.278862+0000","last_fullsized":"2024-04-26T10:37:28.278862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:49.013542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278797+0000","last_change":"2024-04-26T10:37:23.274112+0000","last_active":"2024-04-26T10:37:28.278797+0000","last_peered":"2024-04-26T10:37:28.278797+0000","last_clean":"2024-04-26T10:37:28.278797+0000","last_became_active":"2024-04-26T10:37:23.271967+0000","last_became_peered":"2024-04-26T10:37:23.271967+0000","last_unstale":"2024-04-26T10:37:28.278797+0000","last_undegraded":"2024-04-26T10:37:28.278797+0000","last_fullsized":"2024-04-26T10:37:28.278797+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:35.182239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279897+0000","last_change":"2024-04-26T10:37:23.268432+0000","last_active":"2024-04-26T10:37:27.279897+0000","last_peered":"2024-04-26T10:37:27.279897+0000","last_clean":"2024-04-26T10:37:27.279897+0000","last_became_active":"2024-04-26T10:37:23.267766+0000","last_became_peered":"2024-04-26T10:37:23.267766+0000","last_unstale":"2024-04-26T10:37:27.279897+0000","last_undegraded":"2024-04-26T10:37:27.279897+0000","last_fullsized":"2024-04-26T10:37:27.279897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:46.203749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280877+0000","last_change":"2024-04-26T10:37:23.270217+0000","last_active":"2024-04-26T10:37:28.280877+0000","last_peered":"2024-04-26T10:37:28.280877+0000","last_clean":"2024-04-26T10:37:28.280877+0000","last_became_active":"2024-04-26T10:37:23.269861+0000","last_became_peered":"2024-04-26T10:37:23.269861+0000","last_unstale":"2024-04-26T10:37:28.280877+0000","last_undegraded":"2024-04-26T10:37:28.280877+0000","last_fullsized":"2024-04-26T10:37:28.280877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:39.366800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279815+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:37:27.279815+0000","last_peered":"2024-04-26T10:37:27.279815+0000","last_clean":"2024-04-26T10:37:27.279815+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:37:27.279815+0000","last_undegraded":"2024-04-26T10:37:27.279815+0000","last_fullsized":"2024-04-26T10:37:27.279815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280420+0000","last_change":"2024-04-26T10:37:23.272702+0000","last_active":"2024-04-26T10:37:27.280420+0000","last_peered":"2024-04-26T10:37:27.280420+0000","last_clean":"2024-04-26T10:37:27.280420+0000","last_became_active":"2024-04-26T10:37:23.272218+0000","last_became_peered":"2024-04-26T10:37:23.272218+0000","last_unstale":"2024-04-26T10:37:27.280420+0000","last_undegraded":"2024-04-26T10:37:27.280420+0000","last_fullsized":"2024-04-26T10:37:27.280420+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:01.008010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282600+0000","last_change":"2024-04-26T10:37:23.271247+0000","last_active":"2024-04-26T10:37:28.282600+0000","last_peered":"2024-04-26T10:37:28.282600+0000","last_clean":"2024-04-26T10:37:28.282600+0000","last_became_active":"2024-04-26T10:37:23.270919+0000","last_became_peered":"2024-04-26T10:37:23.270919+0000","last_unstale":"2024-04-26T10:37:28.282600+0000","last_undegraded":"2024-04-26T10:37:28.282600+0000","last_fullsized":"2024-04-26T10:37:28.282600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:18.340235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279085+0000","last_change":"2024-04-26T10:37:23.275081+0000","last_active":"2024-04-26T10:37:28.279085+0000","last_peered":"2024-04-26T10:37:28.279085+0000","last_clean":"2024-04-26T10:37:28.279085+0000","last_became_active":"2024-04-26T10:37:23.273821+0000","last_became_peered":"2024-04-26T10:37:23.273821+0000","last_unstale":"2024-04-26T10:37:28.279085+0000","last_undegraded":"2024-04-26T10:37:28.279085+0000","last_fullsized":"2024-04-26T10:37:28.279085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:39.585583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279903+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:37:27.279903+0000","last_peered":"2024-04-26T10:37:27.279903+0000","last_clean":"2024-04-26T10:37:27.279903+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:37:27.279903+0000","last_undegraded":"2024-04-26T10:37:27.279903+0000","last_fullsized":"2024-04-26T10:37:27.279903+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":90,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280754+0000","last_change":"2024-04-26T10:37:23.273494+0000","last_active":"2024-04-26T10:37:27.280754+0000","last_peered":"2024-04-26T10:37:27.280754+0000","last_clean":"2024-04-26T10:37:27.280754+0000","last_became_active":"2024-04-26T10:37:23.272837+0000","last_became_peered":"2024-04-26T10:37:23.272837+0000","last_unstale":"2024-04-26T10:37:27.280754+0000","last_undegraded":"2024-04-26T10:37:27.280754+0000","last_fullsized":"2024-04-26T10:37:27.280754+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:41.090971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280871+0000","last_change":"2024-04-26T10:37:23.269480+0000","last_active":"2024-04-26T10:37:28.280871+0000","last_peered":"2024-04-26T10:37:28.280871+0000","last_clean":"2024-04-26T10:37:28.280871+0000","last_became_active":"2024-04-26T10:37:23.269197+0000","last_became_peered":"2024-04-26T10:37:23.269197+0000","last_unstale":"2024-04-26T10:37:28.280871+0000","last_undegraded":"2024-04-26T10:37:28.280871+0000","last_fullsized":"2024-04-26T10:37:28.280871+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:37.936936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.284041+0000","last_change":"2024-04-26T10:37:28.283688+0000","last_active":"2024-04-26T10:37:28.284041+0000","last_peered":"2024-04-26T10:37:28.284041+0000","last_clean":"2024-04-26T10:37:28.284041+0000","last_became_active":"2024-04-26T10:37:28.283421+0000","last_became_peered":"2024-04-26T10:37:28.283421+0000","last_unstale":"2024-04-26T10:37:28.284041+0000","last_undegraded":"2024-04-26T10:37:28.284041+0000","last_fullsized":"2024-04-26T10:37:28.284041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:49.619896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280536+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:37:28.280536+0000","last_peered":"2024-04-26T10:37:28.280536+0000","last_clean":"2024-04-26T10:37:28.280536+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:37:28.280536+0000","last_undegraded":"2024-04-26T10:37:28.280536+0000","last_fullsized":"2024-04-26T10:37:28.280536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:19.856062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280679+0000","last_change":"2024-04-26T10:37:23.273035+0000","last_active":"2024-04-26T10:37:27.280679+0000","last_peered":"2024-04-26T10:37:27.280679+0000","last_clean":"2024-04-26T10:37:27.280679+0000","last_became_active":"2024-04-26T10:37:23.272666+0000","last_became_peered":"2024-04-26T10:37:23.272666+0000","last_unstale":"2024-04-26T10:37:27.280679+0000","last_undegraded":"2024-04-26T10:37:27.280679+0000","last_fullsized":"2024-04-26T10:37:27.280679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:37.560011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282711+0000","last_change":"2024-04-26T10:37:23.271100+0000","last_active":"2024-04-26T10:37:28.282711+0000","last_peered":"2024-04-26T10:37:28.282711+0000","last_clean":"2024-04-26T10:37:28.282711+0000","last_became_active":"2024-04-26T10:37:23.270725+0000","last_became_peered":"2024-04-26T10:37:23.270725+0000","last_unstale":"2024-04-26T10:37:28.282711+0000","last_undegraded":"2024-04-26T10:37:28.282711+0000","last_fullsized":"2024-04-26T10:37:28.282711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:27.315487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280408+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:37:28.280408+0000","last_peered":"2024-04-26T10:37:28.280408+0000","last_clean":"2024-04-26T10:37:28.280408+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:37:28.280408+0000","last_undegraded":"2024-04-26T10:37:28.280408+0000","last_fullsized":"2024-04-26T10:37:28.280408+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:04.852453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278996+0000","last_change":"2024-04-26T10:37:23.269851+0000","last_active":"2024-04-26T10:37:28.278996+0000","last_peered":"2024-04-26T10:37:28.278996+0000","last_clean":"2024-04-26T10:37:28.278996+0000","last_became_active":"2024-04-26T10:37:23.269371+0000","last_became_peered":"2024-04-26T10:37:23.269371+0000","last_unstale":"2024-04-26T10:37:28.278996+0000","last_undegraded":"2024-04-26T10:37:28.278996+0000","last_fullsized":"2024-04-26T10:37:28.278996+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:45.005775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280987+0000","last_change":"2024-04-26T10:37:23.269749+0000","last_active":"2024-04-26T10:37:28.280987+0000","last_peered":"2024-04-26T10:37:28.280987+0000","last_clean":"2024-04-26T10:37:28.280987+0000","last_became_active":"2024-04-26T10:37:23.269344+0000","last_became_peered":"2024-04-26T10:37:23.269344+0000","last_unstale":"2024-04-26T10:37:28.280987+0000","last_undegraded":"2024-04-26T10:37:28.280987+0000","last_fullsized":"2024-04-26T10:37:28.280987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:02.488934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280474+0000","last_change":"2024-04-26T10:37:23.273205+0000","last_active":"2024-04-26T10:37:27.280474+0000","last_peered":"2024-04-26T10:37:27.280474+0000","last_clean":"2024-04-26T10:37:27.280474+0000","last_became_active":"2024-04-26T10:37:23.272731+0000","last_became_peered":"2024-04-26T10:37:23.272731+0000","last_unstale":"2024-04-26T10:37:27.280474+0000","last_undegraded":"2024-04-26T10:37:27.280474+0000","last_fullsized":"2024-04-26T10:37:27.280474+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:01.502486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280869+0000","last_change":"2024-04-26T10:34:14.509381+0000","last_active":"2024-04-26T10:37:28.280869+0000","last_peered":"2024-04-26T10:37:28.280869+0000","last_clean":"2024-04-26T10:37:28.280869+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:37:28.280869+0000","last_undegraded":"2024-04-26T10:37:28.280869+0000","last_fullsized":"2024-04-26T10:37:28.280869+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:05.841519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278712+0000","last_change":"2024-04-26T10:37:23.272627+0000","last_active":"2024-04-26T10:37:28.278712+0000","last_peered":"2024-04-26T10:37:28.278712+0000","last_clean":"2024-04-26T10:37:28.278712+0000","last_became_active":"2024-04-26T10:37:23.269968+0000","last_became_peered":"2024-04-26T10:37:23.269968+0000","last_unstale":"2024-04-26T10:37:28.278712+0000","last_undegraded":"2024-04-26T10:37:28.278712+0000","last_fullsized":"2024-04-26T10:37:28.278712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:30.387833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278915+0000","last_change":"2024-04-26T10:37:23.274880+0000","last_active":"2024-04-26T10:37:28.278915+0000","last_peered":"2024-04-26T10:37:28.278915+0000","last_clean":"2024-04-26T10:37:28.278915+0000","last_became_active":"2024-04-26T10:37:23.274045+0000","last_became_peered":"2024-04-26T10:37:23.274045+0000","last_unstale":"2024-04-26T10:37:28.278915+0000","last_undegraded":"2024-04-26T10:37:28.278915+0000","last_fullsized":"2024-04-26T10:37:28.278915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:40.208538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278315+0000","last_change":"2024-04-26T10:37:23.273798+0000","last_active":"2024-04-26T10:37:28.278315+0000","last_peered":"2024-04-26T10:37:28.278315+0000","last_clean":"2024-04-26T10:37:28.278315+0000","last_became_active":"2024-04-26T10:37:23.269775+0000","last_became_peered":"2024-04-26T10:37:23.269775+0000","last_unstale":"2024-04-26T10:37:28.278315+0000","last_undegraded":"2024-04-26T10:37:28.278315+0000","last_fullsized":"2024-04-26T10:37:28.278315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:12.757286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280347+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:37:27.280347+0000","last_peered":"2024-04-26T10:37:27.280347+0000","last_clean":"2024-04-26T10:37:27.280347+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:37:27.280347+0000","last_undegraded":"2024-04-26T10:37:27.280347+0000","last_fullsized":"2024-04-26T10:37:27.280347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:02.872251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280994+0000","last_change":"2024-04-26T10:37:23.270164+0000","last_active":"2024-04-26T10:37:28.280994+0000","last_peered":"2024-04-26T10:37:28.280994+0000","last_clean":"2024-04-26T10:37:28.280994+0000","last_became_active":"2024-04-26T10:37:23.269537+0000","last_became_peered":"2024-04-26T10:37:23.269537+0000","last_unstale":"2024-04-26T10:37:28.280994+0000","last_undegraded":"2024-04-26T10:37:28.280994+0000","last_fullsized":"2024-04-26T10:37:28.280994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:01.680925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280201+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:37:27.280201+0000","last_peered":"2024-04-26T10:37:27.280201+0000","last_clean":"2024-04-26T10:37:27.280201+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:37:27.280201+0000","last_undegraded":"2024-04-26T10:37:27.280201+0000","last_fullsized":"2024-04-26T10:37:27.280201+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:43.500342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279316+0000","last_change":"2024-04-26T10:37:23.268114+0000","last_active":"2024-04-26T10:37:27.279316+0000","last_peered":"2024-04-26T10:37:27.279316+0000","last_clean":"2024-04-26T10:37:27.279316+0000","last_became_active":"2024-04-26T10:37:23.267121+0000","last_became_peered":"2024-04-26T10:37:23.267121+0000","last_unstale":"2024-04-26T10:37:27.279316+0000","last_undegraded":"2024-04-26T10:37:27.279316+0000","last_fullsized":"2024-04-26T10:37:27.279316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:02.467933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282886+0000","last_change":"2024-04-26T10:37:28.282100+0000","last_active":"2024-04-26T10:37:28.282886+0000","last_peered":"2024-04-26T10:37:28.282886+0000","last_clean":"2024-04-26T10:37:28.282886+0000","last_became_active":"2024-04-26T10:37:28.281512+0000","last_became_peered":"2024-04-26T10:37:28.281512+0000","last_unstale":"2024-04-26T10:37:28.282886+0000","last_undegraded":"2024-04-26T10:37:28.282886+0000","last_fullsized":"2024-04-26T10:37:28.282886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.432394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278274+0000","last_change":"2024-04-26T10:37:23.268184+0000","last_active":"2024-04-26T10:37:28.278274+0000","last_peered":"2024-04-26T10:37:28.278274+0000","last_clean":"2024-04-26T10:37:28.278274+0000","last_became_active":"2024-04-26T10:37:23.266377+0000","last_became_peered":"2024-04-26T10:37:23.266377+0000","last_unstale":"2024-04-26T10:37:28.278274+0000","last_undegraded":"2024-04-26T10:37:28.278274+0000","last_fullsized":"2024-04-26T10:37:28.278274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:30.680130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282822+0000","last_change":"2024-04-26T10:37:23.272074+0000","last_active":"2024-04-26T10:37:28.282822+0000","last_peered":"2024-04-26T10:37:28.282822+0000","last_clean":"2024-04-26T10:37:28.282822+0000","last_became_active":"2024-04-26T10:37:23.271752+0000","last_became_peered":"2024-04-26T10:37:23.271752+0000","last_unstale":"2024-04-26T10:37:28.282822+0000","last_undegraded":"2024-04-26T10:37:28.282822+0000","last_fullsized":"2024-04-26T10:37:28.282822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:49.465872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279270+0000","last_change":"2024-04-26T10:37:23.273840+0000","last_active":"2024-04-26T10:37:28.279270+0000","last_peered":"2024-04-26T10:37:28.279270+0000","last_clean":"2024-04-26T10:37:28.279270+0000","last_became_active":"2024-04-26T10:37:23.272156+0000","last_became_peered":"2024-04-26T10:37:23.272156+0000","last_unstale":"2024-04-26T10:37:28.279270+0000","last_undegraded":"2024-04-26T10:37:28.279270+0000","last_fullsized":"2024-04-26T10:37:28.279270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:37.470181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279506+0000","last_change":"2024-04-26T10:37:23.268011+0000","last_active":"2024-04-26T10:37:27.279506+0000","last_peered":"2024-04-26T10:37:27.279506+0000","last_clean":"2024-04-26T10:37:27.279506+0000","last_became_active":"2024-04-26T10:37:23.267717+0000","last_became_peered":"2024-04-26T10:37:23.267717+0000","last_unstale":"2024-04-26T10:37:27.279506+0000","last_undegraded":"2024-04-26T10:37:27.279506+0000","last_fullsized":"2024-04-26T10:37:27.279506+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:51.923777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":94,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280555+0000","last_change":"2024-04-26T10:37:23.273179+0000","last_active":"2024-04-26T10:37:27.280555+0000","last_peered":"2024-04-26T10:37:27.280555+0000","last_clean":"2024-04-26T10:37:27.280555+0000","last_became_active":"2024-04-26T10:37:23.272260+0000","last_became_peered":"2024-04-26T10:37:23.272260+0000","last_unstale":"2024-04-26T10:37:27.280555+0000","last_undegraded":"2024-04-26T10:37:27.280555+0000","last_fullsized":"2024-04-26T10:37:27.280555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.097396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279635+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:37:27.279635+0000","last_peered":"2024-04-26T10:37:27.279635+0000","last_clean":"2024-04-26T10:37:27.279635+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:37:27.279635+0000","last_undegraded":"2024-04-26T10:37:27.279635+0000","last_fullsized":"2024-04-26T10:37:27.279635+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:12.954308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278652+0000","last_change":"2024-04-26T10:37:23.269836+0000","last_active":"2024-04-26T10:37:28.278652+0000","last_peered":"2024-04-26T10:37:28.278652+0000","last_clean":"2024-04-26T10:37:28.278652+0000","last_became_active":"2024-04-26T10:37:23.268441+0000","last_became_peered":"2024-04-26T10:37:23.268441+0000","last_unstale":"2024-04-26T10:37:28.278652+0000","last_undegraded":"2024-04-26T10:37:28.278652+0000","last_fullsized":"2024-04-26T10:37:28.278652+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:09.971337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278371+0000","last_change":"2024-04-26T10:37:23.270851+0000","last_active":"2024-04-26T10:37:28.278371+0000","last_peered":"2024-04-26T10:37:28.278371+0000","last_clean":"2024-04-26T10:37:28.278371+0000","last_became_active":"2024-04-26T10:37:23.268451+0000","last_became_peered":"2024-04-26T10:37:23.268451+0000","last_unstale":"2024-04-26T10:37:28.278371+0000","last_undegraded":"2024-04-26T10:37:28.278371+0000","last_fullsized":"2024-04-26T10:37:28.278371+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:48.226025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278899+0000","last_change":"2024-04-26T10:37:23.273635+0000","last_active":"2024-04-26T10:37:28.278899+0000","last_peered":"2024-04-26T10:37:28.278899+0000","last_clean":"2024-04-26T10:37:28.278899+0000","last_became_active":"2024-04-26T10:37:23.272938+0000","last_became_peered":"2024-04-26T10:37:23.272938+0000","last_unstale":"2024-04-26T10:37:28.278899+0000","last_undegraded":"2024-04-26T10:37:28.278899+0000","last_fullsized":"2024-04-26T10:37:28.278899+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:05.613682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281241+0000","last_change":"2024-04-26T10:37:23.277366+0000","last_active":"2024-04-26T10:37:28.281241+0000","last_peered":"2024-04-26T10:37:28.281241+0000","last_clean":"2024-04-26T10:37:28.281241+0000","last_became_active":"2024-04-26T10:37:23.276957+0000","last_became_peered":"2024-04-26T10:37:23.276957+0000","last_unstale":"2024-04-26T10:37:28.281241+0000","last_undegraded":"2024-04-26T10:37:28.281241+0000","last_fullsized":"2024-04-26T10:37:28.281241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:33.029508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281114+0000","last_change":"2024-04-26T10:37:23.277440+0000","last_active":"2024-04-26T10:37:28.281114+0000","last_peered":"2024-04-26T10:37:28.281114+0000","last_clean":"2024-04-26T10:37:28.281114+0000","last_became_active":"2024-04-26T10:37:23.277037+0000","last_became_peered":"2024-04-26T10:37:23.277037+0000","last_unstale":"2024-04-26T10:37:28.281114+0000","last_undegraded":"2024-04-26T10:37:28.281114+0000","last_fullsized":"2024-04-26T10:37:28.281114+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:39.705318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278295+0000","last_change":"2024-04-26T10:37:23.270454+0000","last_active":"2024-04-26T10:37:28.278295+0000","last_peered":"2024-04-26T10:37:28.278295+0000","last_clean":"2024-04-26T10:37:28.278295+0000","last_became_active":"2024-04-26T10:37:23.269473+0000","last_became_peered":"2024-04-26T10:37:23.269473+0000","last_unstale":"2024-04-26T10:37:28.278295+0000","last_undegraded":"2024-04-26T10:37:28.278295+0000","last_fullsized":"2024-04-26T10:37:28.278295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:51.049298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278233+0000","last_change":"2024-04-26T10:37:23.267503+0000","last_active":"2024-04-26T10:37:28.278233+0000","last_peered":"2024-04-26T10:37:28.278233+0000","last_clean":"2024-04-26T10:37:28.278233+0000","last_became_active":"2024-04-26T10:37:23.267235+0000","last_became_peered":"2024-04-26T10:37:23.267235+0000","last_unstale":"2024-04-26T10:37:28.278233+0000","last_undegraded":"2024-04-26T10:37:28.278233+0000","last_fullsized":"2024-04-26T10:37:28.278233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:44.951919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278983+0000","last_change":"2024-04-26T10:37:23.274693+0000","last_active":"2024-04-26T10:37:28.278983+0000","last_peered":"2024-04-26T10:37:28.278983+0000","last_clean":"2024-04-26T10:37:28.278983+0000","last_became_active":"2024-04-26T10:37:23.272111+0000","last_became_peered":"2024-04-26T10:37:23.272111+0000","last_unstale":"2024-04-26T10:37:28.278983+0000","last_undegraded":"2024-04-26T10:37:28.278983+0000","last_fullsized":"2024-04-26T10:37:28.278983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:49.690746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280094+0000","last_change":"2024-04-26T10:37:23.274381+0000","last_active":"2024-04-26T10:37:27.280094+0000","last_peered":"2024-04-26T10:37:27.280094+0000","last_clean":"2024-04-26T10:37:27.280094+0000","last_became_active":"2024-04-26T10:37:23.273867+0000","last_became_peered":"2024-04-26T10:37:23.273867+0000","last_unstale":"2024-04-26T10:37:27.280094+0000","last_undegraded":"2024-04-26T10:37:27.280094+0000","last_fullsized":"2024-04-26T10:37:27.280094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:05.525071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279020+0000","last_change":"2024-04-26T10:37:23.273539+0000","last_active":"2024-04-26T10:37:28.279020+0000","last_peered":"2024-04-26T10:37:28.279020+0000","last_clean":"2024-04-26T10:37:28.279020+0000","last_became_active":"2024-04-26T10:37:23.272569+0000","last_became_peered":"2024-04-26T10:37:23.272569+0000","last_unstale":"2024-04-26T10:37:28.279020+0000","last_undegraded":"2024-04-26T10:37:28.279020+0000","last_fullsized":"2024-04-26T10:37:28.279020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:40.584797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279341+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:37:27.279341+0000","last_peered":"2024-04-26T10:37:27.279341+0000","last_clean":"2024-04-26T10:37:27.279341+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:37:27.279341+0000","last_undegraded":"2024-04-26T10:37:27.279341+0000","last_fullsized":"2024-04-26T10:37:27.279341+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:35.111495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282520+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:37:28.282520+0000","last_peered":"2024-04-26T10:37:28.282520+0000","last_clean":"2024-04-26T10:37:28.282520+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:37:28.282520+0000","last_undegraded":"2024-04-26T10:37:28.282520+0000","last_fullsized":"2024-04-26T10:37:28.282520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284088+0000","last_change":"2024-04-26T10:37:28.282767+0000","last_active":"2024-04-26T10:37:29.284088+0000","last_peered":"2024-04-26T10:37:29.284088+0000","last_clean":"2024-04-26T10:37:29.284088+0000","last_became_active":"2024-04-26T10:37:28.282419+0000","last_became_peered":"2024-04-26T10:37:28.282419+0000","last_unstale":"2024-04-26T10:37:29.284088+0000","last_undegraded":"2024-04-26T10:37:29.284088+0000","last_fullsized":"2024-04-26T10:37:29.284088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:44.531133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278848+0000","last_change":"2024-04-26T10:37:23.274843+0000","last_active":"2024-04-26T10:37:28.278848+0000","last_peered":"2024-04-26T10:37:28.278848+0000","last_clean":"2024-04-26T10:37:28.278848+0000","last_became_active":"2024-04-26T10:37:23.273114+0000","last_became_peered":"2024-04-26T10:37:23.273114+0000","last_unstale":"2024-04-26T10:37:28.278848+0000","last_undegraded":"2024-04-26T10:37:28.278848+0000","last_fullsized":"2024-04-26T10:37:28.278848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:33.001910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279711+0000","last_change":"2024-04-26T10:37:23.268149+0000","last_active":"2024-04-26T10:37:27.279711+0000","last_peered":"2024-04-26T10:37:27.279711+0000","last_clean":"2024-04-26T10:37:27.279711+0000","last_became_active":"2024-04-26T10:37:23.267319+0000","last_became_peered":"2024-04-26T10:37:23.267319+0000","last_unstale":"2024-04-26T10:37:27.279711+0000","last_undegraded":"2024-04-26T10:37:27.279711+0000","last_fullsized":"2024-04-26T10:37:27.279711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:36.211011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278094+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:28.278094+0000","last_peered":"2024-04-26T10:37:28.278094+0000","last_clean":"2024-04-26T10:37:28.278094+0000","last_became_active":"2024-04-26T10:37:23.266332+0000","last_became_peered":"2024-04-26T10:37:23.266332+0000","last_unstale":"2024-04-26T10:37:28.278094+0000","last_undegraded":"2024-04-26T10:37:28.278094+0000","last_fullsized":"2024-04-26T10:37:28.278094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:26.218509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278389+0000","last_change":"2024-04-26T10:37:23.272871+0000","last_active":"2024-04-26T10:37:28.278389+0000","last_peered":"2024-04-26T10:37:28.278389+0000","last_clean":"2024-04-26T10:37:28.278389+0000","last_became_active":"2024-04-26T10:37:23.269657+0000","last_became_peered":"2024-04-26T10:37:23.269657+0000","last_unstale":"2024-04-26T10:37:28.278389+0000","last_undegraded":"2024-04-26T10:37:28.278389+0000","last_fullsized":"2024-04-26T10:37:28.278389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:38.769793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281666+0000","last_change":"2024-04-26T10:34:14.513348+0000","last_active":"2024-04-26T10:37:28.281666+0000","last_peered":"2024-04-26T10:37:28.281666+0000","last_clean":"2024-04-26T10:37:28.281666+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:37:28.281666+0000","last_undegraded":"2024-04-26T10:37:28.281666+0000","last_fullsized":"2024-04-26T10:37:28.281666+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:21.161769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280745+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:37:28.280745+0000","last_peered":"2024-04-26T10:37:28.280745+0000","last_clean":"2024-04-26T10:37:28.280745+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:37:28.280745+0000","last_undegraded":"2024-04-26T10:37:28.280745+0000","last_fullsized":"2024-04-26T10:37:28.280745+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":92,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279603+0000","last_change":"2024-04-26T10:37:23.267893+0000","last_active":"2024-04-26T10:37:27.279603+0000","last_peered":"2024-04-26T10:37:27.279603+0000","last_clean":"2024-04-26T10:37:27.279603+0000","last_became_active":"2024-04-26T10:37:23.267595+0000","last_became_peered":"2024-04-26T10:37:23.267595+0000","last_unstale":"2024-04-26T10:37:27.279603+0000","last_undegraded":"2024-04-26T10:37:27.279603+0000","last_fullsized":"2024-04-26T10:37:27.279603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:34.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282762+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:37:28.282762+0000","last_peered":"2024-04-26T10:37:28.282762+0000","last_clean":"2024-04-26T10:37:28.282762+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:37:28.282762+0000","last_undegraded":"2024-04-26T10:37:28.282762+0000","last_fullsized":"2024-04-26T10:37:28.282762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:57.803542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278274+0000","last_change":"2024-04-26T10:37:23.273754+0000","last_active":"2024-04-26T10:37:28.278274+0000","last_peered":"2024-04-26T10:37:28.278274+0000","last_clean":"2024-04-26T10:37:28.278274+0000","last_became_active":"2024-04-26T10:37:23.270451+0000","last_became_peered":"2024-04-26T10:37:23.270451+0000","last_unstale":"2024-04-26T10:37:28.278274+0000","last_undegraded":"2024-04-26T10:37:28.278274+0000","last_fullsized":"2024-04-26T10:37:28.278274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:03.023862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":300,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278550+0000","last_change":"2024-04-26T10:37:23.269600+0000","last_active":"2024-04-26T10:37:28.278550+0000","last_peered":"2024-04-26T10:37:28.278550+0000","last_clean":"2024-04-26T10:37:28.278550+0000","last_became_active":"2024-04-26T10:37:23.268665+0000","last_became_peered":"2024-04-26T10:37:23.268665+0000","last_unstale":"2024-04-26T10:37:28.278550+0000","last_undegraded":"2024-04-26T10:37:28.278550+0000","last_fullsized":"2024-04-26T10:37:28.278550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:27.734866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280817+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:37:28.280817+0000","last_peered":"2024-04-26T10:37:28.280817+0000","last_clean":"2024-04-26T10:37:28.280817+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:37:28.280817+0000","last_undegraded":"2024-04-26T10:37:28.280817+0000","last_fullsized":"2024-04-26T10:37:28.280817+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278725+0000","last_change":"2024-04-26T10:37:23.271849+0000","last_active":"2024-04-26T10:37:28.278725+0000","last_peered":"2024-04-26T10:37:28.278725+0000","last_clean":"2024-04-26T10:37:28.278725+0000","last_became_active":"2024-04-26T10:37:23.269736+0000","last_became_peered":"2024-04-26T10:37:23.269736+0000","last_unstale":"2024-04-26T10:37:28.278725+0000","last_undegraded":"2024-04-26T10:37:28.278725+0000","last_fullsized":"2024-04-26T10:37:28.278725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.639109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278343+0000","last_change":"2024-04-26T10:37:23.266348+0000","last_active":"2024-04-26T10:37:28.278343+0000","last_peered":"2024-04-26T10:37:28.278343+0000","last_clean":"2024-04-26T10:37:28.278343+0000","last_became_active":"2024-04-26T10:37:23.265317+0000","last_became_peered":"2024-04-26T10:37:23.265317+0000","last_unstale":"2024-04-26T10:37:28.278343+0000","last_undegraded":"2024-04-26T10:37:28.278343+0000","last_fullsized":"2024-04-26T10:37:28.278343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:13.956142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280740+0000","last_change":"2024-04-26T10:37:23.276509+0000","last_active":"2024-04-26T10:37:28.280740+0000","last_peered":"2024-04-26T10:37:28.280740+0000","last_clean":"2024-04-26T10:37:28.280740+0000","last_became_active":"2024-04-26T10:37:23.276151+0000","last_became_peered":"2024-04-26T10:37:23.276151+0000","last_unstale":"2024-04-26T10:37:28.280740+0000","last_undegraded":"2024-04-26T10:37:28.280740+0000","last_fullsized":"2024-04-26T10:37:28.280740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:30.924727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280594+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:37:27.280594+0000","last_peered":"2024-04-26T10:37:27.280594+0000","last_clean":"2024-04-26T10:37:27.280594+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:37:27.280594+0000","last_undegraded":"2024-04-26T10:37:27.280594+0000","last_fullsized":"2024-04-26T10:37:27.280594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280625+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:37:27.280625+0000","last_peered":"2024-04-26T10:37:27.280625+0000","last_clean":"2024-04-26T10:37:27.280625+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:37:27.280625+0000","last_undegraded":"2024-04-26T10:37:27.280625+0000","last_fullsized":"2024-04-26T10:37:27.280625+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282126+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:37:28.282126+0000","last_peered":"2024-04-26T10:37:28.282126+0000","last_clean":"2024-04-26T10:37:28.282126+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:37:28.282126+0000","last_undegraded":"2024-04-26T10:37:28.282126+0000","last_fullsized":"2024-04-26T10:37:28.282126+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:21.048381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280027+0000","last_change":"2024-04-26T10:37:23.277636+0000","last_active":"2024-04-26T10:37:27.280027+0000","last_peered":"2024-04-26T10:37:27.280027+0000","last_clean":"2024-04-26T10:37:27.280027+0000","last_became_active":"2024-04-26T10:37:23.277309+0000","last_became_peered":"2024-04-26T10:37:23.277309+0000","last_unstale":"2024-04-26T10:37:27.280027+0000","last_undegraded":"2024-04-26T10:37:27.280027+0000","last_fullsized":"2024-04-26T10:37:27.280027+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:00.429064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282446+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:37:28.282446+0000","last_peered":"2024-04-26T10:37:28.282446+0000","last_clean":"2024-04-26T10:37:28.282446+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:37:28.282446+0000","last_undegraded":"2024-04-26T10:37:28.282446+0000","last_fullsized":"2024-04-26T10:37:28.282446+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282702+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:37:28.282702+0000","last_peered":"2024-04-26T10:37:28.282702+0000","last_clean":"2024-04-26T10:37:28.282702+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:37:28.282702+0000","last_undegraded":"2024-04-26T10:37:28.282702+0000","last_fullsized":"2024-04-26T10:37:28.282702+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.172123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.283483+0000","last_change":"2024-04-26T10:37:28.282300+0000","last_active":"2024-04-26T10:37:28.283483+0000","last_peered":"2024-04-26T10:37:28.283483+0000","last_clean":"2024-04-26T10:37:28.283483+0000","last_became_active":"2024-04-26T10:37:28.281669+0000","last_became_peered":"2024-04-26T10:37:28.281669+0000","last_unstale":"2024-04-26T10:37:28.283483+0000","last_undegraded":"2024-04-26T10:37:28.283483+0000","last_fullsized":"2024-04-26T10:37:28.283483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:23.776919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279088+0000","last_change":"2024-04-26T10:37:23.269479+0000","last_active":"2024-04-26T10:37:28.279088+0000","last_peered":"2024-04-26T10:37:28.279088+0000","last_clean":"2024-04-26T10:37:28.279088+0000","last_became_active":"2024-04-26T10:37:23.268673+0000","last_became_peered":"2024-04-26T10:37:23.268673+0000","last_unstale":"2024-04-26T10:37:28.279088+0000","last_undegraded":"2024-04-26T10:37:28.279088+0000","last_fullsized":"2024-04-26T10:37:28.279088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:52.269482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282451+0000","last_change":"2024-04-26T10:37:23.277426+0000","last_active":"2024-04-26T10:37:28.282451+0000","last_peered":"2024-04-26T10:37:28.282451+0000","last_clean":"2024-04-26T10:37:28.282451+0000","last_became_active":"2024-04-26T10:37:23.277001+0000","last_became_peered":"2024-04-26T10:37:23.277001+0000","last_unstale":"2024-04-26T10:37:28.282451+0000","last_undegraded":"2024-04-26T10:37:28.282451+0000","last_fullsized":"2024-04-26T10:37:28.282451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:38.308038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279463+0000","last_change":"2024-04-26T10:37:23.267342+0000","last_active":"2024-04-26T10:37:27.279463+0000","last_peered":"2024-04-26T10:37:27.279463+0000","last_clean":"2024-04-26T10:37:27.279463+0000","last_became_active":"2024-04-26T10:37:23.266912+0000","last_became_peered":"2024-04-26T10:37:23.266912+0000","last_unstale":"2024-04-26T10:37:27.279463+0000","last_undegraded":"2024-04-26T10:37:27.279463+0000","last_fullsized":"2024-04-26T10:37:27.279463+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:28.070169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279987+0000","last_change":"2024-04-26T10:37:23.277620+0000","last_active":"2024-04-26T10:37:27.279987+0000","last_peered":"2024-04-26T10:37:27.279987+0000","last_clean":"2024-04-26T10:37:27.279987+0000","last_became_active":"2024-04-26T10:37:23.277303+0000","last_became_peered":"2024-04-26T10:37:23.277303+0000","last_unstale":"2024-04-26T10:37:27.279987+0000","last_undegraded":"2024-04-26T10:37:27.279987+0000","last_fullsized":"2024-04-26T10:37:27.279987+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:57.292594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280339+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:37:27.280339+0000","last_peered":"2024-04-26T10:37:27.280339+0000","last_clean":"2024-04-26T10:37:27.280339+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:37:27.280339+0000","last_undegraded":"2024-04-26T10:37:27.280339+0000","last_fullsized":"2024-04-26T10:37:27.280339+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278431+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:28.278431+0000","last_peered":"2024-04-26T10:37:28.278431+0000","last_clean":"2024-04-26T10:37:28.278431+0000","last_became_active":"2024-04-26T10:37:23.266295+0000","last_became_peered":"2024-04-26T10:37:23.266295+0000","last_unstale":"2024-04-26T10:37:28.278431+0000","last_undegraded":"2024-04-26T10:37:28.278431+0000","last_fullsized":"2024-04-26T10:37:28.278431+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:19.026704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278934+0000","last_change":"2024-04-26T10:37:23.274686+0000","last_active":"2024-04-26T10:37:28.278934+0000","last_peered":"2024-04-26T10:37:28.278934+0000","last_clean":"2024-04-26T10:37:28.278934+0000","last_became_active":"2024-04-26T10:37:23.272039+0000","last_became_peered":"2024-04-26T10:37:23.272039+0000","last_unstale":"2024-04-26T10:37:28.278934+0000","last_undegraded":"2024-04-26T10:37:28.278934+0000","last_fullsized":"2024-04-26T10:37:28.278934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:42.152908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":93,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280761+0000","last_change":"2024-04-26T10:37:23.273723+0000","last_active":"2024-04-26T10:37:27.280761+0000","last_peered":"2024-04-26T10:37:27.280761+0000","last_clean":"2024-04-26T10:37:27.280761+0000","last_became_active":"2024-04-26T10:37:23.273253+0000","last_became_peered":"2024-04-26T10:37:23.273253+0000","last_unstale":"2024-04-26T10:37:27.280761+0000","last_undegraded":"2024-04-26T10:37:27.280761+0000","last_fullsized":"2024-04-26T10:37:27.280761+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:30.644188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278246+0000","last_change":"2024-04-26T10:37:23.267726+0000","last_active":"2024-04-26T10:37:28.278246+0000","last_peered":"2024-04-26T10:37:28.278246+0000","last_clean":"2024-04-26T10:37:28.278246+0000","last_became_active":"2024-04-26T10:37:23.267434+0000","last_became_peered":"2024-04-26T10:37:23.267434+0000","last_unstale":"2024-04-26T10:37:28.278246+0000","last_undegraded":"2024-04-26T10:37:28.278246+0000","last_fullsized":"2024-04-26T10:37:28.278246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:43.219752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282593+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:37:28.282593+0000","last_peered":"2024-04-26T10:37:28.282593+0000","last_clean":"2024-04-26T10:37:28.282593+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:37:28.282593+0000","last_undegraded":"2024-04-26T10:37:28.282593+0000","last_fullsized":"2024-04-26T10:37:28.282593+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.280206+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:37:27.280206+0000","last_peered":"2024-04-26T10:37:27.280206+0000","last_clean":"2024-04-26T10:37:27.280206+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:37:27.280206+0000","last_undegraded":"2024-04-26T10:37:27.280206+0000","last_fullsized":"2024-04-26T10:37:27.280206+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282593+0000","last_change":"2024-04-26T10:37:23.272052+0000","last_active":"2024-04-26T10:37:28.282593+0000","last_peered":"2024-04-26T10:37:28.282593+0000","last_clean":"2024-04-26T10:37:28.282593+0000","last_became_active":"2024-04-26T10:37:23.271663+0000","last_became_peered":"2024-04-26T10:37:23.271663+0000","last_unstale":"2024-04-26T10:37:28.282593+0000","last_undegraded":"2024-04-26T10:37:28.282593+0000","last_fullsized":"2024-04-26T10:37:28.282593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:31.778313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278501+0000","last_change":"2024-04-26T10:37:23.268370+0000","last_active":"2024-04-26T10:37:28.278501+0000","last_peered":"2024-04-26T10:37:28.278501+0000","last_clean":"2024-04-26T10:37:28.278501+0000","last_became_active":"2024-04-26T10:37:23.266624+0000","last_became_peered":"2024-04-26T10:37:23.266624+0000","last_unstale":"2024-04-26T10:37:28.278501+0000","last_undegraded":"2024-04-26T10:37:28.278501+0000","last_fullsized":"2024-04-26T10:37:28.278501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:42.205710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278444+0000","last_change":"2024-04-26T10:37:23.267652+0000","last_active":"2024-04-26T10:37:28.278444+0000","last_peered":"2024-04-26T10:37:28.278444+0000","last_clean":"2024-04-26T10:37:28.278444+0000","last_became_active":"2024-04-26T10:37:23.266063+0000","last_became_peered":"2024-04-26T10:37:23.266063+0000","last_unstale":"2024-04-26T10:37:28.278444+0000","last_undegraded":"2024-04-26T10:37:28.278444+0000","last_fullsized":"2024-04-26T10:37:28.278444+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:23.209788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283546+0000","last_change":"2024-04-26T10:37:28.282145+0000","last_active":"2024-04-26T10:37:29.283546+0000","last_peered":"2024-04-26T10:37:29.283546+0000","last_clean":"2024-04-26T10:37:29.283546+0000","last_became_active":"2024-04-26T10:37:28.281541+0000","last_became_peered":"2024-04-26T10:37:28.281541+0000","last_unstale":"2024-04-26T10:37:29.283546+0000","last_undegraded":"2024-04-26T10:37:29.283546+0000","last_fullsized":"2024-04-26T10:37:29.283546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:55.649460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":91,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279988+0000","last_change":"2024-04-26T10:37:23.268479+0000","last_active":"2024-04-26T10:37:27.279988+0000","last_peered":"2024-04-26T10:37:27.279988+0000","last_clean":"2024-04-26T10:37:27.279988+0000","last_became_active":"2024-04-26T10:37:23.267644+0000","last_became_peered":"2024-04-26T10:37:23.267644+0000","last_unstale":"2024-04-26T10:37:27.279988+0000","last_undegraded":"2024-04-26T10:37:27.279988+0000","last_fullsized":"2024-04-26T10:37:27.279988+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:47.606620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281350+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:37:28.281350+0000","last_peered":"2024-04-26T10:37:28.281350+0000","last_clean":"2024-04-26T10:37:28.281350+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:37:28.281350+0000","last_undegraded":"2024-04-26T10:37:28.281350+0000","last_fullsized":"2024-04-26T10:37:28.281350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.021846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":63,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T10:37:27.279979+0000","last_change":"2024-04-26T10:37:23.274199+0000","last_active":"2024-04-26T10:37:27.279979+0000","last_peered":"2024-04-26T10:37:27.279979+0000","last_clean":"2024-04-26T10:37:27.279979+0000","last_became_active":"2024-04-26T10:37:23.273023+0000","last_became_peered":"2024-04-26T10:37:23.273023+0000","last_unstale":"2024-04-26T10:37:27.279979+0000","last_undegraded":"2024-04-26T10:37:27.279979+0000","last_fullsized":"2024-04-26T10:37:27.279979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:55.142124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1766,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738429,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":338840,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":94033000,"statfs":{"total":96636764160,"available":96289792000,"internally_reserved":0,"allocated":917504,"data_stored":359527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346028486},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55000000000000004}]},{"osd":1,"last update":"Fri Apr 26 10:36:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.38100000000000001},"min":{"1min":0.36399999999999999,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.56799999999999995,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.63800000000000001,"15min":0.496},"min":{"1min":0.373,"5min":0.19,"15min":0.19},"max":{"1min":0.59699999999999998,"5min":12.206,"15min":12.206},"last":0.47899999999999998}]}]},{"osd":0,"up_from":75,"seq":322122547204,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55024,"kb_used_data":1500,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94316816,"statfs":{"total":96636764160,"available":96580419584,"internally_reserved":0,"allocated":1536000,"data_stored":951641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7111,"internal_metadata":54780985},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":1,"up_from":8,"seq":34359738428,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257364,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":255870,"kb_avail":94114476,"statfs":{"total":96636764160,"available":96373223424,"internally_reserved":0,"allocated":1515520,"data_stored":944680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262011334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Apr 26 10:36:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.42199999999999999,"15min":0.35599999999999998},"min":{"1min":0.307,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.59199999999999997,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.503},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48199999999999998,"15min":0.45200000000000001},"min":{"1min":0.27600000000000002,"5min":0.183,"15min":0.183},"max":{"1min":0.60699999999999998,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:37:34.361 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:37:34.735 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:37:34.736 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":82,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:37:29.279779+0000","last_up_change":"2024-04-26T10:37:22.247952+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:32:49.859710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:32:50.968196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":58,"up_from":75,"up_thru":75,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":6175},{"type":"v1","addr":"172.21.15.112:6801","nonce":6175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":6175},{"type":"v1","addr":"172.21.15.112:6803","nonce":6175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":6175},{"type":"v1","addr":"172.21.15.112:6807","nonce":6175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":6175},{"type":"v1","addr":"172.21.15.112:6805","nonce":6175}]},"public_addr":"172.21.15.112:6801/6175","cluster_addr":"172.21.15.112:6803/6175","heartbeat_back_addr":"172.21.15.112:6807/6175","heartbeat_front_addr":"172.21.15.112:6805/6175","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":58},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:37:35.752 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T10:37:35.752 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T10:37:35.918 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-26T10:37:35.919 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-26T10:37:35.919 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-26T10:37:35.931 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T10:37:36.271 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T10:37:36.283 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T10:37:36.284 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T10:37:36.436 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-26T10:37:36.436 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T10:37:36.436 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-26T10:37:36.448 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T10:37:36.789 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T10:37:36.801 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T10:37:36.801 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T10:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-04-26T10:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T10:37:36.952 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-04-26T10:37:36.964 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T10:37:37.306 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T10:37:37.318 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:37:37.661 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:37:37.663 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:37:37.673 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2024-04-26T10:37:37.059689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":592134,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":651236,"kb_used_data":3884,"kb_used_omap":10,"kb_used_meta":647285,"kb_avail":282464284,"statfs":{"total":289910292480,"available":289243426816,"internally_reserved":0,"allocated":3977216,"data_stored":2260080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10299,"internal_metadata":662820805},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.783072"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279702+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:37:28.279702+0000","last_peered":"2024-04-26T10:37:28.279702+0000","last_clean":"2024-04-26T10:37:28.279702+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:37:28.279702+0000","last_undegraded":"2024-04-26T10:37:28.279702+0000","last_fullsized":"2024-04-26T10:37:28.279702+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:26.964955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279564+0000","last_change":"2024-04-26T10:32:52.001240+0000","last_active":"2024-04-26T10:37:28.279564+0000","last_peered":"2024-04-26T10:37:28.279564+0000","last_clean":"2024-04-26T10:37:28.279564+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:37:28.279564+0000","last_undegraded":"2024-04-26T10:37:28.279564+0000","last_fullsized":"2024-04-26T10:37:28.279564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278894+0000","last_change":"2024-04-26T10:37:23.274531+0000","last_active":"2024-04-26T10:37:28.278894+0000","last_peered":"2024-04-26T10:37:28.278894+0000","last_clean":"2024-04-26T10:37:28.278894+0000","last_became_active":"2024-04-26T10:37:23.272107+0000","last_became_peered":"2024-04-26T10:37:23.272107+0000","last_unstale":"2024-04-26T10:37:28.278894+0000","last_undegraded":"2024-04-26T10:37:28.278894+0000","last_fullsized":"2024-04-26T10:37:28.278894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:36.699634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278352+0000","last_change":"2024-04-26T10:37:23.271611+0000","last_active":"2024-04-26T10:37:28.278352+0000","last_peered":"2024-04-26T10:37:28.278352+0000","last_clean":"2024-04-26T10:37:28.278352+0000","last_became_active":"2024-04-26T10:37:23.269752+0000","last_became_peered":"2024-04-26T10:37:23.269752+0000","last_unstale":"2024-04-26T10:37:28.278352+0000","last_undegraded":"2024-04-26T10:37:28.278352+0000","last_fullsized":"2024-04-26T10:37:28.278352+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:17.370231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278969+0000","last_change":"2024-04-26T10:34:14.507618+0000","last_active":"2024-04-26T10:37:28.278969+0000","last_peered":"2024-04-26T10:37:28.278969+0000","last_clean":"2024-04-26T10:37:28.278969+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:37:28.278969+0000","last_undegraded":"2024-04-26T10:37:28.278969+0000","last_fullsized":"2024-04-26T10:37:28.278969+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:27.721106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278624+0000","last_change":"2024-04-26T10:37:23.271901+0000","last_active":"2024-04-26T10:37:28.278624+0000","last_peered":"2024-04-26T10:37:28.278624+0000","last_clean":"2024-04-26T10:37:28.278624+0000","last_became_active":"2024-04-26T10:37:23.270593+0000","last_became_peered":"2024-04-26T10:37:23.270593+0000","last_unstale":"2024-04-26T10:37:28.278624+0000","last_undegraded":"2024-04-26T10:37:28.278624+0000","last_fullsized":"2024-04-26T10:37:28.278624+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:56.909979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278139+0000","last_change":"2024-04-26T10:37:23.271640+0000","last_active":"2024-04-26T10:37:28.278139+0000","last_peered":"2024-04-26T10:37:28.278139+0000","last_clean":"2024-04-26T10:37:28.278139+0000","last_became_active":"2024-04-26T10:37:23.270393+0000","last_became_peered":"2024-04-26T10:37:23.270393+0000","last_unstale":"2024-04-26T10:37:28.278139+0000","last_undegraded":"2024-04-26T10:37:28.278139+0000","last_fullsized":"2024-04-26T10:37:28.278139+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:30.161615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.277990+0000","last_change":"2024-04-26T10:37:23.268381+0000","last_active":"2024-04-26T10:37:28.277990+0000","last_peered":"2024-04-26T10:37:28.277990+0000","last_clean":"2024-04-26T10:37:28.277990+0000","last_became_active":"2024-04-26T10:37:23.267296+0000","last_became_peered":"2024-04-26T10:37:23.267296+0000","last_unstale":"2024-04-26T10:37:28.277990+0000","last_undegraded":"2024-04-26T10:37:28.277990+0000","last_fullsized":"2024-04-26T10:37:28.277990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:09.197024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282256+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:37:28.282256+0000","last_peered":"2024-04-26T10:37:28.282256+0000","last_clean":"2024-04-26T10:37:28.282256+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:37:28.282256+0000","last_undegraded":"2024-04-26T10:37:28.282256+0000","last_fullsized":"2024-04-26T10:37:28.282256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:43.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279464+0000","last_change":"2024-04-26T10:34:14.507265+0000","last_active":"2024-04-26T10:37:28.279464+0000","last_peered":"2024-04-26T10:37:28.279464+0000","last_clean":"2024-04-26T10:37:28.279464+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:37:28.279464+0000","last_undegraded":"2024-04-26T10:37:28.279464+0000","last_fullsized":"2024-04-26T10:37:28.279464+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:24:07.268421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278994+0000","last_change":"2024-04-26T10:37:23.275734+0000","last_active":"2024-04-26T10:37:28.278994+0000","last_peered":"2024-04-26T10:37:28.278994+0000","last_clean":"2024-04-26T10:37:28.278994+0000","last_became_active":"2024-04-26T10:37:23.273996+0000","last_became_peered":"2024-04-26T10:37:23.273996+0000","last_unstale":"2024-04-26T10:37:28.278994+0000","last_undegraded":"2024-04-26T10:37:28.278994+0000","last_fullsized":"2024-04-26T10:37:28.278994+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:19.909745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279324+0000","last_change":"2024-04-26T10:37:23.274459+0000","last_active":"2024-04-26T10:37:28.279324+0000","last_peered":"2024-04-26T10:37:28.279324+0000","last_clean":"2024-04-26T10:37:28.279324+0000","last_became_active":"2024-04-26T10:37:23.273290+0000","last_became_peered":"2024-04-26T10:37:23.273290+0000","last_unstale":"2024-04-26T10:37:28.279324+0000","last_undegraded":"2024-04-26T10:37:28.279324+0000","last_fullsized":"2024-04-26T10:37:28.279324+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:48.501270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278976+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:37:28.278976+0000","last_peered":"2024-04-26T10:37:28.278976+0000","last_clean":"2024-04-26T10:37:28.278976+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:37:28.278976+0000","last_undegraded":"2024-04-26T10:37:28.278976+0000","last_fullsized":"2024-04-26T10:37:28.278976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:03.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278723+0000","last_change":"2024-04-26T10:37:23.271722+0000","last_active":"2024-04-26T10:37:28.278723+0000","last_peered":"2024-04-26T10:37:28.278723+0000","last_clean":"2024-04-26T10:37:28.278723+0000","last_became_active":"2024-04-26T10:37:23.269722+0000","last_became_peered":"2024-04-26T10:37:23.269722+0000","last_unstale":"2024-04-26T10:37:28.278723+0000","last_undegraded":"2024-04-26T10:37:28.278723+0000","last_fullsized":"2024-04-26T10:37:28.278723+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:57:22.768002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278663+0000","last_change":"2024-04-26T10:37:23.271761+0000","last_active":"2024-04-26T10:37:28.278663+0000","last_peered":"2024-04-26T10:37:28.278663+0000","last_clean":"2024-04-26T10:37:28.278663+0000","last_became_active":"2024-04-26T10:37:23.270852+0000","last_became_peered":"2024-04-26T10:37:23.270852+0000","last_unstale":"2024-04-26T10:37:28.278663+0000","last_undegraded":"2024-04-26T10:37:28.278663+0000","last_fullsized":"2024-04-26T10:37:28.278663+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:17.289523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278631+0000","last_change":"2024-04-26T10:37:23.270523+0000","last_active":"2024-04-26T10:37:28.278631+0000","last_peered":"2024-04-26T10:37:28.278631+0000","last_clean":"2024-04-26T10:37:28.278631+0000","last_became_active":"2024-04-26T10:37:23.268640+0000","last_became_peered":"2024-04-26T10:37:23.268640+0000","last_unstale":"2024-04-26T10:37:28.278631+0000","last_undegraded":"2024-04-26T10:37:28.278631+0000","last_fullsized":"2024-04-26T10:37:28.278631+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:45.353248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284300+0000","last_change":"2024-04-26T10:37:28.282247+0000","last_active":"2024-04-26T10:37:29.284300+0000","last_peered":"2024-04-26T10:37:29.284300+0000","last_clean":"2024-04-26T10:37:29.284300+0000","last_became_active":"2024-04-26T10:37:28.281510+0000","last_became_peered":"2024-04-26T10:37:28.281510+0000","last_unstale":"2024-04-26T10:37:29.284300+0000","last_undegraded":"2024-04-26T10:37:29.284300+0000","last_fullsized":"2024-04-26T10:37:29.284300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:37.366727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279453+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:37:28.279453+0000","last_peered":"2024-04-26T10:37:28.279453+0000","last_clean":"2024-04-26T10:37:28.279453+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:37:28.279453+0000","last_undegraded":"2024-04-26T10:37:28.279453+0000","last_fullsized":"2024-04-26T10:37:28.279453+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.343269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281607+0000","last_change":"2024-04-26T10:32:52.007774+0000","last_active":"2024-04-26T10:37:28.281607+0000","last_peered":"2024-04-26T10:37:28.281607+0000","last_clean":"2024-04-26T10:37:28.281607+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:37:28.281607+0000","last_undegraded":"2024-04-26T10:37:28.281607+0000","last_fullsized":"2024-04-26T10:37:28.281607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:12.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278862+0000","last_change":"2024-04-26T10:37:23.273700+0000","last_active":"2024-04-26T10:37:28.278862+0000","last_peered":"2024-04-26T10:37:28.278862+0000","last_clean":"2024-04-26T10:37:28.278862+0000","last_became_active":"2024-04-26T10:37:23.272964+0000","last_became_peered":"2024-04-26T10:37:23.272964+0000","last_unstale":"2024-04-26T10:37:28.278862+0000","last_undegraded":"2024-04-26T10:37:28.278862+0000","last_fullsized":"2024-04-26T10:37:28.278862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:49.013542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278797+0000","last_change":"2024-04-26T10:37:23.274112+0000","last_active":"2024-04-26T10:37:28.278797+0000","last_peered":"2024-04-26T10:37:28.278797+0000","last_clean":"2024-04-26T10:37:28.278797+0000","last_became_active":"2024-04-26T10:37:23.271967+0000","last_became_peered":"2024-04-26T10:37:23.271967+0000","last_unstale":"2024-04-26T10:37:28.278797+0000","last_undegraded":"2024-04-26T10:37:28.278797+0000","last_fullsized":"2024-04-26T10:37:28.278797+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:41:35.182239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278945+0000","last_change":"2024-04-26T10:37:23.268432+0000","last_active":"2024-04-26T10:37:28.278945+0000","last_peered":"2024-04-26T10:37:28.278945+0000","last_clean":"2024-04-26T10:37:28.278945+0000","last_became_active":"2024-04-26T10:37:23.267766+0000","last_became_peered":"2024-04-26T10:37:23.267766+0000","last_unstale":"2024-04-26T10:37:28.278945+0000","last_undegraded":"2024-04-26T10:37:28.278945+0000","last_fullsized":"2024-04-26T10:37:28.278945+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:46.203749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280877+0000","last_change":"2024-04-26T10:37:23.270217+0000","last_active":"2024-04-26T10:37:28.280877+0000","last_peered":"2024-04-26T10:37:28.280877+0000","last_clean":"2024-04-26T10:37:28.280877+0000","last_became_active":"2024-04-26T10:37:23.269861+0000","last_became_peered":"2024-04-26T10:37:23.269861+0000","last_unstale":"2024-04-26T10:37:28.280877+0000","last_undegraded":"2024-04-26T10:37:28.280877+0000","last_fullsized":"2024-04-26T10:37:28.280877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:39.366800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278942+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:37:28.278942+0000","last_peered":"2024-04-26T10:37:28.278942+0000","last_clean":"2024-04-26T10:37:28.278942+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:37:28.278942+0000","last_undegraded":"2024-04-26T10:37:28.278942+0000","last_fullsized":"2024-04-26T10:37:28.278942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:30:14.906164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279635+0000","last_change":"2024-04-26T10:37:23.272702+0000","last_active":"2024-04-26T10:37:28.279635+0000","last_peered":"2024-04-26T10:37:28.279635+0000","last_clean":"2024-04-26T10:37:28.279635+0000","last_became_active":"2024-04-26T10:37:23.272218+0000","last_became_peered":"2024-04-26T10:37:23.272218+0000","last_unstale":"2024-04-26T10:37:28.279635+0000","last_undegraded":"2024-04-26T10:37:28.279635+0000","last_fullsized":"2024-04-26T10:37:28.279635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:01.008010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282600+0000","last_change":"2024-04-26T10:37:23.271247+0000","last_active":"2024-04-26T10:37:28.282600+0000","last_peered":"2024-04-26T10:37:28.282600+0000","last_clean":"2024-04-26T10:37:28.282600+0000","last_became_active":"2024-04-26T10:37:23.270919+0000","last_became_peered":"2024-04-26T10:37:23.270919+0000","last_unstale":"2024-04-26T10:37:28.282600+0000","last_undegraded":"2024-04-26T10:37:28.282600+0000","last_fullsized":"2024-04-26T10:37:28.282600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:18.340235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279085+0000","last_change":"2024-04-26T10:37:23.275081+0000","last_active":"2024-04-26T10:37:28.279085+0000","last_peered":"2024-04-26T10:37:28.279085+0000","last_clean":"2024-04-26T10:37:28.279085+0000","last_became_active":"2024-04-26T10:37:23.273821+0000","last_became_peered":"2024-04-26T10:37:23.273821+0000","last_unstale":"2024-04-26T10:37:28.279085+0000","last_undegraded":"2024-04-26T10:37:28.279085+0000","last_fullsized":"2024-04-26T10:37:28.279085+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:39.585583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278946+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:37:28.278946+0000","last_peered":"2024-04-26T10:37:28.278946+0000","last_clean":"2024-04-26T10:37:28.278946+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:37:28.278946+0000","last_undegraded":"2024-04-26T10:37:28.278946+0000","last_fullsized":"2024-04-26T10:37:28.278946+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:25.710688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279717+0000","last_change":"2024-04-26T10:37:23.273494+0000","last_active":"2024-04-26T10:37:28.279717+0000","last_peered":"2024-04-26T10:37:28.279717+0000","last_clean":"2024-04-26T10:37:28.279717+0000","last_became_active":"2024-04-26T10:37:23.272837+0000","last_became_peered":"2024-04-26T10:37:23.272837+0000","last_unstale":"2024-04-26T10:37:28.279717+0000","last_undegraded":"2024-04-26T10:37:28.279717+0000","last_fullsized":"2024-04-26T10:37:28.279717+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:04:41.090971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280871+0000","last_change":"2024-04-26T10:37:23.269480+0000","last_active":"2024-04-26T10:37:28.280871+0000","last_peered":"2024-04-26T10:37:28.280871+0000","last_clean":"2024-04-26T10:37:28.280871+0000","last_became_active":"2024-04-26T10:37:23.269197+0000","last_became_peered":"2024-04-26T10:37:23.269197+0000","last_unstale":"2024-04-26T10:37:28.280871+0000","last_undegraded":"2024-04-26T10:37:28.280871+0000","last_fullsized":"2024-04-26T10:37:28.280871+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:56:37.936936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.284041+0000","last_change":"2024-04-26T10:37:28.283688+0000","last_active":"2024-04-26T10:37:28.284041+0000","last_peered":"2024-04-26T10:37:28.284041+0000","last_clean":"2024-04-26T10:37:28.284041+0000","last_became_active":"2024-04-26T10:37:28.283421+0000","last_became_peered":"2024-04-26T10:37:28.283421+0000","last_unstale":"2024-04-26T10:37:28.284041+0000","last_undegraded":"2024-04-26T10:37:28.284041+0000","last_fullsized":"2024-04-26T10:37:28.284041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:49.619896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280536+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:37:28.280536+0000","last_peered":"2024-04-26T10:37:28.280536+0000","last_clean":"2024-04-26T10:37:28.280536+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:37:28.280536+0000","last_undegraded":"2024-04-26T10:37:28.280536+0000","last_fullsized":"2024-04-26T10:37:28.280536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:19.856062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279897+0000","last_change":"2024-04-26T10:37:23.273035+0000","last_active":"2024-04-26T10:37:28.279897+0000","last_peered":"2024-04-26T10:37:28.279897+0000","last_clean":"2024-04-26T10:37:28.279897+0000","last_became_active":"2024-04-26T10:37:23.272666+0000","last_became_peered":"2024-04-26T10:37:23.272666+0000","last_unstale":"2024-04-26T10:37:28.279897+0000","last_undegraded":"2024-04-26T10:37:28.279897+0000","last_fullsized":"2024-04-26T10:37:28.279897+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:21:37.560011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282711+0000","last_change":"2024-04-26T10:37:23.271100+0000","last_active":"2024-04-26T10:37:28.282711+0000","last_peered":"2024-04-26T10:37:28.282711+0000","last_clean":"2024-04-26T10:37:28.282711+0000","last_became_active":"2024-04-26T10:37:23.270725+0000","last_became_peered":"2024-04-26T10:37:23.270725+0000","last_unstale":"2024-04-26T10:37:28.282711+0000","last_undegraded":"2024-04-26T10:37:28.282711+0000","last_fullsized":"2024-04-26T10:37:28.282711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:27.315487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283376+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:37:29.283376+0000","last_peered":"2024-04-26T10:37:29.283376+0000","last_clean":"2024-04-26T10:37:29.283376+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:37:29.283376+0000","last_undegraded":"2024-04-26T10:37:29.283376+0000","last_fullsized":"2024-04-26T10:37:29.283376+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:04.852453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278996+0000","last_change":"2024-04-26T10:37:23.269851+0000","last_active":"2024-04-26T10:37:28.278996+0000","last_peered":"2024-04-26T10:37:28.278996+0000","last_clean":"2024-04-26T10:37:28.278996+0000","last_became_active":"2024-04-26T10:37:23.269371+0000","last_became_peered":"2024-04-26T10:37:23.269371+0000","last_unstale":"2024-04-26T10:37:28.278996+0000","last_undegraded":"2024-04-26T10:37:28.278996+0000","last_fullsized":"2024-04-26T10:37:28.278996+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:45.005775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283777+0000","last_change":"2024-04-26T10:37:23.269749+0000","last_active":"2024-04-26T10:37:29.283777+0000","last_peered":"2024-04-26T10:37:29.283777+0000","last_clean":"2024-04-26T10:37:29.283777+0000","last_became_active":"2024-04-26T10:37:23.269344+0000","last_became_peered":"2024-04-26T10:37:23.269344+0000","last_unstale":"2024-04-26T10:37:29.283777+0000","last_undegraded":"2024-04-26T10:37:29.283777+0000","last_fullsized":"2024-04-26T10:37:29.283777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:00:02.488934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":70,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279253+0000","last_change":"2024-04-26T10:37:23.273205+0000","last_active":"2024-04-26T10:37:28.279253+0000","last_peered":"2024-04-26T10:37:28.279253+0000","last_clean":"2024-04-26T10:37:28.279253+0000","last_became_active":"2024-04-26T10:37:23.272731+0000","last_became_peered":"2024-04-26T10:37:23.272731+0000","last_unstale":"2024-04-26T10:37:28.279253+0000","last_undegraded":"2024-04-26T10:37:28.279253+0000","last_fullsized":"2024-04-26T10:37:28.279253+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:01.502486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283750+0000","last_change":"2024-04-26T10:34:14.509381+0000","last_active":"2024-04-26T10:37:29.283750+0000","last_peered":"2024-04-26T10:37:29.283750+0000","last_clean":"2024-04-26T10:37:29.283750+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:37:29.283750+0000","last_undegraded":"2024-04-26T10:37:29.283750+0000","last_fullsized":"2024-04-26T10:37:29.283750+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:24:05.841519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278712+0000","last_change":"2024-04-26T10:37:23.272627+0000","last_active":"2024-04-26T10:37:28.278712+0000","last_peered":"2024-04-26T10:37:28.278712+0000","last_clean":"2024-04-26T10:37:28.278712+0000","last_became_active":"2024-04-26T10:37:23.269968+0000","last_became_peered":"2024-04-26T10:37:23.269968+0000","last_unstale":"2024-04-26T10:37:28.278712+0000","last_undegraded":"2024-04-26T10:37:28.278712+0000","last_fullsized":"2024-04-26T10:37:28.278712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:30.387833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278915+0000","last_change":"2024-04-26T10:37:23.274880+0000","last_active":"2024-04-26T10:37:28.278915+0000","last_peered":"2024-04-26T10:37:28.278915+0000","last_clean":"2024-04-26T10:37:28.278915+0000","last_became_active":"2024-04-26T10:37:23.274045+0000","last_became_peered":"2024-04-26T10:37:23.274045+0000","last_unstale":"2024-04-26T10:37:28.278915+0000","last_undegraded":"2024-04-26T10:37:28.278915+0000","last_fullsized":"2024-04-26T10:37:28.278915+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:40.208538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278315+0000","last_change":"2024-04-26T10:37:23.273798+0000","last_active":"2024-04-26T10:37:28.278315+0000","last_peered":"2024-04-26T10:37:28.278315+0000","last_clean":"2024-04-26T10:37:28.278315+0000","last_became_active":"2024-04-26T10:37:23.269775+0000","last_became_peered":"2024-04-26T10:37:23.269775+0000","last_unstale":"2024-04-26T10:37:28.278315+0000","last_undegraded":"2024-04-26T10:37:28.278315+0000","last_fullsized":"2024-04-26T10:37:28.278315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:12.757286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279257+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:37:28.279257+0000","last_peered":"2024-04-26T10:37:28.279257+0000","last_clean":"2024-04-26T10:37:28.279257+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:37:28.279257+0000","last_undegraded":"2024-04-26T10:37:28.279257+0000","last_fullsized":"2024-04-26T10:37:28.279257+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:02.872251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283840+0000","last_change":"2024-04-26T10:37:23.270164+0000","last_active":"2024-04-26T10:37:29.283840+0000","last_peered":"2024-04-26T10:37:29.283840+0000","last_clean":"2024-04-26T10:37:29.283840+0000","last_became_active":"2024-04-26T10:37:23.269537+0000","last_became_peered":"2024-04-26T10:37:23.269537+0000","last_unstale":"2024-04-26T10:37:29.283840+0000","last_undegraded":"2024-04-26T10:37:29.283840+0000","last_fullsized":"2024-04-26T10:37:29.283840+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:38:01.680925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279366+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:37:28.279366+0000","last_peered":"2024-04-26T10:37:28.279366+0000","last_clean":"2024-04-26T10:37:28.279366+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:37:28.279366+0000","last_undegraded":"2024-04-26T10:37:28.279366+0000","last_fullsized":"2024-04-26T10:37:28.279366+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:43.500342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278613+0000","last_change":"2024-04-26T10:37:23.268114+0000","last_active":"2024-04-26T10:37:28.278613+0000","last_peered":"2024-04-26T10:37:28.278613+0000","last_clean":"2024-04-26T10:37:28.278613+0000","last_became_active":"2024-04-26T10:37:23.267121+0000","last_became_peered":"2024-04-26T10:37:23.267121+0000","last_unstale":"2024-04-26T10:37:28.278613+0000","last_undegraded":"2024-04-26T10:37:28.278613+0000","last_fullsized":"2024-04-26T10:37:28.278613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:02.467933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282886+0000","last_change":"2024-04-26T10:37:28.282100+0000","last_active":"2024-04-26T10:37:28.282886+0000","last_peered":"2024-04-26T10:37:28.282886+0000","last_clean":"2024-04-26T10:37:28.282886+0000","last_became_active":"2024-04-26T10:37:28.281512+0000","last_became_peered":"2024-04-26T10:37:28.281512+0000","last_unstale":"2024-04-26T10:37:28.282886+0000","last_undegraded":"2024-04-26T10:37:28.282886+0000","last_fullsized":"2024-04-26T10:37:28.282886+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:14.432394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278274+0000","last_change":"2024-04-26T10:37:23.268184+0000","last_active":"2024-04-26T10:37:28.278274+0000","last_peered":"2024-04-26T10:37:28.278274+0000","last_clean":"2024-04-26T10:37:28.278274+0000","last_became_active":"2024-04-26T10:37:23.266377+0000","last_became_peered":"2024-04-26T10:37:23.266377+0000","last_unstale":"2024-04-26T10:37:28.278274+0000","last_undegraded":"2024-04-26T10:37:28.278274+0000","last_fullsized":"2024-04-26T10:37:28.278274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:59:30.680130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282822+0000","last_change":"2024-04-26T10:37:23.272074+0000","last_active":"2024-04-26T10:37:28.282822+0000","last_peered":"2024-04-26T10:37:28.282822+0000","last_clean":"2024-04-26T10:37:28.282822+0000","last_became_active":"2024-04-26T10:37:23.271752+0000","last_became_peered":"2024-04-26T10:37:23.271752+0000","last_unstale":"2024-04-26T10:37:28.282822+0000","last_undegraded":"2024-04-26T10:37:28.282822+0000","last_fullsized":"2024-04-26T10:37:28.282822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:31:49.465872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":81,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279270+0000","last_change":"2024-04-26T10:37:23.273840+0000","last_active":"2024-04-26T10:37:28.279270+0000","last_peered":"2024-04-26T10:37:28.279270+0000","last_clean":"2024-04-26T10:37:28.279270+0000","last_became_active":"2024-04-26T10:37:23.272156+0000","last_became_peered":"2024-04-26T10:37:23.272156+0000","last_unstale":"2024-04-26T10:37:28.279270+0000","last_undegraded":"2024-04-26T10:37:28.279270+0000","last_fullsized":"2024-04-26T10:37:28.279270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:37.470181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278733+0000","last_change":"2024-04-26T10:37:23.268011+0000","last_active":"2024-04-26T10:37:28.278733+0000","last_peered":"2024-04-26T10:37:28.278733+0000","last_clean":"2024-04-26T10:37:28.278733+0000","last_became_active":"2024-04-26T10:37:23.267717+0000","last_became_peered":"2024-04-26T10:37:23.267717+0000","last_unstale":"2024-04-26T10:37:28.278733+0000","last_undegraded":"2024-04-26T10:37:28.278733+0000","last_fullsized":"2024-04-26T10:37:28.278733+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:51.923777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":95,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279608+0000","last_change":"2024-04-26T10:37:23.273179+0000","last_active":"2024-04-26T10:37:28.279608+0000","last_peered":"2024-04-26T10:37:28.279608+0000","last_clean":"2024-04-26T10:37:28.279608+0000","last_became_active":"2024-04-26T10:37:23.272260+0000","last_became_peered":"2024-04-26T10:37:23.272260+0000","last_unstale":"2024-04-26T10:37:28.279608+0000","last_undegraded":"2024-04-26T10:37:28.279608+0000","last_fullsized":"2024-04-26T10:37:28.279608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:24.097396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278722+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:37:28.278722+0000","last_peered":"2024-04-26T10:37:28.278722+0000","last_clean":"2024-04-26T10:37:28.278722+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:37:28.278722+0000","last_undegraded":"2024-04-26T10:37:28.278722+0000","last_fullsized":"2024-04-26T10:37:28.278722+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:12.954308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278652+0000","last_change":"2024-04-26T10:37:23.269836+0000","last_active":"2024-04-26T10:37:28.278652+0000","last_peered":"2024-04-26T10:37:28.278652+0000","last_clean":"2024-04-26T10:37:28.278652+0000","last_became_active":"2024-04-26T10:37:23.268441+0000","last_became_peered":"2024-04-26T10:37:23.268441+0000","last_unstale":"2024-04-26T10:37:28.278652+0000","last_undegraded":"2024-04-26T10:37:28.278652+0000","last_fullsized":"2024-04-26T10:37:28.278652+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:09.971337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278371+0000","last_change":"2024-04-26T10:37:23.270851+0000","last_active":"2024-04-26T10:37:28.278371+0000","last_peered":"2024-04-26T10:37:28.278371+0000","last_clean":"2024-04-26T10:37:28.278371+0000","last_became_active":"2024-04-26T10:37:23.268451+0000","last_became_peered":"2024-04-26T10:37:23.268451+0000","last_unstale":"2024-04-26T10:37:28.278371+0000","last_undegraded":"2024-04-26T10:37:28.278371+0000","last_fullsized":"2024-04-26T10:37:28.278371+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:48.226025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278899+0000","last_change":"2024-04-26T10:37:23.273635+0000","last_active":"2024-04-26T10:37:28.278899+0000","last_peered":"2024-04-26T10:37:28.278899+0000","last_clean":"2024-04-26T10:37:28.278899+0000","last_became_active":"2024-04-26T10:37:23.272938+0000","last_became_peered":"2024-04-26T10:37:23.272938+0000","last_unstale":"2024-04-26T10:37:28.278899+0000","last_undegraded":"2024-04-26T10:37:28.278899+0000","last_fullsized":"2024-04-26T10:37:28.278899+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:41:05.613682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281241+0000","last_change":"2024-04-26T10:37:23.277366+0000","last_active":"2024-04-26T10:37:28.281241+0000","last_peered":"2024-04-26T10:37:28.281241+0000","last_clean":"2024-04-26T10:37:28.281241+0000","last_became_active":"2024-04-26T10:37:23.276957+0000","last_became_peered":"2024-04-26T10:37:23.276957+0000","last_unstale":"2024-04-26T10:37:28.281241+0000","last_undegraded":"2024-04-26T10:37:28.281241+0000","last_fullsized":"2024-04-26T10:37:28.281241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:33.029508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281114+0000","last_change":"2024-04-26T10:37:23.277440+0000","last_active":"2024-04-26T10:37:28.281114+0000","last_peered":"2024-04-26T10:37:28.281114+0000","last_clean":"2024-04-26T10:37:28.281114+0000","last_became_active":"2024-04-26T10:37:23.277037+0000","last_became_peered":"2024-04-26T10:37:23.277037+0000","last_unstale":"2024-04-26T10:37:28.281114+0000","last_undegraded":"2024-04-26T10:37:28.281114+0000","last_fullsized":"2024-04-26T10:37:28.281114+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:39.705318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278295+0000","last_change":"2024-04-26T10:37:23.270454+0000","last_active":"2024-04-26T10:37:28.278295+0000","last_peered":"2024-04-26T10:37:28.278295+0000","last_clean":"2024-04-26T10:37:28.278295+0000","last_became_active":"2024-04-26T10:37:23.269473+0000","last_became_peered":"2024-04-26T10:37:23.269473+0000","last_unstale":"2024-04-26T10:37:28.278295+0000","last_undegraded":"2024-04-26T10:37:28.278295+0000","last_fullsized":"2024-04-26T10:37:28.278295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:51.049298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278233+0000","last_change":"2024-04-26T10:37:23.267503+0000","last_active":"2024-04-26T10:37:28.278233+0000","last_peered":"2024-04-26T10:37:28.278233+0000","last_clean":"2024-04-26T10:37:28.278233+0000","last_became_active":"2024-04-26T10:37:23.267235+0000","last_became_peered":"2024-04-26T10:37:23.267235+0000","last_unstale":"2024-04-26T10:37:28.278233+0000","last_undegraded":"2024-04-26T10:37:28.278233+0000","last_fullsized":"2024-04-26T10:37:28.278233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:44.951919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278983+0000","last_change":"2024-04-26T10:37:23.274693+0000","last_active":"2024-04-26T10:37:28.278983+0000","last_peered":"2024-04-26T10:37:28.278983+0000","last_clean":"2024-04-26T10:37:28.278983+0000","last_became_active":"2024-04-26T10:37:23.272111+0000","last_became_peered":"2024-04-26T10:37:23.272111+0000","last_unstale":"2024-04-26T10:37:28.278983+0000","last_undegraded":"2024-04-26T10:37:28.278983+0000","last_fullsized":"2024-04-26T10:37:28.278983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:49.690746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278815+0000","last_change":"2024-04-26T10:37:23.274381+0000","last_active":"2024-04-26T10:37:28.278815+0000","last_peered":"2024-04-26T10:37:28.278815+0000","last_clean":"2024-04-26T10:37:28.278815+0000","last_became_active":"2024-04-26T10:37:23.273867+0000","last_became_peered":"2024-04-26T10:37:23.273867+0000","last_unstale":"2024-04-26T10:37:28.278815+0000","last_undegraded":"2024-04-26T10:37:28.278815+0000","last_fullsized":"2024-04-26T10:37:28.278815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:05.525071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279020+0000","last_change":"2024-04-26T10:37:23.273539+0000","last_active":"2024-04-26T10:37:28.279020+0000","last_peered":"2024-04-26T10:37:28.279020+0000","last_clean":"2024-04-26T10:37:28.279020+0000","last_became_active":"2024-04-26T10:37:23.272569+0000","last_became_peered":"2024-04-26T10:37:23.272569+0000","last_unstale":"2024-04-26T10:37:28.279020+0000","last_undegraded":"2024-04-26T10:37:28.279020+0000","last_fullsized":"2024-04-26T10:37:28.279020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:40.584797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278652+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:37:28.278652+0000","last_peered":"2024-04-26T10:37:28.278652+0000","last_clean":"2024-04-26T10:37:28.278652+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:37:28.278652+0000","last_undegraded":"2024-04-26T10:37:28.278652+0000","last_fullsized":"2024-04-26T10:37:28.278652+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:35.111495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282520+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:37:28.282520+0000","last_peered":"2024-04-26T10:37:28.282520+0000","last_clean":"2024-04-26T10:37:28.282520+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:37:28.282520+0000","last_undegraded":"2024-04-26T10:37:28.282520+0000","last_fullsized":"2024-04-26T10:37:28.282520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:11.369206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284088+0000","last_change":"2024-04-26T10:37:28.282767+0000","last_active":"2024-04-26T10:37:29.284088+0000","last_peered":"2024-04-26T10:37:29.284088+0000","last_clean":"2024-04-26T10:37:29.284088+0000","last_became_active":"2024-04-26T10:37:28.282419+0000","last_became_peered":"2024-04-26T10:37:28.282419+0000","last_unstale":"2024-04-26T10:37:29.284088+0000","last_undegraded":"2024-04-26T10:37:29.284088+0000","last_fullsized":"2024-04-26T10:37:29.284088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:44.531133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278848+0000","last_change":"2024-04-26T10:37:23.274843+0000","last_active":"2024-04-26T10:37:28.278848+0000","last_peered":"2024-04-26T10:37:28.278848+0000","last_clean":"2024-04-26T10:37:28.278848+0000","last_became_active":"2024-04-26T10:37:23.273114+0000","last_became_peered":"2024-04-26T10:37:23.273114+0000","last_unstale":"2024-04-26T10:37:28.278848+0000","last_undegraded":"2024-04-26T10:37:28.278848+0000","last_fullsized":"2024-04-26T10:37:28.278848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:29:33.001910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278815+0000","last_change":"2024-04-26T10:37:23.268149+0000","last_active":"2024-04-26T10:37:28.278815+0000","last_peered":"2024-04-26T10:37:28.278815+0000","last_clean":"2024-04-26T10:37:28.278815+0000","last_became_active":"2024-04-26T10:37:23.267319+0000","last_became_peered":"2024-04-26T10:37:23.267319+0000","last_unstale":"2024-04-26T10:37:28.278815+0000","last_undegraded":"2024-04-26T10:37:28.278815+0000","last_fullsized":"2024-04-26T10:37:28.278815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:36.211011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278094+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:28.278094+0000","last_peered":"2024-04-26T10:37:28.278094+0000","last_clean":"2024-04-26T10:37:28.278094+0000","last_became_active":"2024-04-26T10:37:23.266332+0000","last_became_peered":"2024-04-26T10:37:23.266332+0000","last_unstale":"2024-04-26T10:37:28.278094+0000","last_undegraded":"2024-04-26T10:37:28.278094+0000","last_fullsized":"2024-04-26T10:37:28.278094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:26.218509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278389+0000","last_change":"2024-04-26T10:37:23.272871+0000","last_active":"2024-04-26T10:37:28.278389+0000","last_peered":"2024-04-26T10:37:28.278389+0000","last_clean":"2024-04-26T10:37:28.278389+0000","last_became_active":"2024-04-26T10:37:23.269657+0000","last_became_peered":"2024-04-26T10:37:23.269657+0000","last_unstale":"2024-04-26T10:37:28.278389+0000","last_undegraded":"2024-04-26T10:37:28.278389+0000","last_fullsized":"2024-04-26T10:37:28.278389+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:38.769793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281666+0000","last_change":"2024-04-26T10:34:14.513348+0000","last_active":"2024-04-26T10:37:28.281666+0000","last_peered":"2024-04-26T10:37:28.281666+0000","last_clean":"2024-04-26T10:37:28.281666+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:37:28.281666+0000","last_undegraded":"2024-04-26T10:37:28.281666+0000","last_fullsized":"2024-04-26T10:37:28.281666+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:39:21.161769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280745+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:37:28.280745+0000","last_peered":"2024-04-26T10:37:28.280745+0000","last_clean":"2024-04-26T10:37:28.280745+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:37:28.280745+0000","last_undegraded":"2024-04-26T10:37:28.280745+0000","last_fullsized":"2024-04-26T10:37:28.280745+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:12:03.304721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278848+0000","last_change":"2024-04-26T10:37:23.267893+0000","last_active":"2024-04-26T10:37:28.278848+0000","last_peered":"2024-04-26T10:37:28.278848+0000","last_clean":"2024-04-26T10:37:28.278848+0000","last_became_active":"2024-04-26T10:37:23.267595+0000","last_became_peered":"2024-04-26T10:37:23.267595+0000","last_unstale":"2024-04-26T10:37:28.278848+0000","last_undegraded":"2024-04-26T10:37:28.278848+0000","last_fullsized":"2024-04-26T10:37:28.278848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:34.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282762+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:37:28.282762+0000","last_peered":"2024-04-26T10:37:28.282762+0000","last_clean":"2024-04-26T10:37:28.282762+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:37:28.282762+0000","last_undegraded":"2024-04-26T10:37:28.282762+0000","last_fullsized":"2024-04-26T10:37:28.282762+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:57.803542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278274+0000","last_change":"2024-04-26T10:37:23.273754+0000","last_active":"2024-04-26T10:37:28.278274+0000","last_peered":"2024-04-26T10:37:28.278274+0000","last_clean":"2024-04-26T10:37:28.278274+0000","last_became_active":"2024-04-26T10:37:23.270451+0000","last_became_peered":"2024-04-26T10:37:23.270451+0000","last_unstale":"2024-04-26T10:37:28.278274+0000","last_undegraded":"2024-04-26T10:37:28.278274+0000","last_fullsized":"2024-04-26T10:37:28.278274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:03.023862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":300,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278550+0000","last_change":"2024-04-26T10:37:23.269600+0000","last_active":"2024-04-26T10:37:28.278550+0000","last_peered":"2024-04-26T10:37:28.278550+0000","last_clean":"2024-04-26T10:37:28.278550+0000","last_became_active":"2024-04-26T10:37:23.268665+0000","last_became_peered":"2024-04-26T10:37:23.268665+0000","last_unstale":"2024-04-26T10:37:28.278550+0000","last_undegraded":"2024-04-26T10:37:28.278550+0000","last_fullsized":"2024-04-26T10:37:28.278550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:27.734866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280817+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:37:28.280817+0000","last_peered":"2024-04-26T10:37:28.280817+0000","last_clean":"2024-04-26T10:37:28.280817+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:37:28.280817+0000","last_undegraded":"2024-04-26T10:37:28.280817+0000","last_fullsized":"2024-04-26T10:37:28.280817+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:01:27.207501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278725+0000","last_change":"2024-04-26T10:37:23.271849+0000","last_active":"2024-04-26T10:37:28.278725+0000","last_peered":"2024-04-26T10:37:28.278725+0000","last_clean":"2024-04-26T10:37:28.278725+0000","last_became_active":"2024-04-26T10:37:23.269736+0000","last_became_peered":"2024-04-26T10:37:23.269736+0000","last_unstale":"2024-04-26T10:37:28.278725+0000","last_undegraded":"2024-04-26T10:37:28.278725+0000","last_fullsized":"2024-04-26T10:37:28.278725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:04.639109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278343+0000","last_change":"2024-04-26T10:37:23.266348+0000","last_active":"2024-04-26T10:37:28.278343+0000","last_peered":"2024-04-26T10:37:28.278343+0000","last_clean":"2024-04-26T10:37:28.278343+0000","last_became_active":"2024-04-26T10:37:23.265317+0000","last_became_peered":"2024-04-26T10:37:23.265317+0000","last_unstale":"2024-04-26T10:37:28.278343+0000","last_undegraded":"2024-04-26T10:37:28.278343+0000","last_fullsized":"2024-04-26T10:37:28.278343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:37:13.956142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.280740+0000","last_change":"2024-04-26T10:37:23.276509+0000","last_active":"2024-04-26T10:37:28.280740+0000","last_peered":"2024-04-26T10:37:28.280740+0000","last_clean":"2024-04-26T10:37:28.280740+0000","last_became_active":"2024-04-26T10:37:23.276151+0000","last_became_peered":"2024-04-26T10:37:23.276151+0000","last_unstale":"2024-04-26T10:37:28.280740+0000","last_undegraded":"2024-04-26T10:37:28.280740+0000","last_fullsized":"2024-04-26T10:37:28.280740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:17:30.924727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279655+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:37:28.279655+0000","last_peered":"2024-04-26T10:37:28.279655+0000","last_clean":"2024-04-26T10:37:28.279655+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:37:28.279655+0000","last_undegraded":"2024-04-26T10:37:28.279655+0000","last_fullsized":"2024-04-26T10:37:28.279655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:40.692563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279559+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:37:28.279559+0000","last_peered":"2024-04-26T10:37:28.279559+0000","last_clean":"2024-04-26T10:37:28.279559+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:37:28.279559+0000","last_undegraded":"2024-04-26T10:37:28.279559+0000","last_fullsized":"2024-04-26T10:37:28.279559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:16:51.500323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":93,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282126+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:37:28.282126+0000","last_peered":"2024-04-26T10:37:28.282126+0000","last_clean":"2024-04-26T10:37:28.282126+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:37:28.282126+0000","last_undegraded":"2024-04-26T10:37:28.282126+0000","last_fullsized":"2024-04-26T10:37:28.282126+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:20:21.048381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279176+0000","last_change":"2024-04-26T10:37:23.277636+0000","last_active":"2024-04-26T10:37:28.279176+0000","last_peered":"2024-04-26T10:37:28.279176+0000","last_clean":"2024-04-26T10:37:28.279176+0000","last_became_active":"2024-04-26T10:37:23.277309+0000","last_became_peered":"2024-04-26T10:37:23.277309+0000","last_unstale":"2024-04-26T10:37:28.279176+0000","last_undegraded":"2024-04-26T10:37:28.279176+0000","last_fullsized":"2024-04-26T10:37:28.279176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:00.429064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282446+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:37:28.282446+0000","last_peered":"2024-04-26T10:37:28.282446+0000","last_clean":"2024-04-26T10:37:28.282446+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:37:28.282446+0000","last_undegraded":"2024-04-26T10:37:28.282446+0000","last_fullsized":"2024-04-26T10:37:28.282446+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:54:08.666625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282702+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:37:28.282702+0000","last_peered":"2024-04-26T10:37:28.282702+0000","last_clean":"2024-04-26T10:37:28.282702+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:37:28.282702+0000","last_undegraded":"2024-04-26T10:37:28.282702+0000","last_fullsized":"2024-04-26T10:37:28.282702+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:38.172123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.283483+0000","last_change":"2024-04-26T10:37:28.282300+0000","last_active":"2024-04-26T10:37:28.283483+0000","last_peered":"2024-04-26T10:37:28.283483+0000","last_clean":"2024-04-26T10:37:28.283483+0000","last_became_active":"2024-04-26T10:37:28.281669+0000","last_became_peered":"2024-04-26T10:37:28.281669+0000","last_unstale":"2024-04-26T10:37:28.283483+0000","last_undegraded":"2024-04-26T10:37:28.283483+0000","last_fullsized":"2024-04-26T10:37:28.283483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:23.776919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279088+0000","last_change":"2024-04-26T10:37:23.269479+0000","last_active":"2024-04-26T10:37:28.279088+0000","last_peered":"2024-04-26T10:37:28.279088+0000","last_clean":"2024-04-26T10:37:28.279088+0000","last_became_active":"2024-04-26T10:37:23.268673+0000","last_became_peered":"2024-04-26T10:37:23.268673+0000","last_unstale":"2024-04-26T10:37:28.279088+0000","last_undegraded":"2024-04-26T10:37:28.279088+0000","last_fullsized":"2024-04-26T10:37:28.279088+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:52.269482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282451+0000","last_change":"2024-04-26T10:37:23.277426+0000","last_active":"2024-04-26T10:37:28.282451+0000","last_peered":"2024-04-26T10:37:28.282451+0000","last_clean":"2024-04-26T10:37:28.282451+0000","last_became_active":"2024-04-26T10:37:23.277001+0000","last_became_peered":"2024-04-26T10:37:23.277001+0000","last_unstale":"2024-04-26T10:37:28.282451+0000","last_undegraded":"2024-04-26T10:37:28.282451+0000","last_fullsized":"2024-04-26T10:37:28.282451+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:49:38.308038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278669+0000","last_change":"2024-04-26T10:37:23.267342+0000","last_active":"2024-04-26T10:37:28.278669+0000","last_peered":"2024-04-26T10:37:28.278669+0000","last_clean":"2024-04-26T10:37:28.278669+0000","last_became_active":"2024-04-26T10:37:23.266912+0000","last_became_peered":"2024-04-26T10:37:23.266912+0000","last_unstale":"2024-04-26T10:37:28.278669+0000","last_undegraded":"2024-04-26T10:37:28.278669+0000","last_fullsized":"2024-04-26T10:37:28.278669+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:28.070169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279163+0000","last_change":"2024-04-26T10:37:23.277620+0000","last_active":"2024-04-26T10:37:28.279163+0000","last_peered":"2024-04-26T10:37:28.279163+0000","last_clean":"2024-04-26T10:37:28.279163+0000","last_became_active":"2024-04-26T10:37:23.277303+0000","last_became_peered":"2024-04-26T10:37:23.277303+0000","last_unstale":"2024-04-26T10:37:28.279163+0000","last_undegraded":"2024-04-26T10:37:28.279163+0000","last_fullsized":"2024-04-26T10:37:28.279163+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:57.292594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279418+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:37:28.279418+0000","last_peered":"2024-04-26T10:37:28.279418+0000","last_clean":"2024-04-26T10:37:28.279418+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:37:28.279418+0000","last_undegraded":"2024-04-26T10:37:28.279418+0000","last_fullsized":"2024-04-26T10:37:28.279418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:56.710554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278431+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:28.278431+0000","last_peered":"2024-04-26T10:37:28.278431+0000","last_clean":"2024-04-26T10:37:28.278431+0000","last_became_active":"2024-04-26T10:37:23.266295+0000","last_became_peered":"2024-04-26T10:37:23.266295+0000","last_unstale":"2024-04-26T10:37:28.278431+0000","last_undegraded":"2024-04-26T10:37:28.278431+0000","last_fullsized":"2024-04-26T10:37:28.278431+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:19.026704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278934+0000","last_change":"2024-04-26T10:37:23.274686+0000","last_active":"2024-04-26T10:37:28.278934+0000","last_peered":"2024-04-26T10:37:28.278934+0000","last_clean":"2024-04-26T10:37:28.278934+0000","last_became_active":"2024-04-26T10:37:23.272039+0000","last_became_peered":"2024-04-26T10:37:23.272039+0000","last_unstale":"2024-04-26T10:37:28.278934+0000","last_undegraded":"2024-04-26T10:37:28.278934+0000","last_fullsized":"2024-04-26T10:37:28.278934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:24:42.152908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279676+0000","last_change":"2024-04-26T10:37:23.273723+0000","last_active":"2024-04-26T10:37:28.279676+0000","last_peered":"2024-04-26T10:37:28.279676+0000","last_clean":"2024-04-26T10:37:28.279676+0000","last_became_active":"2024-04-26T10:37:23.273253+0000","last_became_peered":"2024-04-26T10:37:23.273253+0000","last_unstale":"2024-04-26T10:37:28.279676+0000","last_undegraded":"2024-04-26T10:37:28.279676+0000","last_fullsized":"2024-04-26T10:37:28.279676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:30.644188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278246+0000","last_change":"2024-04-26T10:37:23.267726+0000","last_active":"2024-04-26T10:37:28.278246+0000","last_peered":"2024-04-26T10:37:28.278246+0000","last_clean":"2024-04-26T10:37:28.278246+0000","last_became_active":"2024-04-26T10:37:23.267434+0000","last_became_peered":"2024-04-26T10:37:23.267434+0000","last_unstale":"2024-04-26T10:37:28.278246+0000","last_undegraded":"2024-04-26T10:37:28.278246+0000","last_fullsized":"2024-04-26T10:37:28.278246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:43.219752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282593+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:37:28.282593+0000","last_peered":"2024-04-26T10:37:28.282593+0000","last_clean":"2024-04-26T10:37:28.282593+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:37:28.282593+0000","last_undegraded":"2024-04-26T10:37:28.282593+0000","last_fullsized":"2024-04-26T10:37:28.282593+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:04.742012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279161+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:37:28.279161+0000","last_peered":"2024-04-26T10:37:28.279161+0000","last_clean":"2024-04-26T10:37:28.279161+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:37:28.279161+0000","last_undegraded":"2024-04-26T10:37:28.279161+0000","last_fullsized":"2024-04-26T10:37:28.279161+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:26:24.574507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.282593+0000","last_change":"2024-04-26T10:37:23.272052+0000","last_active":"2024-04-26T10:37:28.282593+0000","last_peered":"2024-04-26T10:37:28.282593+0000","last_clean":"2024-04-26T10:37:28.282593+0000","last_became_active":"2024-04-26T10:37:23.271663+0000","last_became_peered":"2024-04-26T10:37:23.271663+0000","last_unstale":"2024-04-26T10:37:28.282593+0000","last_undegraded":"2024-04-26T10:37:28.282593+0000","last_fullsized":"2024-04-26T10:37:28.282593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:56:31.778313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278501+0000","last_change":"2024-04-26T10:37:23.268370+0000","last_active":"2024-04-26T10:37:28.278501+0000","last_peered":"2024-04-26T10:37:28.278501+0000","last_clean":"2024-04-26T10:37:28.278501+0000","last_became_active":"2024-04-26T10:37:23.266624+0000","last_became_peered":"2024-04-26T10:37:23.266624+0000","last_unstale":"2024-04-26T10:37:28.278501+0000","last_undegraded":"2024-04-26T10:37:28.278501+0000","last_fullsized":"2024-04-26T10:37:28.278501+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:35:42.205710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.278444+0000","last_change":"2024-04-26T10:37:23.267652+0000","last_active":"2024-04-26T10:37:28.278444+0000","last_peered":"2024-04-26T10:37:28.278444+0000","last_clean":"2024-04-26T10:37:28.278444+0000","last_became_active":"2024-04-26T10:37:23.266063+0000","last_became_peered":"2024-04-26T10:37:23.266063+0000","last_unstale":"2024-04-26T10:37:28.278444+0000","last_undegraded":"2024-04-26T10:37:28.278444+0000","last_fullsized":"2024-04-26T10:37:28.278444+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:23.209788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283546+0000","last_change":"2024-04-26T10:37:28.282145+0000","last_active":"2024-04-26T10:37:29.283546+0000","last_peered":"2024-04-26T10:37:29.283546+0000","last_clean":"2024-04-26T10:37:29.283546+0000","last_became_active":"2024-04-26T10:37:28.281541+0000","last_became_peered":"2024-04-26T10:37:28.281541+0000","last_unstale":"2024-04-26T10:37:29.283546+0000","last_undegraded":"2024-04-26T10:37:29.283546+0000","last_fullsized":"2024-04-26T10:37:29.283546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:55.649460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279073+0000","last_change":"2024-04-26T10:37:23.268479+0000","last_active":"2024-04-26T10:37:28.279073+0000","last_peered":"2024-04-26T10:37:28.279073+0000","last_clean":"2024-04-26T10:37:28.279073+0000","last_became_active":"2024-04-26T10:37:23.267644+0000","last_became_peered":"2024-04-26T10:37:23.267644+0000","last_unstale":"2024-04-26T10:37:28.279073+0000","last_undegraded":"2024-04-26T10:37:28.279073+0000","last_fullsized":"2024-04-26T10:37:28.279073+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:47.606620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.281350+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:37:28.281350+0000","last_peered":"2024-04-26T10:37:28.281350+0000","last_clean":"2024-04-26T10:37:28.281350+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:37:28.281350+0000","last_undegraded":"2024-04-26T10:37:28.281350+0000","last_fullsized":"2024-04-26T10:37:28.281350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.021846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T10:37:28.279209+0000","last_change":"2024-04-26T10:37:23.274199+0000","last_active":"2024-04-26T10:37:28.279209+0000","last_peered":"2024-04-26T10:37:28.279209+0000","last_clean":"2024-04-26T10:37:28.279209+0000","last_became_active":"2024-04-26T10:37:23.273023+0000","last_became_peered":"2024-04-26T10:37:23.273023+0000","last_unstale":"2024-04-26T10:37:28.279209+0000","last_undegraded":"2024-04-26T10:37:28.279209+0000","last_fullsized":"2024-04-26T10:37:28.279209+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:39:55.142124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1766,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":338840,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":94033000,"statfs":{"total":96636764160,"available":96289792000,"internally_reserved":0,"allocated":917504,"data_stored":359527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346028486},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Apr 26 10:36:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.38100000000000001},"min":{"1min":0.36399999999999999,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.56799999999999995,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.63800000000000001,"15min":0.496},"min":{"1min":0.373,"5min":0.19,"15min":0.19},"max":{"1min":0.59699999999999998,"5min":12.206,"15min":12.206},"last":0.40799999999999997}]}]},{"osd":0,"up_from":75,"seq":322122547205,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55024,"kb_used_data":1500,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94316816,"statfs":{"total":96636764160,"available":96580419584,"internally_reserved":0,"allocated":1536000,"data_stored":951641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7111,"internal_metadata":54780985},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":1,"up_from":8,"seq":34359738429,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257372,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":255870,"kb_avail":94114468,"statfs":{"total":96636764160,"available":96373215232,"internally_reserved":0,"allocated":1523712,"data_stored":948912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262011334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.42399999999999999}]},{"osd":2,"last update":"Fri Apr 26 10:36:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.42199999999999999,"15min":0.35599999999999998},"min":{"1min":0.307,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.59199999999999997,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.442},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.48199999999999998,"15min":0.45200000000000001},"min":{"1min":0.27600000000000002,"5min":0.183,"15min":0.183},"max":{"1min":0.60699999999999998,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:37:37.680 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.680 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.680 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.680 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.680 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.681 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.681 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.681 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.681 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.681 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.681 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.681 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.681 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.681 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.681 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.682 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.682 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.682 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.682 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.682 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.682 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.682 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.682 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.682 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.683 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.683 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.683 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.683 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.683 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.683 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.683 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.683 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.683 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.683 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.684 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.684 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.684 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.684 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.684 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.684 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.684 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.684 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.684 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.685 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.685 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.685 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.685 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.685 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.685 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.685 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.685 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.685 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.685 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.686 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.686 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.686 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.686 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.686 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.686 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.686 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.686 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.686 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.687 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.687 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.687 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.687 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.687 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.687 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.687 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.687 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.687 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.687 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.688 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.688 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.688 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.688 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.688 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.688 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.688 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.688 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.688 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.689 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.689 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.689 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.689 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.689 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.689 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.689 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.689 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.689 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.689 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.690 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.690 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.690 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.690 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.690 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.690 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.690 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.690 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.690 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.690 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.691 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.691 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.691 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.691 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:37.691 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:37:57.693 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:37:58.051 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:37:58.053 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:37:58.062 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-04-26T10:37:57.064672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":592134,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":651204,"kb_used_data":3884,"kb_used_omap":10,"kb_used_meta":647285,"kb_avail":282464316,"statfs":{"total":289910292480,"available":289243459584,"internally_reserved":0,"allocated":3977216,"data_stored":2260080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10299,"internal_metadata":662820805},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003055"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888515+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:37:30.888515+0000","last_peered":"2024-04-26T10:37:30.888515+0000","last_clean":"2024-04-26T10:37:30.888515+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:37:30.888515+0000","last_undegraded":"2024-04-26T10:37:30.888515+0000","last_fullsized":"2024-04-26T10:37:30.888515+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:46.090568+0000","last_change":"2024-04-26T10:37:46.090713+0000","last_active":"2024-04-26T10:37:46.090568+0000","last_peered":"2024-04-26T10:37:46.090568+0000","last_clean":"2024-04-26T10:37:46.090568+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:37:46.090568+0000","last_undegraded":"2024-04-26T10:37:46.090568+0000","last_fullsized":"2024-04-26T10:37:46.090568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:46.090545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:46.090545+0000","last_clean_scrub_stamp":"2024-04-26T10:37:46.090545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:42.129201+0000","scrub_duration":0.001738082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.946243+0000","last_change":"2024-04-26T10:37:36.946374+0000","last_active":"2024-04-26T10:37:36.946243+0000","last_peered":"2024-04-26T10:37:36.946243+0000","last_clean":"2024-04-26T10:37:36.946243+0000","last_became_active":"2024-04-26T10:37:23.272107+0000","last_became_peered":"2024-04-26T10:37:23.272107+0000","last_unstale":"2024-04-26T10:37:36.946243+0000","last_undegraded":"2024-04-26T10:37:36.946243+0000","last_fullsized":"2024-04-26T10:37:36.946243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:36.946219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:36.946219+0000","last_clean_scrub_stamp":"2024-04-26T10:37:36.946219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:56.583737+0000","scrub_duration":0.0019495529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:54.913664+0000","last_change":"2024-04-26T10:37:54.913778+0000","last_active":"2024-04-26T10:37:54.913664+0000","last_peered":"2024-04-26T10:37:54.913664+0000","last_clean":"2024-04-26T10:37:54.913664+0000","last_became_active":"2024-04-26T10:37:23.269752+0000","last_became_peered":"2024-04-26T10:37:23.269752+0000","last_unstale":"2024-04-26T10:37:54.913664+0000","last_undegraded":"2024-04-26T10:37:54.913664+0000","last_fullsized":"2024-04-26T10:37:54.913664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:54.913640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:54.913640+0000","last_clean_scrub_stamp":"2024-04-26T10:37:54.913640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:45.220783+0000","scrub_duration":0.0019585140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:44.056407+0000","last_change":"2024-04-26T10:37:44.056524+0000","last_active":"2024-04-26T10:37:44.056407+0000","last_peered":"2024-04-26T10:37:44.056407+0000","last_clean":"2024-04-26T10:37:44.056407+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:37:44.056407+0000","last_undegraded":"2024-04-26T10:37:44.056407+0000","last_fullsized":"2024-04-26T10:37:44.056407+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:44.056381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:44.056381+0000","last_clean_scrub_stamp":"2024-04-26T10:37:44.056381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:26.047330+0000","scrub_duration":0.016160926999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283850+0000","last_change":"2024-04-26T10:37:23.271901+0000","last_active":"2024-04-26T10:37:29.283850+0000","last_peered":"2024-04-26T10:37:29.283850+0000","last_clean":"2024-04-26T10:37:29.283850+0000","last_became_active":"2024-04-26T10:37:23.270593+0000","last_became_peered":"2024-04-26T10:37:23.270593+0000","last_unstale":"2024-04-26T10:37:29.283850+0000","last_undegraded":"2024-04-26T10:37:29.283850+0000","last_fullsized":"2024-04-26T10:37:29.283850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283538+0000","last_change":"2024-04-26T10:37:23.271640+0000","last_active":"2024-04-26T10:37:29.283538+0000","last_peered":"2024-04-26T10:37:29.283538+0000","last_clean":"2024-04-26T10:37:29.283538+0000","last_became_active":"2024-04-26T10:37:23.270393+0000","last_became_peered":"2024-04-26T10:37:23.270393+0000","last_unstale":"2024-04-26T10:37:29.283538+0000","last_undegraded":"2024-04-26T10:37:29.283538+0000","last_fullsized":"2024-04-26T10:37:29.283538+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283332+0000","last_change":"2024-04-26T10:37:23.268381+0000","last_active":"2024-04-26T10:37:29.283332+0000","last_peered":"2024-04-26T10:37:29.283332+0000","last_clean":"2024-04-26T10:37:29.283332+0000","last_became_active":"2024-04-26T10:37:23.267296+0000","last_became_peered":"2024-04-26T10:37:23.267296+0000","last_unstale":"2024-04-26T10:37:29.283332+0000","last_undegraded":"2024-04-26T10:37:29.283332+0000","last_fullsized":"2024-04-26T10:37:29.283332+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302677+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:37:37.302677+0000","last_peered":"2024-04-26T10:37:37.302677+0000","last_clean":"2024-04-26T10:37:37.302677+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:37:37.302677+0000","last_undegraded":"2024-04-26T10:37:37.302677+0000","last_fullsized":"2024-04-26T10:37:37.302677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:45.073035+0000","last_change":"2024-04-26T10:37:45.073164+0000","last_active":"2024-04-26T10:37:45.073035+0000","last_peered":"2024-04-26T10:37:45.073035+0000","last_clean":"2024-04-26T10:37:45.073035+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:37:45.073035+0000","last_undegraded":"2024-04-26T10:37:45.073035+0000","last_fullsized":"2024-04-26T10:37:45.073035+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:45.073006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:45.073006+0000","last_clean_scrub_stamp":"2024-04-26T10:37:45.073006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:23.891265+0000","scrub_duration":0.001902131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:48.878670+0000","last_change":"2024-04-26T10:37:48.878771+0000","last_active":"2024-04-26T10:37:48.878670+0000","last_peered":"2024-04-26T10:37:48.878670+0000","last_clean":"2024-04-26T10:37:48.878670+0000","last_became_active":"2024-04-26T10:37:23.273996+0000","last_became_peered":"2024-04-26T10:37:23.273996+0000","last_unstale":"2024-04-26T10:37:48.878670+0000","last_undegraded":"2024-04-26T10:37:48.878670+0000","last_fullsized":"2024-04-26T10:37:48.878670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:48.878645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:48.878645+0000","last_clean_scrub_stamp":"2024-04-26T10:37:48.878645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:14.620591+0000","scrub_duration":0.017302161999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786830+0000","last_change":"2024-04-26T10:37:23.274459+0000","last_active":"2024-04-26T10:37:36.786830+0000","last_peered":"2024-04-26T10:37:36.786830+0000","last_clean":"2024-04-26T10:37:36.786830+0000","last_became_active":"2024-04-26T10:37:23.273290+0000","last_became_peered":"2024-04-26T10:37:23.273290+0000","last_unstale":"2024-04-26T10:37:36.786830+0000","last_undegraded":"2024-04-26T10:37:36.786830+0000","last_fullsized":"2024-04-26T10:37:36.786830+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887837+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:37:30.887837+0000","last_peered":"2024-04-26T10:37:30.887837+0000","last_clean":"2024-04-26T10:37:30.887837+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:37:30.887837+0000","last_undegraded":"2024-04-26T10:37:30.887837+0000","last_fullsized":"2024-04-26T10:37:30.887837+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283950+0000","last_change":"2024-04-26T10:37:23.271722+0000","last_active":"2024-04-26T10:37:29.283950+0000","last_peered":"2024-04-26T10:37:29.283950+0000","last_clean":"2024-04-26T10:37:29.283950+0000","last_became_active":"2024-04-26T10:37:23.269722+0000","last_became_peered":"2024-04-26T10:37:23.269722+0000","last_unstale":"2024-04-26T10:37:29.283950+0000","last_undegraded":"2024-04-26T10:37:29.283950+0000","last_fullsized":"2024-04-26T10:37:29.283950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284161+0000","last_change":"2024-04-26T10:37:23.271761+0000","last_active":"2024-04-26T10:37:29.284161+0000","last_peered":"2024-04-26T10:37:29.284161+0000","last_clean":"2024-04-26T10:37:29.284161+0000","last_became_active":"2024-04-26T10:37:23.270852+0000","last_became_peered":"2024-04-26T10:37:23.270852+0000","last_unstale":"2024-04-26T10:37:29.284161+0000","last_undegraded":"2024-04-26T10:37:29.284161+0000","last_fullsized":"2024-04-26T10:37:29.284161+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:38.963069+0000","last_change":"2024-04-26T10:37:38.963200+0000","last_active":"2024-04-26T10:37:38.963069+0000","last_peered":"2024-04-26T10:37:38.963069+0000","last_clean":"2024-04-26T10:37:38.963069+0000","last_became_active":"2024-04-26T10:37:23.268640+0000","last_became_peered":"2024-04-26T10:37:23.268640+0000","last_unstale":"2024-04-26T10:37:38.963069+0000","last_undegraded":"2024-04-26T10:37:38.963069+0000","last_fullsized":"2024-04-26T10:37:38.963069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:38.963045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:38.963045+0000","last_clean_scrub_stamp":"2024-04-26T10:37:38.963045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:17.672777+0000","scrub_duration":0.0018662049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.177542+0000","last_change":"2024-04-26T10:37:28.282247+0000","last_active":"2024-04-26T10:37:30.177542+0000","last_peered":"2024-04-26T10:37:30.177542+0000","last_clean":"2024-04-26T10:37:30.177542+0000","last_became_active":"2024-04-26T10:37:28.281510+0000","last_became_peered":"2024-04-26T10:37:28.281510+0000","last_unstale":"2024-04-26T10:37:30.177542+0000","last_undegraded":"2024-04-26T10:37:30.177542+0000","last_fullsized":"2024-04-26T10:37:30.177542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888300+0000","last_change":"2024-04-26T10:34:14.506583+0000","last_active":"2024-04-26T10:37:30.888300+0000","last_peered":"2024-04-26T10:37:30.888300+0000","last_clean":"2024-04-26T10:37:30.888300+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:37:30.888300+0000","last_undegraded":"2024-04-26T10:37:30.888300+0000","last_fullsized":"2024-04-26T10:37:30.888300+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:38.715625+0000","last_change":"2024-04-26T10:37:38.715778+0000","last_active":"2024-04-26T10:37:38.715625+0000","last_peered":"2024-04-26T10:37:38.715625+0000","last_clean":"2024-04-26T10:37:38.715625+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:37:38.715625+0000","last_undegraded":"2024-04-26T10:37:38.715625+0000","last_fullsized":"2024-04-26T10:37:38.715625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:38.715602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:38.715602+0000","last_clean_scrub_stamp":"2024-04-26T10:37:38.715602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:48.931629+0000","scrub_duration":0.028191391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284226+0000","last_change":"2024-04-26T10:37:23.273700+0000","last_active":"2024-04-26T10:37:29.284226+0000","last_peered":"2024-04-26T10:37:29.284226+0000","last_clean":"2024-04-26T10:37:29.284226+0000","last_became_active":"2024-04-26T10:37:23.272964+0000","last_became_peered":"2024-04-26T10:37:23.272964+0000","last_unstale":"2024-04-26T10:37:29.284226+0000","last_undegraded":"2024-04-26T10:37:29.284226+0000","last_fullsized":"2024-04-26T10:37:29.284226+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284064+0000","last_change":"2024-04-26T10:37:23.274112+0000","last_active":"2024-04-26T10:37:29.284064+0000","last_peered":"2024-04-26T10:37:29.284064+0000","last_clean":"2024-04-26T10:37:29.284064+0000","last_became_active":"2024-04-26T10:37:23.271967+0000","last_became_peered":"2024-04-26T10:37:23.271967+0000","last_unstale":"2024-04-26T10:37:29.284064+0000","last_undegraded":"2024-04-26T10:37:29.284064+0000","last_fullsized":"2024-04-26T10:37:29.284064+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887950+0000","last_change":"2024-04-26T10:37:23.268432+0000","last_active":"2024-04-26T10:37:30.887950+0000","last_peered":"2024-04-26T10:37:30.887950+0000","last_clean":"2024-04-26T10:37:30.887950+0000","last_became_active":"2024-04-26T10:37:23.267766+0000","last_became_peered":"2024-04-26T10:37:23.267766+0000","last_unstale":"2024-04-26T10:37:30.887950+0000","last_undegraded":"2024-04-26T10:37:30.887950+0000","last_fullsized":"2024-04-26T10:37:30.887950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283659+0000","last_change":"2024-04-26T10:37:23.270217+0000","last_active":"2024-04-26T10:37:29.283659+0000","last_peered":"2024-04-26T10:37:29.283659+0000","last_clean":"2024-04-26T10:37:29.283659+0000","last_became_active":"2024-04-26T10:37:23.269861+0000","last_became_peered":"2024-04-26T10:37:23.269861+0000","last_unstale":"2024-04-26T10:37:29.283659+0000","last_undegraded":"2024-04-26T10:37:29.283659+0000","last_fullsized":"2024-04-26T10:37:29.283659+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887915+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:37:30.887915+0000","last_peered":"2024-04-26T10:37:30.887915+0000","last_clean":"2024-04-26T10:37:30.887915+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:37:30.887915+0000","last_undegraded":"2024-04-26T10:37:30.887915+0000","last_fullsized":"2024-04-26T10:37:30.887915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888514+0000","last_change":"2024-04-26T10:37:23.272702+0000","last_active":"2024-04-26T10:37:30.888514+0000","last_peered":"2024-04-26T10:37:30.888514+0000","last_clean":"2024-04-26T10:37:30.888514+0000","last_became_active":"2024-04-26T10:37:23.272218+0000","last_became_peered":"2024-04-26T10:37:23.272218+0000","last_unstale":"2024-04-26T10:37:30.888514+0000","last_undegraded":"2024-04-26T10:37:30.888514+0000","last_fullsized":"2024-04-26T10:37:30.888514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284266+0000","last_change":"2024-04-26T10:37:23.271247+0000","last_active":"2024-04-26T10:37:29.284266+0000","last_peered":"2024-04-26T10:37:29.284266+0000","last_clean":"2024-04-26T10:37:29.284266+0000","last_became_active":"2024-04-26T10:37:23.270919+0000","last_became_peered":"2024-04-26T10:37:23.270919+0000","last_unstale":"2024-04-26T10:37:29.284266+0000","last_undegraded":"2024-04-26T10:37:29.284266+0000","last_fullsized":"2024-04-26T10:37:29.284266+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284349+0000","last_change":"2024-04-26T10:37:23.275081+0000","last_active":"2024-04-26T10:37:29.284349+0000","last_peered":"2024-04-26T10:37:29.284349+0000","last_clean":"2024-04-26T10:37:29.284349+0000","last_became_active":"2024-04-26T10:37:23.273821+0000","last_became_peered":"2024-04-26T10:37:23.273821+0000","last_unstale":"2024-04-26T10:37:29.284349+0000","last_undegraded":"2024-04-26T10:37:29.284349+0000","last_fullsized":"2024-04-26T10:37:29.284349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786495+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:37:36.786495+0000","last_peered":"2024-04-26T10:37:36.786495+0000","last_clean":"2024-04-26T10:37:36.786495+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:37:36.786495+0000","last_undegraded":"2024-04-26T10:37:36.786495+0000","last_fullsized":"2024-04-26T10:37:36.786495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786726+0000","last_change":"2024-04-26T10:37:23.273494+0000","last_active":"2024-04-26T10:37:36.786726+0000","last_peered":"2024-04-26T10:37:36.786726+0000","last_clean":"2024-04-26T10:37:36.786726+0000","last_became_active":"2024-04-26T10:37:23.272837+0000","last_became_peered":"2024-04-26T10:37:23.272837+0000","last_unstale":"2024-04-26T10:37:36.786726+0000","last_undegraded":"2024-04-26T10:37:36.786726+0000","last_fullsized":"2024-04-26T10:37:36.786726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302346+0000","last_change":"2024-04-26T10:37:23.269480+0000","last_active":"2024-04-26T10:37:37.302346+0000","last_peered":"2024-04-26T10:37:37.302346+0000","last_clean":"2024-04-26T10:37:37.302346+0000","last_became_active":"2024-04-26T10:37:23.269197+0000","last_became_peered":"2024-04-26T10:37:23.269197+0000","last_unstale":"2024-04-26T10:37:37.302346+0000","last_undegraded":"2024-04-26T10:37:37.302346+0000","last_fullsized":"2024-04-26T10:37:37.302346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.674963+0000","last_change":"2024-04-26T10:37:37.675146+0000","last_active":"2024-04-26T10:37:37.674963+0000","last_peered":"2024-04-26T10:37:37.674963+0000","last_clean":"2024-04-26T10:37:37.674963+0000","last_became_active":"2024-04-26T10:37:28.283421+0000","last_became_peered":"2024-04-26T10:37:28.283421+0000","last_unstale":"2024-04-26T10:37:37.674963+0000","last_undegraded":"2024-04-26T10:37:37.674963+0000","last_fullsized":"2024-04-26T10:37:37.674963+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:37.674937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:37.674937+0000","last_clean_scrub_stamp":"2024-04-26T10:37:37.674937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:45.188074+0000","scrub_duration":0.0017282650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302337+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:37:37.302337+0000","last_peered":"2024-04-26T10:37:37.302337+0000","last_clean":"2024-04-26T10:37:37.302337+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:37:37.302337+0000","last_undegraded":"2024-04-26T10:37:37.302337+0000","last_fullsized":"2024-04-26T10:37:37.302337+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888683+0000","last_change":"2024-04-26T10:37:23.273035+0000","last_active":"2024-04-26T10:37:30.888683+0000","last_peered":"2024-04-26T10:37:30.888683+0000","last_clean":"2024-04-26T10:37:30.888683+0000","last_became_active":"2024-04-26T10:37:23.272666+0000","last_became_peered":"2024-04-26T10:37:23.272666+0000","last_unstale":"2024-04-26T10:37:30.888683+0000","last_undegraded":"2024-04-26T10:37:30.888683+0000","last_fullsized":"2024-04-26T10:37:30.888683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302305+0000","last_change":"2024-04-26T10:37:23.271100+0000","last_active":"2024-04-26T10:37:37.302305+0000","last_peered":"2024-04-26T10:37:37.302305+0000","last_clean":"2024-04-26T10:37:37.302305+0000","last_became_active":"2024-04-26T10:37:23.270725+0000","last_became_peered":"2024-04-26T10:37:23.270725+0000","last_unstale":"2024-04-26T10:37:37.302305+0000","last_undegraded":"2024-04-26T10:37:37.302305+0000","last_fullsized":"2024-04-26T10:37:37.302305+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:35.178129+0000","last_change":"2024-04-26T10:34:14.511362+0000","last_active":"2024-04-26T10:37:35.178129+0000","last_peered":"2024-04-26T10:37:35.178129+0000","last_clean":"2024-04-26T10:37:35.178129+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:37:35.178129+0000","last_undegraded":"2024-04-26T10:37:35.178129+0000","last_fullsized":"2024-04-26T10:37:35.178129+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:55.908127+0000","last_change":"2024-04-26T10:37:55.908269+0000","last_active":"2024-04-26T10:37:55.908127+0000","last_peered":"2024-04-26T10:37:55.908127+0000","last_clean":"2024-04-26T10:37:55.908127+0000","last_became_active":"2024-04-26T10:37:23.269371+0000","last_became_peered":"2024-04-26T10:37:23.269371+0000","last_unstale":"2024-04-26T10:37:55.908127+0000","last_undegraded":"2024-04-26T10:37:55.908127+0000","last_fullsized":"2024-04-26T10:37:55.908127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:55.908102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:55.908102+0000","last_clean_scrub_stamp":"2024-04-26T10:37:55.908102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:11.319524+0000","scrub_duration":0.0019603670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:35.178199+0000","last_change":"2024-04-26T10:37:23.269749+0000","last_active":"2024-04-26T10:37:35.178199+0000","last_peered":"2024-04-26T10:37:35.178199+0000","last_clean":"2024-04-26T10:37:35.178199+0000","last_became_active":"2024-04-26T10:37:23.269344+0000","last_became_peered":"2024-04-26T10:37:23.269344+0000","last_unstale":"2024-04-26T10:37:35.178199+0000","last_undegraded":"2024-04-26T10:37:35.178199+0000","last_fullsized":"2024-04-26T10:37:35.178199+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888069+0000","last_change":"2024-04-26T10:37:23.273205+0000","last_active":"2024-04-26T10:37:30.888069+0000","last_peered":"2024-04-26T10:37:30.888069+0000","last_clean":"2024-04-26T10:37:30.888069+0000","last_became_active":"2024-04-26T10:37:23.272731+0000","last_became_peered":"2024-04-26T10:37:23.272731+0000","last_unstale":"2024-04-26T10:37:30.888069+0000","last_undegraded":"2024-04-26T10:37:30.888069+0000","last_fullsized":"2024-04-26T10:37:30.888069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:46.569879+0000","last_change":"2024-04-26T10:37:46.570003+0000","last_active":"2024-04-26T10:37:46.569879+0000","last_peered":"2024-04-26T10:37:46.569879+0000","last_clean":"2024-04-26T10:37:46.569879+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:37:46.569879+0000","last_undegraded":"2024-04-26T10:37:46.569879+0000","last_fullsized":"2024-04-26T10:37:46.569879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:46.569855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:46.569855+0000","last_clean_scrub_stamp":"2024-04-26T10:37:46.569855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:12.891140+0000","scrub_duration":0.00144177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":99,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284123+0000","last_change":"2024-04-26T10:37:23.272627+0000","last_active":"2024-04-26T10:37:29.284123+0000","last_peered":"2024-04-26T10:37:29.284123+0000","last_clean":"2024-04-26T10:37:29.284123+0000","last_became_active":"2024-04-26T10:37:23.269968+0000","last_became_peered":"2024-04-26T10:37:23.269968+0000","last_unstale":"2024-04-26T10:37:29.284123+0000","last_undegraded":"2024-04-26T10:37:29.284123+0000","last_fullsized":"2024-04-26T10:37:29.284123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:39.919590+0000","last_change":"2024-04-26T10:37:39.919719+0000","last_active":"2024-04-26T10:37:39.919590+0000","last_peered":"2024-04-26T10:37:39.919590+0000","last_clean":"2024-04-26T10:37:39.919590+0000","last_became_active":"2024-04-26T10:37:23.274045+0000","last_became_peered":"2024-04-26T10:37:23.274045+0000","last_unstale":"2024-04-26T10:37:39.919590+0000","last_undegraded":"2024-04-26T10:37:39.919590+0000","last_fullsized":"2024-04-26T10:37:39.919590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:39.919570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:39.919570+0000","last_clean_scrub_stamp":"2024-04-26T10:37:39.919570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:44.433055+0000","scrub_duration":0.001537217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283720+0000","last_change":"2024-04-26T10:37:23.273798+0000","last_active":"2024-04-26T10:37:29.283720+0000","last_peered":"2024-04-26T10:37:29.283720+0000","last_clean":"2024-04-26T10:37:29.283720+0000","last_became_active":"2024-04-26T10:37:23.269775+0000","last_became_peered":"2024-04-26T10:37:23.269775+0000","last_unstale":"2024-04-26T10:37:29.283720+0000","last_undegraded":"2024-04-26T10:37:29.283720+0000","last_fullsized":"2024-04-26T10:37:29.283720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888089+0000","last_change":"2024-04-26T10:34:14.508569+0000","last_active":"2024-04-26T10:37:30.888089+0000","last_peered":"2024-04-26T10:37:30.888089+0000","last_clean":"2024-04-26T10:37:30.888089+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:37:30.888089+0000","last_undegraded":"2024-04-26T10:37:30.888089+0000","last_fullsized":"2024-04-26T10:37:30.888089+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:35.178229+0000","last_change":"2024-04-26T10:37:23.270164+0000","last_active":"2024-04-26T10:37:35.178229+0000","last_peered":"2024-04-26T10:37:35.178229+0000","last_clean":"2024-04-26T10:37:35.178229+0000","last_became_active":"2024-04-26T10:37:23.269537+0000","last_became_peered":"2024-04-26T10:37:23.269537+0000","last_unstale":"2024-04-26T10:37:35.178229+0000","last_undegraded":"2024-04-26T10:37:35.178229+0000","last_fullsized":"2024-04-26T10:37:35.178229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888133+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:37:30.888133+0000","last_peered":"2024-04-26T10:37:30.888133+0000","last_clean":"2024-04-26T10:37:30.888133+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:37:30.888133+0000","last_undegraded":"2024-04-26T10:37:30.888133+0000","last_fullsized":"2024-04-26T10:37:30.888133+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887513+0000","last_change":"2024-04-26T10:37:23.268114+0000","last_active":"2024-04-26T10:37:30.887513+0000","last_peered":"2024-04-26T10:37:30.887513+0000","last_clean":"2024-04-26T10:37:30.887513+0000","last_became_active":"2024-04-26T10:37:23.267121+0000","last_became_peered":"2024-04-26T10:37:23.267121+0000","last_unstale":"2024-04-26T10:37:30.887513+0000","last_undegraded":"2024-04-26T10:37:30.887513+0000","last_fullsized":"2024-04-26T10:37:30.887513+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302532+0000","last_change":"2024-04-26T10:37:28.282100+0000","last_active":"2024-04-26T10:37:37.302532+0000","last_peered":"2024-04-26T10:37:37.302532+0000","last_clean":"2024-04-26T10:37:37.302532+0000","last_became_active":"2024-04-26T10:37:28.281512+0000","last_became_peered":"2024-04-26T10:37:28.281512+0000","last_unstale":"2024-04-26T10:37:37.302532+0000","last_undegraded":"2024-04-26T10:37:37.302532+0000","last_fullsized":"2024-04-26T10:37:37.302532+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283487+0000","last_change":"2024-04-26T10:37:23.268184+0000","last_active":"2024-04-26T10:37:29.283487+0000","last_peered":"2024-04-26T10:37:29.283487+0000","last_clean":"2024-04-26T10:37:29.283487+0000","last_became_active":"2024-04-26T10:37:23.266377+0000","last_became_peered":"2024-04-26T10:37:23.266377+0000","last_unstale":"2024-04-26T10:37:29.283487+0000","last_undegraded":"2024-04-26T10:37:29.283487+0000","last_fullsized":"2024-04-26T10:37:29.283487+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302625+0000","last_change":"2024-04-26T10:37:23.272074+0000","last_active":"2024-04-26T10:37:37.302625+0000","last_peered":"2024-04-26T10:37:37.302625+0000","last_clean":"2024-04-26T10:37:37.302625+0000","last_became_active":"2024-04-26T10:37:23.271752+0000","last_became_peered":"2024-04-26T10:37:23.271752+0000","last_unstale":"2024-04-26T10:37:37.302625+0000","last_undegraded":"2024-04-26T10:37:37.302625+0000","last_fullsized":"2024-04-26T10:37:37.302625+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284617+0000","last_change":"2024-04-26T10:37:23.273840+0000","last_active":"2024-04-26T10:37:29.284617+0000","last_peered":"2024-04-26T10:37:29.284617+0000","last_clean":"2024-04-26T10:37:29.284617+0000","last_became_active":"2024-04-26T10:37:23.272156+0000","last_became_peered":"2024-04-26T10:37:23.272156+0000","last_unstale":"2024-04-26T10:37:29.284617+0000","last_undegraded":"2024-04-26T10:37:29.284617+0000","last_fullsized":"2024-04-26T10:37:29.284617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887569+0000","last_change":"2024-04-26T10:37:23.268011+0000","last_active":"2024-04-26T10:37:30.887569+0000","last_peered":"2024-04-26T10:37:30.887569+0000","last_clean":"2024-04-26T10:37:30.887569+0000","last_became_active":"2024-04-26T10:37:23.267717+0000","last_became_peered":"2024-04-26T10:37:23.267717+0000","last_unstale":"2024-04-26T10:37:30.887569+0000","last_undegraded":"2024-04-26T10:37:30.887569+0000","last_fullsized":"2024-04-26T10:37:30.887569+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888511+0000","last_change":"2024-04-26T10:37:23.273179+0000","last_active":"2024-04-26T10:37:30.888511+0000","last_peered":"2024-04-26T10:37:30.888511+0000","last_clean":"2024-04-26T10:37:30.888511+0000","last_became_active":"2024-04-26T10:37:23.272260+0000","last_became_peered":"2024-04-26T10:37:23.272260+0000","last_unstale":"2024-04-26T10:37:30.888511+0000","last_undegraded":"2024-04-26T10:37:30.888511+0000","last_fullsized":"2024-04-26T10:37:30.888511+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887628+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:37:30.887628+0000","last_peered":"2024-04-26T10:37:30.887628+0000","last_clean":"2024-04-26T10:37:30.887628+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:37:30.887628+0000","last_undegraded":"2024-04-26T10:37:30.887628+0000","last_fullsized":"2024-04-26T10:37:30.887628+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283990+0000","last_change":"2024-04-26T10:37:23.269836+0000","last_active":"2024-04-26T10:37:29.283990+0000","last_peered":"2024-04-26T10:37:29.283990+0000","last_clean":"2024-04-26T10:37:29.283990+0000","last_became_active":"2024-04-26T10:37:23.268441+0000","last_became_peered":"2024-04-26T10:37:23.268441+0000","last_unstale":"2024-04-26T10:37:29.283990+0000","last_undegraded":"2024-04-26T10:37:29.283990+0000","last_fullsized":"2024-04-26T10:37:29.283990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283818+0000","last_change":"2024-04-26T10:37:23.270851+0000","last_active":"2024-04-26T10:37:29.283818+0000","last_peered":"2024-04-26T10:37:29.283818+0000","last_clean":"2024-04-26T10:37:29.283818+0000","last_became_active":"2024-04-26T10:37:23.268451+0000","last_became_peered":"2024-04-26T10:37:23.268451+0000","last_unstale":"2024-04-26T10:37:29.283818+0000","last_undegraded":"2024-04-26T10:37:29.283818+0000","last_fullsized":"2024-04-26T10:37:29.283818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284314+0000","last_change":"2024-04-26T10:37:23.273635+0000","last_active":"2024-04-26T10:37:29.284314+0000","last_peered":"2024-04-26T10:37:29.284314+0000","last_clean":"2024-04-26T10:37:29.284314+0000","last_became_active":"2024-04-26T10:37:23.272938+0000","last_became_peered":"2024-04-26T10:37:23.272938+0000","last_unstale":"2024-04-26T10:37:29.284314+0000","last_undegraded":"2024-04-26T10:37:29.284314+0000","last_fullsized":"2024-04-26T10:37:29.284314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:42.638376+0000","last_change":"2024-04-26T10:37:42.638539+0000","last_active":"2024-04-26T10:37:42.638376+0000","last_peered":"2024-04-26T10:37:42.638376+0000","last_clean":"2024-04-26T10:37:42.638376+0000","last_became_active":"2024-04-26T10:37:23.276957+0000","last_became_peered":"2024-04-26T10:37:23.276957+0000","last_unstale":"2024-04-26T10:37:42.638376+0000","last_undegraded":"2024-04-26T10:37:42.638376+0000","last_fullsized":"2024-04-26T10:37:42.638376+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:42.638352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:42.638352+0000","last_clean_scrub_stamp":"2024-04-26T10:37:42.638352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:15.896041+0000","scrub_duration":0.027944383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283904+0000","last_change":"2024-04-26T10:37:23.277440+0000","last_active":"2024-04-26T10:37:29.283904+0000","last_peered":"2024-04-26T10:37:29.283904+0000","last_clean":"2024-04-26T10:37:29.283904+0000","last_became_active":"2024-04-26T10:37:23.277037+0000","last_became_peered":"2024-04-26T10:37:23.277037+0000","last_unstale":"2024-04-26T10:37:29.283904+0000","last_undegraded":"2024-04-26T10:37:29.283904+0000","last_fullsized":"2024-04-26T10:37:29.283904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283803+0000","last_change":"2024-04-26T10:37:23.270454+0000","last_active":"2024-04-26T10:37:29.283803+0000","last_peered":"2024-04-26T10:37:29.283803+0000","last_clean":"2024-04-26T10:37:29.283803+0000","last_became_active":"2024-04-26T10:37:23.269473+0000","last_became_peered":"2024-04-26T10:37:23.269473+0000","last_unstale":"2024-04-26T10:37:29.283803+0000","last_undegraded":"2024-04-26T10:37:29.283803+0000","last_fullsized":"2024-04-26T10:37:29.283803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283674+0000","last_change":"2024-04-26T10:37:23.267503+0000","last_active":"2024-04-26T10:37:29.283674+0000","last_peered":"2024-04-26T10:37:29.283674+0000","last_clean":"2024-04-26T10:37:29.283674+0000","last_became_active":"2024-04-26T10:37:23.267235+0000","last_became_peered":"2024-04-26T10:37:23.267235+0000","last_unstale":"2024-04-26T10:37:29.283674+0000","last_undegraded":"2024-04-26T10:37:29.283674+0000","last_fullsized":"2024-04-26T10:37:29.283674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284323+0000","last_change":"2024-04-26T10:37:23.274693+0000","last_active":"2024-04-26T10:37:29.284323+0000","last_peered":"2024-04-26T10:37:29.284323+0000","last_clean":"2024-04-26T10:37:29.284323+0000","last_became_active":"2024-04-26T10:37:23.272111+0000","last_became_peered":"2024-04-26T10:37:23.272111+0000","last_unstale":"2024-04-26T10:37:29.284323+0000","last_undegraded":"2024-04-26T10:37:29.284323+0000","last_fullsized":"2024-04-26T10:37:29.284323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887722+0000","last_change":"2024-04-26T10:37:23.274381+0000","last_active":"2024-04-26T10:37:30.887722+0000","last_peered":"2024-04-26T10:37:30.887722+0000","last_clean":"2024-04-26T10:37:30.887722+0000","last_became_active":"2024-04-26T10:37:23.273867+0000","last_became_peered":"2024-04-26T10:37:23.273867+0000","last_unstale":"2024-04-26T10:37:30.887722+0000","last_undegraded":"2024-04-26T10:37:30.887722+0000","last_fullsized":"2024-04-26T10:37:30.887722+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284379+0000","last_change":"2024-04-26T10:37:23.273539+0000","last_active":"2024-04-26T10:37:29.284379+0000","last_peered":"2024-04-26T10:37:29.284379+0000","last_clean":"2024-04-26T10:37:29.284379+0000","last_became_active":"2024-04-26T10:37:23.272569+0000","last_became_peered":"2024-04-26T10:37:23.272569+0000","last_unstale":"2024-04-26T10:37:29.284379+0000","last_undegraded":"2024-04-26T10:37:29.284379+0000","last_fullsized":"2024-04-26T10:37:29.284379+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887566+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:37:30.887566+0000","last_peered":"2024-04-26T10:37:30.887566+0000","last_clean":"2024-04-26T10:37:30.887566+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:37:30.887566+0000","last_undegraded":"2024-04-26T10:37:30.887566+0000","last_fullsized":"2024-04-26T10:37:30.887566+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284388+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:37:29.284388+0000","last_peered":"2024-04-26T10:37:29.284388+0000","last_clean":"2024-04-26T10:37:29.284388+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:37:29.284388+0000","last_undegraded":"2024-04-26T10:37:29.284388+0000","last_fullsized":"2024-04-26T10:37:29.284388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.177479+0000","last_change":"2024-04-26T10:37:28.282767+0000","last_active":"2024-04-26T10:37:30.177479+0000","last_peered":"2024-04-26T10:37:30.177479+0000","last_clean":"2024-04-26T10:37:30.177479+0000","last_became_active":"2024-04-26T10:37:28.282419+0000","last_became_peered":"2024-04-26T10:37:28.282419+0000","last_unstale":"2024-04-26T10:37:30.177479+0000","last_undegraded":"2024-04-26T10:37:30.177479+0000","last_fullsized":"2024-04-26T10:37:30.177479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:47.889504+0000","last_change":"2024-04-26T10:37:47.889608+0000","last_active":"2024-04-26T10:37:47.889504+0000","last_peered":"2024-04-26T10:37:47.889504+0000","last_clean":"2024-04-26T10:37:47.889504+0000","last_became_active":"2024-04-26T10:37:23.273114+0000","last_became_peered":"2024-04-26T10:37:23.273114+0000","last_unstale":"2024-04-26T10:37:47.889504+0000","last_undegraded":"2024-04-26T10:37:47.889504+0000","last_fullsized":"2024-04-26T10:37:47.889504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:47.889480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:47.889480+0000","last_clean_scrub_stamp":"2024-04-26T10:37:47.889480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:38.351949+0000","scrub_duration":0.0018432660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887718+0000","last_change":"2024-04-26T10:37:23.268149+0000","last_active":"2024-04-26T10:37:30.887718+0000","last_peered":"2024-04-26T10:37:30.887718+0000","last_clean":"2024-04-26T10:37:30.887718+0000","last_became_active":"2024-04-26T10:37:23.267319+0000","last_became_peered":"2024-04-26T10:37:23.267319+0000","last_unstale":"2024-04-26T10:37:30.887718+0000","last_undegraded":"2024-04-26T10:37:30.887718+0000","last_fullsized":"2024-04-26T10:37:30.887718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283586+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:29.283586+0000","last_peered":"2024-04-26T10:37:29.283586+0000","last_clean":"2024-04-26T10:37:29.283586+0000","last_became_active":"2024-04-26T10:37:23.266332+0000","last_became_peered":"2024-04-26T10:37:23.266332+0000","last_unstale":"2024-04-26T10:37:29.283586+0000","last_undegraded":"2024-04-26T10:37:29.283586+0000","last_fullsized":"2024-04-26T10:37:29.283586+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283846+0000","last_change":"2024-04-26T10:37:23.272871+0000","last_active":"2024-04-26T10:37:29.283846+0000","last_peered":"2024-04-26T10:37:29.283846+0000","last_clean":"2024-04-26T10:37:29.283846+0000","last_became_active":"2024-04-26T10:37:23.269657+0000","last_became_peered":"2024-04-26T10:37:23.269657+0000","last_unstale":"2024-04-26T10:37:29.283846+0000","last_undegraded":"2024-04-26T10:37:29.283846+0000","last_fullsized":"2024-04-26T10:37:29.283846+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:41.612812+0000","last_change":"2024-04-26T10:37:41.612919+0000","last_active":"2024-04-26T10:37:41.612812+0000","last_peered":"2024-04-26T10:37:41.612812+0000","last_clean":"2024-04-26T10:37:41.612812+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:37:41.612812+0000","last_undegraded":"2024-04-26T10:37:41.612812+0000","last_fullsized":"2024-04-26T10:37:41.612812+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:41.612787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:41.612787+0000","last_clean_scrub_stamp":"2024-04-26T10:37:41.612787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:15.886238+0000","scrub_duration":0.001521445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283587+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:37:29.283587+0000","last_peered":"2024-04-26T10:37:29.283587+0000","last_clean":"2024-04-26T10:37:29.283587+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:37:29.283587+0000","last_undegraded":"2024-04-26T10:37:29.283587+0000","last_fullsized":"2024-04-26T10:37:29.283587+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887687+0000","last_change":"2024-04-26T10:37:23.267893+0000","last_active":"2024-04-26T10:37:30.887687+0000","last_peered":"2024-04-26T10:37:30.887687+0000","last_clean":"2024-04-26T10:37:30.887687+0000","last_became_active":"2024-04-26T10:37:23.267595+0000","last_became_peered":"2024-04-26T10:37:23.267595+0000","last_unstale":"2024-04-26T10:37:30.887687+0000","last_undegraded":"2024-04-26T10:37:30.887687+0000","last_fullsized":"2024-04-26T10:37:30.887687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284517+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:37:29.284517+0000","last_peered":"2024-04-26T10:37:29.284517+0000","last_clean":"2024-04-26T10:37:29.284517+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:37:29.284517+0000","last_undegraded":"2024-04-26T10:37:29.284517+0000","last_fullsized":"2024-04-26T10:37:29.284517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283704+0000","last_change":"2024-04-26T10:37:23.273754+0000","last_active":"2024-04-26T10:37:29.283704+0000","last_peered":"2024-04-26T10:37:29.283704+0000","last_clean":"2024-04-26T10:37:29.283704+0000","last_became_active":"2024-04-26T10:37:23.270451+0000","last_became_peered":"2024-04-26T10:37:23.270451+0000","last_unstale":"2024-04-26T10:37:29.283704+0000","last_undegraded":"2024-04-26T10:37:29.283704+0000","last_fullsized":"2024-04-26T10:37:29.283704+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":301,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283617+0000","last_change":"2024-04-26T10:37:23.269600+0000","last_active":"2024-04-26T10:37:29.283617+0000","last_peered":"2024-04-26T10:37:29.283617+0000","last_clean":"2024-04-26T10:37:29.283617+0000","last_became_active":"2024-04-26T10:37:23.268665+0000","last_became_peered":"2024-04-26T10:37:23.268665+0000","last_unstale":"2024-04-26T10:37:29.283617+0000","last_undegraded":"2024-04-26T10:37:29.283617+0000","last_fullsized":"2024-04-26T10:37:29.283617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283661+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:37:29.283661+0000","last_peered":"2024-04-26T10:37:29.283661+0000","last_clean":"2024-04-26T10:37:29.283661+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:37:29.283661+0000","last_undegraded":"2024-04-26T10:37:29.283661+0000","last_fullsized":"2024-04-26T10:37:29.283661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284086+0000","last_change":"2024-04-26T10:37:23.271849+0000","last_active":"2024-04-26T10:37:29.284086+0000","last_peered":"2024-04-26T10:37:29.284086+0000","last_clean":"2024-04-26T10:37:29.284086+0000","last_became_active":"2024-04-26T10:37:23.269736+0000","last_became_peered":"2024-04-26T10:37:23.269736+0000","last_unstale":"2024-04-26T10:37:29.284086+0000","last_undegraded":"2024-04-26T10:37:29.284086+0000","last_fullsized":"2024-04-26T10:37:29.284086+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283418+0000","last_change":"2024-04-26T10:37:23.266348+0000","last_active":"2024-04-26T10:37:29.283418+0000","last_peered":"2024-04-26T10:37:29.283418+0000","last_clean":"2024-04-26T10:37:29.283418+0000","last_became_active":"2024-04-26T10:37:23.265317+0000","last_became_peered":"2024-04-26T10:37:23.265317+0000","last_unstale":"2024-04-26T10:37:29.283418+0000","last_undegraded":"2024-04-26T10:37:29.283418+0000","last_fullsized":"2024-04-26T10:37:29.283418+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283491+0000","last_change":"2024-04-26T10:37:23.276509+0000","last_active":"2024-04-26T10:37:29.283491+0000","last_peered":"2024-04-26T10:37:29.283491+0000","last_clean":"2024-04-26T10:37:29.283491+0000","last_became_active":"2024-04-26T10:37:23.276151+0000","last_became_peered":"2024-04-26T10:37:23.276151+0000","last_unstale":"2024-04-26T10:37:29.283491+0000","last_undegraded":"2024-04-26T10:37:29.283491+0000","last_fullsized":"2024-04-26T10:37:29.283491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888549+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:37:30.888549+0000","last_peered":"2024-04-26T10:37:30.888549+0000","last_clean":"2024-04-26T10:37:30.888549+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:37:30.888549+0000","last_undegraded":"2024-04-26T10:37:30.888549+0000","last_fullsized":"2024-04-26T10:37:30.888549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888349+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:37:30.888349+0000","last_peered":"2024-04-26T10:37:30.888349+0000","last_clean":"2024-04-26T10:37:30.888349+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:37:30.888349+0000","last_undegraded":"2024-04-26T10:37:30.888349+0000","last_fullsized":"2024-04-26T10:37:30.888349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284207+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:37:29.284207+0000","last_peered":"2024-04-26T10:37:29.284207+0000","last_clean":"2024-04-26T10:37:29.284207+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:37:29.284207+0000","last_undegraded":"2024-04-26T10:37:29.284207+0000","last_fullsized":"2024-04-26T10:37:29.284207+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887955+0000","last_change":"2024-04-26T10:37:23.277636+0000","last_active":"2024-04-26T10:37:30.887955+0000","last_peered":"2024-04-26T10:37:30.887955+0000","last_clean":"2024-04-26T10:37:30.887955+0000","last_became_active":"2024-04-26T10:37:23.277309+0000","last_became_peered":"2024-04-26T10:37:23.277309+0000","last_unstale":"2024-04-26T10:37:30.887955+0000","last_undegraded":"2024-04-26T10:37:30.887955+0000","last_fullsized":"2024-04-26T10:37:30.887955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284373+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:37:29.284373+0000","last_peered":"2024-04-26T10:37:29.284373+0000","last_clean":"2024-04-26T10:37:29.284373+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:37:29.284373+0000","last_undegraded":"2024-04-26T10:37:29.284373+0000","last_fullsized":"2024-04-26T10:37:29.284373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284463+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:37:29.284463+0000","last_peered":"2024-04-26T10:37:29.284463+0000","last_clean":"2024-04-26T10:37:29.284463+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:37:29.284463+0000","last_undegraded":"2024-04-26T10:37:29.284463+0000","last_fullsized":"2024-04-26T10:37:29.284463+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283367+0000","last_change":"2024-04-26T10:37:28.282300+0000","last_active":"2024-04-26T10:37:29.283367+0000","last_peered":"2024-04-26T10:37:29.283367+0000","last_clean":"2024-04-26T10:37:29.283367+0000","last_became_active":"2024-04-26T10:37:28.281669+0000","last_became_peered":"2024-04-26T10:37:28.281669+0000","last_unstale":"2024-04-26T10:37:29.283367+0000","last_undegraded":"2024-04-26T10:37:29.283367+0000","last_fullsized":"2024-04-26T10:37:29.283367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284378+0000","last_change":"2024-04-26T10:37:23.269479+0000","last_active":"2024-04-26T10:37:29.284378+0000","last_peered":"2024-04-26T10:37:29.284378+0000","last_clean":"2024-04-26T10:37:29.284378+0000","last_became_active":"2024-04-26T10:37:23.268673+0000","last_became_peered":"2024-04-26T10:37:23.268673+0000","last_unstale":"2024-04-26T10:37:29.284378+0000","last_undegraded":"2024-04-26T10:37:29.284378+0000","last_fullsized":"2024-04-26T10:37:29.284378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284270+0000","last_change":"2024-04-26T10:37:23.277426+0000","last_active":"2024-04-26T10:37:29.284270+0000","last_peered":"2024-04-26T10:37:29.284270+0000","last_clean":"2024-04-26T10:37:29.284270+0000","last_became_active":"2024-04-26T10:37:23.277001+0000","last_became_peered":"2024-04-26T10:37:23.277001+0000","last_unstale":"2024-04-26T10:37:29.284270+0000","last_undegraded":"2024-04-26T10:37:29.284270+0000","last_fullsized":"2024-04-26T10:37:29.284270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887515+0000","last_change":"2024-04-26T10:37:23.267342+0000","last_active":"2024-04-26T10:37:30.887515+0000","last_peered":"2024-04-26T10:37:30.887515+0000","last_clean":"2024-04-26T10:37:30.887515+0000","last_became_active":"2024-04-26T10:37:23.266912+0000","last_became_peered":"2024-04-26T10:37:23.266912+0000","last_unstale":"2024-04-26T10:37:30.887515+0000","last_undegraded":"2024-04-26T10:37:30.887515+0000","last_fullsized":"2024-04-26T10:37:30.887515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:39.091120+0000","last_change":"2024-04-26T10:37:39.091234+0000","last_active":"2024-04-26T10:37:39.091120+0000","last_peered":"2024-04-26T10:37:39.091120+0000","last_clean":"2024-04-26T10:37:39.091120+0000","last_became_active":"2024-04-26T10:37:23.277303+0000","last_became_peered":"2024-04-26T10:37:23.277303+0000","last_unstale":"2024-04-26T10:37:39.091120+0000","last_undegraded":"2024-04-26T10:37:39.091120+0000","last_fullsized":"2024-04-26T10:37:39.091120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:37:39.091052+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:37:39.091052+0000","last_clean_scrub_stamp":"2024-04-26T10:37:39.091052+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:34.281919+0000","scrub_duration":0.0021606110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786627+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:37:36.786627+0000","last_peered":"2024-04-26T10:37:36.786627+0000","last_clean":"2024-04-26T10:37:36.786627+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:37:36.786627+0000","last_undegraded":"2024-04-26T10:37:36.786627+0000","last_fullsized":"2024-04-26T10:37:36.786627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284020+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:29.284020+0000","last_peered":"2024-04-26T10:37:29.284020+0000","last_clean":"2024-04-26T10:37:29.284020+0000","last_became_active":"2024-04-26T10:37:23.266295+0000","last_became_peered":"2024-04-26T10:37:23.266295+0000","last_unstale":"2024-04-26T10:37:29.284020+0000","last_undegraded":"2024-04-26T10:37:29.284020+0000","last_fullsized":"2024-04-26T10:37:29.284020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:49.930540+0000","last_change":"2024-04-26T10:37:49.930694+0000","last_active":"2024-04-26T10:37:49.930540+0000","last_peered":"2024-04-26T10:37:49.930540+0000","last_clean":"2024-04-26T10:37:49.930540+0000","last_became_active":"2024-04-26T10:37:23.272039+0000","last_became_peered":"2024-04-26T10:37:23.272039+0000","last_unstale":"2024-04-26T10:37:49.930540+0000","last_undegraded":"2024-04-26T10:37:49.930540+0000","last_fullsized":"2024-04-26T10:37:49.930540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:49.930517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:49.930517+0000","last_clean_scrub_stamp":"2024-04-26T10:37:49.930517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:31.070842+0000","scrub_duration":0.046350850999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786604+0000","last_change":"2024-04-26T10:37:23.273723+0000","last_active":"2024-04-26T10:37:36.786604+0000","last_peered":"2024-04-26T10:37:36.786604+0000","last_clean":"2024-04-26T10:37:36.786604+0000","last_became_active":"2024-04-26T10:37:23.273253+0000","last_became_peered":"2024-04-26T10:37:23.273253+0000","last_unstale":"2024-04-26T10:37:36.786604+0000","last_undegraded":"2024-04-26T10:37:36.786604+0000","last_fullsized":"2024-04-26T10:37:36.786604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283706+0000","last_change":"2024-04-26T10:37:23.267726+0000","last_active":"2024-04-26T10:37:29.283706+0000","last_peered":"2024-04-26T10:37:29.283706+0000","last_clean":"2024-04-26T10:37:29.283706+0000","last_became_active":"2024-04-26T10:37:23.267434+0000","last_became_peered":"2024-04-26T10:37:23.267434+0000","last_unstale":"2024-04-26T10:37:29.283706+0000","last_undegraded":"2024-04-26T10:37:29.283706+0000","last_fullsized":"2024-04-26T10:37:29.283706+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284470+0000","last_change":"2024-04-26T10:32:51.589042+0000","last_active":"2024-04-26T10:37:29.284470+0000","last_peered":"2024-04-26T10:37:29.284470+0000","last_clean":"2024-04-26T10:37:29.284470+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:37:29.284470+0000","last_undegraded":"2024-04-26T10:37:29.284470+0000","last_fullsized":"2024-04-26T10:37:29.284470+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887831+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:37:30.887831+0000","last_peered":"2024-04-26T10:37:30.887831+0000","last_clean":"2024-04-26T10:37:30.887831+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:37:30.887831+0000","last_undegraded":"2024-04-26T10:37:30.887831+0000","last_fullsized":"2024-04-26T10:37:30.887831+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284461+0000","last_change":"2024-04-26T10:37:23.272052+0000","last_active":"2024-04-26T10:37:29.284461+0000","last_peered":"2024-04-26T10:37:29.284461+0000","last_clean":"2024-04-26T10:37:29.284461+0000","last_became_active":"2024-04-26T10:37:23.271663+0000","last_became_peered":"2024-04-26T10:37:23.271663+0000","last_unstale":"2024-04-26T10:37:29.284461+0000","last_undegraded":"2024-04-26T10:37:29.284461+0000","last_fullsized":"2024-04-26T10:37:29.284461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283610+0000","last_change":"2024-04-26T10:37:23.268370+0000","last_active":"2024-04-26T10:37:29.283610+0000","last_peered":"2024-04-26T10:37:29.283610+0000","last_clean":"2024-04-26T10:37:29.283610+0000","last_became_active":"2024-04-26T10:37:23.266624+0000","last_became_peered":"2024-04-26T10:37:23.266624+0000","last_unstale":"2024-04-26T10:37:29.283610+0000","last_undegraded":"2024-04-26T10:37:29.283610+0000","last_fullsized":"2024-04-26T10:37:29.283610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283499+0000","last_change":"2024-04-26T10:37:23.267652+0000","last_active":"2024-04-26T10:37:29.283499+0000","last_peered":"2024-04-26T10:37:29.283499+0000","last_clean":"2024-04-26T10:37:29.283499+0000","last_became_active":"2024-04-26T10:37:23.266063+0000","last_became_peered":"2024-04-26T10:37:23.266063+0000","last_unstale":"2024-04-26T10:37:29.283499+0000","last_undegraded":"2024-04-26T10:37:29.283499+0000","last_fullsized":"2024-04-26T10:37:29.283499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.177409+0000","last_change":"2024-04-26T10:37:28.282145+0000","last_active":"2024-04-26T10:37:30.177409+0000","last_peered":"2024-04-26T10:37:30.177409+0000","last_clean":"2024-04-26T10:37:30.177409+0000","last_became_active":"2024-04-26T10:37:28.281541+0000","last_became_peered":"2024-04-26T10:37:28.281541+0000","last_unstale":"2024-04-26T10:37:30.177409+0000","last_undegraded":"2024-04-26T10:37:30.177409+0000","last_fullsized":"2024-04-26T10:37:30.177409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887978+0000","last_change":"2024-04-26T10:37:23.268479+0000","last_active":"2024-04-26T10:37:30.887978+0000","last_peered":"2024-04-26T10:37:30.887978+0000","last_clean":"2024-04-26T10:37:30.887978+0000","last_became_active":"2024-04-26T10:37:23.267644+0000","last_became_peered":"2024-04-26T10:37:23.267644+0000","last_unstale":"2024-04-26T10:37:30.887978+0000","last_undegraded":"2024-04-26T10:37:30.887978+0000","last_fullsized":"2024-04-26T10:37:30.887978+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284302+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:37:29.284302+0000","last_peered":"2024-04-26T10:37:29.284302+0000","last_clean":"2024-04-26T10:37:29.284302+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:37:29.284302+0000","last_undegraded":"2024-04-26T10:37:29.284302+0000","last_fullsized":"2024-04-26T10:37:29.284302+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888052+0000","last_change":"2024-04-26T10:37:23.274199+0000","last_active":"2024-04-26T10:37:30.888052+0000","last_peered":"2024-04-26T10:37:30.888052+0000","last_clean":"2024-04-26T10:37:30.888052+0000","last_became_active":"2024-04-26T10:37:23.273023+0000","last_became_peered":"2024-04-26T10:37:23.273023+0000","last_unstale":"2024-04-26T10:37:30.888052+0000","last_undegraded":"2024-04-26T10:37:30.888052+0000","last_fullsized":"2024-04-26T10:37:30.888052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1766,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738434,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":338824,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":94033016,"statfs":{"total":96636764160,"available":96289808384,"internally_reserved":0,"allocated":917504,"data_stored":359527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346028486},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Apr 26 10:37:52 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.39000000000000001},"min":{"1min":0.35399999999999998,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.65100000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.436},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.64500000000000002,"15min":0.498},"min":{"1min":0.314,"5min":0.19,"15min":0.19},"max":{"1min":0.61799999999999999,"5min":12.206,"15min":12.206},"last":0.47799999999999998}]}]},{"osd":0,"up_from":75,"seq":322122547209,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55012,"kb_used_data":1500,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94316828,"statfs":{"total":96636764160,"available":96580431872,"internally_reserved":0,"allocated":1536000,"data_stored":951641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7111,"internal_metadata":54780985},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]}]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257368,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":255870,"kb_avail":94114472,"statfs":{"total":96636764160,"available":96373219328,"internally_reserved":0,"allocated":1523712,"data_stored":948912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262011334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.502},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Apr 26 10:37:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.45600000000000002,"15min":0.36699999999999999},"min":{"1min":0.33700000000000002,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.65700000000000003,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49099999999999999,"15min":0.45500000000000002},"min":{"1min":0.308,"5min":0.183,"15min":0.183},"max":{"1min":0.60599999999999998,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.46200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:37:58.068 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.068 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.068 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.069 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.069 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.069 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.069 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.069 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.070 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.070 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.070 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.070 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.070 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.070 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.070 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.070 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.070 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.071 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.071 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.071 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.071 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.071 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.071 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.071 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.071 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.071 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.072 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.072 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.072 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.072 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.072 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.072 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.072 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.072 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.072 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.073 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.073 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.073 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.073 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.073 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.073 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.073 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.073 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.073 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.074 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.074 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.074 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.074 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.074 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.074 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.074 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.074 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.074 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.075 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.075 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.075 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.075 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.075 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.075 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.075 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.075 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.075 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.076 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.076 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.076 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.076 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.076 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.076 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.076 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.076 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.076 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.077 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.077 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.077 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.077 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.077 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.077 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.077 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.077 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.077 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.078 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.078 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.078 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.078 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.078 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.078 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.078 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.078 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:37:58.078 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:38:18.080 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:38:18.439 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:38:18.441 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:38:18.451 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-04-26T10:38:17.069470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":592134,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":651204,"kb_used_data":3884,"kb_used_omap":10,"kb_used_meta":647285,"kb_avail":282464316,"statfs":{"total":289910292480,"available":289243459584,"internally_reserved":0,"allocated":3977216,"data_stored":2260080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10299,"internal_metadata":662820805},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002647"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888515+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:37:30.888515+0000","last_peered":"2024-04-26T10:37:30.888515+0000","last_clean":"2024-04-26T10:37:30.888515+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:37:30.888515+0000","last_undegraded":"2024-04-26T10:37:30.888515+0000","last_fullsized":"2024-04-26T10:37:30.888515+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:46.090568+0000","last_change":"2024-04-26T10:37:46.090713+0000","last_active":"2024-04-26T10:37:46.090568+0000","last_peered":"2024-04-26T10:37:46.090568+0000","last_clean":"2024-04-26T10:37:46.090568+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:37:46.090568+0000","last_undegraded":"2024-04-26T10:37:46.090568+0000","last_fullsized":"2024-04-26T10:37:46.090568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:46.090545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:46.090545+0000","last_clean_scrub_stamp":"2024-04-26T10:37:46.090545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:42.129201+0000","scrub_duration":0.001738082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.946243+0000","last_change":"2024-04-26T10:37:36.946374+0000","last_active":"2024-04-26T10:37:36.946243+0000","last_peered":"2024-04-26T10:37:36.946243+0000","last_clean":"2024-04-26T10:37:36.946243+0000","last_became_active":"2024-04-26T10:37:23.272107+0000","last_became_peered":"2024-04-26T10:37:23.272107+0000","last_unstale":"2024-04-26T10:37:36.946243+0000","last_undegraded":"2024-04-26T10:37:36.946243+0000","last_fullsized":"2024-04-26T10:37:36.946243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:36.946219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:36.946219+0000","last_clean_scrub_stamp":"2024-04-26T10:37:36.946219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:56.583737+0000","scrub_duration":0.0019495529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:54.913664+0000","last_change":"2024-04-26T10:37:54.913778+0000","last_active":"2024-04-26T10:37:54.913664+0000","last_peered":"2024-04-26T10:37:54.913664+0000","last_clean":"2024-04-26T10:37:54.913664+0000","last_became_active":"2024-04-26T10:37:23.269752+0000","last_became_peered":"2024-04-26T10:37:23.269752+0000","last_unstale":"2024-04-26T10:37:54.913664+0000","last_undegraded":"2024-04-26T10:37:54.913664+0000","last_fullsized":"2024-04-26T10:37:54.913664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:54.913640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:54.913640+0000","last_clean_scrub_stamp":"2024-04-26T10:37:54.913640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:45.220783+0000","scrub_duration":0.0019585140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:44.056407+0000","last_change":"2024-04-26T10:37:44.056524+0000","last_active":"2024-04-26T10:37:44.056407+0000","last_peered":"2024-04-26T10:37:44.056407+0000","last_clean":"2024-04-26T10:37:44.056407+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:37:44.056407+0000","last_undegraded":"2024-04-26T10:37:44.056407+0000","last_fullsized":"2024-04-26T10:37:44.056407+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:44.056381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:44.056381+0000","last_clean_scrub_stamp":"2024-04-26T10:37:44.056381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:26.047330+0000","scrub_duration":0.016160926999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.015997+0000","last_change":"2024-04-26T10:38:03.016124+0000","last_active":"2024-04-26T10:38:03.015997+0000","last_peered":"2024-04-26T10:38:03.015997+0000","last_clean":"2024-04-26T10:38:03.015997+0000","last_became_active":"2024-04-26T10:37:23.270593+0000","last_became_peered":"2024-04-26T10:37:23.270593+0000","last_unstale":"2024-04-26T10:38:03.015997+0000","last_undegraded":"2024-04-26T10:38:03.015997+0000","last_fullsized":"2024-04-26T10:38:03.015997+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.015972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.015972+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.015972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:42.504031+0000","scrub_duration":0.001820241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283538+0000","last_change":"2024-04-26T10:37:23.271640+0000","last_active":"2024-04-26T10:37:29.283538+0000","last_peered":"2024-04-26T10:37:29.283538+0000","last_clean":"2024-04-26T10:37:29.283538+0000","last_became_active":"2024-04-26T10:37:23.270393+0000","last_became_peered":"2024-04-26T10:37:23.270393+0000","last_unstale":"2024-04-26T10:37:29.283538+0000","last_undegraded":"2024-04-26T10:37:29.283538+0000","last_fullsized":"2024-04-26T10:37:29.283538+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283332+0000","last_change":"2024-04-26T10:37:23.268381+0000","last_active":"2024-04-26T10:37:29.283332+0000","last_peered":"2024-04-26T10:37:29.283332+0000","last_clean":"2024-04-26T10:37:29.283332+0000","last_became_active":"2024-04-26T10:37:23.267296+0000","last_became_peered":"2024-04-26T10:37:23.267296+0000","last_unstale":"2024-04-26T10:37:29.283332+0000","last_undegraded":"2024-04-26T10:37:29.283332+0000","last_fullsized":"2024-04-26T10:37:29.283332+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302677+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:37:37.302677+0000","last_peered":"2024-04-26T10:37:37.302677+0000","last_clean":"2024-04-26T10:37:37.302677+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:37:37.302677+0000","last_undegraded":"2024-04-26T10:37:37.302677+0000","last_fullsized":"2024-04-26T10:37:37.302677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:45.073035+0000","last_change":"2024-04-26T10:37:45.073164+0000","last_active":"2024-04-26T10:37:45.073035+0000","last_peered":"2024-04-26T10:37:45.073035+0000","last_clean":"2024-04-26T10:37:45.073035+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:37:45.073035+0000","last_undegraded":"2024-04-26T10:37:45.073035+0000","last_fullsized":"2024-04-26T10:37:45.073035+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:45.073006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:45.073006+0000","last_clean_scrub_stamp":"2024-04-26T10:37:45.073006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:23.891265+0000","scrub_duration":0.001902131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:48.878670+0000","last_change":"2024-04-26T10:37:48.878771+0000","last_active":"2024-04-26T10:37:48.878670+0000","last_peered":"2024-04-26T10:37:48.878670+0000","last_clean":"2024-04-26T10:37:48.878670+0000","last_became_active":"2024-04-26T10:37:23.273996+0000","last_became_peered":"2024-04-26T10:37:23.273996+0000","last_unstale":"2024-04-26T10:37:48.878670+0000","last_undegraded":"2024-04-26T10:37:48.878670+0000","last_fullsized":"2024-04-26T10:37:48.878670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:48.878645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:48.878645+0000","last_clean_scrub_stamp":"2024-04-26T10:37:48.878645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:14.620591+0000","scrub_duration":0.017302161999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:02.964860+0000","last_change":"2024-04-26T10:38:02.964962+0000","last_active":"2024-04-26T10:38:02.964860+0000","last_peered":"2024-04-26T10:38:02.964860+0000","last_clean":"2024-04-26T10:38:02.964860+0000","last_became_active":"2024-04-26T10:37:23.273290+0000","last_became_peered":"2024-04-26T10:37:23.273290+0000","last_unstale":"2024-04-26T10:38:02.964860+0000","last_undegraded":"2024-04-26T10:38:02.964860+0000","last_fullsized":"2024-04-26T10:38:02.964860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:02.964836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:02.964836+0000","last_clean_scrub_stamp":"2024-04-26T10:38:02.964836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:19.028065+0000","scrub_duration":0.0018081550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887837+0000","last_change":"2024-04-26T10:34:14.507648+0000","last_active":"2024-04-26T10:37:30.887837+0000","last_peered":"2024-04-26T10:37:30.887837+0000","last_clean":"2024-04-26T10:37:30.887837+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:37:30.887837+0000","last_undegraded":"2024-04-26T10:37:30.887837+0000","last_fullsized":"2024-04-26T10:37:30.887837+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283950+0000","last_change":"2024-04-26T10:37:23.271722+0000","last_active":"2024-04-26T10:37:29.283950+0000","last_peered":"2024-04-26T10:37:29.283950+0000","last_clean":"2024-04-26T10:37:29.283950+0000","last_became_active":"2024-04-26T10:37:23.269722+0000","last_became_peered":"2024-04-26T10:37:23.269722+0000","last_unstale":"2024-04-26T10:37:29.283950+0000","last_undegraded":"2024-04-26T10:37:29.283950+0000","last_fullsized":"2024-04-26T10:37:29.283950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:13.078246+0000","last_change":"2024-04-26T10:38:13.078391+0000","last_active":"2024-04-26T10:38:13.078246+0000","last_peered":"2024-04-26T10:38:13.078246+0000","last_clean":"2024-04-26T10:38:13.078246+0000","last_became_active":"2024-04-26T10:37:23.270852+0000","last_became_peered":"2024-04-26T10:37:23.270852+0000","last_unstale":"2024-04-26T10:38:13.078246+0000","last_undegraded":"2024-04-26T10:38:13.078246+0000","last_fullsized":"2024-04-26T10:38:13.078246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:13.078224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:13.078224+0000","last_clean_scrub_stamp":"2024-04-26T10:38:13.078224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:09.840624+0000","scrub_duration":0.0018370000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:38.963069+0000","last_change":"2024-04-26T10:37:38.963200+0000","last_active":"2024-04-26T10:37:38.963069+0000","last_peered":"2024-04-26T10:37:38.963069+0000","last_clean":"2024-04-26T10:37:38.963069+0000","last_became_active":"2024-04-26T10:37:23.268640+0000","last_became_peered":"2024-04-26T10:37:23.268640+0000","last_unstale":"2024-04-26T10:37:38.963069+0000","last_undegraded":"2024-04-26T10:37:38.963069+0000","last_fullsized":"2024-04-26T10:37:38.963069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:38.963045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:38.963045+0000","last_clean_scrub_stamp":"2024-04-26T10:37:38.963045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:17.672777+0000","scrub_duration":0.0018662049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.177542+0000","last_change":"2024-04-26T10:37:28.282247+0000","last_active":"2024-04-26T10:37:30.177542+0000","last_peered":"2024-04-26T10:37:30.177542+0000","last_clean":"2024-04-26T10:37:30.177542+0000","last_became_active":"2024-04-26T10:37:28.281510+0000","last_became_peered":"2024-04-26T10:37:28.281510+0000","last_unstale":"2024-04-26T10:37:30.177542+0000","last_undegraded":"2024-04-26T10:37:30.177542+0000","last_fullsized":"2024-04-26T10:37:30.177542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:07.970695+0000","last_change":"2024-04-26T10:38:07.970813+0000","last_active":"2024-04-26T10:38:07.970695+0000","last_peered":"2024-04-26T10:38:07.970695+0000","last_clean":"2024-04-26T10:38:07.970695+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:38:07.970695+0000","last_undegraded":"2024-04-26T10:38:07.970695+0000","last_fullsized":"2024-04-26T10:38:07.970695+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:07.970664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:07.970664+0000","last_clean_scrub_stamp":"2024-04-26T10:38:07.970664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:55.346373+0000","scrub_duration":0.001805283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:38.715625+0000","last_change":"2024-04-26T10:37:38.715778+0000","last_active":"2024-04-26T10:37:38.715625+0000","last_peered":"2024-04-26T10:37:38.715625+0000","last_clean":"2024-04-26T10:37:38.715625+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:37:38.715625+0000","last_undegraded":"2024-04-26T10:37:38.715625+0000","last_fullsized":"2024-04-26T10:37:38.715625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:38.715602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:38.715602+0000","last_clean_scrub_stamp":"2024-04-26T10:37:38.715602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:48.931629+0000","scrub_duration":0.028191391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284226+0000","last_change":"2024-04-26T10:37:23.273700+0000","last_active":"2024-04-26T10:37:29.284226+0000","last_peered":"2024-04-26T10:37:29.284226+0000","last_clean":"2024-04-26T10:37:29.284226+0000","last_became_active":"2024-04-26T10:37:23.272964+0000","last_became_peered":"2024-04-26T10:37:23.272964+0000","last_unstale":"2024-04-26T10:37:29.284226+0000","last_undegraded":"2024-04-26T10:37:29.284226+0000","last_fullsized":"2024-04-26T10:37:29.284226+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284064+0000","last_change":"2024-04-26T10:37:23.274112+0000","last_active":"2024-04-26T10:37:29.284064+0000","last_peered":"2024-04-26T10:37:29.284064+0000","last_clean":"2024-04-26T10:37:29.284064+0000","last_became_active":"2024-04-26T10:37:23.271967+0000","last_became_peered":"2024-04-26T10:37:23.271967+0000","last_unstale":"2024-04-26T10:37:29.284064+0000","last_undegraded":"2024-04-26T10:37:29.284064+0000","last_fullsized":"2024-04-26T10:37:29.284064+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887950+0000","last_change":"2024-04-26T10:37:23.268432+0000","last_active":"2024-04-26T10:37:30.887950+0000","last_peered":"2024-04-26T10:37:30.887950+0000","last_clean":"2024-04-26T10:37:30.887950+0000","last_became_active":"2024-04-26T10:37:23.267766+0000","last_became_peered":"2024-04-26T10:37:23.267766+0000","last_unstale":"2024-04-26T10:37:30.887950+0000","last_undegraded":"2024-04-26T10:37:30.887950+0000","last_fullsized":"2024-04-26T10:37:30.887950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:13.618361+0000","last_change":"2024-04-26T10:38:13.618466+0000","last_active":"2024-04-26T10:38:13.618361+0000","last_peered":"2024-04-26T10:38:13.618361+0000","last_clean":"2024-04-26T10:38:13.618361+0000","last_became_active":"2024-04-26T10:37:23.269861+0000","last_became_peered":"2024-04-26T10:37:23.269861+0000","last_unstale":"2024-04-26T10:38:13.618361+0000","last_undegraded":"2024-04-26T10:38:13.618361+0000","last_fullsized":"2024-04-26T10:38:13.618361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:13.618337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:13.618337+0000","last_clean_scrub_stamp":"2024-04-26T10:38:13.618337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:51.339204+0000","scrub_duration":0.0019172900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887915+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:37:30.887915+0000","last_peered":"2024-04-26T10:37:30.887915+0000","last_clean":"2024-04-26T10:37:30.887915+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:37:30.887915+0000","last_undegraded":"2024-04-26T10:37:30.887915+0000","last_fullsized":"2024-04-26T10:37:30.887915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888514+0000","last_change":"2024-04-26T10:37:23.272702+0000","last_active":"2024-04-26T10:37:30.888514+0000","last_peered":"2024-04-26T10:37:30.888514+0000","last_clean":"2024-04-26T10:37:30.888514+0000","last_became_active":"2024-04-26T10:37:23.272218+0000","last_became_peered":"2024-04-26T10:37:23.272218+0000","last_unstale":"2024-04-26T10:37:30.888514+0000","last_undegraded":"2024-04-26T10:37:30.888514+0000","last_fullsized":"2024-04-26T10:37:30.888514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284266+0000","last_change":"2024-04-26T10:37:23.271247+0000","last_active":"2024-04-26T10:37:29.284266+0000","last_peered":"2024-04-26T10:37:29.284266+0000","last_clean":"2024-04-26T10:37:29.284266+0000","last_became_active":"2024-04-26T10:37:23.270919+0000","last_became_peered":"2024-04-26T10:37:23.270919+0000","last_unstale":"2024-04-26T10:37:29.284266+0000","last_undegraded":"2024-04-26T10:37:29.284266+0000","last_fullsized":"2024-04-26T10:37:29.284266+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284349+0000","last_change":"2024-04-26T10:37:23.275081+0000","last_active":"2024-04-26T10:37:29.284349+0000","last_peered":"2024-04-26T10:37:29.284349+0000","last_clean":"2024-04-26T10:37:29.284349+0000","last_became_active":"2024-04-26T10:37:23.273821+0000","last_became_peered":"2024-04-26T10:37:23.273821+0000","last_unstale":"2024-04-26T10:37:29.284349+0000","last_undegraded":"2024-04-26T10:37:29.284349+0000","last_fullsized":"2024-04-26T10:37:29.284349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786495+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:37:36.786495+0000","last_peered":"2024-04-26T10:37:36.786495+0000","last_clean":"2024-04-26T10:37:36.786495+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:37:36.786495+0000","last_undegraded":"2024-04-26T10:37:36.786495+0000","last_fullsized":"2024-04-26T10:37:36.786495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786726+0000","last_change":"2024-04-26T10:37:23.273494+0000","last_active":"2024-04-26T10:37:36.786726+0000","last_peered":"2024-04-26T10:37:36.786726+0000","last_clean":"2024-04-26T10:37:36.786726+0000","last_became_active":"2024-04-26T10:37:23.272837+0000","last_became_peered":"2024-04-26T10:37:23.272837+0000","last_unstale":"2024-04-26T10:37:36.786726+0000","last_undegraded":"2024-04-26T10:37:36.786726+0000","last_fullsized":"2024-04-26T10:37:36.786726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302346+0000","last_change":"2024-04-26T10:37:23.269480+0000","last_active":"2024-04-26T10:37:37.302346+0000","last_peered":"2024-04-26T10:37:37.302346+0000","last_clean":"2024-04-26T10:37:37.302346+0000","last_became_active":"2024-04-26T10:37:23.269197+0000","last_became_peered":"2024-04-26T10:37:23.269197+0000","last_unstale":"2024-04-26T10:37:37.302346+0000","last_undegraded":"2024-04-26T10:37:37.302346+0000","last_fullsized":"2024-04-26T10:37:37.302346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.674963+0000","last_change":"2024-04-26T10:37:37.675146+0000","last_active":"2024-04-26T10:37:37.674963+0000","last_peered":"2024-04-26T10:37:37.674963+0000","last_clean":"2024-04-26T10:37:37.674963+0000","last_became_active":"2024-04-26T10:37:28.283421+0000","last_became_peered":"2024-04-26T10:37:28.283421+0000","last_unstale":"2024-04-26T10:37:37.674963+0000","last_undegraded":"2024-04-26T10:37:37.674963+0000","last_fullsized":"2024-04-26T10:37:37.674963+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:37.674937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:37.674937+0000","last_clean_scrub_stamp":"2024-04-26T10:37:37.674937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:45.188074+0000","scrub_duration":0.0017282650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302337+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:37:37.302337+0000","last_peered":"2024-04-26T10:37:37.302337+0000","last_clean":"2024-04-26T10:37:37.302337+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:37:37.302337+0000","last_undegraded":"2024-04-26T10:37:37.302337+0000","last_fullsized":"2024-04-26T10:37:37.302337+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888683+0000","last_change":"2024-04-26T10:37:23.273035+0000","last_active":"2024-04-26T10:37:30.888683+0000","last_peered":"2024-04-26T10:37:30.888683+0000","last_clean":"2024-04-26T10:37:30.888683+0000","last_became_active":"2024-04-26T10:37:23.272666+0000","last_became_peered":"2024-04-26T10:37:23.272666+0000","last_unstale":"2024-04-26T10:37:30.888683+0000","last_undegraded":"2024-04-26T10:37:30.888683+0000","last_fullsized":"2024-04-26T10:37:30.888683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302305+0000","last_change":"2024-04-26T10:37:23.271100+0000","last_active":"2024-04-26T10:37:37.302305+0000","last_peered":"2024-04-26T10:37:37.302305+0000","last_clean":"2024-04-26T10:37:37.302305+0000","last_became_active":"2024-04-26T10:37:23.270725+0000","last_became_peered":"2024-04-26T10:37:23.270725+0000","last_unstale":"2024-04-26T10:37:37.302305+0000","last_undegraded":"2024-04-26T10:37:37.302305+0000","last_fullsized":"2024-04-26T10:37:37.302305+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.478595+0000","last_change":"2024-04-26T10:38:03.478731+0000","last_active":"2024-04-26T10:38:03.478595+0000","last_peered":"2024-04-26T10:38:03.478595+0000","last_clean":"2024-04-26T10:38:03.478595+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:38:03.478595+0000","last_undegraded":"2024-04-26T10:38:03.478595+0000","last_fullsized":"2024-04-26T10:38:03.478595+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.478570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.478570+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.478570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:49.705887+0000","scrub_duration":0.00149917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:55.908127+0000","last_change":"2024-04-26T10:37:55.908269+0000","last_active":"2024-04-26T10:37:55.908127+0000","last_peered":"2024-04-26T10:37:55.908127+0000","last_clean":"2024-04-26T10:37:55.908127+0000","last_became_active":"2024-04-26T10:37:23.269371+0000","last_became_peered":"2024-04-26T10:37:23.269371+0000","last_unstale":"2024-04-26T10:37:55.908127+0000","last_undegraded":"2024-04-26T10:37:55.908127+0000","last_fullsized":"2024-04-26T10:37:55.908127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:55.908102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:55.908102+0000","last_clean_scrub_stamp":"2024-04-26T10:37:55.908102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:11.319524+0000","scrub_duration":0.0019603670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:35.178199+0000","last_change":"2024-04-26T10:37:23.269749+0000","last_active":"2024-04-26T10:37:35.178199+0000","last_peered":"2024-04-26T10:37:35.178199+0000","last_clean":"2024-04-26T10:37:35.178199+0000","last_became_active":"2024-04-26T10:37:23.269344+0000","last_became_peered":"2024-04-26T10:37:23.269344+0000","last_unstale":"2024-04-26T10:37:35.178199+0000","last_undegraded":"2024-04-26T10:37:35.178199+0000","last_fullsized":"2024-04-26T10:37:35.178199+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888069+0000","last_change":"2024-04-26T10:37:23.273205+0000","last_active":"2024-04-26T10:37:30.888069+0000","last_peered":"2024-04-26T10:37:30.888069+0000","last_clean":"2024-04-26T10:37:30.888069+0000","last_became_active":"2024-04-26T10:37:23.272731+0000","last_became_peered":"2024-04-26T10:37:23.272731+0000","last_unstale":"2024-04-26T10:37:30.888069+0000","last_undegraded":"2024-04-26T10:37:30.888069+0000","last_fullsized":"2024-04-26T10:37:30.888069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:46.569879+0000","last_change":"2024-04-26T10:37:46.570003+0000","last_active":"2024-04-26T10:37:46.569879+0000","last_peered":"2024-04-26T10:37:46.569879+0000","last_clean":"2024-04-26T10:37:46.569879+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:37:46.569879+0000","last_undegraded":"2024-04-26T10:37:46.569879+0000","last_fullsized":"2024-04-26T10:37:46.569879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:46.569855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:46.569855+0000","last_clean_scrub_stamp":"2024-04-26T10:37:46.569855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:12.891140+0000","scrub_duration":0.00144177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":99,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284123+0000","last_change":"2024-04-26T10:37:23.272627+0000","last_active":"2024-04-26T10:37:29.284123+0000","last_peered":"2024-04-26T10:37:29.284123+0000","last_clean":"2024-04-26T10:37:29.284123+0000","last_became_active":"2024-04-26T10:37:23.269968+0000","last_became_peered":"2024-04-26T10:37:23.269968+0000","last_unstale":"2024-04-26T10:37:29.284123+0000","last_undegraded":"2024-04-26T10:37:29.284123+0000","last_fullsized":"2024-04-26T10:37:29.284123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:39.919590+0000","last_change":"2024-04-26T10:37:39.919719+0000","last_active":"2024-04-26T10:37:39.919590+0000","last_peered":"2024-04-26T10:37:39.919590+0000","last_clean":"2024-04-26T10:37:39.919590+0000","last_became_active":"2024-04-26T10:37:23.274045+0000","last_became_peered":"2024-04-26T10:37:23.274045+0000","last_unstale":"2024-04-26T10:37:39.919590+0000","last_undegraded":"2024-04-26T10:37:39.919590+0000","last_fullsized":"2024-04-26T10:37:39.919590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:39.919570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:39.919570+0000","last_clean_scrub_stamp":"2024-04-26T10:37:39.919570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:44.433055+0000","scrub_duration":0.001537217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283720+0000","last_change":"2024-04-26T10:37:23.273798+0000","last_active":"2024-04-26T10:37:29.283720+0000","last_peered":"2024-04-26T10:37:29.283720+0000","last_clean":"2024-04-26T10:37:29.283720+0000","last_became_active":"2024-04-26T10:37:23.269775+0000","last_became_peered":"2024-04-26T10:37:23.269775+0000","last_unstale":"2024-04-26T10:37:29.283720+0000","last_undegraded":"2024-04-26T10:37:29.283720+0000","last_fullsized":"2024-04-26T10:37:29.283720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:04.000852+0000","last_change":"2024-04-26T10:38:04.000953+0000","last_active":"2024-04-26T10:38:04.000852+0000","last_peered":"2024-04-26T10:38:04.000852+0000","last_clean":"2024-04-26T10:38:04.000852+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:38:04.000852+0000","last_undegraded":"2024-04-26T10:38:04.000852+0000","last_fullsized":"2024-04-26T10:38:04.000852+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:04.000827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:04.000827+0000","last_clean_scrub_stamp":"2024-04-26T10:38:04.000827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:34.824818+0000","scrub_duration":0.0020431870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:35.178229+0000","last_change":"2024-04-26T10:37:23.270164+0000","last_active":"2024-04-26T10:37:35.178229+0000","last_peered":"2024-04-26T10:37:35.178229+0000","last_clean":"2024-04-26T10:37:35.178229+0000","last_became_active":"2024-04-26T10:37:23.269537+0000","last_became_peered":"2024-04-26T10:37:23.269537+0000","last_unstale":"2024-04-26T10:37:35.178229+0000","last_undegraded":"2024-04-26T10:37:35.178229+0000","last_fullsized":"2024-04-26T10:37:35.178229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888133+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:37:30.888133+0000","last_peered":"2024-04-26T10:37:30.888133+0000","last_clean":"2024-04-26T10:37:30.888133+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:37:30.888133+0000","last_undegraded":"2024-04-26T10:37:30.888133+0000","last_fullsized":"2024-04-26T10:37:30.888133+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887513+0000","last_change":"2024-04-26T10:37:23.268114+0000","last_active":"2024-04-26T10:37:30.887513+0000","last_peered":"2024-04-26T10:37:30.887513+0000","last_clean":"2024-04-26T10:37:30.887513+0000","last_became_active":"2024-04-26T10:37:23.267121+0000","last_became_peered":"2024-04-26T10:37:23.267121+0000","last_unstale":"2024-04-26T10:37:30.887513+0000","last_undegraded":"2024-04-26T10:37:30.887513+0000","last_fullsized":"2024-04-26T10:37:30.887513+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:09.576502+0000","last_change":"2024-04-26T10:38:09.576610+0000","last_active":"2024-04-26T10:38:09.576502+0000","last_peered":"2024-04-26T10:38:09.576502+0000","last_clean":"2024-04-26T10:38:09.576502+0000","last_became_active":"2024-04-26T10:37:28.281512+0000","last_became_peered":"2024-04-26T10:37:28.281512+0000","last_unstale":"2024-04-26T10:38:09.576502+0000","last_undegraded":"2024-04-26T10:38:09.576502+0000","last_fullsized":"2024-04-26T10:38:09.576502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:09.576479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:09.576479+0000","last_clean_scrub_stamp":"2024-04-26T10:38:09.576479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:58.472401+0000","scrub_duration":0.0016694769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283487+0000","last_change":"2024-04-26T10:37:23.268184+0000","last_active":"2024-04-26T10:37:29.283487+0000","last_peered":"2024-04-26T10:37:29.283487+0000","last_clean":"2024-04-26T10:37:29.283487+0000","last_became_active":"2024-04-26T10:37:23.266377+0000","last_became_peered":"2024-04-26T10:37:23.266377+0000","last_unstale":"2024-04-26T10:37:29.283487+0000","last_undegraded":"2024-04-26T10:37:29.283487+0000","last_fullsized":"2024-04-26T10:37:29.283487+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:00.539928+0000","last_change":"2024-04-26T10:38:00.540104+0000","last_active":"2024-04-26T10:38:00.539928+0000","last_peered":"2024-04-26T10:38:00.539928+0000","last_clean":"2024-04-26T10:38:00.539928+0000","last_became_active":"2024-04-26T10:37:23.271752+0000","last_became_peered":"2024-04-26T10:37:23.271752+0000","last_unstale":"2024-04-26T10:38:00.539928+0000","last_undegraded":"2024-04-26T10:38:00.539928+0000","last_fullsized":"2024-04-26T10:38:00.539928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:00.539869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:00.539869+0000","last_clean_scrub_stamp":"2024-04-26T10:38:00.539869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:46.107019+0000","scrub_duration":0.052375984,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284617+0000","last_change":"2024-04-26T10:37:23.273840+0000","last_active":"2024-04-26T10:37:29.284617+0000","last_peered":"2024-04-26T10:37:29.284617+0000","last_clean":"2024-04-26T10:37:29.284617+0000","last_became_active":"2024-04-26T10:37:23.272156+0000","last_became_peered":"2024-04-26T10:37:23.272156+0000","last_unstale":"2024-04-26T10:37:29.284617+0000","last_undegraded":"2024-04-26T10:37:29.284617+0000","last_fullsized":"2024-04-26T10:37:29.284617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:09.993382+0000","last_change":"2024-04-26T10:38:09.993498+0000","last_active":"2024-04-26T10:38:09.993382+0000","last_peered":"2024-04-26T10:38:09.993382+0000","last_clean":"2024-04-26T10:38:09.993382+0000","last_became_active":"2024-04-26T10:37:23.267717+0000","last_became_peered":"2024-04-26T10:37:23.267717+0000","last_unstale":"2024-04-26T10:38:09.993382+0000","last_undegraded":"2024-04-26T10:38:09.993382+0000","last_fullsized":"2024-04-26T10:38:09.993382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:09.993363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:09.993363+0000","last_clean_scrub_stamp":"2024-04-26T10:38:09.993363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:57.793706+0000","scrub_duration":0.0019586830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888511+0000","last_change":"2024-04-26T10:37:23.273179+0000","last_active":"2024-04-26T10:37:30.888511+0000","last_peered":"2024-04-26T10:37:30.888511+0000","last_clean":"2024-04-26T10:37:30.888511+0000","last_became_active":"2024-04-26T10:37:23.272260+0000","last_became_peered":"2024-04-26T10:37:23.272260+0000","last_unstale":"2024-04-26T10:37:30.888511+0000","last_undegraded":"2024-04-26T10:37:30.888511+0000","last_fullsized":"2024-04-26T10:37:30.888511+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887628+0000","last_change":"2024-04-26T10:34:14.505435+0000","last_active":"2024-04-26T10:37:30.887628+0000","last_peered":"2024-04-26T10:37:30.887628+0000","last_clean":"2024-04-26T10:37:30.887628+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:37:30.887628+0000","last_undegraded":"2024-04-26T10:37:30.887628+0000","last_fullsized":"2024-04-26T10:37:30.887628+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'2","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:15.087666+0000","last_change":"2024-04-26T10:38:15.087778+0000","last_active":"2024-04-26T10:38:15.087666+0000","last_peered":"2024-04-26T10:38:15.087666+0000","last_clean":"2024-04-26T10:38:15.087666+0000","last_became_active":"2024-04-26T10:37:23.268441+0000","last_became_peered":"2024-04-26T10:37:23.268441+0000","last_unstale":"2024-04-26T10:38:15.087666+0000","last_undegraded":"2024-04-26T10:38:15.087666+0000","last_fullsized":"2024-04-26T10:38:15.087666+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T10:38:15.087643+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T10:38:15.087643+0000","last_clean_scrub_stamp":"2024-04-26T10:38:15.087643+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:42.284590+0000","scrub_duration":0.003756396,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:12.046677+0000","last_change":"2024-04-26T10:38:12.046827+0000","last_active":"2024-04-26T10:38:12.046677+0000","last_peered":"2024-04-26T10:38:12.046677+0000","last_clean":"2024-04-26T10:38:12.046677+0000","last_became_active":"2024-04-26T10:37:23.268451+0000","last_became_peered":"2024-04-26T10:37:23.268451+0000","last_unstale":"2024-04-26T10:38:12.046677+0000","last_undegraded":"2024-04-26T10:38:12.046677+0000","last_fullsized":"2024-04-26T10:38:12.046677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:12.046640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:12.046640+0000","last_clean_scrub_stamp":"2024-04-26T10:38:12.046640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:04.521493+0000","scrub_duration":0.002019739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284314+0000","last_change":"2024-04-26T10:37:23.273635+0000","last_active":"2024-04-26T10:37:29.284314+0000","last_peered":"2024-04-26T10:37:29.284314+0000","last_clean":"2024-04-26T10:37:29.284314+0000","last_became_active":"2024-04-26T10:37:23.272938+0000","last_became_peered":"2024-04-26T10:37:23.272938+0000","last_unstale":"2024-04-26T10:37:29.284314+0000","last_undegraded":"2024-04-26T10:37:29.284314+0000","last_fullsized":"2024-04-26T10:37:29.284314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:42.638376+0000","last_change":"2024-04-26T10:37:42.638539+0000","last_active":"2024-04-26T10:37:42.638376+0000","last_peered":"2024-04-26T10:37:42.638376+0000","last_clean":"2024-04-26T10:37:42.638376+0000","last_became_active":"2024-04-26T10:37:23.276957+0000","last_became_peered":"2024-04-26T10:37:23.276957+0000","last_unstale":"2024-04-26T10:37:42.638376+0000","last_undegraded":"2024-04-26T10:37:42.638376+0000","last_fullsized":"2024-04-26T10:37:42.638376+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:42.638352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:42.638352+0000","last_clean_scrub_stamp":"2024-04-26T10:37:42.638352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:15.896041+0000","scrub_duration":0.027944383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283904+0000","last_change":"2024-04-26T10:37:23.277440+0000","last_active":"2024-04-26T10:37:29.283904+0000","last_peered":"2024-04-26T10:37:29.283904+0000","last_clean":"2024-04-26T10:37:29.283904+0000","last_became_active":"2024-04-26T10:37:23.277037+0000","last_became_peered":"2024-04-26T10:37:23.277037+0000","last_unstale":"2024-04-26T10:37:29.283904+0000","last_undegraded":"2024-04-26T10:37:29.283904+0000","last_fullsized":"2024-04-26T10:37:29.283904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283803+0000","last_change":"2024-04-26T10:37:23.270454+0000","last_active":"2024-04-26T10:37:29.283803+0000","last_peered":"2024-04-26T10:37:29.283803+0000","last_clean":"2024-04-26T10:37:29.283803+0000","last_became_active":"2024-04-26T10:37:23.269473+0000","last_became_peered":"2024-04-26T10:37:23.269473+0000","last_unstale":"2024-04-26T10:37:29.283803+0000","last_undegraded":"2024-04-26T10:37:29.283803+0000","last_fullsized":"2024-04-26T10:37:29.283803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283674+0000","last_change":"2024-04-26T10:37:23.267503+0000","last_active":"2024-04-26T10:37:29.283674+0000","last_peered":"2024-04-26T10:37:29.283674+0000","last_clean":"2024-04-26T10:37:29.283674+0000","last_became_active":"2024-04-26T10:37:23.267235+0000","last_became_peered":"2024-04-26T10:37:23.267235+0000","last_unstale":"2024-04-26T10:37:29.283674+0000","last_undegraded":"2024-04-26T10:37:29.283674+0000","last_fullsized":"2024-04-26T10:37:29.283674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284323+0000","last_change":"2024-04-26T10:37:23.274693+0000","last_active":"2024-04-26T10:37:29.284323+0000","last_peered":"2024-04-26T10:37:29.284323+0000","last_clean":"2024-04-26T10:37:29.284323+0000","last_became_active":"2024-04-26T10:37:23.272111+0000","last_became_peered":"2024-04-26T10:37:23.272111+0000","last_unstale":"2024-04-26T10:37:29.284323+0000","last_undegraded":"2024-04-26T10:37:29.284323+0000","last_fullsized":"2024-04-26T10:37:29.284323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887722+0000","last_change":"2024-04-26T10:37:23.274381+0000","last_active":"2024-04-26T10:37:30.887722+0000","last_peered":"2024-04-26T10:37:30.887722+0000","last_clean":"2024-04-26T10:37:30.887722+0000","last_became_active":"2024-04-26T10:37:23.273867+0000","last_became_peered":"2024-04-26T10:37:23.273867+0000","last_unstale":"2024-04-26T10:37:30.887722+0000","last_undegraded":"2024-04-26T10:37:30.887722+0000","last_fullsized":"2024-04-26T10:37:30.887722+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:57.878941+0000","last_change":"2024-04-26T10:37:57.879044+0000","last_active":"2024-04-26T10:37:57.878941+0000","last_peered":"2024-04-26T10:37:57.878941+0000","last_clean":"2024-04-26T10:37:57.878941+0000","last_became_active":"2024-04-26T10:37:23.272569+0000","last_became_peered":"2024-04-26T10:37:23.272569+0000","last_unstale":"2024-04-26T10:37:57.878941+0000","last_undegraded":"2024-04-26T10:37:57.878941+0000","last_fullsized":"2024-04-26T10:37:57.878941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:57.878919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:57.878919+0000","last_clean_scrub_stamp":"2024-04-26T10:37:57.878919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:02.166486+0000","scrub_duration":0.0020039089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887566+0000","last_change":"2024-04-26T10:34:14.506435+0000","last_active":"2024-04-26T10:37:30.887566+0000","last_peered":"2024-04-26T10:37:30.887566+0000","last_clean":"2024-04-26T10:37:30.887566+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:37:30.887566+0000","last_undegraded":"2024-04-26T10:37:30.887566+0000","last_fullsized":"2024-04-26T10:37:30.887566+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284388+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:37:29.284388+0000","last_peered":"2024-04-26T10:37:29.284388+0000","last_clean":"2024-04-26T10:37:29.284388+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:37:29.284388+0000","last_undegraded":"2024-04-26T10:37:29.284388+0000","last_fullsized":"2024-04-26T10:37:29.284388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.177479+0000","last_change":"2024-04-26T10:37:28.282767+0000","last_active":"2024-04-26T10:37:30.177479+0000","last_peered":"2024-04-26T10:37:30.177479+0000","last_clean":"2024-04-26T10:37:30.177479+0000","last_became_active":"2024-04-26T10:37:28.282419+0000","last_became_peered":"2024-04-26T10:37:28.282419+0000","last_unstale":"2024-04-26T10:37:30.177479+0000","last_undegraded":"2024-04-26T10:37:30.177479+0000","last_fullsized":"2024-04-26T10:37:30.177479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:47.889504+0000","last_change":"2024-04-26T10:37:47.889608+0000","last_active":"2024-04-26T10:37:47.889504+0000","last_peered":"2024-04-26T10:37:47.889504+0000","last_clean":"2024-04-26T10:37:47.889504+0000","last_became_active":"2024-04-26T10:37:23.273114+0000","last_became_peered":"2024-04-26T10:37:23.273114+0000","last_unstale":"2024-04-26T10:37:47.889504+0000","last_undegraded":"2024-04-26T10:37:47.889504+0000","last_fullsized":"2024-04-26T10:37:47.889504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:47.889480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:47.889480+0000","last_clean_scrub_stamp":"2024-04-26T10:37:47.889480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:38.351949+0000","scrub_duration":0.0018432660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:00.037196+0000","last_change":"2024-04-26T10:38:00.037320+0000","last_active":"2024-04-26T10:38:00.037196+0000","last_peered":"2024-04-26T10:38:00.037196+0000","last_clean":"2024-04-26T10:38:00.037196+0000","last_became_active":"2024-04-26T10:37:23.267319+0000","last_became_peered":"2024-04-26T10:37:23.267319+0000","last_unstale":"2024-04-26T10:38:00.037196+0000","last_undegraded":"2024-04-26T10:38:00.037196+0000","last_fullsized":"2024-04-26T10:38:00.037196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:00.037154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:00.037154+0000","last_clean_scrub_stamp":"2024-04-26T10:38:00.037154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:01.442829+0000","scrub_duration":0.0020604550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283586+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:29.283586+0000","last_peered":"2024-04-26T10:37:29.283586+0000","last_clean":"2024-04-26T10:37:29.283586+0000","last_became_active":"2024-04-26T10:37:23.266332+0000","last_became_peered":"2024-04-26T10:37:23.266332+0000","last_unstale":"2024-04-26T10:37:29.283586+0000","last_undegraded":"2024-04-26T10:37:29.283586+0000","last_fullsized":"2024-04-26T10:37:29.283586+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283846+0000","last_change":"2024-04-26T10:37:23.272871+0000","last_active":"2024-04-26T10:37:29.283846+0000","last_peered":"2024-04-26T10:37:29.283846+0000","last_clean":"2024-04-26T10:37:29.283846+0000","last_became_active":"2024-04-26T10:37:23.269657+0000","last_became_peered":"2024-04-26T10:37:23.269657+0000","last_unstale":"2024-04-26T10:37:29.283846+0000","last_undegraded":"2024-04-26T10:37:29.283846+0000","last_fullsized":"2024-04-26T10:37:29.283846+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:41.612812+0000","last_change":"2024-04-26T10:37:41.612919+0000","last_active":"2024-04-26T10:37:41.612812+0000","last_peered":"2024-04-26T10:37:41.612812+0000","last_clean":"2024-04-26T10:37:41.612812+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:37:41.612812+0000","last_undegraded":"2024-04-26T10:37:41.612812+0000","last_fullsized":"2024-04-26T10:37:41.612812+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:41.612787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:41.612787+0000","last_clean_scrub_stamp":"2024-04-26T10:37:41.612787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:15.886238+0000","scrub_duration":0.001521445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283587+0000","last_change":"2024-04-26T10:32:46.555242+0000","last_active":"2024-04-26T10:37:29.283587+0000","last_peered":"2024-04-26T10:37:29.283587+0000","last_clean":"2024-04-26T10:37:29.283587+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:37:29.283587+0000","last_undegraded":"2024-04-26T10:37:29.283587+0000","last_fullsized":"2024-04-26T10:37:29.283587+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887687+0000","last_change":"2024-04-26T10:37:23.267893+0000","last_active":"2024-04-26T10:37:30.887687+0000","last_peered":"2024-04-26T10:37:30.887687+0000","last_clean":"2024-04-26T10:37:30.887687+0000","last_became_active":"2024-04-26T10:37:23.267595+0000","last_became_peered":"2024-04-26T10:37:23.267595+0000","last_unstale":"2024-04-26T10:37:30.887687+0000","last_undegraded":"2024-04-26T10:37:30.887687+0000","last_fullsized":"2024-04-26T10:37:30.887687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284517+0000","last_change":"2024-04-26T10:34:14.511363+0000","last_active":"2024-04-26T10:37:29.284517+0000","last_peered":"2024-04-26T10:37:29.284517+0000","last_clean":"2024-04-26T10:37:29.284517+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:37:29.284517+0000","last_undegraded":"2024-04-26T10:37:29.284517+0000","last_fullsized":"2024-04-26T10:37:29.284517+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283704+0000","last_change":"2024-04-26T10:37:23.273754+0000","last_active":"2024-04-26T10:37:29.283704+0000","last_peered":"2024-04-26T10:37:29.283704+0000","last_clean":"2024-04-26T10:37:29.283704+0000","last_became_active":"2024-04-26T10:37:23.270451+0000","last_became_peered":"2024-04-26T10:37:23.270451+0000","last_unstale":"2024-04-26T10:37:29.283704+0000","last_undegraded":"2024-04-26T10:37:29.283704+0000","last_fullsized":"2024-04-26T10:37:29.283704+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":301,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283617+0000","last_change":"2024-04-26T10:37:23.269600+0000","last_active":"2024-04-26T10:37:29.283617+0000","last_peered":"2024-04-26T10:37:29.283617+0000","last_clean":"2024-04-26T10:37:29.283617+0000","last_became_active":"2024-04-26T10:37:23.268665+0000","last_became_peered":"2024-04-26T10:37:23.268665+0000","last_unstale":"2024-04-26T10:37:29.283617+0000","last_undegraded":"2024-04-26T10:37:29.283617+0000","last_fullsized":"2024-04-26T10:37:29.283617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283661+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:37:29.283661+0000","last_peered":"2024-04-26T10:37:29.283661+0000","last_clean":"2024-04-26T10:37:29.283661+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:37:29.283661+0000","last_undegraded":"2024-04-26T10:37:29.283661+0000","last_fullsized":"2024-04-26T10:37:29.283661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:58.886200+0000","last_change":"2024-04-26T10:37:58.886319+0000","last_active":"2024-04-26T10:37:58.886200+0000","last_peered":"2024-04-26T10:37:58.886200+0000","last_clean":"2024-04-26T10:37:58.886200+0000","last_became_active":"2024-04-26T10:37:23.269736+0000","last_became_peered":"2024-04-26T10:37:23.269736+0000","last_unstale":"2024-04-26T10:37:58.886200+0000","last_undegraded":"2024-04-26T10:37:58.886200+0000","last_fullsized":"2024-04-26T10:37:58.886200+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:58.886177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:58.886177+0000","last_clean_scrub_stamp":"2024-04-26T10:37:58.886177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:36.789200+0000","scrub_duration":0.002025603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283418+0000","last_change":"2024-04-26T10:37:23.266348+0000","last_active":"2024-04-26T10:37:29.283418+0000","last_peered":"2024-04-26T10:37:29.283418+0000","last_clean":"2024-04-26T10:37:29.283418+0000","last_became_active":"2024-04-26T10:37:23.265317+0000","last_became_peered":"2024-04-26T10:37:23.265317+0000","last_unstale":"2024-04-26T10:37:29.283418+0000","last_undegraded":"2024-04-26T10:37:29.283418+0000","last_fullsized":"2024-04-26T10:37:29.283418+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283491+0000","last_change":"2024-04-26T10:37:23.276509+0000","last_active":"2024-04-26T10:37:29.283491+0000","last_peered":"2024-04-26T10:37:29.283491+0000","last_clean":"2024-04-26T10:37:29.283491+0000","last_became_active":"2024-04-26T10:37:23.276151+0000","last_became_peered":"2024-04-26T10:37:23.276151+0000","last_unstale":"2024-04-26T10:37:29.283491+0000","last_undegraded":"2024-04-26T10:37:29.283491+0000","last_fullsized":"2024-04-26T10:37:29.283491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888549+0000","last_change":"2024-04-26T10:32:52.000371+0000","last_active":"2024-04-26T10:37:30.888549+0000","last_peered":"2024-04-26T10:37:30.888549+0000","last_clean":"2024-04-26T10:37:30.888549+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:37:30.888549+0000","last_undegraded":"2024-04-26T10:37:30.888549+0000","last_fullsized":"2024-04-26T10:37:30.888549+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888349+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:37:30.888349+0000","last_peered":"2024-04-26T10:37:30.888349+0000","last_clean":"2024-04-26T10:37:30.888349+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:37:30.888349+0000","last_undegraded":"2024-04-26T10:37:30.888349+0000","last_fullsized":"2024-04-26T10:37:30.888349+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284207+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:37:29.284207+0000","last_peered":"2024-04-26T10:37:29.284207+0000","last_clean":"2024-04-26T10:37:29.284207+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:37:29.284207+0000","last_undegraded":"2024-04-26T10:37:29.284207+0000","last_fullsized":"2024-04-26T10:37:29.284207+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887955+0000","last_change":"2024-04-26T10:37:23.277636+0000","last_active":"2024-04-26T10:37:30.887955+0000","last_peered":"2024-04-26T10:37:30.887955+0000","last_clean":"2024-04-26T10:37:30.887955+0000","last_became_active":"2024-04-26T10:37:23.277309+0000","last_became_peered":"2024-04-26T10:37:23.277309+0000","last_unstale":"2024-04-26T10:37:30.887955+0000","last_undegraded":"2024-04-26T10:37:30.887955+0000","last_fullsized":"2024-04-26T10:37:30.887955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284373+0000","last_change":"2024-04-26T10:32:51.588875+0000","last_active":"2024-04-26T10:37:29.284373+0000","last_peered":"2024-04-26T10:37:29.284373+0000","last_clean":"2024-04-26T10:37:29.284373+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:37:29.284373+0000","last_undegraded":"2024-04-26T10:37:29.284373+0000","last_fullsized":"2024-04-26T10:37:29.284373+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284463+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:37:29.284463+0000","last_peered":"2024-04-26T10:37:29.284463+0000","last_clean":"2024-04-26T10:37:29.284463+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:37:29.284463+0000","last_undegraded":"2024-04-26T10:37:29.284463+0000","last_fullsized":"2024-04-26T10:37:29.284463+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:01.536945+0000","last_change":"2024-04-26T10:38:01.537057+0000","last_active":"2024-04-26T10:38:01.536945+0000","last_peered":"2024-04-26T10:38:01.536945+0000","last_clean":"2024-04-26T10:38:01.536945+0000","last_became_active":"2024-04-26T10:37:28.281669+0000","last_became_peered":"2024-04-26T10:37:28.281669+0000","last_unstale":"2024-04-26T10:38:01.536945+0000","last_undegraded":"2024-04-26T10:38:01.536945+0000","last_fullsized":"2024-04-26T10:38:01.536945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:01.536922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:01.536922+0000","last_clean_scrub_stamp":"2024-04-26T10:38:01.536922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:18.958300+0000","scrub_duration":0.0019935619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.992676+0000","last_change":"2024-04-26T10:38:03.992792+0000","last_active":"2024-04-26T10:38:03.992676+0000","last_peered":"2024-04-26T10:38:03.992676+0000","last_clean":"2024-04-26T10:38:03.992676+0000","last_became_active":"2024-04-26T10:37:23.268673+0000","last_became_peered":"2024-04-26T10:37:23.268673+0000","last_unstale":"2024-04-26T10:38:03.992676+0000","last_undegraded":"2024-04-26T10:38:03.992676+0000","last_fullsized":"2024-04-26T10:38:03.992676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.992656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.992656+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.992656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:06.482083+0000","scrub_duration":0.0019801340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284270+0000","last_change":"2024-04-26T10:37:23.277426+0000","last_active":"2024-04-26T10:37:29.284270+0000","last_peered":"2024-04-26T10:37:29.284270+0000","last_clean":"2024-04-26T10:37:29.284270+0000","last_became_active":"2024-04-26T10:37:23.277001+0000","last_became_peered":"2024-04-26T10:37:23.277001+0000","last_unstale":"2024-04-26T10:37:29.284270+0000","last_undegraded":"2024-04-26T10:37:29.284270+0000","last_fullsized":"2024-04-26T10:37:29.284270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887515+0000","last_change":"2024-04-26T10:37:23.267342+0000","last_active":"2024-04-26T10:37:30.887515+0000","last_peered":"2024-04-26T10:37:30.887515+0000","last_clean":"2024-04-26T10:37:30.887515+0000","last_became_active":"2024-04-26T10:37:23.266912+0000","last_became_peered":"2024-04-26T10:37:23.266912+0000","last_unstale":"2024-04-26T10:37:30.887515+0000","last_undegraded":"2024-04-26T10:37:30.887515+0000","last_fullsized":"2024-04-26T10:37:30.887515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:39.091120+0000","last_change":"2024-04-26T10:37:39.091234+0000","last_active":"2024-04-26T10:37:39.091120+0000","last_peered":"2024-04-26T10:37:39.091120+0000","last_clean":"2024-04-26T10:37:39.091120+0000","last_became_active":"2024-04-26T10:37:23.277303+0000","last_became_peered":"2024-04-26T10:37:23.277303+0000","last_unstale":"2024-04-26T10:37:39.091120+0000","last_undegraded":"2024-04-26T10:37:39.091120+0000","last_fullsized":"2024-04-26T10:37:39.091120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:37:39.091052+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:37:39.091052+0000","last_clean_scrub_stamp":"2024-04-26T10:37:39.091052+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:34.281919+0000","scrub_duration":0.0021606110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786627+0000","last_change":"2024-04-26T10:32:51.999435+0000","last_active":"2024-04-26T10:37:36.786627+0000","last_peered":"2024-04-26T10:37:36.786627+0000","last_clean":"2024-04-26T10:37:36.786627+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:37:36.786627+0000","last_undegraded":"2024-04-26T10:37:36.786627+0000","last_fullsized":"2024-04-26T10:37:36.786627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284020+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:29.284020+0000","last_peered":"2024-04-26T10:37:29.284020+0000","last_clean":"2024-04-26T10:37:29.284020+0000","last_became_active":"2024-04-26T10:37:23.266295+0000","last_became_peered":"2024-04-26T10:37:23.266295+0000","last_unstale":"2024-04-26T10:37:29.284020+0000","last_undegraded":"2024-04-26T10:37:29.284020+0000","last_fullsized":"2024-04-26T10:37:29.284020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:49.930540+0000","last_change":"2024-04-26T10:37:49.930694+0000","last_active":"2024-04-26T10:37:49.930540+0000","last_peered":"2024-04-26T10:37:49.930540+0000","last_clean":"2024-04-26T10:37:49.930540+0000","last_became_active":"2024-04-26T10:37:23.272039+0000","last_became_peered":"2024-04-26T10:37:23.272039+0000","last_unstale":"2024-04-26T10:37:49.930540+0000","last_undegraded":"2024-04-26T10:37:49.930540+0000","last_fullsized":"2024-04-26T10:37:49.930540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:49.930517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:49.930517+0000","last_clean_scrub_stamp":"2024-04-26T10:37:49.930517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:31.070842+0000","scrub_duration":0.046350850999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786604+0000","last_change":"2024-04-26T10:37:23.273723+0000","last_active":"2024-04-26T10:37:36.786604+0000","last_peered":"2024-04-26T10:37:36.786604+0000","last_clean":"2024-04-26T10:37:36.786604+0000","last_became_active":"2024-04-26T10:37:23.273253+0000","last_became_peered":"2024-04-26T10:37:23.273253+0000","last_unstale":"2024-04-26T10:37:36.786604+0000","last_undegraded":"2024-04-26T10:37:36.786604+0000","last_fullsized":"2024-04-26T10:37:36.786604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283706+0000","last_change":"2024-04-26T10:37:23.267726+0000","last_active":"2024-04-26T10:37:29.283706+0000","last_peered":"2024-04-26T10:37:29.283706+0000","last_clean":"2024-04-26T10:37:29.283706+0000","last_became_active":"2024-04-26T10:37:23.267434+0000","last_became_peered":"2024-04-26T10:37:23.267434+0000","last_unstale":"2024-04-26T10:37:29.283706+0000","last_undegraded":"2024-04-26T10:37:29.283706+0000","last_fullsized":"2024-04-26T10:37:29.283706+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:11.578361+0000","last_change":"2024-04-26T10:38:11.578515+0000","last_active":"2024-04-26T10:38:11.578361+0000","last_peered":"2024-04-26T10:38:11.578361+0000","last_clean":"2024-04-26T10:38:11.578361+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:38:11.578361+0000","last_undegraded":"2024-04-26T10:38:11.578361+0000","last_fullsized":"2024-04-26T10:38:11.578361+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:38:11.578322+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:38:11.578322+0000","last_clean_scrub_stamp":"2024-04-26T10:38:11.578322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:12.780448+0000","scrub_duration":0.0019376879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887831+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:37:30.887831+0000","last_peered":"2024-04-26T10:37:30.887831+0000","last_clean":"2024-04-26T10:37:30.887831+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:37:30.887831+0000","last_undegraded":"2024-04-26T10:37:30.887831+0000","last_fullsized":"2024-04-26T10:37:30.887831+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:04.517677+0000","last_change":"2024-04-26T10:38:04.517785+0000","last_active":"2024-04-26T10:38:04.517677+0000","last_peered":"2024-04-26T10:38:04.517677+0000","last_clean":"2024-04-26T10:38:04.517677+0000","last_became_active":"2024-04-26T10:37:23.271663+0000","last_became_peered":"2024-04-26T10:37:23.271663+0000","last_unstale":"2024-04-26T10:38:04.517677+0000","last_undegraded":"2024-04-26T10:38:04.517677+0000","last_fullsized":"2024-04-26T10:38:04.517677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-26T10:38:04.517652+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-26T10:38:04.517652+0000","last_clean_scrub_stamp":"2024-04-26T10:38:04.517652+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:57.558254+0000","scrub_duration":0.0039017489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:06.954934+0000","last_change":"2024-04-26T10:38:06.955074+0000","last_active":"2024-04-26T10:38:06.954934+0000","last_peered":"2024-04-26T10:38:06.954934+0000","last_clean":"2024-04-26T10:38:06.954934+0000","last_became_active":"2024-04-26T10:37:23.266624+0000","last_became_peered":"2024-04-26T10:37:23.266624+0000","last_unstale":"2024-04-26T10:38:06.954934+0000","last_undegraded":"2024-04-26T10:38:06.954934+0000","last_fullsized":"2024-04-26T10:38:06.954934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:06.954911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:06.954911+0000","last_clean_scrub_stamp":"2024-04-26T10:38:06.954911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:18.063497+0000","scrub_duration":0.0021816610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283499+0000","last_change":"2024-04-26T10:37:23.267652+0000","last_active":"2024-04-26T10:37:29.283499+0000","last_peered":"2024-04-26T10:37:29.283499+0000","last_clean":"2024-04-26T10:37:29.283499+0000","last_became_active":"2024-04-26T10:37:23.266063+0000","last_became_peered":"2024-04-26T10:37:23.266063+0000","last_unstale":"2024-04-26T10:37:29.283499+0000","last_undegraded":"2024-04-26T10:37:29.283499+0000","last_fullsized":"2024-04-26T10:37:29.283499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.177409+0000","last_change":"2024-04-26T10:37:28.282145+0000","last_active":"2024-04-26T10:37:30.177409+0000","last_peered":"2024-04-26T10:37:30.177409+0000","last_clean":"2024-04-26T10:37:30.177409+0000","last_became_active":"2024-04-26T10:37:28.281541+0000","last_became_peered":"2024-04-26T10:37:28.281541+0000","last_unstale":"2024-04-26T10:37:30.177409+0000","last_undegraded":"2024-04-26T10:37:30.177409+0000","last_fullsized":"2024-04-26T10:37:30.177409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:06.997133+0000","last_change":"2024-04-26T10:38:06.997233+0000","last_active":"2024-04-26T10:38:06.997133+0000","last_peered":"2024-04-26T10:38:06.997133+0000","last_clean":"2024-04-26T10:38:06.997133+0000","last_became_active":"2024-04-26T10:37:23.267644+0000","last_became_peered":"2024-04-26T10:37:23.267644+0000","last_unstale":"2024-04-26T10:38:06.997133+0000","last_undegraded":"2024-04-26T10:38:06.997133+0000","last_fullsized":"2024-04-26T10:38:06.997133+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:06.997106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:06.997106+0000","last_clean_scrub_stamp":"2024-04-26T10:38:06.997106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:56:00.253043+0000","scrub_duration":0.001652953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284302+0000","last_change":"2024-04-26T10:34:14.516166+0000","last_active":"2024-04-26T10:37:29.284302+0000","last_peered":"2024-04-26T10:37:29.284302+0000","last_clean":"2024-04-26T10:37:29.284302+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:37:29.284302+0000","last_undegraded":"2024-04-26T10:37:29.284302+0000","last_fullsized":"2024-04-26T10:37:29.284302+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888052+0000","last_change":"2024-04-26T10:37:23.274199+0000","last_active":"2024-04-26T10:37:30.888052+0000","last_peered":"2024-04-26T10:37:30.888052+0000","last_clean":"2024-04-26T10:37:30.888052+0000","last_became_active":"2024-04-26T10:37:23.273023+0000","last_became_peered":"2024-04-26T10:37:23.273023+0000","last_unstale":"2024-04-26T10:37:30.888052+0000","last_undegraded":"2024-04-26T10:37:30.888052+0000","last_fullsized":"2024-04-26T10:37:30.888052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1766,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738438,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":338824,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":94033016,"statfs":{"total":96636764160,"available":96289808384,"internally_reserved":0,"allocated":917504,"data_stored":359527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346028486},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:46 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Apr 26 10:37:52 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.39000000000000001},"min":{"1min":0.35399999999999998,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.65100000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.64500000000000002,"15min":0.498},"min":{"1min":0.314,"5min":0.19,"15min":0.19},"max":{"1min":0.61799999999999999,"5min":12.206,"15min":12.206},"last":0.42399999999999999}]}]},{"osd":0,"up_from":75,"seq":322122547213,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55012,"kb_used_data":1500,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94316828,"statfs":{"total":96636764160,"available":96580431872,"internally_reserved":0,"allocated":1536000,"data_stored":951641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7111,"internal_metadata":54780985},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738437,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257368,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":255870,"kb_avail":94114472,"statfs":{"total":96636764160,"available":96373219328,"internally_reserved":0,"allocated":1523712,"data_stored":948912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262011334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:33:47 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:37:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.45600000000000002,"15min":0.36699999999999999},"min":{"1min":0.33700000000000002,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.65700000000000003,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49099999999999999,"15min":0.45500000000000002},"min":{"1min":0.308,"5min":0.183,"15min":0.183},"max":{"1min":0.60599999999999998,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:38:18.457 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.457 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.457 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.457 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.457 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.458 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.458 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.458 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.458 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.458 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.458 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.458 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.459 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.459 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.459 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.459 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.459 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.459 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.459 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.459 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.459 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.460 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.460 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.460 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.460 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.460 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.460 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.460 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.461 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.461 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.461 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.461 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.461 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.461 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.461 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.462 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.462 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.462 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.462 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.462 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.462 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.462 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.463 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.464 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.464 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.464 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.465 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.465 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.465 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.465 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.466 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.466 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.466 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.466 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.467 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.467 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.467 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.467 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.468 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.468 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.468 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.468 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.469 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.469 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.469 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.470 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.470 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:18.470 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:38:38.472 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:38:38.828 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:38:38.831 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:38:38.837 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-04-26T10:38:37.074346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":592134,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":651204,"kb_used_data":3884,"kb_used_omap":10,"kb_used_meta":647285,"kb_avail":282464316,"statfs":{"total":289910292480,"available":289243459584,"internally_reserved":0,"allocated":3977216,"data_stored":2260080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10299,"internal_metadata":662820805},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002759"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786881+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:37:36.786881+0000","last_peered":"2024-04-26T10:37:36.786881+0000","last_clean":"2024-04-26T10:37:36.786881+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:37:36.786881+0000","last_undegraded":"2024-04-26T10:37:36.786881+0000","last_fullsized":"2024-04-26T10:37:36.786881+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:46.090568+0000","last_change":"2024-04-26T10:37:46.090713+0000","last_active":"2024-04-26T10:37:46.090568+0000","last_peered":"2024-04-26T10:37:46.090568+0000","last_clean":"2024-04-26T10:37:46.090568+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:37:46.090568+0000","last_undegraded":"2024-04-26T10:37:46.090568+0000","last_fullsized":"2024-04-26T10:37:46.090568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:46.090545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:46.090545+0000","last_clean_scrub_stamp":"2024-04-26T10:37:46.090545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:42.129201+0000","scrub_duration":0.001738082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.946243+0000","last_change":"2024-04-26T10:37:36.946374+0000","last_active":"2024-04-26T10:37:36.946243+0000","last_peered":"2024-04-26T10:37:36.946243+0000","last_clean":"2024-04-26T10:37:36.946243+0000","last_became_active":"2024-04-26T10:37:23.272107+0000","last_became_peered":"2024-04-26T10:37:23.272107+0000","last_unstale":"2024-04-26T10:37:36.946243+0000","last_undegraded":"2024-04-26T10:37:36.946243+0000","last_fullsized":"2024-04-26T10:37:36.946243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:36.946219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:36.946219+0000","last_clean_scrub_stamp":"2024-04-26T10:37:36.946219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:56.583737+0000","scrub_duration":0.0019495529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:54.913664+0000","last_change":"2024-04-26T10:37:54.913778+0000","last_active":"2024-04-26T10:37:54.913664+0000","last_peered":"2024-04-26T10:37:54.913664+0000","last_clean":"2024-04-26T10:37:54.913664+0000","last_became_active":"2024-04-26T10:37:23.269752+0000","last_became_peered":"2024-04-26T10:37:23.269752+0000","last_unstale":"2024-04-26T10:37:54.913664+0000","last_undegraded":"2024-04-26T10:37:54.913664+0000","last_fullsized":"2024-04-26T10:37:54.913664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:54.913640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:54.913640+0000","last_clean_scrub_stamp":"2024-04-26T10:37:54.913640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:45.220783+0000","scrub_duration":0.0019585140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:44.056407+0000","last_change":"2024-04-26T10:37:44.056524+0000","last_active":"2024-04-26T10:37:44.056407+0000","last_peered":"2024-04-26T10:37:44.056407+0000","last_clean":"2024-04-26T10:37:44.056407+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:37:44.056407+0000","last_undegraded":"2024-04-26T10:37:44.056407+0000","last_fullsized":"2024-04-26T10:37:44.056407+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:44.056381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:44.056381+0000","last_clean_scrub_stamp":"2024-04-26T10:37:44.056381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:26.047330+0000","scrub_duration":0.016160926999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.015997+0000","last_change":"2024-04-26T10:38:03.016124+0000","last_active":"2024-04-26T10:38:03.015997+0000","last_peered":"2024-04-26T10:38:03.015997+0000","last_clean":"2024-04-26T10:38:03.015997+0000","last_became_active":"2024-04-26T10:37:23.270593+0000","last_became_peered":"2024-04-26T10:37:23.270593+0000","last_unstale":"2024-04-26T10:38:03.015997+0000","last_undegraded":"2024-04-26T10:38:03.015997+0000","last_fullsized":"2024-04-26T10:38:03.015997+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.015972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.015972+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.015972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:42.504031+0000","scrub_duration":0.001820241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:22.072251+0000","last_change":"2024-04-26T10:38:22.072368+0000","last_active":"2024-04-26T10:38:22.072251+0000","last_peered":"2024-04-26T10:38:22.072251+0000","last_clean":"2024-04-26T10:38:22.072251+0000","last_became_active":"2024-04-26T10:37:23.270393+0000","last_became_peered":"2024-04-26T10:37:23.270393+0000","last_unstale":"2024-04-26T10:38:22.072251+0000","last_undegraded":"2024-04-26T10:38:22.072251+0000","last_fullsized":"2024-04-26T10:38:22.072251+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:22.072225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:22.072225+0000","last_clean_scrub_stamp":"2024-04-26T10:38:22.072225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:16.925527+0000","scrub_duration":0.016661415999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:35.066777+0000","last_change":"2024-04-26T10:38:35.066914+0000","last_active":"2024-04-26T10:38:35.066777+0000","last_peered":"2024-04-26T10:38:35.066777+0000","last_clean":"2024-04-26T10:38:35.066777+0000","last_became_active":"2024-04-26T10:37:23.267296+0000","last_became_peered":"2024-04-26T10:37:23.267296+0000","last_unstale":"2024-04-26T10:38:35.066777+0000","last_undegraded":"2024-04-26T10:38:35.066777+0000","last_fullsized":"2024-04-26T10:38:35.066777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:35.066756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:35.066756+0000","last_clean_scrub_stamp":"2024-04-26T10:38:35.066756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:14.500147+0000","scrub_duration":0.0017231670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302677+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:37:37.302677+0000","last_peered":"2024-04-26T10:37:37.302677+0000","last_clean":"2024-04-26T10:37:37.302677+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:37:37.302677+0000","last_undegraded":"2024-04-26T10:37:37.302677+0000","last_fullsized":"2024-04-26T10:37:37.302677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:45.073035+0000","last_change":"2024-04-26T10:37:45.073164+0000","last_active":"2024-04-26T10:37:45.073035+0000","last_peered":"2024-04-26T10:37:45.073035+0000","last_clean":"2024-04-26T10:37:45.073035+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:37:45.073035+0000","last_undegraded":"2024-04-26T10:37:45.073035+0000","last_fullsized":"2024-04-26T10:37:45.073035+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:45.073006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:45.073006+0000","last_clean_scrub_stamp":"2024-04-26T10:37:45.073006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:23.891265+0000","scrub_duration":0.001902131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:48.878670+0000","last_change":"2024-04-26T10:37:48.878771+0000","last_active":"2024-04-26T10:37:48.878670+0000","last_peered":"2024-04-26T10:37:48.878670+0000","last_clean":"2024-04-26T10:37:48.878670+0000","last_became_active":"2024-04-26T10:37:23.273996+0000","last_became_peered":"2024-04-26T10:37:23.273996+0000","last_unstale":"2024-04-26T10:37:48.878670+0000","last_undegraded":"2024-04-26T10:37:48.878670+0000","last_fullsized":"2024-04-26T10:37:48.878670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:48.878645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:48.878645+0000","last_clean_scrub_stamp":"2024-04-26T10:37:48.878645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:14.620591+0000","scrub_duration":0.017302161999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:02.964860+0000","last_change":"2024-04-26T10:38:02.964962+0000","last_active":"2024-04-26T10:38:02.964860+0000","last_peered":"2024-04-26T10:38:02.964860+0000","last_clean":"2024-04-26T10:38:02.964860+0000","last_became_active":"2024-04-26T10:37:23.273290+0000","last_became_peered":"2024-04-26T10:37:23.273290+0000","last_unstale":"2024-04-26T10:38:02.964860+0000","last_undegraded":"2024-04-26T10:38:02.964860+0000","last_fullsized":"2024-04-26T10:38:02.964860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:02.964836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:02.964836+0000","last_clean_scrub_stamp":"2024-04-26T10:38:02.964836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:19.028065+0000","scrub_duration":0.0018081550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:28.062536+0000","last_change":"2024-04-26T10:38:28.062652+0000","last_active":"2024-04-26T10:38:28.062536+0000","last_peered":"2024-04-26T10:38:28.062536+0000","last_clean":"2024-04-26T10:38:28.062536+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:38:28.062536+0000","last_undegraded":"2024-04-26T10:38:28.062536+0000","last_fullsized":"2024-04-26T10:38:28.062536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:28.062510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:28.062510+0000","last_clean_scrub_stamp":"2024-04-26T10:38:28.062510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:26.115949+0000","scrub_duration":0.016455943000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:17.121016+0000","last_change":"2024-04-26T10:38:17.121111+0000","last_active":"2024-04-26T10:38:17.121016+0000","last_peered":"2024-04-26T10:38:17.121016+0000","last_clean":"2024-04-26T10:38:17.121016+0000","last_became_active":"2024-04-26T10:37:23.269722+0000","last_became_peered":"2024-04-26T10:37:23.269722+0000","last_unstale":"2024-04-26T10:38:17.121016+0000","last_undegraded":"2024-04-26T10:38:17.121016+0000","last_fullsized":"2024-04-26T10:38:17.121016+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:17.120993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:17.120993+0000","last_clean_scrub_stamp":"2024-04-26T10:38:17.120993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:25.421013+0000","scrub_duration":0.001930906,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:13.078246+0000","last_change":"2024-04-26T10:38:13.078391+0000","last_active":"2024-04-26T10:38:13.078246+0000","last_peered":"2024-04-26T10:38:13.078246+0000","last_clean":"2024-04-26T10:38:13.078246+0000","last_became_active":"2024-04-26T10:37:23.270852+0000","last_became_peered":"2024-04-26T10:37:23.270852+0000","last_unstale":"2024-04-26T10:38:13.078246+0000","last_undegraded":"2024-04-26T10:38:13.078246+0000","last_fullsized":"2024-04-26T10:38:13.078246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:13.078224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:13.078224+0000","last_clean_scrub_stamp":"2024-04-26T10:38:13.078224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:09.840624+0000","scrub_duration":0.0018370000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:38.963069+0000","last_change":"2024-04-26T10:37:38.963200+0000","last_active":"2024-04-26T10:37:38.963069+0000","last_peered":"2024-04-26T10:37:38.963069+0000","last_clean":"2024-04-26T10:37:38.963069+0000","last_became_active":"2024-04-26T10:37:23.268640+0000","last_became_peered":"2024-04-26T10:37:23.268640+0000","last_unstale":"2024-04-26T10:37:38.963069+0000","last_undegraded":"2024-04-26T10:37:38.963069+0000","last_fullsized":"2024-04-26T10:37:38.963069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:38.963045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:38.963045+0000","last_clean_scrub_stamp":"2024-04-26T10:37:38.963045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:17.672777+0000","scrub_duration":0.0018662049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.177542+0000","last_change":"2024-04-26T10:37:28.282247+0000","last_active":"2024-04-26T10:37:30.177542+0000","last_peered":"2024-04-26T10:37:30.177542+0000","last_clean":"2024-04-26T10:37:30.177542+0000","last_became_active":"2024-04-26T10:37:28.281510+0000","last_became_peered":"2024-04-26T10:37:28.281510+0000","last_unstale":"2024-04-26T10:37:30.177542+0000","last_undegraded":"2024-04-26T10:37:30.177542+0000","last_fullsized":"2024-04-26T10:37:30.177542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:07.970695+0000","last_change":"2024-04-26T10:38:07.970813+0000","last_active":"2024-04-26T10:38:07.970695+0000","last_peered":"2024-04-26T10:38:07.970695+0000","last_clean":"2024-04-26T10:38:07.970695+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:38:07.970695+0000","last_undegraded":"2024-04-26T10:38:07.970695+0000","last_fullsized":"2024-04-26T10:38:07.970695+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:07.970664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:07.970664+0000","last_clean_scrub_stamp":"2024-04-26T10:38:07.970664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:55.346373+0000","scrub_duration":0.001805283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:38.715625+0000","last_change":"2024-04-26T10:37:38.715778+0000","last_active":"2024-04-26T10:37:38.715625+0000","last_peered":"2024-04-26T10:37:38.715625+0000","last_clean":"2024-04-26T10:37:38.715625+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:37:38.715625+0000","last_undegraded":"2024-04-26T10:37:38.715625+0000","last_fullsized":"2024-04-26T10:37:38.715625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:38.715602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:38.715602+0000","last_clean_scrub_stamp":"2024-04-26T10:37:38.715602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:48.931629+0000","scrub_duration":0.028191391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284226+0000","last_change":"2024-04-26T10:37:23.273700+0000","last_active":"2024-04-26T10:37:29.284226+0000","last_peered":"2024-04-26T10:37:29.284226+0000","last_clean":"2024-04-26T10:37:29.284226+0000","last_became_active":"2024-04-26T10:37:23.272964+0000","last_became_peered":"2024-04-26T10:37:23.272964+0000","last_unstale":"2024-04-26T10:37:29.284226+0000","last_undegraded":"2024-04-26T10:37:29.284226+0000","last_fullsized":"2024-04-26T10:37:29.284226+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:30.097028+0000","last_change":"2024-04-26T10:38:30.097185+0000","last_active":"2024-04-26T10:38:30.097028+0000","last_peered":"2024-04-26T10:38:30.097028+0000","last_clean":"2024-04-26T10:38:30.097028+0000","last_became_active":"2024-04-26T10:37:23.271967+0000","last_became_peered":"2024-04-26T10:37:23.271967+0000","last_unstale":"2024-04-26T10:38:30.097028+0000","last_undegraded":"2024-04-26T10:38:30.097028+0000","last_fullsized":"2024-04-26T10:38:30.097028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:30.096999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:30.096999+0000","last_clean_scrub_stamp":"2024-04-26T10:38:30.096999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:19.434538+0000","scrub_duration":0.028246974000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:35.081996+0000","last_change":"2024-04-26T10:38:35.082140+0000","last_active":"2024-04-26T10:38:35.081996+0000","last_peered":"2024-04-26T10:38:35.081996+0000","last_clean":"2024-04-26T10:38:35.081996+0000","last_became_active":"2024-04-26T10:37:23.267766+0000","last_became_peered":"2024-04-26T10:37:23.267766+0000","last_unstale":"2024-04-26T10:38:35.081996+0000","last_undegraded":"2024-04-26T10:38:35.081996+0000","last_fullsized":"2024-04-26T10:38:35.081996+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:35.081966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:35.081966+0000","last_clean_scrub_stamp":"2024-04-26T10:38:35.081966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:40.239398+0000","scrub_duration":0.0016982189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:13.618361+0000","last_change":"2024-04-26T10:38:13.618466+0000","last_active":"2024-04-26T10:38:13.618361+0000","last_peered":"2024-04-26T10:38:13.618361+0000","last_clean":"2024-04-26T10:38:13.618361+0000","last_became_active":"2024-04-26T10:37:23.269861+0000","last_became_peered":"2024-04-26T10:37:23.269861+0000","last_unstale":"2024-04-26T10:38:13.618361+0000","last_undegraded":"2024-04-26T10:38:13.618361+0000","last_fullsized":"2024-04-26T10:38:13.618361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:13.618337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:13.618337+0000","last_clean_scrub_stamp":"2024-04-26T10:38:13.618337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:51.339204+0000","scrub_duration":0.0019172900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887915+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:37:30.887915+0000","last_peered":"2024-04-26T10:37:30.887915+0000","last_clean":"2024-04-26T10:37:30.887915+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:37:30.887915+0000","last_undegraded":"2024-04-26T10:37:30.887915+0000","last_fullsized":"2024-04-26T10:37:30.887915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786748+0000","last_change":"2024-04-26T10:37:23.272702+0000","last_active":"2024-04-26T10:37:36.786748+0000","last_peered":"2024-04-26T10:37:36.786748+0000","last_clean":"2024-04-26T10:37:36.786748+0000","last_became_active":"2024-04-26T10:37:23.272218+0000","last_became_peered":"2024-04-26T10:37:23.272218+0000","last_unstale":"2024-04-26T10:37:36.786748+0000","last_undegraded":"2024-04-26T10:37:36.786748+0000","last_fullsized":"2024-04-26T10:37:36.786748+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284266+0000","last_change":"2024-04-26T10:37:23.271247+0000","last_active":"2024-04-26T10:37:29.284266+0000","last_peered":"2024-04-26T10:37:29.284266+0000","last_clean":"2024-04-26T10:37:29.284266+0000","last_became_active":"2024-04-26T10:37:23.270919+0000","last_became_peered":"2024-04-26T10:37:23.270919+0000","last_unstale":"2024-04-26T10:37:29.284266+0000","last_undegraded":"2024-04-26T10:37:29.284266+0000","last_fullsized":"2024-04-26T10:37:29.284266+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284349+0000","last_change":"2024-04-26T10:37:23.275081+0000","last_active":"2024-04-26T10:37:29.284349+0000","last_peered":"2024-04-26T10:37:29.284349+0000","last_clean":"2024-04-26T10:37:29.284349+0000","last_became_active":"2024-04-26T10:37:23.273821+0000","last_became_peered":"2024-04-26T10:37:23.273821+0000","last_unstale":"2024-04-26T10:37:29.284349+0000","last_undegraded":"2024-04-26T10:37:29.284349+0000","last_fullsized":"2024-04-26T10:37:29.284349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786495+0000","last_change":"2024-04-26T10:32:51.584516+0000","last_active":"2024-04-26T10:37:36.786495+0000","last_peered":"2024-04-26T10:37:36.786495+0000","last_clean":"2024-04-26T10:37:36.786495+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:37:36.786495+0000","last_undegraded":"2024-04-26T10:37:36.786495+0000","last_fullsized":"2024-04-26T10:37:36.786495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:27.028396+0000","last_change":"2024-04-26T10:38:27.028530+0000","last_active":"2024-04-26T10:38:27.028396+0000","last_peered":"2024-04-26T10:38:27.028396+0000","last_clean":"2024-04-26T10:38:27.028396+0000","last_became_active":"2024-04-26T10:37:23.272837+0000","last_became_peered":"2024-04-26T10:37:23.272837+0000","last_unstale":"2024-04-26T10:38:27.028396+0000","last_undegraded":"2024-04-26T10:38:27.028396+0000","last_fullsized":"2024-04-26T10:38:27.028396+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:27.028373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:27.028373+0000","last_clean_scrub_stamp":"2024-04-26T10:38:27.028373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:37.281488+0000","scrub_duration":0.001773223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:20.440926+0000","last_change":"2024-04-26T10:38:20.441032+0000","last_active":"2024-04-26T10:38:20.440926+0000","last_peered":"2024-04-26T10:38:20.440926+0000","last_clean":"2024-04-26T10:38:20.440926+0000","last_became_active":"2024-04-26T10:37:23.269197+0000","last_became_peered":"2024-04-26T10:37:23.269197+0000","last_unstale":"2024-04-26T10:38:20.440926+0000","last_undegraded":"2024-04-26T10:38:20.440926+0000","last_fullsized":"2024-04-26T10:38:20.440926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:20.440901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:20.440901+0000","last_clean_scrub_stamp":"2024-04-26T10:38:20.440901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:56.822074+0000","scrub_duration":0.0016497720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.674963+0000","last_change":"2024-04-26T10:37:37.675146+0000","last_active":"2024-04-26T10:37:37.674963+0000","last_peered":"2024-04-26T10:37:37.674963+0000","last_clean":"2024-04-26T10:37:37.674963+0000","last_became_active":"2024-04-26T10:37:28.283421+0000","last_became_peered":"2024-04-26T10:37:28.283421+0000","last_unstale":"2024-04-26T10:37:37.674963+0000","last_undegraded":"2024-04-26T10:37:37.674963+0000","last_fullsized":"2024-04-26T10:37:37.674963+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:37.674937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:37.674937+0000","last_clean_scrub_stamp":"2024-04-26T10:37:37.674937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:45.188074+0000","scrub_duration":0.0017282650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302337+0000","last_change":"2024-04-26T10:34:14.511168+0000","last_active":"2024-04-26T10:37:37.302337+0000","last_peered":"2024-04-26T10:37:37.302337+0000","last_clean":"2024-04-26T10:37:37.302337+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:37:37.302337+0000","last_undegraded":"2024-04-26T10:37:37.302337+0000","last_fullsized":"2024-04-26T10:37:37.302337+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888683+0000","last_change":"2024-04-26T10:37:23.273035+0000","last_active":"2024-04-26T10:37:30.888683+0000","last_peered":"2024-04-26T10:37:30.888683+0000","last_clean":"2024-04-26T10:37:30.888683+0000","last_became_active":"2024-04-26T10:37:23.272666+0000","last_became_peered":"2024-04-26T10:37:23.272666+0000","last_unstale":"2024-04-26T10:37:30.888683+0000","last_undegraded":"2024-04-26T10:37:30.888683+0000","last_fullsized":"2024-04-26T10:37:30.888683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302305+0000","last_change":"2024-04-26T10:37:23.271100+0000","last_active":"2024-04-26T10:37:37.302305+0000","last_peered":"2024-04-26T10:37:37.302305+0000","last_clean":"2024-04-26T10:37:37.302305+0000","last_became_active":"2024-04-26T10:37:23.270725+0000","last_became_peered":"2024-04-26T10:37:23.270725+0000","last_unstale":"2024-04-26T10:37:37.302305+0000","last_undegraded":"2024-04-26T10:37:37.302305+0000","last_fullsized":"2024-04-26T10:37:37.302305+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.478595+0000","last_change":"2024-04-26T10:38:03.478731+0000","last_active":"2024-04-26T10:38:03.478595+0000","last_peered":"2024-04-26T10:38:03.478595+0000","last_clean":"2024-04-26T10:38:03.478595+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:38:03.478595+0000","last_undegraded":"2024-04-26T10:38:03.478595+0000","last_fullsized":"2024-04-26T10:38:03.478595+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.478570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.478570+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.478570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:49.705887+0000","scrub_duration":0.00149917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:55.908127+0000","last_change":"2024-04-26T10:37:55.908269+0000","last_active":"2024-04-26T10:37:55.908127+0000","last_peered":"2024-04-26T10:37:55.908127+0000","last_clean":"2024-04-26T10:37:55.908127+0000","last_became_active":"2024-04-26T10:37:23.269371+0000","last_became_peered":"2024-04-26T10:37:23.269371+0000","last_unstale":"2024-04-26T10:37:55.908127+0000","last_undegraded":"2024-04-26T10:37:55.908127+0000","last_fullsized":"2024-04-26T10:37:55.908127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:55.908102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:55.908102+0000","last_clean_scrub_stamp":"2024-04-26T10:37:55.908102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:11.319524+0000","scrub_duration":0.0019603670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:35.178199+0000","last_change":"2024-04-26T10:37:23.269749+0000","last_active":"2024-04-26T10:37:35.178199+0000","last_peered":"2024-04-26T10:37:35.178199+0000","last_clean":"2024-04-26T10:37:35.178199+0000","last_became_active":"2024-04-26T10:37:23.269344+0000","last_became_peered":"2024-04-26T10:37:23.269344+0000","last_unstale":"2024-04-26T10:37:35.178199+0000","last_undegraded":"2024-04-26T10:37:35.178199+0000","last_fullsized":"2024-04-26T10:37:35.178199+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888069+0000","last_change":"2024-04-26T10:37:23.273205+0000","last_active":"2024-04-26T10:37:30.888069+0000","last_peered":"2024-04-26T10:37:30.888069+0000","last_clean":"2024-04-26T10:37:30.888069+0000","last_became_active":"2024-04-26T10:37:23.272731+0000","last_became_peered":"2024-04-26T10:37:23.272731+0000","last_unstale":"2024-04-26T10:37:30.888069+0000","last_undegraded":"2024-04-26T10:37:30.888069+0000","last_fullsized":"2024-04-26T10:37:30.888069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:46.569879+0000","last_change":"2024-04-26T10:37:46.570003+0000","last_active":"2024-04-26T10:37:46.569879+0000","last_peered":"2024-04-26T10:37:46.569879+0000","last_clean":"2024-04-26T10:37:46.569879+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:37:46.569879+0000","last_undegraded":"2024-04-26T10:37:46.569879+0000","last_fullsized":"2024-04-26T10:37:46.569879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:46.569855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:46.569855+0000","last_clean_scrub_stamp":"2024-04-26T10:37:46.569855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:12.891140+0000","scrub_duration":0.00144177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":99,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284123+0000","last_change":"2024-04-26T10:37:23.272627+0000","last_active":"2024-04-26T10:37:29.284123+0000","last_peered":"2024-04-26T10:37:29.284123+0000","last_clean":"2024-04-26T10:37:29.284123+0000","last_became_active":"2024-04-26T10:37:23.269968+0000","last_became_peered":"2024-04-26T10:37:23.269968+0000","last_unstale":"2024-04-26T10:37:29.284123+0000","last_undegraded":"2024-04-26T10:37:29.284123+0000","last_fullsized":"2024-04-26T10:37:29.284123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:39.919590+0000","last_change":"2024-04-26T10:37:39.919719+0000","last_active":"2024-04-26T10:37:39.919590+0000","last_peered":"2024-04-26T10:37:39.919590+0000","last_clean":"2024-04-26T10:37:39.919590+0000","last_became_active":"2024-04-26T10:37:23.274045+0000","last_became_peered":"2024-04-26T10:37:23.274045+0000","last_unstale":"2024-04-26T10:37:39.919590+0000","last_undegraded":"2024-04-26T10:37:39.919590+0000","last_fullsized":"2024-04-26T10:37:39.919590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:39.919570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:39.919570+0000","last_clean_scrub_stamp":"2024-04-26T10:37:39.919570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:44.433055+0000","scrub_duration":0.001537217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283720+0000","last_change":"2024-04-26T10:37:23.273798+0000","last_active":"2024-04-26T10:37:29.283720+0000","last_peered":"2024-04-26T10:37:29.283720+0000","last_clean":"2024-04-26T10:37:29.283720+0000","last_became_active":"2024-04-26T10:37:23.269775+0000","last_became_peered":"2024-04-26T10:37:23.269775+0000","last_unstale":"2024-04-26T10:37:29.283720+0000","last_undegraded":"2024-04-26T10:37:29.283720+0000","last_fullsized":"2024-04-26T10:37:29.283720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:04.000852+0000","last_change":"2024-04-26T10:38:04.000953+0000","last_active":"2024-04-26T10:38:04.000852+0000","last_peered":"2024-04-26T10:38:04.000852+0000","last_clean":"2024-04-26T10:38:04.000852+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:38:04.000852+0000","last_undegraded":"2024-04-26T10:38:04.000852+0000","last_fullsized":"2024-04-26T10:38:04.000852+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:04.000827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:04.000827+0000","last_clean_scrub_stamp":"2024-04-26T10:38:04.000827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:34.824818+0000","scrub_duration":0.0020431870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:32.456176+0000","last_change":"2024-04-26T10:38:32.456289+0000","last_active":"2024-04-26T10:38:32.456176+0000","last_peered":"2024-04-26T10:38:32.456176+0000","last_clean":"2024-04-26T10:38:32.456176+0000","last_became_active":"2024-04-26T10:37:23.269537+0000","last_became_peered":"2024-04-26T10:37:23.269537+0000","last_unstale":"2024-04-26T10:38:32.456176+0000","last_undegraded":"2024-04-26T10:38:32.456176+0000","last_fullsized":"2024-04-26T10:38:32.456176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:32.456150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:32.456150+0000","last_clean_scrub_stamp":"2024-04-26T10:38:32.456150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:05.179342+0000","scrub_duration":0.001825459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888133+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:37:30.888133+0000","last_peered":"2024-04-26T10:37:30.888133+0000","last_clean":"2024-04-26T10:37:30.888133+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:37:30.888133+0000","last_undegraded":"2024-04-26T10:37:30.888133+0000","last_fullsized":"2024-04-26T10:37:30.888133+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887513+0000","last_change":"2024-04-26T10:37:23.268114+0000","last_active":"2024-04-26T10:37:30.887513+0000","last_peered":"2024-04-26T10:37:30.887513+0000","last_clean":"2024-04-26T10:37:30.887513+0000","last_became_active":"2024-04-26T10:37:23.267121+0000","last_became_peered":"2024-04-26T10:37:23.267121+0000","last_unstale":"2024-04-26T10:37:30.887513+0000","last_undegraded":"2024-04-26T10:37:30.887513+0000","last_fullsized":"2024-04-26T10:37:30.887513+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:09.576502+0000","last_change":"2024-04-26T10:38:09.576610+0000","last_active":"2024-04-26T10:38:09.576502+0000","last_peered":"2024-04-26T10:38:09.576502+0000","last_clean":"2024-04-26T10:38:09.576502+0000","last_became_active":"2024-04-26T10:37:28.281512+0000","last_became_peered":"2024-04-26T10:37:28.281512+0000","last_unstale":"2024-04-26T10:38:09.576502+0000","last_undegraded":"2024-04-26T10:38:09.576502+0000","last_fullsized":"2024-04-26T10:38:09.576502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:09.576479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:09.576479+0000","last_clean_scrub_stamp":"2024-04-26T10:38:09.576479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:58.472401+0000","scrub_duration":0.0016694769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283487+0000","last_change":"2024-04-26T10:37:23.268184+0000","last_active":"2024-04-26T10:37:29.283487+0000","last_peered":"2024-04-26T10:37:29.283487+0000","last_clean":"2024-04-26T10:37:29.283487+0000","last_became_active":"2024-04-26T10:37:23.266377+0000","last_became_peered":"2024-04-26T10:37:23.266377+0000","last_unstale":"2024-04-26T10:37:29.283487+0000","last_undegraded":"2024-04-26T10:37:29.283487+0000","last_fullsized":"2024-04-26T10:37:29.283487+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:00.539928+0000","last_change":"2024-04-26T10:38:00.540104+0000","last_active":"2024-04-26T10:38:00.539928+0000","last_peered":"2024-04-26T10:38:00.539928+0000","last_clean":"2024-04-26T10:38:00.539928+0000","last_became_active":"2024-04-26T10:37:23.271752+0000","last_became_peered":"2024-04-26T10:37:23.271752+0000","last_unstale":"2024-04-26T10:38:00.539928+0000","last_undegraded":"2024-04-26T10:38:00.539928+0000","last_fullsized":"2024-04-26T10:38:00.539928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:00.539869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:00.539869+0000","last_clean_scrub_stamp":"2024-04-26T10:38:00.539869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:46.107019+0000","scrub_duration":0.052375984,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284617+0000","last_change":"2024-04-26T10:37:23.273840+0000","last_active":"2024-04-26T10:37:29.284617+0000","last_peered":"2024-04-26T10:37:29.284617+0000","last_clean":"2024-04-26T10:37:29.284617+0000","last_became_active":"2024-04-26T10:37:23.272156+0000","last_became_peered":"2024-04-26T10:37:23.272156+0000","last_unstale":"2024-04-26T10:37:29.284617+0000","last_undegraded":"2024-04-26T10:37:29.284617+0000","last_fullsized":"2024-04-26T10:37:29.284617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:09.993382+0000","last_change":"2024-04-26T10:38:09.993498+0000","last_active":"2024-04-26T10:38:09.993382+0000","last_peered":"2024-04-26T10:38:09.993382+0000","last_clean":"2024-04-26T10:38:09.993382+0000","last_became_active":"2024-04-26T10:37:23.267717+0000","last_became_peered":"2024-04-26T10:37:23.267717+0000","last_unstale":"2024-04-26T10:38:09.993382+0000","last_undegraded":"2024-04-26T10:38:09.993382+0000","last_fullsized":"2024-04-26T10:38:09.993382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:09.993363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:09.993363+0000","last_clean_scrub_stamp":"2024-04-26T10:38:09.993363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:57.793706+0000","scrub_duration":0.0019586830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888511+0000","last_change":"2024-04-26T10:37:23.273179+0000","last_active":"2024-04-26T10:37:30.888511+0000","last_peered":"2024-04-26T10:37:30.888511+0000","last_clean":"2024-04-26T10:37:30.888511+0000","last_became_active":"2024-04-26T10:37:23.272260+0000","last_became_peered":"2024-04-26T10:37:23.272260+0000","last_unstale":"2024-04-26T10:37:30.888511+0000","last_undegraded":"2024-04-26T10:37:30.888511+0000","last_fullsized":"2024-04-26T10:37:30.888511+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:22.996504+0000","last_change":"2024-04-26T10:38:22.996504+0000","last_active":"2024-04-26T10:38:22.996504+0000","last_peered":"2024-04-26T10:38:22.996504+0000","last_clean":"2024-04-26T10:38:22.996504+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:38:22.996504+0000","last_undegraded":"2024-04-26T10:38:22.996504+0000","last_fullsized":"2024-04-26T10:38:22.996504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:22.996344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:22.996344+0000","last_clean_scrub_stamp":"2024-04-26T10:38:22.996344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:42.025260+0000","scrub_duration":0.001643909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'2","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:15.087666+0000","last_change":"2024-04-26T10:38:15.087778+0000","last_active":"2024-04-26T10:38:15.087666+0000","last_peered":"2024-04-26T10:38:15.087666+0000","last_clean":"2024-04-26T10:38:15.087666+0000","last_became_active":"2024-04-26T10:37:23.268441+0000","last_became_peered":"2024-04-26T10:37:23.268441+0000","last_unstale":"2024-04-26T10:38:15.087666+0000","last_undegraded":"2024-04-26T10:38:15.087666+0000","last_fullsized":"2024-04-26T10:38:15.087666+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T10:38:15.087643+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T10:38:15.087643+0000","last_clean_scrub_stamp":"2024-04-26T10:38:15.087643+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:42.284590+0000","scrub_duration":0.003756396,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:12.046677+0000","last_change":"2024-04-26T10:38:12.046827+0000","last_active":"2024-04-26T10:38:12.046677+0000","last_peered":"2024-04-26T10:38:12.046677+0000","last_clean":"2024-04-26T10:38:12.046677+0000","last_became_active":"2024-04-26T10:37:23.268451+0000","last_became_peered":"2024-04-26T10:37:23.268451+0000","last_unstale":"2024-04-26T10:38:12.046677+0000","last_undegraded":"2024-04-26T10:38:12.046677+0000","last_fullsized":"2024-04-26T10:38:12.046677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:12.046640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:12.046640+0000","last_clean_scrub_stamp":"2024-04-26T10:38:12.046640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:04.521493+0000","scrub_duration":0.002019739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284314+0000","last_change":"2024-04-26T10:37:23.273635+0000","last_active":"2024-04-26T10:37:29.284314+0000","last_peered":"2024-04-26T10:37:29.284314+0000","last_clean":"2024-04-26T10:37:29.284314+0000","last_became_active":"2024-04-26T10:37:23.272938+0000","last_became_peered":"2024-04-26T10:37:23.272938+0000","last_unstale":"2024-04-26T10:37:29.284314+0000","last_undegraded":"2024-04-26T10:37:29.284314+0000","last_fullsized":"2024-04-26T10:37:29.284314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:42.638376+0000","last_change":"2024-04-26T10:37:42.638539+0000","last_active":"2024-04-26T10:37:42.638376+0000","last_peered":"2024-04-26T10:37:42.638376+0000","last_clean":"2024-04-26T10:37:42.638376+0000","last_became_active":"2024-04-26T10:37:23.276957+0000","last_became_peered":"2024-04-26T10:37:23.276957+0000","last_unstale":"2024-04-26T10:37:42.638376+0000","last_undegraded":"2024-04-26T10:37:42.638376+0000","last_fullsized":"2024-04-26T10:37:42.638376+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:42.638352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:42.638352+0000","last_clean_scrub_stamp":"2024-04-26T10:37:42.638352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:15.896041+0000","scrub_duration":0.027944383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283904+0000","last_change":"2024-04-26T10:37:23.277440+0000","last_active":"2024-04-26T10:37:29.283904+0000","last_peered":"2024-04-26T10:37:29.283904+0000","last_clean":"2024-04-26T10:37:29.283904+0000","last_became_active":"2024-04-26T10:37:23.277037+0000","last_became_peered":"2024-04-26T10:37:23.277037+0000","last_unstale":"2024-04-26T10:37:29.283904+0000","last_undegraded":"2024-04-26T10:37:29.283904+0000","last_fullsized":"2024-04-26T10:37:29.283904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283803+0000","last_change":"2024-04-26T10:37:23.270454+0000","last_active":"2024-04-26T10:37:29.283803+0000","last_peered":"2024-04-26T10:37:29.283803+0000","last_clean":"2024-04-26T10:37:29.283803+0000","last_became_active":"2024-04-26T10:37:23.269473+0000","last_became_peered":"2024-04-26T10:37:23.269473+0000","last_unstale":"2024-04-26T10:37:29.283803+0000","last_undegraded":"2024-04-26T10:37:29.283803+0000","last_fullsized":"2024-04-26T10:37:29.283803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283674+0000","last_change":"2024-04-26T10:37:23.267503+0000","last_active":"2024-04-26T10:37:29.283674+0000","last_peered":"2024-04-26T10:37:29.283674+0000","last_clean":"2024-04-26T10:37:29.283674+0000","last_became_active":"2024-04-26T10:37:23.267235+0000","last_became_peered":"2024-04-26T10:37:23.267235+0000","last_unstale":"2024-04-26T10:37:29.283674+0000","last_undegraded":"2024-04-26T10:37:29.283674+0000","last_fullsized":"2024-04-26T10:37:29.283674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284323+0000","last_change":"2024-04-26T10:37:23.274693+0000","last_active":"2024-04-26T10:37:29.284323+0000","last_peered":"2024-04-26T10:37:29.284323+0000","last_clean":"2024-04-26T10:37:29.284323+0000","last_became_active":"2024-04-26T10:37:23.272111+0000","last_became_peered":"2024-04-26T10:37:23.272111+0000","last_unstale":"2024-04-26T10:37:29.284323+0000","last_undegraded":"2024-04-26T10:37:29.284323+0000","last_fullsized":"2024-04-26T10:37:29.284323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887722+0000","last_change":"2024-04-26T10:37:23.274381+0000","last_active":"2024-04-26T10:37:30.887722+0000","last_peered":"2024-04-26T10:37:30.887722+0000","last_clean":"2024-04-26T10:37:30.887722+0000","last_became_active":"2024-04-26T10:37:23.273867+0000","last_became_peered":"2024-04-26T10:37:23.273867+0000","last_unstale":"2024-04-26T10:37:30.887722+0000","last_undegraded":"2024-04-26T10:37:30.887722+0000","last_fullsized":"2024-04-26T10:37:30.887722+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:57.878941+0000","last_change":"2024-04-26T10:37:57.879044+0000","last_active":"2024-04-26T10:37:57.878941+0000","last_peered":"2024-04-26T10:37:57.878941+0000","last_clean":"2024-04-26T10:37:57.878941+0000","last_became_active":"2024-04-26T10:37:23.272569+0000","last_became_peered":"2024-04-26T10:37:23.272569+0000","last_unstale":"2024-04-26T10:37:57.878941+0000","last_undegraded":"2024-04-26T10:37:57.878941+0000","last_fullsized":"2024-04-26T10:37:57.878941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:57.878919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:57.878919+0000","last_clean_scrub_stamp":"2024-04-26T10:37:57.878919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:02.166486+0000","scrub_duration":0.0020039089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:29.992871+0000","last_change":"2024-04-26T10:38:29.992871+0000","last_active":"2024-04-26T10:38:29.992871+0000","last_peered":"2024-04-26T10:38:29.992871+0000","last_clean":"2024-04-26T10:38:29.992871+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:38:29.992871+0000","last_undegraded":"2024-04-26T10:38:29.992871+0000","last_fullsized":"2024-04-26T10:38:29.992871+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:29.992711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:29.992711+0000","last_clean_scrub_stamp":"2024-04-26T10:38:29.992711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:32.502846+0000","scrub_duration":0.0017064700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284388+0000","last_change":"2024-04-26T10:32:52.008580+0000","last_active":"2024-04-26T10:37:29.284388+0000","last_peered":"2024-04-26T10:37:29.284388+0000","last_clean":"2024-04-26T10:37:29.284388+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:37:29.284388+0000","last_undegraded":"2024-04-26T10:37:29.284388+0000","last_fullsized":"2024-04-26T10:37:29.284388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.177479+0000","last_change":"2024-04-26T10:37:28.282767+0000","last_active":"2024-04-26T10:37:30.177479+0000","last_peered":"2024-04-26T10:37:30.177479+0000","last_clean":"2024-04-26T10:37:30.177479+0000","last_became_active":"2024-04-26T10:37:28.282419+0000","last_became_peered":"2024-04-26T10:37:28.282419+0000","last_unstale":"2024-04-26T10:37:30.177479+0000","last_undegraded":"2024-04-26T10:37:30.177479+0000","last_fullsized":"2024-04-26T10:37:30.177479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:47.889504+0000","last_change":"2024-04-26T10:37:47.889608+0000","last_active":"2024-04-26T10:37:47.889504+0000","last_peered":"2024-04-26T10:37:47.889504+0000","last_clean":"2024-04-26T10:37:47.889504+0000","last_became_active":"2024-04-26T10:37:23.273114+0000","last_became_peered":"2024-04-26T10:37:23.273114+0000","last_unstale":"2024-04-26T10:37:47.889504+0000","last_undegraded":"2024-04-26T10:37:47.889504+0000","last_fullsized":"2024-04-26T10:37:47.889504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:47.889480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:47.889480+0000","last_clean_scrub_stamp":"2024-04-26T10:37:47.889480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:38.351949+0000","scrub_duration":0.0018432660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:00.037320+0000","last_change":"2024-04-26T10:38:00.037320+0000","last_active":"2024-04-26T10:38:00.037320+0000","last_peered":"2024-04-26T10:38:00.037320+0000","last_clean":"2024-04-26T10:38:00.037320+0000","last_became_active":"2024-04-26T10:37:23.267319+0000","last_became_peered":"2024-04-26T10:37:23.267319+0000","last_unstale":"2024-04-26T10:38:00.037320+0000","last_undegraded":"2024-04-26T10:38:00.037320+0000","last_fullsized":"2024-04-26T10:38:00.037320+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:00.037154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:00.037154+0000","last_clean_scrub_stamp":"2024-04-26T10:38:00.037154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:01.442829+0000","scrub_duration":0.0020604550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283586+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:29.283586+0000","last_peered":"2024-04-26T10:37:29.283586+0000","last_clean":"2024-04-26T10:37:29.283586+0000","last_became_active":"2024-04-26T10:37:23.266332+0000","last_became_peered":"2024-04-26T10:37:23.266332+0000","last_unstale":"2024-04-26T10:37:29.283586+0000","last_undegraded":"2024-04-26T10:37:29.283586+0000","last_fullsized":"2024-04-26T10:37:29.283586+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:32.115831+0000","last_change":"2024-04-26T10:38:32.115967+0000","last_active":"2024-04-26T10:38:32.115831+0000","last_peered":"2024-04-26T10:38:32.115831+0000","last_clean":"2024-04-26T10:38:32.115831+0000","last_became_active":"2024-04-26T10:37:23.269657+0000","last_became_peered":"2024-04-26T10:37:23.269657+0000","last_unstale":"2024-04-26T10:38:32.115831+0000","last_undegraded":"2024-04-26T10:38:32.115831+0000","last_fullsized":"2024-04-26T10:38:32.115831+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:32.115807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:32.115807+0000","last_clean_scrub_stamp":"2024-04-26T10:38:32.115807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:12.148163+0000","scrub_duration":0.0016869439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:41.612812+0000","last_change":"2024-04-26T10:37:41.612919+0000","last_active":"2024-04-26T10:37:41.612812+0000","last_peered":"2024-04-26T10:37:41.612812+0000","last_clean":"2024-04-26T10:37:41.612812+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:37:41.612812+0000","last_undegraded":"2024-04-26T10:37:41.612812+0000","last_fullsized":"2024-04-26T10:37:41.612812+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:41.612787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:41.612787+0000","last_clean_scrub_stamp":"2024-04-26T10:37:41.612787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:15.886238+0000","scrub_duration":0.001521445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:34.428552+0000","last_change":"2024-04-26T10:38:34.428825+0000","last_active":"2024-04-26T10:38:34.428552+0000","last_peered":"2024-04-26T10:38:34.428552+0000","last_clean":"2024-04-26T10:38:34.428552+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:38:34.428552+0000","last_undegraded":"2024-04-26T10:38:34.428552+0000","last_fullsized":"2024-04-26T10:38:34.428552+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:34.428529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:34.428529+0000","last_clean_scrub_stamp":"2024-04-26T10:38:34.428529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:41.415399+0000","scrub_duration":0.0019058580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887687+0000","last_change":"2024-04-26T10:37:23.267893+0000","last_active":"2024-04-26T10:37:30.887687+0000","last_peered":"2024-04-26T10:37:30.887687+0000","last_clean":"2024-04-26T10:37:30.887687+0000","last_became_active":"2024-04-26T10:37:23.267595+0000","last_became_peered":"2024-04-26T10:37:23.267595+0000","last_unstale":"2024-04-26T10:37:30.887687+0000","last_undegraded":"2024-04-26T10:37:30.887687+0000","last_fullsized":"2024-04-26T10:37:30.887687+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:18.553783+0000","last_change":"2024-04-26T10:38:18.553915+0000","last_active":"2024-04-26T10:38:18.553783+0000","last_peered":"2024-04-26T10:38:18.553783+0000","last_clean":"2024-04-26T10:38:18.553783+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:38:18.553783+0000","last_undegraded":"2024-04-26T10:38:18.553783+0000","last_fullsized":"2024-04-26T10:38:18.553783+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:18.553758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:18.553758+0000","last_clean_scrub_stamp":"2024-04-26T10:38:18.553758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:18.557993+0000","scrub_duration":0.028014801999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283704+0000","last_change":"2024-04-26T10:37:23.273754+0000","last_active":"2024-04-26T10:37:29.283704+0000","last_peered":"2024-04-26T10:37:29.283704+0000","last_clean":"2024-04-26T10:37:29.283704+0000","last_became_active":"2024-04-26T10:37:23.270451+0000","last_became_peered":"2024-04-26T10:37:23.270451+0000","last_unstale":"2024-04-26T10:37:29.283704+0000","last_undegraded":"2024-04-26T10:37:29.283704+0000","last_fullsized":"2024-04-26T10:37:29.283704+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":301,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283617+0000","last_change":"2024-04-26T10:37:23.269600+0000","last_active":"2024-04-26T10:37:29.283617+0000","last_peered":"2024-04-26T10:37:29.283617+0000","last_clean":"2024-04-26T10:37:29.283617+0000","last_became_active":"2024-04-26T10:37:23.268665+0000","last_became_peered":"2024-04-26T10:37:23.268665+0000","last_unstale":"2024-04-26T10:37:29.283617+0000","last_undegraded":"2024-04-26T10:37:29.283617+0000","last_fullsized":"2024-04-26T10:37:29.283617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283661+0000","last_change":"2024-04-26T10:32:51.588293+0000","last_active":"2024-04-26T10:37:29.283661+0000","last_peered":"2024-04-26T10:37:29.283661+0000","last_clean":"2024-04-26T10:37:29.283661+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:37:29.283661+0000","last_undegraded":"2024-04-26T10:37:29.283661+0000","last_fullsized":"2024-04-26T10:37:29.283661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:58.886200+0000","last_change":"2024-04-26T10:37:58.886319+0000","last_active":"2024-04-26T10:37:58.886200+0000","last_peered":"2024-04-26T10:37:58.886200+0000","last_clean":"2024-04-26T10:37:58.886200+0000","last_became_active":"2024-04-26T10:37:23.269736+0000","last_became_peered":"2024-04-26T10:37:23.269736+0000","last_unstale":"2024-04-26T10:37:58.886200+0000","last_undegraded":"2024-04-26T10:37:58.886200+0000","last_fullsized":"2024-04-26T10:37:58.886200+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:58.886177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:58.886177+0000","last_clean_scrub_stamp":"2024-04-26T10:37:58.886177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:36.789200+0000","scrub_duration":0.002025603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:23.996073+0000","last_change":"2024-04-26T10:38:23.996208+0000","last_active":"2024-04-26T10:38:23.996073+0000","last_peered":"2024-04-26T10:38:23.996073+0000","last_clean":"2024-04-26T10:38:23.996073+0000","last_became_active":"2024-04-26T10:37:23.265317+0000","last_became_peered":"2024-04-26T10:37:23.265317+0000","last_unstale":"2024-04-26T10:38:23.996073+0000","last_undegraded":"2024-04-26T10:38:23.996073+0000","last_fullsized":"2024-04-26T10:38:23.996073+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:23.996042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:23.996042+0000","last_clean_scrub_stamp":"2024-04-26T10:38:23.996042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:33.504025+0000","scrub_duration":0.001878865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283491+0000","last_change":"2024-04-26T10:37:23.276509+0000","last_active":"2024-04-26T10:37:29.283491+0000","last_peered":"2024-04-26T10:37:29.283491+0000","last_clean":"2024-04-26T10:37:29.283491+0000","last_became_active":"2024-04-26T10:37:23.276151+0000","last_became_peered":"2024-04-26T10:37:23.276151+0000","last_unstale":"2024-04-26T10:37:29.283491+0000","last_undegraded":"2024-04-26T10:37:29.283491+0000","last_fullsized":"2024-04-26T10:37:29.283491+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:20.029488+0000","last_change":"2024-04-26T10:38:20.029638+0000","last_active":"2024-04-26T10:38:20.029488+0000","last_peered":"2024-04-26T10:38:20.029488+0000","last_clean":"2024-04-26T10:38:20.029488+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:38:20.029488+0000","last_undegraded":"2024-04-26T10:38:20.029488+0000","last_fullsized":"2024-04-26T10:38:20.029488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:20.029457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:20.029457+0000","last_clean_scrub_stamp":"2024-04-26T10:38:20.029457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:12.454711+0000","scrub_duration":0.0017301249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786413+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:37:36.786413+0000","last_peered":"2024-04-26T10:37:36.786413+0000","last_clean":"2024-04-26T10:37:36.786413+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:37:36.786413+0000","last_undegraded":"2024-04-26T10:37:36.786413+0000","last_fullsized":"2024-04-26T10:37:36.786413+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":94,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284207+0000","last_change":"2024-04-26T10:34:14.509602+0000","last_active":"2024-04-26T10:37:29.284207+0000","last_peered":"2024-04-26T10:37:29.284207+0000","last_clean":"2024-04-26T10:37:29.284207+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:37:29.284207+0000","last_undegraded":"2024-04-26T10:37:29.284207+0000","last_fullsized":"2024-04-26T10:37:29.284207+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887955+0000","last_change":"2024-04-26T10:37:23.277636+0000","last_active":"2024-04-26T10:37:30.887955+0000","last_peered":"2024-04-26T10:37:30.887955+0000","last_clean":"2024-04-26T10:37:30.887955+0000","last_became_active":"2024-04-26T10:37:23.277309+0000","last_became_peered":"2024-04-26T10:37:23.277309+0000","last_unstale":"2024-04-26T10:37:30.887955+0000","last_undegraded":"2024-04-26T10:37:30.887955+0000","last_fullsized":"2024-04-26T10:37:30.887955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"82'3","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:15.552718+0000","last_change":"2024-04-26T10:38:15.552856+0000","last_active":"2024-04-26T10:38:15.552718+0000","last_peered":"2024-04-26T10:38:15.552718+0000","last_clean":"2024-04-26T10:38:15.552718+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:38:15.552718+0000","last_undegraded":"2024-04-26T10:38:15.552718+0000","last_fullsized":"2024-04-26T10:38:15.552718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:38:15.552692+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:38:15.552692+0000","last_clean_scrub_stamp":"2024-04-26T10:38:15.552692+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:15.123234+0000","scrub_duration":0.0030682249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284463+0000","last_change":"2024-04-26T10:34:14.509515+0000","last_active":"2024-04-26T10:37:29.284463+0000","last_peered":"2024-04-26T10:37:29.284463+0000","last_clean":"2024-04-26T10:37:29.284463+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:37:29.284463+0000","last_undegraded":"2024-04-26T10:37:29.284463+0000","last_fullsized":"2024-04-26T10:37:29.284463+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:01.536945+0000","last_change":"2024-04-26T10:38:01.537057+0000","last_active":"2024-04-26T10:38:01.536945+0000","last_peered":"2024-04-26T10:38:01.536945+0000","last_clean":"2024-04-26T10:38:01.536945+0000","last_became_active":"2024-04-26T10:37:28.281669+0000","last_became_peered":"2024-04-26T10:37:28.281669+0000","last_unstale":"2024-04-26T10:38:01.536945+0000","last_undegraded":"2024-04-26T10:38:01.536945+0000","last_fullsized":"2024-04-26T10:38:01.536945+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:01.536922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:01.536922+0000","last_clean_scrub_stamp":"2024-04-26T10:38:01.536922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:18.958300+0000","scrub_duration":0.0019935619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.992676+0000","last_change":"2024-04-26T10:38:03.992792+0000","last_active":"2024-04-26T10:38:03.992676+0000","last_peered":"2024-04-26T10:38:03.992676+0000","last_clean":"2024-04-26T10:38:03.992676+0000","last_became_active":"2024-04-26T10:37:23.268673+0000","last_became_peered":"2024-04-26T10:37:23.268673+0000","last_unstale":"2024-04-26T10:38:03.992676+0000","last_undegraded":"2024-04-26T10:38:03.992676+0000","last_fullsized":"2024-04-26T10:38:03.992676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.992656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.992656+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.992656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:06.482083+0000","scrub_duration":0.0019801340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284270+0000","last_change":"2024-04-26T10:37:23.277426+0000","last_active":"2024-04-26T10:37:29.284270+0000","last_peered":"2024-04-26T10:37:29.284270+0000","last_clean":"2024-04-26T10:37:29.284270+0000","last_became_active":"2024-04-26T10:37:23.277001+0000","last_became_peered":"2024-04-26T10:37:23.277001+0000","last_unstale":"2024-04-26T10:37:29.284270+0000","last_undegraded":"2024-04-26T10:37:29.284270+0000","last_fullsized":"2024-04-26T10:37:29.284270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786547+0000","last_change":"2024-04-26T10:37:23.267342+0000","last_active":"2024-04-26T10:37:36.786547+0000","last_peered":"2024-04-26T10:37:36.786547+0000","last_clean":"2024-04-26T10:37:36.786547+0000","last_became_active":"2024-04-26T10:37:23.266912+0000","last_became_peered":"2024-04-26T10:37:23.266912+0000","last_unstale":"2024-04-26T10:37:36.786547+0000","last_undegraded":"2024-04-26T10:37:36.786547+0000","last_fullsized":"2024-04-26T10:37:36.786547+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:39.091120+0000","last_change":"2024-04-26T10:37:39.091234+0000","last_active":"2024-04-26T10:37:39.091120+0000","last_peered":"2024-04-26T10:37:39.091120+0000","last_clean":"2024-04-26T10:37:39.091120+0000","last_became_active":"2024-04-26T10:37:23.277303+0000","last_became_peered":"2024-04-26T10:37:23.277303+0000","last_unstale":"2024-04-26T10:37:39.091120+0000","last_undegraded":"2024-04-26T10:37:39.091120+0000","last_fullsized":"2024-04-26T10:37:39.091120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:37:39.091052+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:37:39.091052+0000","last_clean_scrub_stamp":"2024-04-26T10:37:39.091052+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:34.281919+0000","scrub_duration":0.0021606110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:29.028179+0000","last_change":"2024-04-26T10:38:29.028282+0000","last_active":"2024-04-26T10:38:29.028179+0000","last_peered":"2024-04-26T10:38:29.028179+0000","last_clean":"2024-04-26T10:38:29.028179+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:38:29.028179+0000","last_undegraded":"2024-04-26T10:38:29.028179+0000","last_fullsized":"2024-04-26T10:38:29.028179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:29.028154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:29.028154+0000","last_clean_scrub_stamp":"2024-04-26T10:38:29.028154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:06:33.111156+0000","scrub_duration":0.001813516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284020+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:29.284020+0000","last_peered":"2024-04-26T10:37:29.284020+0000","last_clean":"2024-04-26T10:37:29.284020+0000","last_became_active":"2024-04-26T10:37:23.266295+0000","last_became_peered":"2024-04-26T10:37:23.266295+0000","last_unstale":"2024-04-26T10:37:29.284020+0000","last_undegraded":"2024-04-26T10:37:29.284020+0000","last_fullsized":"2024-04-26T10:37:29.284020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:49.930540+0000","last_change":"2024-04-26T10:37:49.930694+0000","last_active":"2024-04-26T10:37:49.930540+0000","last_peered":"2024-04-26T10:37:49.930540+0000","last_clean":"2024-04-26T10:37:49.930540+0000","last_became_active":"2024-04-26T10:37:23.272039+0000","last_became_peered":"2024-04-26T10:37:23.272039+0000","last_unstale":"2024-04-26T10:37:49.930540+0000","last_undegraded":"2024-04-26T10:37:49.930540+0000","last_fullsized":"2024-04-26T10:37:49.930540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:49.930517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:49.930517+0000","last_clean_scrub_stamp":"2024-04-26T10:37:49.930517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:31.070842+0000","scrub_duration":0.046350850999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786604+0000","last_change":"2024-04-26T10:37:23.273723+0000","last_active":"2024-04-26T10:37:36.786604+0000","last_peered":"2024-04-26T10:37:36.786604+0000","last_clean":"2024-04-26T10:37:36.786604+0000","last_became_active":"2024-04-26T10:37:23.273253+0000","last_became_peered":"2024-04-26T10:37:23.273253+0000","last_unstale":"2024-04-26T10:37:36.786604+0000","last_undegraded":"2024-04-26T10:37:36.786604+0000","last_fullsized":"2024-04-26T10:37:36.786604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283706+0000","last_change":"2024-04-26T10:37:23.267726+0000","last_active":"2024-04-26T10:37:29.283706+0000","last_peered":"2024-04-26T10:37:29.283706+0000","last_clean":"2024-04-26T10:37:29.283706+0000","last_became_active":"2024-04-26T10:37:23.267434+0000","last_became_peered":"2024-04-26T10:37:23.267434+0000","last_unstale":"2024-04-26T10:37:29.283706+0000","last_undegraded":"2024-04-26T10:37:29.283706+0000","last_fullsized":"2024-04-26T10:37:29.283706+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:11.578361+0000","last_change":"2024-04-26T10:38:11.578515+0000","last_active":"2024-04-26T10:38:11.578361+0000","last_peered":"2024-04-26T10:38:11.578361+0000","last_clean":"2024-04-26T10:38:11.578361+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:38:11.578361+0000","last_undegraded":"2024-04-26T10:38:11.578361+0000","last_fullsized":"2024-04-26T10:38:11.578361+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:38:11.578322+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:38:11.578322+0000","last_clean_scrub_stamp":"2024-04-26T10:38:11.578322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:12.780448+0000","scrub_duration":0.0019376879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887831+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:37:30.887831+0000","last_peered":"2024-04-26T10:37:30.887831+0000","last_clean":"2024-04-26T10:37:30.887831+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:37:30.887831+0000","last_undegraded":"2024-04-26T10:37:30.887831+0000","last_fullsized":"2024-04-26T10:37:30.887831+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:04.517677+0000","last_change":"2024-04-26T10:38:04.517785+0000","last_active":"2024-04-26T10:38:04.517677+0000","last_peered":"2024-04-26T10:38:04.517677+0000","last_clean":"2024-04-26T10:38:04.517677+0000","last_became_active":"2024-04-26T10:37:23.271663+0000","last_became_peered":"2024-04-26T10:37:23.271663+0000","last_unstale":"2024-04-26T10:38:04.517677+0000","last_undegraded":"2024-04-26T10:38:04.517677+0000","last_fullsized":"2024-04-26T10:38:04.517677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-26T10:38:04.517652+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-26T10:38:04.517652+0000","last_clean_scrub_stamp":"2024-04-26T10:38:04.517652+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:57.558254+0000","scrub_duration":0.0039017489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:06.954934+0000","last_change":"2024-04-26T10:38:06.955074+0000","last_active":"2024-04-26T10:38:06.954934+0000","last_peered":"2024-04-26T10:38:06.954934+0000","last_clean":"2024-04-26T10:38:06.954934+0000","last_became_active":"2024-04-26T10:37:23.266624+0000","last_became_peered":"2024-04-26T10:37:23.266624+0000","last_unstale":"2024-04-26T10:38:06.954934+0000","last_undegraded":"2024-04-26T10:38:06.954934+0000","last_fullsized":"2024-04-26T10:38:06.954934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:06.954911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:06.954911+0000","last_clean_scrub_stamp":"2024-04-26T10:38:06.954911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:18.063497+0000","scrub_duration":0.0021816610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:25.969625+0000","last_change":"2024-04-26T10:38:25.969756+0000","last_active":"2024-04-26T10:38:25.969625+0000","last_peered":"2024-04-26T10:38:25.969625+0000","last_clean":"2024-04-26T10:38:25.969625+0000","last_became_active":"2024-04-26T10:37:23.266063+0000","last_became_peered":"2024-04-26T10:37:23.266063+0000","last_unstale":"2024-04-26T10:38:25.969625+0000","last_undegraded":"2024-04-26T10:38:25.969625+0000","last_fullsized":"2024-04-26T10:38:25.969625+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:25.969600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:25.969600+0000","last_clean_scrub_stamp":"2024-04-26T10:38:25.969600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:03.988066+0000","scrub_duration":0.001770282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.177409+0000","last_change":"2024-04-26T10:37:28.282145+0000","last_active":"2024-04-26T10:37:30.177409+0000","last_peered":"2024-04-26T10:37:30.177409+0000","last_clean":"2024-04-26T10:37:30.177409+0000","last_became_active":"2024-04-26T10:37:28.281541+0000","last_became_peered":"2024-04-26T10:37:28.281541+0000","last_unstale":"2024-04-26T10:37:30.177409+0000","last_undegraded":"2024-04-26T10:37:30.177409+0000","last_fullsized":"2024-04-26T10:37:30.177409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:06.997133+0000","last_change":"2024-04-26T10:38:06.997233+0000","last_active":"2024-04-26T10:38:06.997133+0000","last_peered":"2024-04-26T10:38:06.997133+0000","last_clean":"2024-04-26T10:38:06.997133+0000","last_became_active":"2024-04-26T10:37:23.267644+0000","last_became_peered":"2024-04-26T10:37:23.267644+0000","last_unstale":"2024-04-26T10:38:06.997133+0000","last_undegraded":"2024-04-26T10:38:06.997133+0000","last_fullsized":"2024-04-26T10:38:06.997133+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:06.997106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:06.997106+0000","last_clean_scrub_stamp":"2024-04-26T10:38:06.997106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:56:00.253043+0000","scrub_duration":0.001652953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:22.503915+0000","last_change":"2024-04-26T10:38:22.504052+0000","last_active":"2024-04-26T10:38:22.503915+0000","last_peered":"2024-04-26T10:38:22.503915+0000","last_clean":"2024-04-26T10:38:22.503915+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:38:22.503915+0000","last_undegraded":"2024-04-26T10:38:22.503915+0000","last_fullsized":"2024-04-26T10:38:22.503915+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:22.503891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:22.503891+0000","last_clean_scrub_stamp":"2024-04-26T10:38:22.503891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:15.301897+0000","scrub_duration":0.027299981000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:16.025759+0000","last_change":"2024-04-26T10:38:16.025759+0000","last_active":"2024-04-26T10:38:16.025759+0000","last_peered":"2024-04-26T10:38:16.025759+0000","last_clean":"2024-04-26T10:38:16.025759+0000","last_became_active":"2024-04-26T10:37:23.273023+0000","last_became_peered":"2024-04-26T10:37:23.273023+0000","last_unstale":"2024-04-26T10:38:16.025759+0000","last_undegraded":"2024-04-26T10:38:16.025759+0000","last_fullsized":"2024-04-26T10:38:16.025759+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:16.025616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:16.025616+0000","last_clean_scrub_stamp":"2024-04-26T10:38:16.025616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:37.698478+0000","scrub_duration":0.0018282789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1766,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738442,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":338824,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":94033016,"statfs":{"total":96636764160,"available":96289808384,"internally_reserved":0,"allocated":917504,"data_stored":359527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346028486},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:38:22 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.42199999999999999}]},{"osd":1,"last update":"Fri Apr 26 10:37:52 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.39000000000000001},"min":{"1min":0.35399999999999998,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.65100000000000002,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.64500000000000002,"15min":0.498},"min":{"1min":0.314,"5min":0.19,"15min":0.19},"max":{"1min":0.61799999999999999,"5min":12.206,"15min":12.206},"last":0.442}]}]},{"osd":0,"up_from":75,"seq":322122547217,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55012,"kb_used_data":1500,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94316828,"statfs":{"total":96636764160,"available":96580431872,"internally_reserved":0,"allocated":1536000,"data_stored":951641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7111,"internal_metadata":54780985},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:38:22 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.627}]},{"osd":2,"last update":"Fri Apr 26 10:38:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.59099999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738441,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257368,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":255870,"kb_avail":94114472,"statfs":{"total":96636764160,"available":96373219328,"internally_reserved":0,"allocated":1523712,"data_stored":948912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262011334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:38:23 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Apr 26 10:37:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.45600000000000002,"15min":0.36699999999999999},"min":{"1min":0.33700000000000002,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.65700000000000003,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49099999999999999,"15min":0.45500000000000002},"min":{"1min":0.308,"5min":0.183,"15min":0.183},"max":{"1min":0.60599999999999998,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.442}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:38:38.847 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.847 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.848 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.848 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.848 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.848 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.849 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.849 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.849 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.850 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.850 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.850 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.850 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.851 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.851 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.851 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.851 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.852 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.852 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.852 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.853 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.853 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.853 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.853 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.854 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.854 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.854 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.855 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.855 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.855 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.855 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.856 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.856 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.856 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.857 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.857 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.857 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.857 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.858 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.858 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.858 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.859 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.859 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.859 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.859 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.860 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:38.860 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:38:58.861 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:38:59.223 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:38:59.225 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:38:59.234 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-04-26T10:38:59.079868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":592134,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":651204,"kb_used_data":3884,"kb_used_omap":10,"kb_used_meta":647285,"kb_avail":282464316,"statfs":{"total":289910292480,"available":289243459584,"internally_reserved":0,"allocated":3977216,"data_stored":2260080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10299,"internal_metadata":662820805},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003159"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786881+0000","last_change":"2024-04-26T10:34:14.506382+0000","last_active":"2024-04-26T10:37:36.786881+0000","last_peered":"2024-04-26T10:37:36.786881+0000","last_clean":"2024-04-26T10:37:36.786881+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:37:36.786881+0000","last_undegraded":"2024-04-26T10:37:36.786881+0000","last_fullsized":"2024-04-26T10:37:36.786881+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:46.090568+0000","last_change":"2024-04-26T10:37:46.090713+0000","last_active":"2024-04-26T10:37:46.090568+0000","last_peered":"2024-04-26T10:37:46.090568+0000","last_clean":"2024-04-26T10:37:46.090568+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:37:46.090568+0000","last_undegraded":"2024-04-26T10:37:46.090568+0000","last_fullsized":"2024-04-26T10:37:46.090568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:46.090545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:46.090545+0000","last_clean_scrub_stamp":"2024-04-26T10:37:46.090545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:42.129201+0000","scrub_duration":0.001738082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.946243+0000","last_change":"2024-04-26T10:37:36.946374+0000","last_active":"2024-04-26T10:37:36.946243+0000","last_peered":"2024-04-26T10:37:36.946243+0000","last_clean":"2024-04-26T10:37:36.946243+0000","last_became_active":"2024-04-26T10:37:23.272107+0000","last_became_peered":"2024-04-26T10:37:23.272107+0000","last_unstale":"2024-04-26T10:37:36.946243+0000","last_undegraded":"2024-04-26T10:37:36.946243+0000","last_fullsized":"2024-04-26T10:37:36.946243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:36.946219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:36.946219+0000","last_clean_scrub_stamp":"2024-04-26T10:37:36.946219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:56.583737+0000","scrub_duration":0.0019495529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:54.913664+0000","last_change":"2024-04-26T10:37:54.913778+0000","last_active":"2024-04-26T10:37:54.913664+0000","last_peered":"2024-04-26T10:37:54.913664+0000","last_clean":"2024-04-26T10:37:54.913664+0000","last_became_active":"2024-04-26T10:37:23.269752+0000","last_became_peered":"2024-04-26T10:37:23.269752+0000","last_unstale":"2024-04-26T10:37:54.913664+0000","last_undegraded":"2024-04-26T10:37:54.913664+0000","last_fullsized":"2024-04-26T10:37:54.913664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:54.913640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:54.913640+0000","last_clean_scrub_stamp":"2024-04-26T10:37:54.913640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:45.220783+0000","scrub_duration":0.0019585140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:44.056407+0000","last_change":"2024-04-26T10:37:44.056524+0000","last_active":"2024-04-26T10:37:44.056407+0000","last_peered":"2024-04-26T10:37:44.056407+0000","last_clean":"2024-04-26T10:37:44.056407+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:37:44.056407+0000","last_undegraded":"2024-04-26T10:37:44.056407+0000","last_fullsized":"2024-04-26T10:37:44.056407+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:44.056381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:44.056381+0000","last_clean_scrub_stamp":"2024-04-26T10:37:44.056381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:26.047330+0000","scrub_duration":0.016160926999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.015997+0000","last_change":"2024-04-26T10:38:03.016124+0000","last_active":"2024-04-26T10:38:03.015997+0000","last_peered":"2024-04-26T10:38:03.015997+0000","last_clean":"2024-04-26T10:38:03.015997+0000","last_became_active":"2024-04-26T10:37:23.270593+0000","last_became_peered":"2024-04-26T10:37:23.270593+0000","last_unstale":"2024-04-26T10:38:03.015997+0000","last_undegraded":"2024-04-26T10:38:03.015997+0000","last_fullsized":"2024-04-26T10:38:03.015997+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.015972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.015972+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.015972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:42.504031+0000","scrub_duration":0.001820241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:22.072251+0000","last_change":"2024-04-26T10:38:22.072368+0000","last_active":"2024-04-26T10:38:22.072251+0000","last_peered":"2024-04-26T10:38:22.072251+0000","last_clean":"2024-04-26T10:38:22.072251+0000","last_became_active":"2024-04-26T10:37:23.270393+0000","last_became_peered":"2024-04-26T10:37:23.270393+0000","last_unstale":"2024-04-26T10:38:22.072251+0000","last_undegraded":"2024-04-26T10:38:22.072251+0000","last_fullsized":"2024-04-26T10:38:22.072251+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:22.072225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:22.072225+0000","last_clean_scrub_stamp":"2024-04-26T10:38:22.072225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:16.925527+0000","scrub_duration":0.016661415999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:35.066777+0000","last_change":"2024-04-26T10:38:35.066914+0000","last_active":"2024-04-26T10:38:35.066777+0000","last_peered":"2024-04-26T10:38:35.066777+0000","last_clean":"2024-04-26T10:38:35.066777+0000","last_became_active":"2024-04-26T10:37:23.267296+0000","last_became_peered":"2024-04-26T10:37:23.267296+0000","last_unstale":"2024-04-26T10:38:35.066777+0000","last_undegraded":"2024-04-26T10:38:35.066777+0000","last_fullsized":"2024-04-26T10:38:35.066777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:35.066756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:35.066756+0000","last_clean_scrub_stamp":"2024-04-26T10:38:35.066756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:14.500147+0000","scrub_duration":0.0017231670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302677+0000","last_change":"2024-04-26T10:32:52.008902+0000","last_active":"2024-04-26T10:37:37.302677+0000","last_peered":"2024-04-26T10:37:37.302677+0000","last_clean":"2024-04-26T10:37:37.302677+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:37:37.302677+0000","last_undegraded":"2024-04-26T10:37:37.302677+0000","last_fullsized":"2024-04-26T10:37:37.302677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:45.073035+0000","last_change":"2024-04-26T10:37:45.073164+0000","last_active":"2024-04-26T10:37:45.073035+0000","last_peered":"2024-04-26T10:37:45.073035+0000","last_clean":"2024-04-26T10:37:45.073035+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:37:45.073035+0000","last_undegraded":"2024-04-26T10:37:45.073035+0000","last_fullsized":"2024-04-26T10:37:45.073035+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:45.073006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:45.073006+0000","last_clean_scrub_stamp":"2024-04-26T10:37:45.073006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:23.891265+0000","scrub_duration":0.001902131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:48.878670+0000","last_change":"2024-04-26T10:37:48.878771+0000","last_active":"2024-04-26T10:37:48.878670+0000","last_peered":"2024-04-26T10:37:48.878670+0000","last_clean":"2024-04-26T10:37:48.878670+0000","last_became_active":"2024-04-26T10:37:23.273996+0000","last_became_peered":"2024-04-26T10:37:23.273996+0000","last_unstale":"2024-04-26T10:37:48.878670+0000","last_undegraded":"2024-04-26T10:37:48.878670+0000","last_fullsized":"2024-04-26T10:37:48.878670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:48.878645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:48.878645+0000","last_clean_scrub_stamp":"2024-04-26T10:37:48.878645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:14.620591+0000","scrub_duration":0.017302161999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:02.964860+0000","last_change":"2024-04-26T10:38:02.964962+0000","last_active":"2024-04-26T10:38:02.964860+0000","last_peered":"2024-04-26T10:38:02.964860+0000","last_clean":"2024-04-26T10:38:02.964860+0000","last_became_active":"2024-04-26T10:37:23.273290+0000","last_became_peered":"2024-04-26T10:37:23.273290+0000","last_unstale":"2024-04-26T10:38:02.964860+0000","last_undegraded":"2024-04-26T10:38:02.964860+0000","last_fullsized":"2024-04-26T10:38:02.964860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:02.964836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:02.964836+0000","last_clean_scrub_stamp":"2024-04-26T10:38:02.964836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:19.028065+0000","scrub_duration":0.0018081550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":63,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:28.062536+0000","last_change":"2024-04-26T10:38:28.062652+0000","last_active":"2024-04-26T10:38:28.062536+0000","last_peered":"2024-04-26T10:38:28.062536+0000","last_clean":"2024-04-26T10:38:28.062536+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:38:28.062536+0000","last_undegraded":"2024-04-26T10:38:28.062536+0000","last_fullsized":"2024-04-26T10:38:28.062536+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:28.062510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:28.062510+0000","last_clean_scrub_stamp":"2024-04-26T10:38:28.062510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:26.115949+0000","scrub_duration":0.016455943000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:17.121016+0000","last_change":"2024-04-26T10:38:17.121111+0000","last_active":"2024-04-26T10:38:17.121016+0000","last_peered":"2024-04-26T10:38:17.121016+0000","last_clean":"2024-04-26T10:38:17.121016+0000","last_became_active":"2024-04-26T10:37:23.269722+0000","last_became_peered":"2024-04-26T10:37:23.269722+0000","last_unstale":"2024-04-26T10:38:17.121016+0000","last_undegraded":"2024-04-26T10:38:17.121016+0000","last_fullsized":"2024-04-26T10:38:17.121016+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:17.120993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:17.120993+0000","last_clean_scrub_stamp":"2024-04-26T10:38:17.120993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:25.421013+0000","scrub_duration":0.001930906,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:13.078246+0000","last_change":"2024-04-26T10:38:13.078391+0000","last_active":"2024-04-26T10:38:13.078246+0000","last_peered":"2024-04-26T10:38:13.078246+0000","last_clean":"2024-04-26T10:38:13.078246+0000","last_became_active":"2024-04-26T10:37:23.270852+0000","last_became_peered":"2024-04-26T10:37:23.270852+0000","last_unstale":"2024-04-26T10:38:13.078246+0000","last_undegraded":"2024-04-26T10:38:13.078246+0000","last_fullsized":"2024-04-26T10:38:13.078246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:13.078224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:13.078224+0000","last_clean_scrub_stamp":"2024-04-26T10:38:13.078224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:09.840624+0000","scrub_duration":0.0018370000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:38.963069+0000","last_change":"2024-04-26T10:37:38.963200+0000","last_active":"2024-04-26T10:37:38.963069+0000","last_peered":"2024-04-26T10:37:38.963069+0000","last_clean":"2024-04-26T10:37:38.963069+0000","last_became_active":"2024-04-26T10:37:23.268640+0000","last_became_peered":"2024-04-26T10:37:23.268640+0000","last_unstale":"2024-04-26T10:37:38.963069+0000","last_undegraded":"2024-04-26T10:37:38.963069+0000","last_fullsized":"2024-04-26T10:37:38.963069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:38.963045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:38.963045+0000","last_clean_scrub_stamp":"2024-04-26T10:37:38.963045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:17.672777+0000","scrub_duration":0.0018662049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.177542+0000","last_change":"2024-04-26T10:37:28.282247+0000","last_active":"2024-04-26T10:37:30.177542+0000","last_peered":"2024-04-26T10:37:30.177542+0000","last_clean":"2024-04-26T10:37:30.177542+0000","last_became_active":"2024-04-26T10:37:28.281510+0000","last_became_peered":"2024-04-26T10:37:28.281510+0000","last_unstale":"2024-04-26T10:37:30.177542+0000","last_undegraded":"2024-04-26T10:37:30.177542+0000","last_fullsized":"2024-04-26T10:37:30.177542+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:07.970813+0000","last_change":"2024-04-26T10:38:07.970813+0000","last_active":"2024-04-26T10:38:07.970813+0000","last_peered":"2024-04-26T10:38:07.970813+0000","last_clean":"2024-04-26T10:38:07.970813+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:38:07.970813+0000","last_undegraded":"2024-04-26T10:38:07.970813+0000","last_fullsized":"2024-04-26T10:38:07.970813+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:07.970664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:07.970664+0000","last_clean_scrub_stamp":"2024-04-26T10:38:07.970664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:55.346373+0000","scrub_duration":0.001805283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:38.715625+0000","last_change":"2024-04-26T10:37:38.715778+0000","last_active":"2024-04-26T10:37:38.715625+0000","last_peered":"2024-04-26T10:37:38.715625+0000","last_clean":"2024-04-26T10:37:38.715625+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:37:38.715625+0000","last_undegraded":"2024-04-26T10:37:38.715625+0000","last_fullsized":"2024-04-26T10:37:38.715625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:38.715602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:38.715602+0000","last_clean_scrub_stamp":"2024-04-26T10:37:38.715602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:48.931629+0000","scrub_duration":0.028191391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284226+0000","last_change":"2024-04-26T10:37:23.273700+0000","last_active":"2024-04-26T10:37:29.284226+0000","last_peered":"2024-04-26T10:37:29.284226+0000","last_clean":"2024-04-26T10:37:29.284226+0000","last_became_active":"2024-04-26T10:37:23.272964+0000","last_became_peered":"2024-04-26T10:37:23.272964+0000","last_unstale":"2024-04-26T10:37:29.284226+0000","last_undegraded":"2024-04-26T10:37:29.284226+0000","last_fullsized":"2024-04-26T10:37:29.284226+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:30.097028+0000","last_change":"2024-04-26T10:38:30.097185+0000","last_active":"2024-04-26T10:38:30.097028+0000","last_peered":"2024-04-26T10:38:30.097028+0000","last_clean":"2024-04-26T10:38:30.097028+0000","last_became_active":"2024-04-26T10:37:23.271967+0000","last_became_peered":"2024-04-26T10:37:23.271967+0000","last_unstale":"2024-04-26T10:38:30.097028+0000","last_undegraded":"2024-04-26T10:38:30.097028+0000","last_fullsized":"2024-04-26T10:38:30.097028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:30.096999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:30.096999+0000","last_clean_scrub_stamp":"2024-04-26T10:38:30.096999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:19.434538+0000","scrub_duration":0.028246974000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:35.081996+0000","last_change":"2024-04-26T10:38:35.082140+0000","last_active":"2024-04-26T10:38:35.081996+0000","last_peered":"2024-04-26T10:38:35.081996+0000","last_clean":"2024-04-26T10:38:35.081996+0000","last_became_active":"2024-04-26T10:37:23.267766+0000","last_became_peered":"2024-04-26T10:37:23.267766+0000","last_unstale":"2024-04-26T10:38:35.081996+0000","last_undegraded":"2024-04-26T10:38:35.081996+0000","last_fullsized":"2024-04-26T10:38:35.081996+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:35.081966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:35.081966+0000","last_clean_scrub_stamp":"2024-04-26T10:38:35.081966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:40.239398+0000","scrub_duration":0.0016982189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:13.618361+0000","last_change":"2024-04-26T10:38:13.618466+0000","last_active":"2024-04-26T10:38:13.618361+0000","last_peered":"2024-04-26T10:38:13.618361+0000","last_clean":"2024-04-26T10:38:13.618361+0000","last_became_active":"2024-04-26T10:37:23.269861+0000","last_became_peered":"2024-04-26T10:37:23.269861+0000","last_unstale":"2024-04-26T10:38:13.618361+0000","last_undegraded":"2024-04-26T10:38:13.618361+0000","last_fullsized":"2024-04-26T10:38:13.618361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:13.618337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:13.618337+0000","last_clean_scrub_stamp":"2024-04-26T10:38:13.618337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:51.339204+0000","scrub_duration":0.0019172900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887915+0000","last_change":"2024-04-26T10:32:51.999033+0000","last_active":"2024-04-26T10:37:30.887915+0000","last_peered":"2024-04-26T10:37:30.887915+0000","last_clean":"2024-04-26T10:37:30.887915+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:37:30.887915+0000","last_undegraded":"2024-04-26T10:37:30.887915+0000","last_fullsized":"2024-04-26T10:37:30.887915+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786748+0000","last_change":"2024-04-26T10:37:23.272702+0000","last_active":"2024-04-26T10:37:36.786748+0000","last_peered":"2024-04-26T10:37:36.786748+0000","last_clean":"2024-04-26T10:37:36.786748+0000","last_became_active":"2024-04-26T10:37:23.272218+0000","last_became_peered":"2024-04-26T10:37:23.272218+0000","last_unstale":"2024-04-26T10:37:36.786748+0000","last_undegraded":"2024-04-26T10:37:36.786748+0000","last_fullsized":"2024-04-26T10:37:36.786748+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284266+0000","last_change":"2024-04-26T10:37:23.271247+0000","last_active":"2024-04-26T10:37:29.284266+0000","last_peered":"2024-04-26T10:37:29.284266+0000","last_clean":"2024-04-26T10:37:29.284266+0000","last_became_active":"2024-04-26T10:37:23.270919+0000","last_became_peered":"2024-04-26T10:37:23.270919+0000","last_unstale":"2024-04-26T10:37:29.284266+0000","last_undegraded":"2024-04-26T10:37:29.284266+0000","last_fullsized":"2024-04-26T10:37:29.284266+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284349+0000","last_change":"2024-04-26T10:37:23.275081+0000","last_active":"2024-04-26T10:37:29.284349+0000","last_peered":"2024-04-26T10:37:29.284349+0000","last_clean":"2024-04-26T10:37:29.284349+0000","last_became_active":"2024-04-26T10:37:23.273821+0000","last_became_peered":"2024-04-26T10:37:23.273821+0000","last_unstale":"2024-04-26T10:37:29.284349+0000","last_undegraded":"2024-04-26T10:37:29.284349+0000","last_fullsized":"2024-04-26T10:37:29.284349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:41.921825+0000","last_change":"2024-04-26T10:38:41.921932+0000","last_active":"2024-04-26T10:38:41.921825+0000","last_peered":"2024-04-26T10:38:41.921825+0000","last_clean":"2024-04-26T10:38:41.921825+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:38:41.921825+0000","last_undegraded":"2024-04-26T10:38:41.921825+0000","last_fullsized":"2024-04-26T10:38:41.921825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:38:41.921800+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:38:41.921800+0000","last_clean_scrub_stamp":"2024-04-26T10:38:41.921800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:13.776029+0000","scrub_duration":0.0017811509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:27.028396+0000","last_change":"2024-04-26T10:38:27.028530+0000","last_active":"2024-04-26T10:38:27.028396+0000","last_peered":"2024-04-26T10:38:27.028396+0000","last_clean":"2024-04-26T10:38:27.028396+0000","last_became_active":"2024-04-26T10:37:23.272837+0000","last_became_peered":"2024-04-26T10:37:23.272837+0000","last_unstale":"2024-04-26T10:38:27.028396+0000","last_undegraded":"2024-04-26T10:38:27.028396+0000","last_fullsized":"2024-04-26T10:38:27.028396+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:27.028373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:27.028373+0000","last_clean_scrub_stamp":"2024-04-26T10:38:27.028373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:37.281488+0000","scrub_duration":0.001773223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:20.440926+0000","last_change":"2024-04-26T10:38:20.441032+0000","last_active":"2024-04-26T10:38:20.440926+0000","last_peered":"2024-04-26T10:38:20.440926+0000","last_clean":"2024-04-26T10:38:20.440926+0000","last_became_active":"2024-04-26T10:37:23.269197+0000","last_became_peered":"2024-04-26T10:37:23.269197+0000","last_unstale":"2024-04-26T10:38:20.440926+0000","last_undegraded":"2024-04-26T10:38:20.440926+0000","last_fullsized":"2024-04-26T10:38:20.440926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:20.440901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:20.440901+0000","last_clean_scrub_stamp":"2024-04-26T10:38:20.440901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:56.822074+0000","scrub_duration":0.0016497720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.675146+0000","last_change":"2024-04-26T10:37:37.675146+0000","last_active":"2024-04-26T10:37:37.675146+0000","last_peered":"2024-04-26T10:37:37.675146+0000","last_clean":"2024-04-26T10:37:37.675146+0000","last_became_active":"2024-04-26T10:37:28.283421+0000","last_became_peered":"2024-04-26T10:37:28.283421+0000","last_unstale":"2024-04-26T10:37:37.675146+0000","last_undegraded":"2024-04-26T10:37:37.675146+0000","last_fullsized":"2024-04-26T10:37:37.675146+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:37.674937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:37.674937+0000","last_clean_scrub_stamp":"2024-04-26T10:37:37.674937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:45.188074+0000","scrub_duration":0.0017282650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:44.382264+0000","last_change":"2024-04-26T10:38:44.382369+0000","last_active":"2024-04-26T10:38:44.382264+0000","last_peered":"2024-04-26T10:38:44.382264+0000","last_clean":"2024-04-26T10:38:44.382264+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:38:44.382264+0000","last_undegraded":"2024-04-26T10:38:44.382264+0000","last_fullsized":"2024-04-26T10:38:44.382264+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:44.382241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:44.382241+0000","last_clean_scrub_stamp":"2024-04-26T10:38:44.382241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:32.405178+0000","scrub_duration":0.001690446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888683+0000","last_change":"2024-04-26T10:37:23.273035+0000","last_active":"2024-04-26T10:37:30.888683+0000","last_peered":"2024-04-26T10:37:30.888683+0000","last_clean":"2024-04-26T10:37:30.888683+0000","last_became_active":"2024-04-26T10:37:23.272666+0000","last_became_peered":"2024-04-26T10:37:23.272666+0000","last_unstale":"2024-04-26T10:37:30.888683+0000","last_undegraded":"2024-04-26T10:37:30.888683+0000","last_fullsized":"2024-04-26T10:37:30.888683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":80,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.302305+0000","last_change":"2024-04-26T10:37:23.271100+0000","last_active":"2024-04-26T10:37:37.302305+0000","last_peered":"2024-04-26T10:37:37.302305+0000","last_clean":"2024-04-26T10:37:37.302305+0000","last_became_active":"2024-04-26T10:37:23.270725+0000","last_became_peered":"2024-04-26T10:37:23.270725+0000","last_unstale":"2024-04-26T10:37:37.302305+0000","last_undegraded":"2024-04-26T10:37:37.302305+0000","last_fullsized":"2024-04-26T10:37:37.302305+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.478595+0000","last_change":"2024-04-26T10:38:03.478731+0000","last_active":"2024-04-26T10:38:03.478595+0000","last_peered":"2024-04-26T10:38:03.478595+0000","last_clean":"2024-04-26T10:38:03.478595+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:38:03.478595+0000","last_undegraded":"2024-04-26T10:38:03.478595+0000","last_fullsized":"2024-04-26T10:38:03.478595+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.478570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.478570+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.478570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:49.705887+0000","scrub_duration":0.00149917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:55.908127+0000","last_change":"2024-04-26T10:37:55.908269+0000","last_active":"2024-04-26T10:37:55.908127+0000","last_peered":"2024-04-26T10:37:55.908127+0000","last_clean":"2024-04-26T10:37:55.908127+0000","last_became_active":"2024-04-26T10:37:23.269371+0000","last_became_peered":"2024-04-26T10:37:23.269371+0000","last_unstale":"2024-04-26T10:37:55.908127+0000","last_undegraded":"2024-04-26T10:37:55.908127+0000","last_fullsized":"2024-04-26T10:37:55.908127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:55.908102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:55.908102+0000","last_clean_scrub_stamp":"2024-04-26T10:37:55.908102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:11.319524+0000","scrub_duration":0.0019603670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:49.354912+0000","last_change":"2024-04-26T10:38:49.355019+0000","last_active":"2024-04-26T10:38:49.354912+0000","last_peered":"2024-04-26T10:38:49.354912+0000","last_clean":"2024-04-26T10:38:49.354912+0000","last_became_active":"2024-04-26T10:37:23.269344+0000","last_became_peered":"2024-04-26T10:37:23.269344+0000","last_unstale":"2024-04-26T10:38:49.354912+0000","last_undegraded":"2024-04-26T10:38:49.354912+0000","last_fullsized":"2024-04-26T10:38:49.354912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:49.354889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:49.354889+0000","last_clean_scrub_stamp":"2024-04-26T10:38:49.354889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:19.945433+0000","scrub_duration":0.0018868769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888069+0000","last_change":"2024-04-26T10:37:23.273205+0000","last_active":"2024-04-26T10:37:30.888069+0000","last_peered":"2024-04-26T10:37:30.888069+0000","last_clean":"2024-04-26T10:37:30.888069+0000","last_became_active":"2024-04-26T10:37:23.272731+0000","last_became_peered":"2024-04-26T10:37:23.272731+0000","last_unstale":"2024-04-26T10:37:30.888069+0000","last_undegraded":"2024-04-26T10:37:30.888069+0000","last_fullsized":"2024-04-26T10:37:30.888069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:46.569879+0000","last_change":"2024-04-26T10:37:46.570003+0000","last_active":"2024-04-26T10:37:46.569879+0000","last_peered":"2024-04-26T10:37:46.569879+0000","last_clean":"2024-04-26T10:37:46.569879+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:37:46.569879+0000","last_undegraded":"2024-04-26T10:37:46.569879+0000","last_fullsized":"2024-04-26T10:37:46.569879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:46.569855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:46.569855+0000","last_clean_scrub_stamp":"2024-04-26T10:37:46.569855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:12.891140+0000","scrub_duration":0.00144177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":99,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284123+0000","last_change":"2024-04-26T10:37:23.272627+0000","last_active":"2024-04-26T10:37:29.284123+0000","last_peered":"2024-04-26T10:37:29.284123+0000","last_clean":"2024-04-26T10:37:29.284123+0000","last_became_active":"2024-04-26T10:37:23.269968+0000","last_became_peered":"2024-04-26T10:37:23.269968+0000","last_unstale":"2024-04-26T10:37:29.284123+0000","last_undegraded":"2024-04-26T10:37:29.284123+0000","last_fullsized":"2024-04-26T10:37:29.284123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:39.919590+0000","last_change":"2024-04-26T10:37:39.919719+0000","last_active":"2024-04-26T10:37:39.919590+0000","last_peered":"2024-04-26T10:37:39.919590+0000","last_clean":"2024-04-26T10:37:39.919590+0000","last_became_active":"2024-04-26T10:37:23.274045+0000","last_became_peered":"2024-04-26T10:37:23.274045+0000","last_unstale":"2024-04-26T10:37:39.919590+0000","last_undegraded":"2024-04-26T10:37:39.919590+0000","last_fullsized":"2024-04-26T10:37:39.919590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:39.919570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:39.919570+0000","last_clean_scrub_stamp":"2024-04-26T10:37:39.919570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:44.433055+0000","scrub_duration":0.001537217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283720+0000","last_change":"2024-04-26T10:37:23.273798+0000","last_active":"2024-04-26T10:37:29.283720+0000","last_peered":"2024-04-26T10:37:29.283720+0000","last_clean":"2024-04-26T10:37:29.283720+0000","last_became_active":"2024-04-26T10:37:23.269775+0000","last_became_peered":"2024-04-26T10:37:23.269775+0000","last_unstale":"2024-04-26T10:37:29.283720+0000","last_undegraded":"2024-04-26T10:37:29.283720+0000","last_fullsized":"2024-04-26T10:37:29.283720+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:04.000953+0000","last_change":"2024-04-26T10:38:04.000953+0000","last_active":"2024-04-26T10:38:04.000953+0000","last_peered":"2024-04-26T10:38:04.000953+0000","last_clean":"2024-04-26T10:38:04.000953+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:38:04.000953+0000","last_undegraded":"2024-04-26T10:38:04.000953+0000","last_fullsized":"2024-04-26T10:38:04.000953+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:04.000827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:04.000827+0000","last_clean_scrub_stamp":"2024-04-26T10:38:04.000827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:34.824818+0000","scrub_duration":0.0020431870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:32.456176+0000","last_change":"2024-04-26T10:38:32.456289+0000","last_active":"2024-04-26T10:38:32.456176+0000","last_peered":"2024-04-26T10:38:32.456176+0000","last_clean":"2024-04-26T10:38:32.456176+0000","last_became_active":"2024-04-26T10:37:23.269537+0000","last_became_peered":"2024-04-26T10:37:23.269537+0000","last_unstale":"2024-04-26T10:38:32.456176+0000","last_undegraded":"2024-04-26T10:38:32.456176+0000","last_fullsized":"2024-04-26T10:38:32.456176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:32.456150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:32.456150+0000","last_clean_scrub_stamp":"2024-04-26T10:38:32.456150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:05.179342+0000","scrub_duration":0.001825459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.888133+0000","last_change":"2024-04-26T10:34:14.507318+0000","last_active":"2024-04-26T10:37:30.888133+0000","last_peered":"2024-04-26T10:37:30.888133+0000","last_clean":"2024-04-26T10:37:30.888133+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:37:30.888133+0000","last_undegraded":"2024-04-26T10:37:30.888133+0000","last_fullsized":"2024-04-26T10:37:30.888133+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786546+0000","last_change":"2024-04-26T10:37:23.268114+0000","last_active":"2024-04-26T10:37:36.786546+0000","last_peered":"2024-04-26T10:37:36.786546+0000","last_clean":"2024-04-26T10:37:36.786546+0000","last_became_active":"2024-04-26T10:37:23.267121+0000","last_became_peered":"2024-04-26T10:37:23.267121+0000","last_unstale":"2024-04-26T10:37:36.786546+0000","last_undegraded":"2024-04-26T10:37:36.786546+0000","last_fullsized":"2024-04-26T10:37:36.786546+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:09.576502+0000","last_change":"2024-04-26T10:38:09.576610+0000","last_active":"2024-04-26T10:38:09.576502+0000","last_peered":"2024-04-26T10:38:09.576502+0000","last_clean":"2024-04-26T10:38:09.576502+0000","last_became_active":"2024-04-26T10:37:28.281512+0000","last_became_peered":"2024-04-26T10:37:28.281512+0000","last_unstale":"2024-04-26T10:38:09.576502+0000","last_undegraded":"2024-04-26T10:38:09.576502+0000","last_fullsized":"2024-04-26T10:38:09.576502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:09.576479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:09.576479+0000","last_clean_scrub_stamp":"2024-04-26T10:38:09.576479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:58.472401+0000","scrub_duration":0.0016694769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283487+0000","last_change":"2024-04-26T10:37:23.268184+0000","last_active":"2024-04-26T10:37:29.283487+0000","last_peered":"2024-04-26T10:37:29.283487+0000","last_clean":"2024-04-26T10:37:29.283487+0000","last_became_active":"2024-04-26T10:37:23.266377+0000","last_became_peered":"2024-04-26T10:37:23.266377+0000","last_unstale":"2024-04-26T10:37:29.283487+0000","last_undegraded":"2024-04-26T10:37:29.283487+0000","last_fullsized":"2024-04-26T10:37:29.283487+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:00.539928+0000","last_change":"2024-04-26T10:38:00.540104+0000","last_active":"2024-04-26T10:38:00.539928+0000","last_peered":"2024-04-26T10:38:00.539928+0000","last_clean":"2024-04-26T10:38:00.539928+0000","last_became_active":"2024-04-26T10:37:23.271752+0000","last_became_peered":"2024-04-26T10:37:23.271752+0000","last_unstale":"2024-04-26T10:38:00.539928+0000","last_undegraded":"2024-04-26T10:38:00.539928+0000","last_fullsized":"2024-04-26T10:38:00.539928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:00.539869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:00.539869+0000","last_clean_scrub_stamp":"2024-04-26T10:38:00.539869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:46.107019+0000","scrub_duration":0.052375984,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284617+0000","last_change":"2024-04-26T10:37:23.273840+0000","last_active":"2024-04-26T10:37:29.284617+0000","last_peered":"2024-04-26T10:37:29.284617+0000","last_clean":"2024-04-26T10:37:29.284617+0000","last_became_active":"2024-04-26T10:37:23.272156+0000","last_became_peered":"2024-04-26T10:37:23.272156+0000","last_unstale":"2024-04-26T10:37:29.284617+0000","last_undegraded":"2024-04-26T10:37:29.284617+0000","last_fullsized":"2024-04-26T10:37:29.284617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:09.993382+0000","last_change":"2024-04-26T10:38:09.993498+0000","last_active":"2024-04-26T10:38:09.993382+0000","last_peered":"2024-04-26T10:38:09.993382+0000","last_clean":"2024-04-26T10:38:09.993382+0000","last_became_active":"2024-04-26T10:37:23.267717+0000","last_became_peered":"2024-04-26T10:37:23.267717+0000","last_unstale":"2024-04-26T10:38:09.993382+0000","last_undegraded":"2024-04-26T10:38:09.993382+0000","last_fullsized":"2024-04-26T10:38:09.993382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:09.993363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:09.993363+0000","last_clean_scrub_stamp":"2024-04-26T10:38:09.993363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:57.793706+0000","scrub_duration":0.0019586830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"82'3","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:42.942776+0000","last_change":"2024-04-26T10:38:42.942922+0000","last_active":"2024-04-26T10:38:42.942776+0000","last_peered":"2024-04-26T10:38:42.942776+0000","last_clean":"2024-04-26T10:38:42.942776+0000","last_became_active":"2024-04-26T10:37:23.272260+0000","last_became_peered":"2024-04-26T10:37:23.272260+0000","last_unstale":"2024-04-26T10:38:42.942776+0000","last_undegraded":"2024-04-26T10:38:42.942776+0000","last_fullsized":"2024-04-26T10:38:42.942776+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:38:42.942735+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:38:42.942735+0000","last_clean_scrub_stamp":"2024-04-26T10:38:42.942735+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:00.597213+0000","scrub_duration":0.0033171590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:22.996504+0000","last_change":"2024-04-26T10:38:22.996504+0000","last_active":"2024-04-26T10:38:22.996504+0000","last_peered":"2024-04-26T10:38:22.996504+0000","last_clean":"2024-04-26T10:38:22.996504+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:38:22.996504+0000","last_undegraded":"2024-04-26T10:38:22.996504+0000","last_fullsized":"2024-04-26T10:38:22.996504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:22.996344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:22.996344+0000","last_clean_scrub_stamp":"2024-04-26T10:38:22.996344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:42.025260+0000","scrub_duration":0.001643909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'2","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:15.087666+0000","last_change":"2024-04-26T10:38:15.087778+0000","last_active":"2024-04-26T10:38:15.087666+0000","last_peered":"2024-04-26T10:38:15.087666+0000","last_clean":"2024-04-26T10:38:15.087666+0000","last_became_active":"2024-04-26T10:37:23.268441+0000","last_became_peered":"2024-04-26T10:37:23.268441+0000","last_unstale":"2024-04-26T10:38:15.087666+0000","last_undegraded":"2024-04-26T10:38:15.087666+0000","last_fullsized":"2024-04-26T10:38:15.087666+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T10:38:15.087643+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T10:38:15.087643+0000","last_clean_scrub_stamp":"2024-04-26T10:38:15.087643+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:42.284590+0000","scrub_duration":0.003756396,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:12.046677+0000","last_change":"2024-04-26T10:38:12.046827+0000","last_active":"2024-04-26T10:38:12.046677+0000","last_peered":"2024-04-26T10:38:12.046677+0000","last_clean":"2024-04-26T10:38:12.046677+0000","last_became_active":"2024-04-26T10:37:23.268451+0000","last_became_peered":"2024-04-26T10:37:23.268451+0000","last_unstale":"2024-04-26T10:38:12.046677+0000","last_undegraded":"2024-04-26T10:38:12.046677+0000","last_fullsized":"2024-04-26T10:38:12.046677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:12.046640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:12.046640+0000","last_clean_scrub_stamp":"2024-04-26T10:38:12.046640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:04.521493+0000","scrub_duration":0.002019739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284314+0000","last_change":"2024-04-26T10:37:23.273635+0000","last_active":"2024-04-26T10:37:29.284314+0000","last_peered":"2024-04-26T10:37:29.284314+0000","last_clean":"2024-04-26T10:37:29.284314+0000","last_became_active":"2024-04-26T10:37:23.272938+0000","last_became_peered":"2024-04-26T10:37:23.272938+0000","last_unstale":"2024-04-26T10:37:29.284314+0000","last_undegraded":"2024-04-26T10:37:29.284314+0000","last_fullsized":"2024-04-26T10:37:29.284314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:42.638376+0000","last_change":"2024-04-26T10:37:42.638539+0000","last_active":"2024-04-26T10:37:42.638376+0000","last_peered":"2024-04-26T10:37:42.638376+0000","last_clean":"2024-04-26T10:37:42.638376+0000","last_became_active":"2024-04-26T10:37:23.276957+0000","last_became_peered":"2024-04-26T10:37:23.276957+0000","last_unstale":"2024-04-26T10:37:42.638376+0000","last_undegraded":"2024-04-26T10:37:42.638376+0000","last_fullsized":"2024-04-26T10:37:42.638376+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:42.638352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:42.638352+0000","last_clean_scrub_stamp":"2024-04-26T10:37:42.638352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:15.896041+0000","scrub_duration":0.027944383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'3","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:43.378881+0000","last_change":"2024-04-26T10:38:43.379010+0000","last_active":"2024-04-26T10:38:43.378881+0000","last_peered":"2024-04-26T10:38:43.378881+0000","last_clean":"2024-04-26T10:38:43.378881+0000","last_became_active":"2024-04-26T10:37:23.277037+0000","last_became_peered":"2024-04-26T10:37:23.277037+0000","last_unstale":"2024-04-26T10:38:43.378881+0000","last_undegraded":"2024-04-26T10:38:43.378881+0000","last_fullsized":"2024-04-26T10:38:43.378881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:38:43.378855+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:38:43.378855+0000","last_clean_scrub_stamp":"2024-04-26T10:38:43.378855+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:09.102845+0000","scrub_duration":0.0033491789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283803+0000","last_change":"2024-04-26T10:37:23.270454+0000","last_active":"2024-04-26T10:37:29.283803+0000","last_peered":"2024-04-26T10:37:29.283803+0000","last_clean":"2024-04-26T10:37:29.283803+0000","last_became_active":"2024-04-26T10:37:23.269473+0000","last_became_peered":"2024-04-26T10:37:23.269473+0000","last_unstale":"2024-04-26T10:37:29.283803+0000","last_undegraded":"2024-04-26T10:37:29.283803+0000","last_fullsized":"2024-04-26T10:37:29.283803+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:51.892263+0000","last_change":"2024-04-26T10:38:51.892365+0000","last_active":"2024-04-26T10:38:51.892263+0000","last_peered":"2024-04-26T10:38:51.892263+0000","last_clean":"2024-04-26T10:38:51.892263+0000","last_became_active":"2024-04-26T10:37:23.267235+0000","last_became_peered":"2024-04-26T10:37:23.267235+0000","last_unstale":"2024-04-26T10:38:51.892263+0000","last_undegraded":"2024-04-26T10:38:51.892263+0000","last_fullsized":"2024-04-26T10:38:51.892263+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:51.892239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:51.892239+0000","last_clean_scrub_stamp":"2024-04-26T10:38:51.892239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:47.035824+0000","scrub_duration":0.001868951,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284323+0000","last_change":"2024-04-26T10:37:23.274693+0000","last_active":"2024-04-26T10:37:29.284323+0000","last_peered":"2024-04-26T10:37:29.284323+0000","last_clean":"2024-04-26T10:37:29.284323+0000","last_became_active":"2024-04-26T10:37:23.272111+0000","last_became_peered":"2024-04-26T10:37:23.272111+0000","last_unstale":"2024-04-26T10:37:29.284323+0000","last_undegraded":"2024-04-26T10:37:29.284323+0000","last_fullsized":"2024-04-26T10:37:29.284323+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:37.059181+0000","last_change":"2024-04-26T10:38:37.059303+0000","last_active":"2024-04-26T10:38:37.059181+0000","last_peered":"2024-04-26T10:38:37.059181+0000","last_clean":"2024-04-26T10:38:37.059181+0000","last_became_active":"2024-04-26T10:37:23.273867+0000","last_became_peered":"2024-04-26T10:37:23.273867+0000","last_unstale":"2024-04-26T10:38:37.059181+0000","last_undegraded":"2024-04-26T10:38:37.059181+0000","last_fullsized":"2024-04-26T10:38:37.059181+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:37.059156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:37.059156+0000","last_clean_scrub_stamp":"2024-04-26T10:38:37.059156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:44.572293+0000","scrub_duration":0.001855294,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:57.878941+0000","last_change":"2024-04-26T10:37:57.879044+0000","last_active":"2024-04-26T10:37:57.878941+0000","last_peered":"2024-04-26T10:37:57.878941+0000","last_clean":"2024-04-26T10:37:57.878941+0000","last_became_active":"2024-04-26T10:37:23.272569+0000","last_became_peered":"2024-04-26T10:37:23.272569+0000","last_unstale":"2024-04-26T10:37:57.878941+0000","last_undegraded":"2024-04-26T10:37:57.878941+0000","last_fullsized":"2024-04-26T10:37:57.878941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:57.878919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:57.878919+0000","last_clean_scrub_stamp":"2024-04-26T10:37:57.878919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:02.166486+0000","scrub_duration":0.0020039089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:29.992871+0000","last_change":"2024-04-26T10:38:29.992871+0000","last_active":"2024-04-26T10:38:29.992871+0000","last_peered":"2024-04-26T10:38:29.992871+0000","last_clean":"2024-04-26T10:38:29.992871+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:38:29.992871+0000","last_undegraded":"2024-04-26T10:38:29.992871+0000","last_fullsized":"2024-04-26T10:38:29.992871+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:29.992711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:29.992711+0000","last_clean_scrub_stamp":"2024-04-26T10:38:29.992711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:32.502846+0000","scrub_duration":0.0017064700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:54.397113+0000","last_change":"2024-04-26T10:38:54.397244+0000","last_active":"2024-04-26T10:38:54.397113+0000","last_peered":"2024-04-26T10:38:54.397113+0000","last_clean":"2024-04-26T10:38:54.397113+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:38:54.397113+0000","last_undegraded":"2024-04-26T10:38:54.397113+0000","last_fullsized":"2024-04-26T10:38:54.397113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:54.397088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:54.397088+0000","last_clean_scrub_stamp":"2024-04-26T10:38:54.397088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:15.372732+0000","scrub_duration":0.054218492,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.177479+0000","last_change":"2024-04-26T10:37:28.282767+0000","last_active":"2024-04-26T10:37:30.177479+0000","last_peered":"2024-04-26T10:37:30.177479+0000","last_clean":"2024-04-26T10:37:30.177479+0000","last_became_active":"2024-04-26T10:37:28.282419+0000","last_became_peered":"2024-04-26T10:37:28.282419+0000","last_unstale":"2024-04-26T10:37:30.177479+0000","last_undegraded":"2024-04-26T10:37:30.177479+0000","last_fullsized":"2024-04-26T10:37:30.177479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:47.889504+0000","last_change":"2024-04-26T10:37:47.889608+0000","last_active":"2024-04-26T10:37:47.889504+0000","last_peered":"2024-04-26T10:37:47.889504+0000","last_clean":"2024-04-26T10:37:47.889504+0000","last_became_active":"2024-04-26T10:37:23.273114+0000","last_became_peered":"2024-04-26T10:37:23.273114+0000","last_unstale":"2024-04-26T10:37:47.889504+0000","last_undegraded":"2024-04-26T10:37:47.889504+0000","last_fullsized":"2024-04-26T10:37:47.889504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:47.889480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:47.889480+0000","last_clean_scrub_stamp":"2024-04-26T10:37:47.889480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:38.351949+0000","scrub_duration":0.0018432660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:00.037320+0000","last_change":"2024-04-26T10:38:00.037320+0000","last_active":"2024-04-26T10:38:00.037320+0000","last_peered":"2024-04-26T10:38:00.037320+0000","last_clean":"2024-04-26T10:38:00.037320+0000","last_became_active":"2024-04-26T10:37:23.267319+0000","last_became_peered":"2024-04-26T10:37:23.267319+0000","last_unstale":"2024-04-26T10:38:00.037320+0000","last_undegraded":"2024-04-26T10:38:00.037320+0000","last_fullsized":"2024-04-26T10:38:00.037320+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:00.037154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:00.037154+0000","last_clean_scrub_stamp":"2024-04-26T10:38:00.037154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:01.442829+0000","scrub_duration":0.0020604550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:38.002518+0000","last_change":"2024-04-26T10:38:38.002661+0000","last_active":"2024-04-26T10:38:38.002518+0000","last_peered":"2024-04-26T10:38:38.002518+0000","last_clean":"2024-04-26T10:38:38.002518+0000","last_became_active":"2024-04-26T10:37:23.266332+0000","last_became_peered":"2024-04-26T10:37:23.266332+0000","last_unstale":"2024-04-26T10:38:38.002518+0000","last_undegraded":"2024-04-26T10:38:38.002518+0000","last_fullsized":"2024-04-26T10:38:38.002518+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:38.002497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:38.002497+0000","last_clean_scrub_stamp":"2024-04-26T10:38:38.002497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:04.953996+0000","scrub_duration":0.0019267080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:32.115831+0000","last_change":"2024-04-26T10:38:32.115967+0000","last_active":"2024-04-26T10:38:32.115831+0000","last_peered":"2024-04-26T10:38:32.115831+0000","last_clean":"2024-04-26T10:38:32.115831+0000","last_became_active":"2024-04-26T10:37:23.269657+0000","last_became_peered":"2024-04-26T10:37:23.269657+0000","last_unstale":"2024-04-26T10:38:32.115831+0000","last_undegraded":"2024-04-26T10:38:32.115831+0000","last_fullsized":"2024-04-26T10:38:32.115831+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:32.115807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:32.115807+0000","last_clean_scrub_stamp":"2024-04-26T10:38:32.115807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:12.148163+0000","scrub_duration":0.0016869439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:41.612812+0000","last_change":"2024-04-26T10:37:41.612919+0000","last_active":"2024-04-26T10:37:41.612812+0000","last_peered":"2024-04-26T10:37:41.612812+0000","last_clean":"2024-04-26T10:37:41.612812+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:37:41.612812+0000","last_undegraded":"2024-04-26T10:37:41.612812+0000","last_fullsized":"2024-04-26T10:37:41.612812+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:41.612787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:41.612787+0000","last_clean_scrub_stamp":"2024-04-26T10:37:41.612787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:15.886238+0000","scrub_duration":0.001521445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:34.428552+0000","last_change":"2024-04-26T10:38:34.428825+0000","last_active":"2024-04-26T10:38:34.428552+0000","last_peered":"2024-04-26T10:38:34.428552+0000","last_clean":"2024-04-26T10:38:34.428552+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:38:34.428552+0000","last_undegraded":"2024-04-26T10:38:34.428552+0000","last_fullsized":"2024-04-26T10:38:34.428552+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:34.428529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:34.428529+0000","last_clean_scrub_stamp":"2024-04-26T10:38:34.428529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:41.415399+0000","scrub_duration":0.0019058580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:38.035356+0000","last_change":"2024-04-26T10:38:38.035356+0000","last_active":"2024-04-26T10:38:38.035356+0000","last_peered":"2024-04-26T10:38:38.035356+0000","last_clean":"2024-04-26T10:38:38.035356+0000","last_became_active":"2024-04-26T10:37:23.267595+0000","last_became_peered":"2024-04-26T10:37:23.267595+0000","last_unstale":"2024-04-26T10:38:38.035356+0000","last_undegraded":"2024-04-26T10:38:38.035356+0000","last_fullsized":"2024-04-26T10:38:38.035356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:38.035219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:38.035219+0000","last_clean_scrub_stamp":"2024-04-26T10:38:38.035219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:48.251247+0000","scrub_duration":0.0018318849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:18.553783+0000","last_change":"2024-04-26T10:38:18.553915+0000","last_active":"2024-04-26T10:38:18.553783+0000","last_peered":"2024-04-26T10:38:18.553783+0000","last_clean":"2024-04-26T10:38:18.553783+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:38:18.553783+0000","last_undegraded":"2024-04-26T10:38:18.553783+0000","last_fullsized":"2024-04-26T10:38:18.553783+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:18.553758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:18.553758+0000","last_clean_scrub_stamp":"2024-04-26T10:38:18.553758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:18.557993+0000","scrub_duration":0.028014801999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:46.963835+0000","last_change":"2024-04-26T10:38:46.963949+0000","last_active":"2024-04-26T10:38:46.963835+0000","last_peered":"2024-04-26T10:38:46.963835+0000","last_clean":"2024-04-26T10:38:46.963835+0000","last_became_active":"2024-04-26T10:37:23.270451+0000","last_became_peered":"2024-04-26T10:37:23.270451+0000","last_unstale":"2024-04-26T10:38:46.963835+0000","last_undegraded":"2024-04-26T10:38:46.963835+0000","last_fullsized":"2024-04-26T10:38:46.963835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:46.963811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:46.963811+0000","last_clean_scrub_stamp":"2024-04-26T10:38:46.963811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:33.953521+0000","scrub_duration":0.0018432749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":301,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283617+0000","last_change":"2024-04-26T10:37:23.269600+0000","last_active":"2024-04-26T10:37:29.283617+0000","last_peered":"2024-04-26T10:37:29.283617+0000","last_clean":"2024-04-26T10:37:29.283617+0000","last_became_active":"2024-04-26T10:37:23.268665+0000","last_became_peered":"2024-04-26T10:37:23.268665+0000","last_unstale":"2024-04-26T10:37:29.283617+0000","last_undegraded":"2024-04-26T10:37:29.283617+0000","last_fullsized":"2024-04-26T10:37:29.283617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:38.410016+0000","last_change":"2024-04-26T10:38:38.410149+0000","last_active":"2024-04-26T10:38:38.410016+0000","last_peered":"2024-04-26T10:38:38.410016+0000","last_clean":"2024-04-26T10:38:38.410016+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:38:38.410016+0000","last_undegraded":"2024-04-26T10:38:38.410016+0000","last_fullsized":"2024-04-26T10:38:38.410016+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:38.409993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:38.409993+0000","last_clean_scrub_stamp":"2024-04-26T10:38:38.409993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:26.451120+0000","scrub_duration":0.0018049819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:58.886200+0000","last_change":"2024-04-26T10:37:58.886319+0000","last_active":"2024-04-26T10:37:58.886200+0000","last_peered":"2024-04-26T10:37:58.886200+0000","last_clean":"2024-04-26T10:37:58.886200+0000","last_became_active":"2024-04-26T10:37:23.269736+0000","last_became_peered":"2024-04-26T10:37:23.269736+0000","last_unstale":"2024-04-26T10:37:58.886200+0000","last_undegraded":"2024-04-26T10:37:58.886200+0000","last_fullsized":"2024-04-26T10:37:58.886200+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:58.886177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:58.886177+0000","last_clean_scrub_stamp":"2024-04-26T10:37:58.886177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:36.789200+0000","scrub_duration":0.002025603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:23.996073+0000","last_change":"2024-04-26T10:38:23.996208+0000","last_active":"2024-04-26T10:38:23.996073+0000","last_peered":"2024-04-26T10:38:23.996073+0000","last_clean":"2024-04-26T10:38:23.996073+0000","last_became_active":"2024-04-26T10:37:23.265317+0000","last_became_peered":"2024-04-26T10:37:23.265317+0000","last_unstale":"2024-04-26T10:38:23.996073+0000","last_undegraded":"2024-04-26T10:38:23.996073+0000","last_fullsized":"2024-04-26T10:38:23.996073+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:23.996042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:23.996042+0000","last_clean_scrub_stamp":"2024-04-26T10:38:23.996042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:33.504025+0000","scrub_duration":0.001878865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:36.367610+0000","last_change":"2024-04-26T10:38:36.367763+0000","last_active":"2024-04-26T10:38:36.367610+0000","last_peered":"2024-04-26T10:38:36.367610+0000","last_clean":"2024-04-26T10:38:36.367610+0000","last_became_active":"2024-04-26T10:37:23.276151+0000","last_became_peered":"2024-04-26T10:37:23.276151+0000","last_unstale":"2024-04-26T10:38:36.367610+0000","last_undegraded":"2024-04-26T10:38:36.367610+0000","last_fullsized":"2024-04-26T10:38:36.367610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:36.367587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:36.367587+0000","last_clean_scrub_stamp":"2024-04-26T10:38:36.367587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:44.437172+0000","scrub_duration":0.001787358,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:20.029488+0000","last_change":"2024-04-26T10:38:20.029638+0000","last_active":"2024-04-26T10:38:20.029488+0000","last_peered":"2024-04-26T10:38:20.029488+0000","last_clean":"2024-04-26T10:38:20.029488+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:38:20.029488+0000","last_undegraded":"2024-04-26T10:38:20.029488+0000","last_fullsized":"2024-04-26T10:38:20.029488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:20.029457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:20.029457+0000","last_clean_scrub_stamp":"2024-04-26T10:38:20.029457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:12.454711+0000","scrub_duration":0.0017301249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786413+0000","last_change":"2024-04-26T10:34:14.508881+0000","last_active":"2024-04-26T10:37:36.786413+0000","last_peered":"2024-04-26T10:37:36.786413+0000","last_clean":"2024-04-26T10:37:36.786413+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:37:36.786413+0000","last_undegraded":"2024-04-26T10:37:36.786413+0000","last_fullsized":"2024-04-26T10:37:36.786413+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:45.546874+0000","last_clean_scrub_stamp":"2024-04-26T10:32:45.546874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:40.389544+0000","last_change":"2024-04-26T10:38:40.389685+0000","last_active":"2024-04-26T10:38:40.389544+0000","last_peered":"2024-04-26T10:38:40.389544+0000","last_clean":"2024-04-26T10:38:40.389544+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:38:40.389544+0000","last_undegraded":"2024-04-26T10:38:40.389544+0000","last_fullsized":"2024-04-26T10:38:40.389544+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:40.389519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:40.389519+0000","last_clean_scrub_stamp":"2024-04-26T10:38:40.389519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:12.790737+0000","scrub_duration":0.001581514,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887955+0000","last_change":"2024-04-26T10:37:23.277636+0000","last_active":"2024-04-26T10:37:30.887955+0000","last_peered":"2024-04-26T10:37:30.887955+0000","last_clean":"2024-04-26T10:37:30.887955+0000","last_became_active":"2024-04-26T10:37:23.277309+0000","last_became_peered":"2024-04-26T10:37:23.277309+0000","last_unstale":"2024-04-26T10:37:30.887955+0000","last_undegraded":"2024-04-26T10:37:30.887955+0000","last_fullsized":"2024-04-26T10:37:30.887955+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"82'3","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:15.552718+0000","last_change":"2024-04-26T10:38:15.552856+0000","last_active":"2024-04-26T10:38:15.552718+0000","last_peered":"2024-04-26T10:38:15.552718+0000","last_clean":"2024-04-26T10:38:15.552718+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:38:15.552718+0000","last_undegraded":"2024-04-26T10:38:15.552718+0000","last_fullsized":"2024-04-26T10:38:15.552718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:38:15.552692+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:38:15.552692+0000","last_clean_scrub_stamp":"2024-04-26T10:38:15.552692+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:15.123234+0000","scrub_duration":0.0030682249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:35.393333+0000","last_change":"2024-04-26T10:38:35.393460+0000","last_active":"2024-04-26T10:38:35.393333+0000","last_peered":"2024-04-26T10:38:35.393333+0000","last_clean":"2024-04-26T10:38:35.393333+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:38:35.393333+0000","last_undegraded":"2024-04-26T10:38:35.393333+0000","last_fullsized":"2024-04-26T10:38:35.393333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:35.393312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:35.393312+0000","last_clean_scrub_stamp":"2024-04-26T10:38:35.393312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:07.081724+0000","scrub_duration":0.001855916,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:01.537057+0000","last_change":"2024-04-26T10:38:01.537057+0000","last_active":"2024-04-26T10:38:01.537057+0000","last_peered":"2024-04-26T10:38:01.537057+0000","last_clean":"2024-04-26T10:38:01.537057+0000","last_became_active":"2024-04-26T10:37:28.281669+0000","last_became_peered":"2024-04-26T10:37:28.281669+0000","last_unstale":"2024-04-26T10:38:01.537057+0000","last_undegraded":"2024-04-26T10:38:01.537057+0000","last_fullsized":"2024-04-26T10:38:01.537057+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:01.536922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:01.536922+0000","last_clean_scrub_stamp":"2024-04-26T10:38:01.536922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:18.958300+0000","scrub_duration":0.0019935619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.992676+0000","last_change":"2024-04-26T10:38:03.992792+0000","last_active":"2024-04-26T10:38:03.992676+0000","last_peered":"2024-04-26T10:38:03.992676+0000","last_clean":"2024-04-26T10:38:03.992676+0000","last_became_active":"2024-04-26T10:37:23.268673+0000","last_became_peered":"2024-04-26T10:37:23.268673+0000","last_unstale":"2024-04-26T10:38:03.992676+0000","last_undegraded":"2024-04-26T10:38:03.992676+0000","last_fullsized":"2024-04-26T10:38:03.992676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.992656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.992656+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.992656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:06.482083+0000","scrub_duration":0.0019801340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'2","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:48.393623+0000","last_change":"2024-04-26T10:38:48.393779+0000","last_active":"2024-04-26T10:38:48.393623+0000","last_peered":"2024-04-26T10:38:48.393623+0000","last_clean":"2024-04-26T10:38:48.393623+0000","last_became_active":"2024-04-26T10:37:23.277001+0000","last_became_peered":"2024-04-26T10:37:23.277001+0000","last_unstale":"2024-04-26T10:38:48.393623+0000","last_undegraded":"2024-04-26T10:38:48.393623+0000","last_fullsized":"2024-04-26T10:38:48.393623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T10:38:48.393591+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T10:38:48.393591+0000","last_clean_scrub_stamp":"2024-04-26T10:38:48.393591+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:47.295722+0000","scrub_duration":0.0033183689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786547+0000","last_change":"2024-04-26T10:37:23.267342+0000","last_active":"2024-04-26T10:37:36.786547+0000","last_peered":"2024-04-26T10:37:36.786547+0000","last_clean":"2024-04-26T10:37:36.786547+0000","last_became_active":"2024-04-26T10:37:23.266912+0000","last_became_peered":"2024-04-26T10:37:23.266912+0000","last_unstale":"2024-04-26T10:37:36.786547+0000","last_undegraded":"2024-04-26T10:37:36.786547+0000","last_fullsized":"2024-04-26T10:37:36.786547+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:39.091120+0000","last_change":"2024-04-26T10:37:39.091234+0000","last_active":"2024-04-26T10:37:39.091120+0000","last_peered":"2024-04-26T10:37:39.091120+0000","last_clean":"2024-04-26T10:37:39.091120+0000","last_became_active":"2024-04-26T10:37:23.277303+0000","last_became_peered":"2024-04-26T10:37:23.277303+0000","last_unstale":"2024-04-26T10:37:39.091120+0000","last_undegraded":"2024-04-26T10:37:39.091120+0000","last_fullsized":"2024-04-26T10:37:39.091120+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:37:39.091052+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:37:39.091052+0000","last_clean_scrub_stamp":"2024-04-26T10:37:39.091052+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:34.281919+0000","scrub_duration":0.0021606110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:29.028179+0000","last_change":"2024-04-26T10:38:29.028282+0000","last_active":"2024-04-26T10:38:29.028179+0000","last_peered":"2024-04-26T10:38:29.028179+0000","last_clean":"2024-04-26T10:38:29.028179+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:38:29.028179+0000","last_undegraded":"2024-04-26T10:38:29.028179+0000","last_fullsized":"2024-04-26T10:38:29.028179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:29.028154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:29.028154+0000","last_clean_scrub_stamp":"2024-04-26T10:38:29.028154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:06:33.111156+0000","scrub_duration":0.001813516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284020+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:29.284020+0000","last_peered":"2024-04-26T10:37:29.284020+0000","last_clean":"2024-04-26T10:37:29.284020+0000","last_became_active":"2024-04-26T10:37:23.266295+0000","last_became_peered":"2024-04-26T10:37:23.266295+0000","last_unstale":"2024-04-26T10:37:29.284020+0000","last_undegraded":"2024-04-26T10:37:29.284020+0000","last_fullsized":"2024-04-26T10:37:29.284020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:49.930540+0000","last_change":"2024-04-26T10:37:49.930694+0000","last_active":"2024-04-26T10:37:49.930540+0000","last_peered":"2024-04-26T10:37:49.930540+0000","last_clean":"2024-04-26T10:37:49.930540+0000","last_became_active":"2024-04-26T10:37:23.272039+0000","last_became_peered":"2024-04-26T10:37:23.272039+0000","last_unstale":"2024-04-26T10:37:49.930540+0000","last_undegraded":"2024-04-26T10:37:49.930540+0000","last_fullsized":"2024-04-26T10:37:49.930540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:49.930517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:49.930517+0000","last_clean_scrub_stamp":"2024-04-26T10:37:49.930517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:31.070842+0000","scrub_duration":0.046350850999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"82'3","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:45.911007+0000","last_change":"2024-04-26T10:38:45.911112+0000","last_active":"2024-04-26T10:38:45.911007+0000","last_peered":"2024-04-26T10:38:45.911007+0000","last_clean":"2024-04-26T10:38:45.911007+0000","last_became_active":"2024-04-26T10:37:23.273253+0000","last_became_peered":"2024-04-26T10:37:23.273253+0000","last_unstale":"2024-04-26T10:38:45.911007+0000","last_undegraded":"2024-04-26T10:38:45.911007+0000","last_fullsized":"2024-04-26T10:38:45.911007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:38:45.910980+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:38:45.910980+0000","last_clean_scrub_stamp":"2024-04-26T10:38:45.910980+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:39.494680+0000","scrub_duration":0.0033169100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.283706+0000","last_change":"2024-04-26T10:37:23.267726+0000","last_active":"2024-04-26T10:37:29.283706+0000","last_peered":"2024-04-26T10:37:29.283706+0000","last_clean":"2024-04-26T10:37:29.283706+0000","last_became_active":"2024-04-26T10:37:23.267434+0000","last_became_peered":"2024-04-26T10:37:23.267434+0000","last_unstale":"2024-04-26T10:37:29.283706+0000","last_undegraded":"2024-04-26T10:37:29.283706+0000","last_fullsized":"2024-04-26T10:37:29.283706+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:11.578515+0000","last_change":"2024-04-26T10:38:11.578515+0000","last_active":"2024-04-26T10:38:11.578515+0000","last_peered":"2024-04-26T10:38:11.578515+0000","last_clean":"2024-04-26T10:38:11.578515+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:38:11.578515+0000","last_undegraded":"2024-04-26T10:38:11.578515+0000","last_fullsized":"2024-04-26T10:38:11.578515+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:38:11.578322+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:38:11.578322+0000","last_clean_scrub_stamp":"2024-04-26T10:38:11.578322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:12.780448+0000","scrub_duration":0.0019376879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":52,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.887831+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:37:30.887831+0000","last_peered":"2024-04-26T10:37:30.887831+0000","last_clean":"2024-04-26T10:37:30.887831+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:37:30.887831+0000","last_undegraded":"2024-04-26T10:37:30.887831+0000","last_fullsized":"2024-04-26T10:37:30.887831+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:04.517677+0000","last_change":"2024-04-26T10:38:04.517785+0000","last_active":"2024-04-26T10:38:04.517677+0000","last_peered":"2024-04-26T10:38:04.517677+0000","last_clean":"2024-04-26T10:38:04.517677+0000","last_became_active":"2024-04-26T10:37:23.271663+0000","last_became_peered":"2024-04-26T10:37:23.271663+0000","last_unstale":"2024-04-26T10:38:04.517677+0000","last_undegraded":"2024-04-26T10:38:04.517677+0000","last_fullsized":"2024-04-26T10:38:04.517677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-26T10:38:04.517652+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-26T10:38:04.517652+0000","last_clean_scrub_stamp":"2024-04-26T10:38:04.517652+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:57.558254+0000","scrub_duration":0.0039017489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:06.954934+0000","last_change":"2024-04-26T10:38:06.955074+0000","last_active":"2024-04-26T10:38:06.954934+0000","last_peered":"2024-04-26T10:38:06.954934+0000","last_clean":"2024-04-26T10:38:06.954934+0000","last_became_active":"2024-04-26T10:37:23.266624+0000","last_became_peered":"2024-04-26T10:37:23.266624+0000","last_unstale":"2024-04-26T10:38:06.954934+0000","last_undegraded":"2024-04-26T10:38:06.954934+0000","last_fullsized":"2024-04-26T10:38:06.954934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:06.954911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:06.954911+0000","last_clean_scrub_stamp":"2024-04-26T10:38:06.954911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:18.063497+0000","scrub_duration":0.0021816610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:25.969625+0000","last_change":"2024-04-26T10:38:25.969756+0000","last_active":"2024-04-26T10:38:25.969625+0000","last_peered":"2024-04-26T10:38:25.969625+0000","last_clean":"2024-04-26T10:38:25.969625+0000","last_became_active":"2024-04-26T10:37:23.266063+0000","last_became_peered":"2024-04-26T10:37:23.266063+0000","last_unstale":"2024-04-26T10:38:25.969625+0000","last_undegraded":"2024-04-26T10:38:25.969625+0000","last_fullsized":"2024-04-26T10:38:25.969625+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:25.969600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:25.969600+0000","last_clean_scrub_stamp":"2024-04-26T10:38:25.969600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:03.988066+0000","scrub_duration":0.001770282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:30.177409+0000","last_change":"2024-04-26T10:37:28.282145+0000","last_active":"2024-04-26T10:37:30.177409+0000","last_peered":"2024-04-26T10:37:30.177409+0000","last_clean":"2024-04-26T10:37:30.177409+0000","last_became_active":"2024-04-26T10:37:28.281541+0000","last_became_peered":"2024-04-26T10:37:28.281541+0000","last_unstale":"2024-04-26T10:37:30.177409+0000","last_undegraded":"2024-04-26T10:37:30.177409+0000","last_fullsized":"2024-04-26T10:37:30.177409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:06.997133+0000","last_change":"2024-04-26T10:38:06.997233+0000","last_active":"2024-04-26T10:38:06.997133+0000","last_peered":"2024-04-26T10:38:06.997133+0000","last_clean":"2024-04-26T10:38:06.997133+0000","last_became_active":"2024-04-26T10:37:23.267644+0000","last_became_peered":"2024-04-26T10:37:23.267644+0000","last_unstale":"2024-04-26T10:38:06.997133+0000","last_undegraded":"2024-04-26T10:38:06.997133+0000","last_fullsized":"2024-04-26T10:38:06.997133+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:06.997106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:06.997106+0000","last_clean_scrub_stamp":"2024-04-26T10:38:06.997106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:56:00.253043+0000","scrub_duration":0.001652953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:22.503915+0000","last_change":"2024-04-26T10:38:22.504052+0000","last_active":"2024-04-26T10:38:22.503915+0000","last_peered":"2024-04-26T10:38:22.503915+0000","last_clean":"2024-04-26T10:38:22.503915+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:38:22.503915+0000","last_undegraded":"2024-04-26T10:38:22.503915+0000","last_fullsized":"2024-04-26T10:38:22.503915+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:22.503891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:22.503891+0000","last_clean_scrub_stamp":"2024-04-26T10:38:22.503891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:15.301897+0000","scrub_duration":0.027299981000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:16.025759+0000","last_change":"2024-04-26T10:38:16.025759+0000","last_active":"2024-04-26T10:38:16.025759+0000","last_peered":"2024-04-26T10:38:16.025759+0000","last_clean":"2024-04-26T10:38:16.025759+0000","last_became_active":"2024-04-26T10:37:23.273023+0000","last_became_peered":"2024-04-26T10:37:23.273023+0000","last_unstale":"2024-04-26T10:38:16.025759+0000","last_undegraded":"2024-04-26T10:38:16.025759+0000","last_fullsized":"2024-04-26T10:38:16.025759+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:16.025616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:16.025616+0000","last_clean_scrub_stamp":"2024-04-26T10:38:16.025616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:37.698478+0000","scrub_duration":0.0018282789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1766,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},"log_size":47,"ondisk_log_size":47,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738446,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":338824,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":94033016,"statfs":{"total":96636764160,"available":96289808384,"internally_reserved":0,"allocated":917504,"data_stored":359527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346028486},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:38:22 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Apr 26 10:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.498,"15min":0.40000000000000002},"min":{"1min":0.26800000000000002,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.59999999999999998,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.65300000000000002,"15min":0.501},"min":{"1min":0.31900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.59199999999999997,"5min":12.206,"15min":12.206},"last":0.49099999999999999}]}]},{"osd":0,"up_from":75,"seq":322122547221,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55012,"kb_used_data":1500,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94316828,"statfs":{"total":96636764160,"available":96580431872,"internally_reserved":0,"allocated":1536000,"data_stored":951641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7111,"internal_metadata":54780985},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:38:22 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Apr 26 10:38:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.63100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738445,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257368,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":255870,"kb_avail":94114472,"statfs":{"total":96636764160,"available":96373219328,"internally_reserved":0,"allocated":1523712,"data_stored":948912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262011334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:38:23 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.53300000000000003}]},{"osd":2,"last update":"Fri Apr 26 10:38:54 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48199999999999998,"15min":0.376},"min":{"1min":0.38400000000000001,"5min":0.17499999999999999,"15min":0.17199999999999999},"max":{"1min":0.55300000000000005,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.499,"15min":0.45700000000000002},"min":{"1min":0.40500000000000003,"5min":0.183,"15min":0.183},"max":{"1min":0.63500000000000001,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:38:59.242 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.243 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.243 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.243 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.244 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.244 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.244 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.244 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.245 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.245 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.245 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.245 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.246 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.246 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.246 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.246 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.247 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.247 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.247 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.247 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.248 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.248 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.248 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T10:32:45.546874+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=45, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.248 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.248 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.248 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.249 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.249 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.249 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:38:59.249 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:39:19.251 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:39:19.612 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:39:19.614 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:39:19.623 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2024-04-26T10:39:19.085042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":592134,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":651204,"kb_used_data":3884,"kb_used_omap":10,"kb_used_meta":647285,"kb_avail":282464316,"statfs":{"total":289910292480,"available":289243459584,"internally_reserved":0,"allocated":3977216,"data_stored":2260080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10299,"internal_metadata":662820805},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003246"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:10.940281+0000","last_change":"2024-04-26T10:39:10.940404+0000","last_active":"2024-04-26T10:39:10.940281+0000","last_peered":"2024-04-26T10:39:10.940281+0000","last_clean":"2024-04-26T10:39:10.940281+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:39:10.940281+0000","last_undegraded":"2024-04-26T10:39:10.940281+0000","last_fullsized":"2024-04-26T10:39:10.940281+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:10.940256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:10.940256+0000","last_clean_scrub_stamp":"2024-04-26T10:39:10.940256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:12.142382+0000","scrub_duration":0.075448575000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:46.090713+0000","last_change":"2024-04-26T10:37:46.090713+0000","last_active":"2024-04-26T10:37:46.090713+0000","last_peered":"2024-04-26T10:37:46.090713+0000","last_clean":"2024-04-26T10:37:46.090713+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:37:46.090713+0000","last_undegraded":"2024-04-26T10:37:46.090713+0000","last_fullsized":"2024-04-26T10:37:46.090713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:46.090545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:46.090545+0000","last_clean_scrub_stamp":"2024-04-26T10:37:46.090545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:42.129201+0000","scrub_duration":0.001738082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.946243+0000","last_change":"2024-04-26T10:37:36.946374+0000","last_active":"2024-04-26T10:37:36.946243+0000","last_peered":"2024-04-26T10:37:36.946243+0000","last_clean":"2024-04-26T10:37:36.946243+0000","last_became_active":"2024-04-26T10:37:23.272107+0000","last_became_peered":"2024-04-26T10:37:23.272107+0000","last_unstale":"2024-04-26T10:37:36.946243+0000","last_undegraded":"2024-04-26T10:37:36.946243+0000","last_fullsized":"2024-04-26T10:37:36.946243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:36.946219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:36.946219+0000","last_clean_scrub_stamp":"2024-04-26T10:37:36.946219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:56.583737+0000","scrub_duration":0.0019495529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:54.913664+0000","last_change":"2024-04-26T10:37:54.913778+0000","last_active":"2024-04-26T10:37:54.913664+0000","last_peered":"2024-04-26T10:37:54.913664+0000","last_clean":"2024-04-26T10:37:54.913664+0000","last_became_active":"2024-04-26T10:37:23.269752+0000","last_became_peered":"2024-04-26T10:37:23.269752+0000","last_unstale":"2024-04-26T10:37:54.913664+0000","last_undegraded":"2024-04-26T10:37:54.913664+0000","last_fullsized":"2024-04-26T10:37:54.913664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:54.913640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:54.913640+0000","last_clean_scrub_stamp":"2024-04-26T10:37:54.913640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:45.220783+0000","scrub_duration":0.0019585140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:44.056524+0000","last_change":"2024-04-26T10:37:44.056524+0000","last_active":"2024-04-26T10:37:44.056524+0000","last_peered":"2024-04-26T10:37:44.056524+0000","last_clean":"2024-04-26T10:37:44.056524+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:37:44.056524+0000","last_undegraded":"2024-04-26T10:37:44.056524+0000","last_fullsized":"2024-04-26T10:37:44.056524+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:44.056381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:44.056381+0000","last_clean_scrub_stamp":"2024-04-26T10:37:44.056381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:26.047330+0000","scrub_duration":0.016160926999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.015997+0000","last_change":"2024-04-26T10:38:03.016124+0000","last_active":"2024-04-26T10:38:03.015997+0000","last_peered":"2024-04-26T10:38:03.015997+0000","last_clean":"2024-04-26T10:38:03.015997+0000","last_became_active":"2024-04-26T10:37:23.270593+0000","last_became_peered":"2024-04-26T10:37:23.270593+0000","last_unstale":"2024-04-26T10:38:03.015997+0000","last_undegraded":"2024-04-26T10:38:03.015997+0000","last_fullsized":"2024-04-26T10:38:03.015997+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.015972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.015972+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.015972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:42.504031+0000","scrub_duration":0.001820241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:22.072251+0000","last_change":"2024-04-26T10:38:22.072368+0000","last_active":"2024-04-26T10:38:22.072251+0000","last_peered":"2024-04-26T10:38:22.072251+0000","last_clean":"2024-04-26T10:38:22.072251+0000","last_became_active":"2024-04-26T10:37:23.270393+0000","last_became_peered":"2024-04-26T10:37:23.270393+0000","last_unstale":"2024-04-26T10:38:22.072251+0000","last_undegraded":"2024-04-26T10:38:22.072251+0000","last_fullsized":"2024-04-26T10:38:22.072251+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:22.072225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:22.072225+0000","last_clean_scrub_stamp":"2024-04-26T10:38:22.072225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:16.925527+0000","scrub_duration":0.016661415999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:35.066777+0000","last_change":"2024-04-26T10:38:35.066914+0000","last_active":"2024-04-26T10:38:35.066777+0000","last_peered":"2024-04-26T10:38:35.066777+0000","last_clean":"2024-04-26T10:38:35.066777+0000","last_became_active":"2024-04-26T10:37:23.267296+0000","last_became_peered":"2024-04-26T10:37:23.267296+0000","last_unstale":"2024-04-26T10:38:35.066777+0000","last_undegraded":"2024-04-26T10:38:35.066777+0000","last_fullsized":"2024-04-26T10:38:35.066777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:35.066756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:35.066756+0000","last_clean_scrub_stamp":"2024-04-26T10:38:35.066756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:14.500147+0000","scrub_duration":0.0017231670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:59.368145+0000","last_change":"2024-04-26T10:38:59.368277+0000","last_active":"2024-04-26T10:38:59.368145+0000","last_peered":"2024-04-26T10:38:59.368145+0000","last_clean":"2024-04-26T10:38:59.368145+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:38:59.368145+0000","last_undegraded":"2024-04-26T10:38:59.368145+0000","last_fullsized":"2024-04-26T10:38:59.368145+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:59.368120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:59.368120+0000","last_clean_scrub_stamp":"2024-04-26T10:38:59.368120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:31:01.115562+0000","scrub_duration":0.028461620999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:45.073164+0000","last_change":"2024-04-26T10:37:45.073164+0000","last_active":"2024-04-26T10:37:45.073164+0000","last_peered":"2024-04-26T10:37:45.073164+0000","last_clean":"2024-04-26T10:37:45.073164+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:37:45.073164+0000","last_undegraded":"2024-04-26T10:37:45.073164+0000","last_fullsized":"2024-04-26T10:37:45.073164+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:45.073006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:45.073006+0000","last_clean_scrub_stamp":"2024-04-26T10:37:45.073006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:23.891265+0000","scrub_duration":0.001902131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:48.878670+0000","last_change":"2024-04-26T10:37:48.878771+0000","last_active":"2024-04-26T10:37:48.878670+0000","last_peered":"2024-04-26T10:37:48.878670+0000","last_clean":"2024-04-26T10:37:48.878670+0000","last_became_active":"2024-04-26T10:37:23.273996+0000","last_became_peered":"2024-04-26T10:37:23.273996+0000","last_unstale":"2024-04-26T10:37:48.878670+0000","last_undegraded":"2024-04-26T10:37:48.878670+0000","last_fullsized":"2024-04-26T10:37:48.878670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:48.878645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:48.878645+0000","last_clean_scrub_stamp":"2024-04-26T10:37:48.878645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:14.620591+0000","scrub_duration":0.017302161999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:02.964860+0000","last_change":"2024-04-26T10:38:02.964962+0000","last_active":"2024-04-26T10:38:02.964860+0000","last_peered":"2024-04-26T10:38:02.964860+0000","last_clean":"2024-04-26T10:38:02.964860+0000","last_became_active":"2024-04-26T10:37:23.273290+0000","last_became_peered":"2024-04-26T10:37:23.273290+0000","last_unstale":"2024-04-26T10:38:02.964860+0000","last_undegraded":"2024-04-26T10:38:02.964860+0000","last_fullsized":"2024-04-26T10:38:02.964860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:02.964836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:02.964836+0000","last_clean_scrub_stamp":"2024-04-26T10:38:02.964836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:19.028065+0000","scrub_duration":0.0018081550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:28.062652+0000","last_change":"2024-04-26T10:38:28.062652+0000","last_active":"2024-04-26T10:38:28.062652+0000","last_peered":"2024-04-26T10:38:28.062652+0000","last_clean":"2024-04-26T10:38:28.062652+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:38:28.062652+0000","last_undegraded":"2024-04-26T10:38:28.062652+0000","last_fullsized":"2024-04-26T10:38:28.062652+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:28.062510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:28.062510+0000","last_clean_scrub_stamp":"2024-04-26T10:38:28.062510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:26.115949+0000","scrub_duration":0.016455943000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:17.121016+0000","last_change":"2024-04-26T10:38:17.121111+0000","last_active":"2024-04-26T10:38:17.121016+0000","last_peered":"2024-04-26T10:38:17.121016+0000","last_clean":"2024-04-26T10:38:17.121016+0000","last_became_active":"2024-04-26T10:37:23.269722+0000","last_became_peered":"2024-04-26T10:37:23.269722+0000","last_unstale":"2024-04-26T10:38:17.121016+0000","last_undegraded":"2024-04-26T10:38:17.121016+0000","last_fullsized":"2024-04-26T10:38:17.121016+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:17.120993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:17.120993+0000","last_clean_scrub_stamp":"2024-04-26T10:38:17.120993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:25.421013+0000","scrub_duration":0.001930906,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:13.078246+0000","last_change":"2024-04-26T10:38:13.078391+0000","last_active":"2024-04-26T10:38:13.078246+0000","last_peered":"2024-04-26T10:38:13.078246+0000","last_clean":"2024-04-26T10:38:13.078246+0000","last_became_active":"2024-04-26T10:37:23.270852+0000","last_became_peered":"2024-04-26T10:37:23.270852+0000","last_unstale":"2024-04-26T10:38:13.078246+0000","last_undegraded":"2024-04-26T10:38:13.078246+0000","last_fullsized":"2024-04-26T10:38:13.078246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:13.078224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:13.078224+0000","last_clean_scrub_stamp":"2024-04-26T10:38:13.078224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:09.840624+0000","scrub_duration":0.0018370000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:38.963069+0000","last_change":"2024-04-26T10:37:38.963200+0000","last_active":"2024-04-26T10:37:38.963069+0000","last_peered":"2024-04-26T10:37:38.963069+0000","last_clean":"2024-04-26T10:37:38.963069+0000","last_became_active":"2024-04-26T10:37:23.268640+0000","last_became_peered":"2024-04-26T10:37:23.268640+0000","last_unstale":"2024-04-26T10:37:38.963069+0000","last_undegraded":"2024-04-26T10:37:38.963069+0000","last_fullsized":"2024-04-26T10:37:38.963069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:38.963045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:38.963045+0000","last_clean_scrub_stamp":"2024-04-26T10:37:38.963045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:17.672777+0000","scrub_duration":0.0018662049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:13.519570+0000","last_change":"2024-04-26T10:39:13.519717+0000","last_active":"2024-04-26T10:39:13.519570+0000","last_peered":"2024-04-26T10:39:13.519570+0000","last_clean":"2024-04-26T10:39:13.519570+0000","last_became_active":"2024-04-26T10:37:28.281510+0000","last_became_peered":"2024-04-26T10:37:28.281510+0000","last_unstale":"2024-04-26T10:39:13.519570+0000","last_undegraded":"2024-04-26T10:39:13.519570+0000","last_fullsized":"2024-04-26T10:39:13.519570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:13.519547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:13.519547+0000","last_clean_scrub_stamp":"2024-04-26T10:39:13.519547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:48.445502+0000","scrub_duration":0.080097699999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:07.970813+0000","last_change":"2024-04-26T10:38:07.970813+0000","last_active":"2024-04-26T10:38:07.970813+0000","last_peered":"2024-04-26T10:38:07.970813+0000","last_clean":"2024-04-26T10:38:07.970813+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:38:07.970813+0000","last_undegraded":"2024-04-26T10:38:07.970813+0000","last_fullsized":"2024-04-26T10:38:07.970813+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:07.970664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:07.970664+0000","last_clean_scrub_stamp":"2024-04-26T10:38:07.970664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:55.346373+0000","scrub_duration":0.001805283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:38.715625+0000","last_change":"2024-04-26T10:37:38.715778+0000","last_active":"2024-04-26T10:37:38.715625+0000","last_peered":"2024-04-26T10:37:38.715625+0000","last_clean":"2024-04-26T10:37:38.715625+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:37:38.715625+0000","last_undegraded":"2024-04-26T10:37:38.715625+0000","last_fullsized":"2024-04-26T10:37:38.715625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:38.715602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:38.715602+0000","last_clean_scrub_stamp":"2024-04-26T10:37:38.715602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:48.931629+0000","scrub_duration":0.028191391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284226+0000","last_change":"2024-04-26T10:37:23.273700+0000","last_active":"2024-04-26T10:37:29.284226+0000","last_peered":"2024-04-26T10:37:29.284226+0000","last_clean":"2024-04-26T10:37:29.284226+0000","last_became_active":"2024-04-26T10:37:23.272964+0000","last_became_peered":"2024-04-26T10:37:23.272964+0000","last_unstale":"2024-04-26T10:37:29.284226+0000","last_undegraded":"2024-04-26T10:37:29.284226+0000","last_fullsized":"2024-04-26T10:37:29.284226+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:30.097028+0000","last_change":"2024-04-26T10:38:30.097185+0000","last_active":"2024-04-26T10:38:30.097028+0000","last_peered":"2024-04-26T10:38:30.097028+0000","last_clean":"2024-04-26T10:38:30.097028+0000","last_became_active":"2024-04-26T10:37:23.271967+0000","last_became_peered":"2024-04-26T10:37:23.271967+0000","last_unstale":"2024-04-26T10:38:30.097028+0000","last_undegraded":"2024-04-26T10:38:30.097028+0000","last_fullsized":"2024-04-26T10:38:30.097028+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:30.096999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:30.096999+0000","last_clean_scrub_stamp":"2024-04-26T10:38:30.096999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:19.434538+0000","scrub_duration":0.028246974000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:35.081996+0000","last_change":"2024-04-26T10:38:35.082140+0000","last_active":"2024-04-26T10:38:35.081996+0000","last_peered":"2024-04-26T10:38:35.081996+0000","last_clean":"2024-04-26T10:38:35.081996+0000","last_became_active":"2024-04-26T10:37:23.267766+0000","last_became_peered":"2024-04-26T10:37:23.267766+0000","last_unstale":"2024-04-26T10:38:35.081996+0000","last_undegraded":"2024-04-26T10:38:35.081996+0000","last_fullsized":"2024-04-26T10:38:35.081996+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:35.081966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:35.081966+0000","last_clean_scrub_stamp":"2024-04-26T10:38:35.081966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:40.239398+0000","scrub_duration":0.0016982189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:13.618361+0000","last_change":"2024-04-26T10:38:13.618466+0000","last_active":"2024-04-26T10:38:13.618361+0000","last_peered":"2024-04-26T10:38:13.618361+0000","last_clean":"2024-04-26T10:38:13.618361+0000","last_became_active":"2024-04-26T10:37:23.269861+0000","last_became_peered":"2024-04-26T10:37:23.269861+0000","last_unstale":"2024-04-26T10:38:13.618361+0000","last_undegraded":"2024-04-26T10:38:13.618361+0000","last_fullsized":"2024-04-26T10:38:13.618361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:13.618337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:13.618337+0000","last_clean_scrub_stamp":"2024-04-26T10:38:13.618337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:51.339204+0000","scrub_duration":0.0019172900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:04.833001+0000","last_change":"2024-04-26T10:39:04.833140+0000","last_active":"2024-04-26T10:39:04.833001+0000","last_peered":"2024-04-26T10:39:04.833001+0000","last_clean":"2024-04-26T10:39:04.833001+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:39:04.833001+0000","last_undegraded":"2024-04-26T10:39:04.833001+0000","last_fullsized":"2024-04-26T10:39:04.833001+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:04.832978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:04.832978+0000","last_clean_scrub_stamp":"2024-04-26T10:39:04.832978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:17.381581+0000","scrub_duration":0.001713902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786748+0000","last_change":"2024-04-26T10:37:23.272702+0000","last_active":"2024-04-26T10:37:36.786748+0000","last_peered":"2024-04-26T10:37:36.786748+0000","last_clean":"2024-04-26T10:37:36.786748+0000","last_became_active":"2024-04-26T10:37:23.272218+0000","last_became_peered":"2024-04-26T10:37:23.272218+0000","last_unstale":"2024-04-26T10:37:36.786748+0000","last_undegraded":"2024-04-26T10:37:36.786748+0000","last_fullsized":"2024-04-26T10:37:36.786748+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:58.343180+0000","last_change":"2024-04-26T10:38:58.343289+0000","last_active":"2024-04-26T10:38:58.343180+0000","last_peered":"2024-04-26T10:38:58.343180+0000","last_clean":"2024-04-26T10:38:58.343180+0000","last_became_active":"2024-04-26T10:37:23.270919+0000","last_became_peered":"2024-04-26T10:37:23.270919+0000","last_unstale":"2024-04-26T10:38:58.343180+0000","last_undegraded":"2024-04-26T10:38:58.343180+0000","last_fullsized":"2024-04-26T10:38:58.343180+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:58.343155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:58.343155+0000","last_clean_scrub_stamp":"2024-04-26T10:38:58.343155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:30.695486+0000","scrub_duration":0.002179009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284349+0000","last_change":"2024-04-26T10:37:23.275081+0000","last_active":"2024-04-26T10:37:29.284349+0000","last_peered":"2024-04-26T10:37:29.284349+0000","last_clean":"2024-04-26T10:37:29.284349+0000","last_became_active":"2024-04-26T10:37:23.273821+0000","last_became_peered":"2024-04-26T10:37:23.273821+0000","last_unstale":"2024-04-26T10:37:29.284349+0000","last_undegraded":"2024-04-26T10:37:29.284349+0000","last_fullsized":"2024-04-26T10:37:29.284349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:41.921825+0000","last_change":"2024-04-26T10:38:41.921932+0000","last_active":"2024-04-26T10:38:41.921825+0000","last_peered":"2024-04-26T10:38:41.921825+0000","last_clean":"2024-04-26T10:38:41.921825+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:38:41.921825+0000","last_undegraded":"2024-04-26T10:38:41.921825+0000","last_fullsized":"2024-04-26T10:38:41.921825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:38:41.921800+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:38:41.921800+0000","last_clean_scrub_stamp":"2024-04-26T10:38:41.921800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:13.776029+0000","scrub_duration":0.0017811509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:27.028396+0000","last_change":"2024-04-26T10:38:27.028530+0000","last_active":"2024-04-26T10:38:27.028396+0000","last_peered":"2024-04-26T10:38:27.028396+0000","last_clean":"2024-04-26T10:38:27.028396+0000","last_became_active":"2024-04-26T10:37:23.272837+0000","last_became_peered":"2024-04-26T10:37:23.272837+0000","last_unstale":"2024-04-26T10:38:27.028396+0000","last_undegraded":"2024-04-26T10:38:27.028396+0000","last_fullsized":"2024-04-26T10:38:27.028396+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:27.028373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:27.028373+0000","last_clean_scrub_stamp":"2024-04-26T10:38:27.028373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:37.281488+0000","scrub_duration":0.001773223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:20.440926+0000","last_change":"2024-04-26T10:38:20.441032+0000","last_active":"2024-04-26T10:38:20.440926+0000","last_peered":"2024-04-26T10:38:20.440926+0000","last_clean":"2024-04-26T10:38:20.440926+0000","last_became_active":"2024-04-26T10:37:23.269197+0000","last_became_peered":"2024-04-26T10:37:23.269197+0000","last_unstale":"2024-04-26T10:38:20.440926+0000","last_undegraded":"2024-04-26T10:38:20.440926+0000","last_fullsized":"2024-04-26T10:38:20.440926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:20.440901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:20.440901+0000","last_clean_scrub_stamp":"2024-04-26T10:38:20.440901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:56.822074+0000","scrub_duration":0.0016497720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.675146+0000","last_change":"2024-04-26T10:37:37.675146+0000","last_active":"2024-04-26T10:37:37.675146+0000","last_peered":"2024-04-26T10:37:37.675146+0000","last_clean":"2024-04-26T10:37:37.675146+0000","last_became_active":"2024-04-26T10:37:28.283421+0000","last_became_peered":"2024-04-26T10:37:28.283421+0000","last_unstale":"2024-04-26T10:37:37.675146+0000","last_undegraded":"2024-04-26T10:37:37.675146+0000","last_fullsized":"2024-04-26T10:37:37.675146+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:37.674937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:37.674937+0000","last_clean_scrub_stamp":"2024-04-26T10:37:37.674937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:45.188074+0000","scrub_duration":0.0017282650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:44.382264+0000","last_change":"2024-04-26T10:38:44.382369+0000","last_active":"2024-04-26T10:38:44.382264+0000","last_peered":"2024-04-26T10:38:44.382264+0000","last_clean":"2024-04-26T10:38:44.382264+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:38:44.382264+0000","last_undegraded":"2024-04-26T10:38:44.382264+0000","last_fullsized":"2024-04-26T10:38:44.382264+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:44.382241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:44.382241+0000","last_clean_scrub_stamp":"2024-04-26T10:38:44.382241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:32.405178+0000","scrub_duration":0.001690446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:03.932199+0000","last_change":"2024-04-26T10:39:03.932199+0000","last_active":"2024-04-26T10:39:03.932199+0000","last_peered":"2024-04-26T10:39:03.932199+0000","last_clean":"2024-04-26T10:39:03.932199+0000","last_became_active":"2024-04-26T10:37:23.272666+0000","last_became_peered":"2024-04-26T10:37:23.272666+0000","last_unstale":"2024-04-26T10:39:03.932199+0000","last_undegraded":"2024-04-26T10:39:03.932199+0000","last_fullsized":"2024-04-26T10:39:03.932199+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:03.932009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:03.932009+0000","last_clean_scrub_stamp":"2024-04-26T10:39:03.932009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:50.159326+0000","scrub_duration":0.066783158999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:03.293880+0000","last_change":"2024-04-26T10:39:03.293991+0000","last_active":"2024-04-26T10:39:03.293880+0000","last_peered":"2024-04-26T10:39:03.293880+0000","last_clean":"2024-04-26T10:39:03.293880+0000","last_became_active":"2024-04-26T10:37:23.270725+0000","last_became_peered":"2024-04-26T10:37:23.270725+0000","last_unstale":"2024-04-26T10:39:03.293880+0000","last_undegraded":"2024-04-26T10:39:03.293880+0000","last_fullsized":"2024-04-26T10:39:03.293880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:03.293855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:03.293855+0000","last_clean_scrub_stamp":"2024-04-26T10:39:03.293855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:24.779313+0000","scrub_duration":0.00178167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.478595+0000","last_change":"2024-04-26T10:38:03.478731+0000","last_active":"2024-04-26T10:38:03.478595+0000","last_peered":"2024-04-26T10:38:03.478595+0000","last_clean":"2024-04-26T10:38:03.478595+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:38:03.478595+0000","last_undegraded":"2024-04-26T10:38:03.478595+0000","last_fullsized":"2024-04-26T10:38:03.478595+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.478570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.478570+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.478570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:49.705887+0000","scrub_duration":0.00149917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:55.908127+0000","last_change":"2024-04-26T10:37:55.908269+0000","last_active":"2024-04-26T10:37:55.908127+0000","last_peered":"2024-04-26T10:37:55.908127+0000","last_clean":"2024-04-26T10:37:55.908127+0000","last_became_active":"2024-04-26T10:37:23.269371+0000","last_became_peered":"2024-04-26T10:37:23.269371+0000","last_unstale":"2024-04-26T10:37:55.908127+0000","last_undegraded":"2024-04-26T10:37:55.908127+0000","last_fullsized":"2024-04-26T10:37:55.908127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:55.908102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:55.908102+0000","last_clean_scrub_stamp":"2024-04-26T10:37:55.908102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:11.319524+0000","scrub_duration":0.0019603670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:49.354912+0000","last_change":"2024-04-26T10:38:49.355019+0000","last_active":"2024-04-26T10:38:49.354912+0000","last_peered":"2024-04-26T10:38:49.354912+0000","last_clean":"2024-04-26T10:38:49.354912+0000","last_became_active":"2024-04-26T10:37:23.269344+0000","last_became_peered":"2024-04-26T10:37:23.269344+0000","last_unstale":"2024-04-26T10:38:49.354912+0000","last_undegraded":"2024-04-26T10:38:49.354912+0000","last_fullsized":"2024-04-26T10:38:49.354912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:49.354889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:49.354889+0000","last_clean_scrub_stamp":"2024-04-26T10:38:49.354889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:19.945433+0000","scrub_duration":0.0018868769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"82'5","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:12.930508+0000","last_change":"2024-04-26T10:39:12.930619+0000","last_active":"2024-04-26T10:39:12.930508+0000","last_peered":"2024-04-26T10:39:12.930508+0000","last_clean":"2024-04-26T10:39:12.930508+0000","last_became_active":"2024-04-26T10:37:23.272731+0000","last_became_peered":"2024-04-26T10:37:23.272731+0000","last_unstale":"2024-04-26T10:39:12.930508+0000","last_undegraded":"2024-04-26T10:39:12.930508+0000","last_fullsized":"2024-04-26T10:39:12.930508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'5","last_scrub_stamp":"2024-04-26T10:39:12.930481+0000","last_deep_scrub":"82'5","last_deep_scrub_stamp":"2024-04-26T10:39:12.930481+0000","last_clean_scrub_stamp":"2024-04-26T10:39:12.930481+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:46.358869+0000","scrub_duration":0.003845785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:46.569879+0000","last_change":"2024-04-26T10:37:46.570003+0000","last_active":"2024-04-26T10:37:46.569879+0000","last_peered":"2024-04-26T10:37:46.569879+0000","last_clean":"2024-04-26T10:37:46.569879+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:37:46.569879+0000","last_undegraded":"2024-04-26T10:37:46.569879+0000","last_fullsized":"2024-04-26T10:37:46.569879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:46.569855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:46.569855+0000","last_clean_scrub_stamp":"2024-04-26T10:37:46.569855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:12.891140+0000","scrub_duration":0.00144177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":99,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284123+0000","last_change":"2024-04-26T10:37:23.272627+0000","last_active":"2024-04-26T10:37:29.284123+0000","last_peered":"2024-04-26T10:37:29.284123+0000","last_clean":"2024-04-26T10:37:29.284123+0000","last_became_active":"2024-04-26T10:37:23.269968+0000","last_became_peered":"2024-04-26T10:37:23.269968+0000","last_unstale":"2024-04-26T10:37:29.284123+0000","last_undegraded":"2024-04-26T10:37:29.284123+0000","last_fullsized":"2024-04-26T10:37:29.284123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:39.919590+0000","last_change":"2024-04-26T10:37:39.919719+0000","last_active":"2024-04-26T10:37:39.919590+0000","last_peered":"2024-04-26T10:37:39.919590+0000","last_clean":"2024-04-26T10:37:39.919590+0000","last_became_active":"2024-04-26T10:37:23.274045+0000","last_became_peered":"2024-04-26T10:37:23.274045+0000","last_unstale":"2024-04-26T10:37:39.919590+0000","last_undegraded":"2024-04-26T10:37:39.919590+0000","last_fullsized":"2024-04-26T10:37:39.919590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:39.919570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:39.919570+0000","last_clean_scrub_stamp":"2024-04-26T10:37:39.919570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:44.433055+0000","scrub_duration":0.001537217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"82'4","reported_seq":86,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:56.905128+0000","last_change":"2024-04-26T10:38:56.905236+0000","last_active":"2024-04-26T10:38:56.905128+0000","last_peered":"2024-04-26T10:38:56.905128+0000","last_clean":"2024-04-26T10:38:56.905128+0000","last_became_active":"2024-04-26T10:37:23.269775+0000","last_became_peered":"2024-04-26T10:37:23.269775+0000","last_unstale":"2024-04-26T10:38:56.905128+0000","last_undegraded":"2024-04-26T10:38:56.905128+0000","last_fullsized":"2024-04-26T10:38:56.905128+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-26T10:38:56.905096+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-26T10:38:56.905096+0000","last_clean_scrub_stamp":"2024-04-26T10:38:56.905096+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:49.759461+0000","scrub_duration":0.0040721890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:04.000953+0000","last_change":"2024-04-26T10:38:04.000953+0000","last_active":"2024-04-26T10:38:04.000953+0000","last_peered":"2024-04-26T10:38:04.000953+0000","last_clean":"2024-04-26T10:38:04.000953+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:38:04.000953+0000","last_undegraded":"2024-04-26T10:38:04.000953+0000","last_fullsized":"2024-04-26T10:38:04.000953+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:04.000827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:04.000827+0000","last_clean_scrub_stamp":"2024-04-26T10:38:04.000827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:34.824818+0000","scrub_duration":0.0020431870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:32.456176+0000","last_change":"2024-04-26T10:38:32.456289+0000","last_active":"2024-04-26T10:38:32.456176+0000","last_peered":"2024-04-26T10:38:32.456176+0000","last_clean":"2024-04-26T10:38:32.456176+0000","last_became_active":"2024-04-26T10:37:23.269537+0000","last_became_peered":"2024-04-26T10:37:23.269537+0000","last_unstale":"2024-04-26T10:38:32.456176+0000","last_undegraded":"2024-04-26T10:38:32.456176+0000","last_fullsized":"2024-04-26T10:38:32.456176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:32.456150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:32.456150+0000","last_clean_scrub_stamp":"2024-04-26T10:38:32.456150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:05.179342+0000","scrub_duration":0.001825459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:05.884205+0000","last_change":"2024-04-26T10:39:05.884302+0000","last_active":"2024-04-26T10:39:05.884205+0000","last_peered":"2024-04-26T10:39:05.884205+0000","last_clean":"2024-04-26T10:39:05.884205+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:39:05.884205+0000","last_undegraded":"2024-04-26T10:39:05.884205+0000","last_fullsized":"2024-04-26T10:39:05.884205+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:05.884182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:05.884182+0000","last_clean_scrub_stamp":"2024-04-26T10:39:05.884182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:17.563813+0000","scrub_duration":0.017044677000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786546+0000","last_change":"2024-04-26T10:37:23.268114+0000","last_active":"2024-04-26T10:37:36.786546+0000","last_peered":"2024-04-26T10:37:36.786546+0000","last_clean":"2024-04-26T10:37:36.786546+0000","last_became_active":"2024-04-26T10:37:23.267121+0000","last_became_peered":"2024-04-26T10:37:23.267121+0000","last_unstale":"2024-04-26T10:37:36.786546+0000","last_undegraded":"2024-04-26T10:37:36.786546+0000","last_fullsized":"2024-04-26T10:37:36.786546+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:09.576502+0000","last_change":"2024-04-26T10:38:09.576610+0000","last_active":"2024-04-26T10:38:09.576502+0000","last_peered":"2024-04-26T10:38:09.576502+0000","last_clean":"2024-04-26T10:38:09.576502+0000","last_became_active":"2024-04-26T10:37:28.281512+0000","last_became_peered":"2024-04-26T10:37:28.281512+0000","last_unstale":"2024-04-26T10:38:09.576502+0000","last_undegraded":"2024-04-26T10:38:09.576502+0000","last_fullsized":"2024-04-26T10:38:09.576502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:09.576479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:09.576479+0000","last_clean_scrub_stamp":"2024-04-26T10:38:09.576479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:58.472401+0000","scrub_duration":0.0016694769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"82'12","reported_seq":116,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:58.841362+0000","last_change":"2024-04-26T10:38:58.841466+0000","last_active":"2024-04-26T10:38:58.841362+0000","last_peered":"2024-04-26T10:38:58.841362+0000","last_clean":"2024-04-26T10:38:58.841362+0000","last_became_active":"2024-04-26T10:37:23.266377+0000","last_became_peered":"2024-04-26T10:37:23.266377+0000","last_unstale":"2024-04-26T10:38:58.841362+0000","last_undegraded":"2024-04-26T10:38:58.841362+0000","last_fullsized":"2024-04-26T10:38:58.841362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'12","last_scrub_stamp":"2024-04-26T10:38:58.841336+0000","last_deep_scrub":"82'12","last_deep_scrub_stamp":"2024-04-26T10:38:58.841336+0000","last_clean_scrub_stamp":"2024-04-26T10:38:58.841336+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:26.881942+0000","scrub_duration":0.0042506749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:00.539928+0000","last_change":"2024-04-26T10:38:00.540104+0000","last_active":"2024-04-26T10:38:00.539928+0000","last_peered":"2024-04-26T10:38:00.539928+0000","last_clean":"2024-04-26T10:38:00.539928+0000","last_became_active":"2024-04-26T10:37:23.271752+0000","last_became_peered":"2024-04-26T10:37:23.271752+0000","last_unstale":"2024-04-26T10:38:00.539928+0000","last_undegraded":"2024-04-26T10:38:00.539928+0000","last_fullsized":"2024-04-26T10:38:00.539928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:00.539869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:00.539869+0000","last_clean_scrub_stamp":"2024-04-26T10:38:00.539869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:46.107019+0000","scrub_duration":0.052375984,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284617+0000","last_change":"2024-04-26T10:37:23.273840+0000","last_active":"2024-04-26T10:37:29.284617+0000","last_peered":"2024-04-26T10:37:29.284617+0000","last_clean":"2024-04-26T10:37:29.284617+0000","last_became_active":"2024-04-26T10:37:23.272156+0000","last_became_peered":"2024-04-26T10:37:23.272156+0000","last_unstale":"2024-04-26T10:37:29.284617+0000","last_undegraded":"2024-04-26T10:37:29.284617+0000","last_fullsized":"2024-04-26T10:37:29.284617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:09.993382+0000","last_change":"2024-04-26T10:38:09.993498+0000","last_active":"2024-04-26T10:38:09.993382+0000","last_peered":"2024-04-26T10:38:09.993382+0000","last_clean":"2024-04-26T10:38:09.993382+0000","last_became_active":"2024-04-26T10:37:23.267717+0000","last_became_peered":"2024-04-26T10:37:23.267717+0000","last_unstale":"2024-04-26T10:38:09.993382+0000","last_undegraded":"2024-04-26T10:38:09.993382+0000","last_fullsized":"2024-04-26T10:38:09.993382+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:09.993363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:09.993363+0000","last_clean_scrub_stamp":"2024-04-26T10:38:09.993363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:57.793706+0000","scrub_duration":0.0019586830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"82'3","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:42.942776+0000","last_change":"2024-04-26T10:38:42.942922+0000","last_active":"2024-04-26T10:38:42.942776+0000","last_peered":"2024-04-26T10:38:42.942776+0000","last_clean":"2024-04-26T10:38:42.942776+0000","last_became_active":"2024-04-26T10:37:23.272260+0000","last_became_peered":"2024-04-26T10:37:23.272260+0000","last_unstale":"2024-04-26T10:38:42.942776+0000","last_undegraded":"2024-04-26T10:38:42.942776+0000","last_fullsized":"2024-04-26T10:38:42.942776+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:38:42.942735+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:38:42.942735+0000","last_clean_scrub_stamp":"2024-04-26T10:38:42.942735+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:00.597213+0000","scrub_duration":0.0033171590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:22.996504+0000","last_change":"2024-04-26T10:38:22.996504+0000","last_active":"2024-04-26T10:38:22.996504+0000","last_peered":"2024-04-26T10:38:22.996504+0000","last_clean":"2024-04-26T10:38:22.996504+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:38:22.996504+0000","last_undegraded":"2024-04-26T10:38:22.996504+0000","last_fullsized":"2024-04-26T10:38:22.996504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:22.996344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:22.996344+0000","last_clean_scrub_stamp":"2024-04-26T10:38:22.996344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:42.025260+0000","scrub_duration":0.001643909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'2","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:15.087666+0000","last_change":"2024-04-26T10:38:15.087778+0000","last_active":"2024-04-26T10:38:15.087666+0000","last_peered":"2024-04-26T10:38:15.087666+0000","last_clean":"2024-04-26T10:38:15.087666+0000","last_became_active":"2024-04-26T10:37:23.268441+0000","last_became_peered":"2024-04-26T10:37:23.268441+0000","last_unstale":"2024-04-26T10:38:15.087666+0000","last_undegraded":"2024-04-26T10:38:15.087666+0000","last_fullsized":"2024-04-26T10:38:15.087666+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T10:38:15.087643+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T10:38:15.087643+0000","last_clean_scrub_stamp":"2024-04-26T10:38:15.087643+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:42.284590+0000","scrub_duration":0.003756396,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:12.046677+0000","last_change":"2024-04-26T10:38:12.046827+0000","last_active":"2024-04-26T10:38:12.046677+0000","last_peered":"2024-04-26T10:38:12.046677+0000","last_clean":"2024-04-26T10:38:12.046677+0000","last_became_active":"2024-04-26T10:37:23.268451+0000","last_became_peered":"2024-04-26T10:37:23.268451+0000","last_unstale":"2024-04-26T10:38:12.046677+0000","last_undegraded":"2024-04-26T10:38:12.046677+0000","last_fullsized":"2024-04-26T10:38:12.046677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:12.046640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:12.046640+0000","last_clean_scrub_stamp":"2024-04-26T10:38:12.046640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:04.521493+0000","scrub_duration":0.002019739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284314+0000","last_change":"2024-04-26T10:37:23.273635+0000","last_active":"2024-04-26T10:37:29.284314+0000","last_peered":"2024-04-26T10:37:29.284314+0000","last_clean":"2024-04-26T10:37:29.284314+0000","last_became_active":"2024-04-26T10:37:23.272938+0000","last_became_peered":"2024-04-26T10:37:23.272938+0000","last_unstale":"2024-04-26T10:37:29.284314+0000","last_undegraded":"2024-04-26T10:37:29.284314+0000","last_fullsized":"2024-04-26T10:37:29.284314+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:42.638376+0000","last_change":"2024-04-26T10:37:42.638539+0000","last_active":"2024-04-26T10:37:42.638376+0000","last_peered":"2024-04-26T10:37:42.638376+0000","last_clean":"2024-04-26T10:37:42.638376+0000","last_became_active":"2024-04-26T10:37:23.276957+0000","last_became_peered":"2024-04-26T10:37:23.276957+0000","last_unstale":"2024-04-26T10:37:42.638376+0000","last_undegraded":"2024-04-26T10:37:42.638376+0000","last_fullsized":"2024-04-26T10:37:42.638376+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:42.638352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:42.638352+0000","last_clean_scrub_stamp":"2024-04-26T10:37:42.638352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:15.896041+0000","scrub_duration":0.027944383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'3","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:43.378881+0000","last_change":"2024-04-26T10:38:43.379010+0000","last_active":"2024-04-26T10:38:43.378881+0000","last_peered":"2024-04-26T10:38:43.378881+0000","last_clean":"2024-04-26T10:38:43.378881+0000","last_became_active":"2024-04-26T10:37:23.277037+0000","last_became_peered":"2024-04-26T10:37:23.277037+0000","last_unstale":"2024-04-26T10:38:43.378881+0000","last_undegraded":"2024-04-26T10:38:43.378881+0000","last_fullsized":"2024-04-26T10:38:43.378881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:38:43.378855+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:38:43.378855+0000","last_clean_scrub_stamp":"2024-04-26T10:38:43.378855+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:09.102845+0000","scrub_duration":0.0033491789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:57.882071+0000","last_change":"2024-04-26T10:38:57.882169+0000","last_active":"2024-04-26T10:38:57.882071+0000","last_peered":"2024-04-26T10:38:57.882071+0000","last_clean":"2024-04-26T10:38:57.882071+0000","last_became_active":"2024-04-26T10:37:23.269473+0000","last_became_peered":"2024-04-26T10:37:23.269473+0000","last_unstale":"2024-04-26T10:38:57.882071+0000","last_undegraded":"2024-04-26T10:38:57.882071+0000","last_fullsized":"2024-04-26T10:38:57.882071+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:57.882050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:57.882050+0000","last_clean_scrub_stamp":"2024-04-26T10:38:57.882050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:32.397616+0000","scrub_duration":0.0018123760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:51.892263+0000","last_change":"2024-04-26T10:38:51.892365+0000","last_active":"2024-04-26T10:38:51.892263+0000","last_peered":"2024-04-26T10:38:51.892263+0000","last_clean":"2024-04-26T10:38:51.892263+0000","last_became_active":"2024-04-26T10:37:23.267235+0000","last_became_peered":"2024-04-26T10:37:23.267235+0000","last_unstale":"2024-04-26T10:38:51.892263+0000","last_undegraded":"2024-04-26T10:38:51.892263+0000","last_fullsized":"2024-04-26T10:38:51.892263+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:51.892239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:51.892239+0000","last_clean_scrub_stamp":"2024-04-26T10:38:51.892239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:47.035824+0000","scrub_duration":0.001868951,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:10.973689+0000","last_change":"2024-04-26T10:39:10.973799+0000","last_active":"2024-04-26T10:39:10.973689+0000","last_peered":"2024-04-26T10:39:10.973689+0000","last_clean":"2024-04-26T10:39:10.973689+0000","last_became_active":"2024-04-26T10:37:23.272111+0000","last_became_peered":"2024-04-26T10:37:23.272111+0000","last_unstale":"2024-04-26T10:39:10.973689+0000","last_undegraded":"2024-04-26T10:39:10.973689+0000","last_fullsized":"2024-04-26T10:39:10.973689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:10.973665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:10.973665+0000","last_clean_scrub_stamp":"2024-04-26T10:39:10.973665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:08.698313+0000","scrub_duration":0.0016713710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:37.059181+0000","last_change":"2024-04-26T10:38:37.059303+0000","last_active":"2024-04-26T10:38:37.059181+0000","last_peered":"2024-04-26T10:38:37.059181+0000","last_clean":"2024-04-26T10:38:37.059181+0000","last_became_active":"2024-04-26T10:37:23.273867+0000","last_became_peered":"2024-04-26T10:37:23.273867+0000","last_unstale":"2024-04-26T10:38:37.059181+0000","last_undegraded":"2024-04-26T10:38:37.059181+0000","last_fullsized":"2024-04-26T10:38:37.059181+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:37.059156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:37.059156+0000","last_clean_scrub_stamp":"2024-04-26T10:38:37.059156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:44.572293+0000","scrub_duration":0.001855294,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:57.878941+0000","last_change":"2024-04-26T10:37:57.879044+0000","last_active":"2024-04-26T10:37:57.878941+0000","last_peered":"2024-04-26T10:37:57.878941+0000","last_clean":"2024-04-26T10:37:57.878941+0000","last_became_active":"2024-04-26T10:37:23.272569+0000","last_became_peered":"2024-04-26T10:37:23.272569+0000","last_unstale":"2024-04-26T10:37:57.878941+0000","last_undegraded":"2024-04-26T10:37:57.878941+0000","last_fullsized":"2024-04-26T10:37:57.878941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:57.878919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:57.878919+0000","last_clean_scrub_stamp":"2024-04-26T10:37:57.878919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:02.166486+0000","scrub_duration":0.0020039089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:29.992871+0000","last_change":"2024-04-26T10:38:29.992871+0000","last_active":"2024-04-26T10:38:29.992871+0000","last_peered":"2024-04-26T10:38:29.992871+0000","last_clean":"2024-04-26T10:38:29.992871+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:38:29.992871+0000","last_undegraded":"2024-04-26T10:38:29.992871+0000","last_fullsized":"2024-04-26T10:38:29.992871+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:29.992711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:29.992711+0000","last_clean_scrub_stamp":"2024-04-26T10:38:29.992711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:32.502846+0000","scrub_duration":0.0017064700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:54.397113+0000","last_change":"2024-04-26T10:38:54.397244+0000","last_active":"2024-04-26T10:38:54.397113+0000","last_peered":"2024-04-26T10:38:54.397113+0000","last_clean":"2024-04-26T10:38:54.397113+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:38:54.397113+0000","last_undegraded":"2024-04-26T10:38:54.397113+0000","last_fullsized":"2024-04-26T10:38:54.397113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:54.397088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:54.397088+0000","last_clean_scrub_stamp":"2024-04-26T10:38:54.397088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:15.372732+0000","scrub_duration":0.054218492,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:10.379509+0000","last_change":"2024-04-26T10:39:10.379603+0000","last_active":"2024-04-26T10:39:10.379509+0000","last_peered":"2024-04-26T10:39:10.379509+0000","last_clean":"2024-04-26T10:39:10.379509+0000","last_became_active":"2024-04-26T10:37:28.282419+0000","last_became_peered":"2024-04-26T10:37:28.282419+0000","last_unstale":"2024-04-26T10:39:10.379509+0000","last_undegraded":"2024-04-26T10:39:10.379509+0000","last_fullsized":"2024-04-26T10:39:10.379509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:10.379484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:10.379484+0000","last_clean_scrub_stamp":"2024-04-26T10:39:10.379484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:00.294598+0000","scrub_duration":0.001681498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:47.889504+0000","last_change":"2024-04-26T10:37:47.889608+0000","last_active":"2024-04-26T10:37:47.889504+0000","last_peered":"2024-04-26T10:37:47.889504+0000","last_clean":"2024-04-26T10:37:47.889504+0000","last_became_active":"2024-04-26T10:37:23.273114+0000","last_became_peered":"2024-04-26T10:37:23.273114+0000","last_unstale":"2024-04-26T10:37:47.889504+0000","last_undegraded":"2024-04-26T10:37:47.889504+0000","last_fullsized":"2024-04-26T10:37:47.889504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:47.889480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:47.889480+0000","last_clean_scrub_stamp":"2024-04-26T10:37:47.889480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:38.351949+0000","scrub_duration":0.0018432660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:00.037320+0000","last_change":"2024-04-26T10:38:00.037320+0000","last_active":"2024-04-26T10:38:00.037320+0000","last_peered":"2024-04-26T10:38:00.037320+0000","last_clean":"2024-04-26T10:38:00.037320+0000","last_became_active":"2024-04-26T10:37:23.267319+0000","last_became_peered":"2024-04-26T10:37:23.267319+0000","last_unstale":"2024-04-26T10:38:00.037320+0000","last_undegraded":"2024-04-26T10:38:00.037320+0000","last_fullsized":"2024-04-26T10:38:00.037320+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:00.037154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:00.037154+0000","last_clean_scrub_stamp":"2024-04-26T10:38:00.037154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:01.442829+0000","scrub_duration":0.0020604550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:38.002518+0000","last_change":"2024-04-26T10:38:38.002661+0000","last_active":"2024-04-26T10:38:38.002518+0000","last_peered":"2024-04-26T10:38:38.002518+0000","last_clean":"2024-04-26T10:38:38.002518+0000","last_became_active":"2024-04-26T10:37:23.266332+0000","last_became_peered":"2024-04-26T10:37:23.266332+0000","last_unstale":"2024-04-26T10:38:38.002518+0000","last_undegraded":"2024-04-26T10:38:38.002518+0000","last_fullsized":"2024-04-26T10:38:38.002518+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:38.002497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:38.002497+0000","last_clean_scrub_stamp":"2024-04-26T10:38:38.002497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:04.953996+0000","scrub_duration":0.0019267080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:32.115831+0000","last_change":"2024-04-26T10:38:32.115967+0000","last_active":"2024-04-26T10:38:32.115831+0000","last_peered":"2024-04-26T10:38:32.115831+0000","last_clean":"2024-04-26T10:38:32.115831+0000","last_became_active":"2024-04-26T10:37:23.269657+0000","last_became_peered":"2024-04-26T10:37:23.269657+0000","last_unstale":"2024-04-26T10:38:32.115831+0000","last_undegraded":"2024-04-26T10:38:32.115831+0000","last_fullsized":"2024-04-26T10:38:32.115831+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:32.115807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:32.115807+0000","last_clean_scrub_stamp":"2024-04-26T10:38:32.115807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:12.148163+0000","scrub_duration":0.0016869439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:41.612919+0000","last_change":"2024-04-26T10:37:41.612919+0000","last_active":"2024-04-26T10:37:41.612919+0000","last_peered":"2024-04-26T10:37:41.612919+0000","last_clean":"2024-04-26T10:37:41.612919+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:37:41.612919+0000","last_undegraded":"2024-04-26T10:37:41.612919+0000","last_fullsized":"2024-04-26T10:37:41.612919+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:41.612787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:41.612787+0000","last_clean_scrub_stamp":"2024-04-26T10:37:41.612787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:15.886238+0000","scrub_duration":0.001521445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:34.428825+0000","last_change":"2024-04-26T10:38:34.428825+0000","last_active":"2024-04-26T10:38:34.428825+0000","last_peered":"2024-04-26T10:38:34.428825+0000","last_clean":"2024-04-26T10:38:34.428825+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:38:34.428825+0000","last_undegraded":"2024-04-26T10:38:34.428825+0000","last_fullsized":"2024-04-26T10:38:34.428825+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:34.428529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:34.428529+0000","last_clean_scrub_stamp":"2024-04-26T10:38:34.428529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:41.415399+0000","scrub_duration":0.0019058580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:38.035356+0000","last_change":"2024-04-26T10:38:38.035356+0000","last_active":"2024-04-26T10:38:38.035356+0000","last_peered":"2024-04-26T10:38:38.035356+0000","last_clean":"2024-04-26T10:38:38.035356+0000","last_became_active":"2024-04-26T10:37:23.267595+0000","last_became_peered":"2024-04-26T10:37:23.267595+0000","last_unstale":"2024-04-26T10:38:38.035356+0000","last_undegraded":"2024-04-26T10:38:38.035356+0000","last_fullsized":"2024-04-26T10:38:38.035356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:38.035219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:38.035219+0000","last_clean_scrub_stamp":"2024-04-26T10:38:38.035219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:48.251247+0000","scrub_duration":0.0018318849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:18.553783+0000","last_change":"2024-04-26T10:38:18.553915+0000","last_active":"2024-04-26T10:38:18.553783+0000","last_peered":"2024-04-26T10:38:18.553783+0000","last_clean":"2024-04-26T10:38:18.553783+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:38:18.553783+0000","last_undegraded":"2024-04-26T10:38:18.553783+0000","last_fullsized":"2024-04-26T10:38:18.553783+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:18.553758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:18.553758+0000","last_clean_scrub_stamp":"2024-04-26T10:38:18.553758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:18.557993+0000","scrub_duration":0.028014801999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:46.963835+0000","last_change":"2024-04-26T10:38:46.963949+0000","last_active":"2024-04-26T10:38:46.963835+0000","last_peered":"2024-04-26T10:38:46.963835+0000","last_clean":"2024-04-26T10:38:46.963835+0000","last_became_active":"2024-04-26T10:37:23.270451+0000","last_became_peered":"2024-04-26T10:37:23.270451+0000","last_unstale":"2024-04-26T10:38:46.963835+0000","last_undegraded":"2024-04-26T10:38:46.963835+0000","last_fullsized":"2024-04-26T10:38:46.963835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:46.963811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:46.963811+0000","last_clean_scrub_stamp":"2024-04-26T10:38:46.963811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:33.953521+0000","scrub_duration":0.0018432749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"82'159","reported_seq":314,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:06.016417+0000","last_change":"2024-04-26T10:39:06.016552+0000","last_active":"2024-04-26T10:39:06.016417+0000","last_peered":"2024-04-26T10:39:06.016417+0000","last_clean":"2024-04-26T10:39:06.016417+0000","last_became_active":"2024-04-26T10:37:23.268665+0000","last_became_peered":"2024-04-26T10:37:23.268665+0000","last_unstale":"2024-04-26T10:39:06.016417+0000","last_undegraded":"2024-04-26T10:39:06.016417+0000","last_fullsized":"2024-04-26T10:39:06.016417+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'159","last_scrub_stamp":"2024-04-26T10:39:06.016391+0000","last_deep_scrub":"82'159","last_deep_scrub_stamp":"2024-04-26T10:39:06.016391+0000","last_clean_scrub_stamp":"2024-04-26T10:39:06.016391+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:24.559177+0000","scrub_duration":0.0052622959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:38.410149+0000","last_change":"2024-04-26T10:38:38.410149+0000","last_active":"2024-04-26T10:38:38.410149+0000","last_peered":"2024-04-26T10:38:38.410149+0000","last_clean":"2024-04-26T10:38:38.410149+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:38:38.410149+0000","last_undegraded":"2024-04-26T10:38:38.410149+0000","last_fullsized":"2024-04-26T10:38:38.410149+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:38.409993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:38.409993+0000","last_clean_scrub_stamp":"2024-04-26T10:38:38.409993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:26.451120+0000","scrub_duration":0.0018049819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:58.886200+0000","last_change":"2024-04-26T10:37:58.886319+0000","last_active":"2024-04-26T10:37:58.886200+0000","last_peered":"2024-04-26T10:37:58.886200+0000","last_clean":"2024-04-26T10:37:58.886200+0000","last_became_active":"2024-04-26T10:37:23.269736+0000","last_became_peered":"2024-04-26T10:37:23.269736+0000","last_unstale":"2024-04-26T10:37:58.886200+0000","last_undegraded":"2024-04-26T10:37:58.886200+0000","last_fullsized":"2024-04-26T10:37:58.886200+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:58.886177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:58.886177+0000","last_clean_scrub_stamp":"2024-04-26T10:37:58.886177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:36.789200+0000","scrub_duration":0.002025603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:23.996073+0000","last_change":"2024-04-26T10:38:23.996208+0000","last_active":"2024-04-26T10:38:23.996073+0000","last_peered":"2024-04-26T10:38:23.996073+0000","last_clean":"2024-04-26T10:38:23.996073+0000","last_became_active":"2024-04-26T10:37:23.265317+0000","last_became_peered":"2024-04-26T10:37:23.265317+0000","last_unstale":"2024-04-26T10:38:23.996073+0000","last_undegraded":"2024-04-26T10:38:23.996073+0000","last_fullsized":"2024-04-26T10:38:23.996073+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:23.996042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:23.996042+0000","last_clean_scrub_stamp":"2024-04-26T10:38:23.996042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:33.504025+0000","scrub_duration":0.001878865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:36.367763+0000","last_change":"2024-04-26T10:38:36.367763+0000","last_active":"2024-04-26T10:38:36.367763+0000","last_peered":"2024-04-26T10:38:36.367763+0000","last_clean":"2024-04-26T10:38:36.367763+0000","last_became_active":"2024-04-26T10:37:23.276151+0000","last_became_peered":"2024-04-26T10:37:23.276151+0000","last_unstale":"2024-04-26T10:38:36.367763+0000","last_undegraded":"2024-04-26T10:38:36.367763+0000","last_fullsized":"2024-04-26T10:38:36.367763+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:36.367587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:36.367587+0000","last_clean_scrub_stamp":"2024-04-26T10:38:36.367587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:44.437172+0000","scrub_duration":0.001787358,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:20.029488+0000","last_change":"2024-04-26T10:38:20.029638+0000","last_active":"2024-04-26T10:38:20.029488+0000","last_peered":"2024-04-26T10:38:20.029488+0000","last_clean":"2024-04-26T10:38:20.029488+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:38:20.029488+0000","last_undegraded":"2024-04-26T10:38:20.029488+0000","last_fullsized":"2024-04-26T10:38:20.029488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:20.029457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:20.029457+0000","last_clean_scrub_stamp":"2024-04-26T10:38:20.029457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:12.454711+0000","scrub_duration":0.0017301249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:08.834615+0000","last_change":"2024-04-26T10:39:08.834740+0000","last_active":"2024-04-26T10:39:08.834615+0000","last_peered":"2024-04-26T10:39:08.834615+0000","last_clean":"2024-04-26T10:39:08.834615+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:39:08.834615+0000","last_undegraded":"2024-04-26T10:39:08.834615+0000","last_fullsized":"2024-04-26T10:39:08.834615+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:08.834593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:08.834593+0000","last_clean_scrub_stamp":"2024-04-26T10:39:08.834593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:57.730514+0000","scrub_duration":0.0015217340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:40.389685+0000","last_change":"2024-04-26T10:38:40.389685+0000","last_active":"2024-04-26T10:38:40.389685+0000","last_peered":"2024-04-26T10:38:40.389685+0000","last_clean":"2024-04-26T10:38:40.389685+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:38:40.389685+0000","last_undegraded":"2024-04-26T10:38:40.389685+0000","last_fullsized":"2024-04-26T10:38:40.389685+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:40.389519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:40.389519+0000","last_clean_scrub_stamp":"2024-04-26T10:38:40.389519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:12.790737+0000","scrub_duration":0.001581514,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:58.907760+0000","last_change":"2024-04-26T10:38:58.907760+0000","last_active":"2024-04-26T10:38:58.907760+0000","last_peered":"2024-04-26T10:38:58.907760+0000","last_clean":"2024-04-26T10:38:58.907760+0000","last_became_active":"2024-04-26T10:37:23.277309+0000","last_became_peered":"2024-04-26T10:37:23.277309+0000","last_unstale":"2024-04-26T10:38:58.907760+0000","last_undegraded":"2024-04-26T10:38:58.907760+0000","last_fullsized":"2024-04-26T10:38:58.907760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:58.907634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:58.907634+0000","last_clean_scrub_stamp":"2024-04-26T10:38:58.907634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:44.474784+0000","scrub_duration":0.0017121739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"82'3","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:15.552718+0000","last_change":"2024-04-26T10:38:15.552856+0000","last_active":"2024-04-26T10:38:15.552718+0000","last_peered":"2024-04-26T10:38:15.552718+0000","last_clean":"2024-04-26T10:38:15.552718+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:38:15.552718+0000","last_undegraded":"2024-04-26T10:38:15.552718+0000","last_fullsized":"2024-04-26T10:38:15.552718+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:38:15.552692+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:38:15.552692+0000","last_clean_scrub_stamp":"2024-04-26T10:38:15.552692+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:15.123234+0000","scrub_duration":0.0030682249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:35.393333+0000","last_change":"2024-04-26T10:38:35.393460+0000","last_active":"2024-04-26T10:38:35.393333+0000","last_peered":"2024-04-26T10:38:35.393333+0000","last_clean":"2024-04-26T10:38:35.393333+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:38:35.393333+0000","last_undegraded":"2024-04-26T10:38:35.393333+0000","last_fullsized":"2024-04-26T10:38:35.393333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:35.393312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:35.393312+0000","last_clean_scrub_stamp":"2024-04-26T10:38:35.393312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:07.081724+0000","scrub_duration":0.001855916,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:01.537057+0000","last_change":"2024-04-26T10:38:01.537057+0000","last_active":"2024-04-26T10:38:01.537057+0000","last_peered":"2024-04-26T10:38:01.537057+0000","last_clean":"2024-04-26T10:38:01.537057+0000","last_became_active":"2024-04-26T10:37:28.281669+0000","last_became_peered":"2024-04-26T10:37:28.281669+0000","last_unstale":"2024-04-26T10:38:01.537057+0000","last_undegraded":"2024-04-26T10:38:01.537057+0000","last_fullsized":"2024-04-26T10:38:01.537057+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:01.536922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:01.536922+0000","last_clean_scrub_stamp":"2024-04-26T10:38:01.536922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:18.958300+0000","scrub_duration":0.0019935619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":87,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.992676+0000","last_change":"2024-04-26T10:38:03.992792+0000","last_active":"2024-04-26T10:38:03.992676+0000","last_peered":"2024-04-26T10:38:03.992676+0000","last_clean":"2024-04-26T10:38:03.992676+0000","last_became_active":"2024-04-26T10:37:23.268673+0000","last_became_peered":"2024-04-26T10:37:23.268673+0000","last_unstale":"2024-04-26T10:38:03.992676+0000","last_undegraded":"2024-04-26T10:38:03.992676+0000","last_fullsized":"2024-04-26T10:38:03.992676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.992656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.992656+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.992656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:06.482083+0000","scrub_duration":0.0019801340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'2","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:48.393623+0000","last_change":"2024-04-26T10:38:48.393779+0000","last_active":"2024-04-26T10:38:48.393623+0000","last_peered":"2024-04-26T10:38:48.393623+0000","last_clean":"2024-04-26T10:38:48.393623+0000","last_became_active":"2024-04-26T10:37:23.277001+0000","last_became_peered":"2024-04-26T10:37:23.277001+0000","last_unstale":"2024-04-26T10:38:48.393623+0000","last_undegraded":"2024-04-26T10:38:48.393623+0000","last_fullsized":"2024-04-26T10:38:48.393623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T10:38:48.393591+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T10:38:48.393591+0000","last_clean_scrub_stamp":"2024-04-26T10:38:48.393591+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:47.295722+0000","scrub_duration":0.0033183689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:14.919416+0000","last_change":"2024-04-26T10:39:14.919552+0000","last_active":"2024-04-26T10:39:14.919416+0000","last_peered":"2024-04-26T10:39:14.919416+0000","last_clean":"2024-04-26T10:39:14.919416+0000","last_became_active":"2024-04-26T10:37:23.266912+0000","last_became_peered":"2024-04-26T10:37:23.266912+0000","last_unstale":"2024-04-26T10:39:14.919416+0000","last_undegraded":"2024-04-26T10:39:14.919416+0000","last_fullsized":"2024-04-26T10:39:14.919416+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:14.919390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:14.919390+0000","last_clean_scrub_stamp":"2024-04-26T10:39:14.919390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.489932+0000","scrub_duration":0.0021573389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:39.091234+0000","last_change":"2024-04-26T10:37:39.091234+0000","last_active":"2024-04-26T10:37:39.091234+0000","last_peered":"2024-04-26T10:37:39.091234+0000","last_clean":"2024-04-26T10:37:39.091234+0000","last_became_active":"2024-04-26T10:37:23.277303+0000","last_became_peered":"2024-04-26T10:37:23.277303+0000","last_unstale":"2024-04-26T10:37:39.091234+0000","last_undegraded":"2024-04-26T10:37:39.091234+0000","last_fullsized":"2024-04-26T10:37:39.091234+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:37:39.091052+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:37:39.091052+0000","last_clean_scrub_stamp":"2024-04-26T10:37:39.091052+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:34.281919+0000","scrub_duration":0.0021606110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:29.028179+0000","last_change":"2024-04-26T10:38:29.028282+0000","last_active":"2024-04-26T10:38:29.028179+0000","last_peered":"2024-04-26T10:38:29.028179+0000","last_clean":"2024-04-26T10:38:29.028179+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:38:29.028179+0000","last_undegraded":"2024-04-26T10:38:29.028179+0000","last_fullsized":"2024-04-26T10:38:29.028179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:29.028154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:29.028154+0000","last_clean_scrub_stamp":"2024-04-26T10:38:29.028154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:06:33.111156+0000","scrub_duration":0.001813516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:29.284020+0000","last_change":"2024-04-26T10:37:23.266600+0000","last_active":"2024-04-26T10:37:29.284020+0000","last_peered":"2024-04-26T10:37:29.284020+0000","last_clean":"2024-04-26T10:37:29.284020+0000","last_became_active":"2024-04-26T10:37:23.266295+0000","last_became_peered":"2024-04-26T10:37:23.266295+0000","last_unstale":"2024-04-26T10:37:29.284020+0000","last_undegraded":"2024-04-26T10:37:29.284020+0000","last_fullsized":"2024-04-26T10:37:29.284020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:50.561227+0000","last_clean_scrub_stamp":"2024-04-26T10:32:50.561227+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:49.930540+0000","last_change":"2024-04-26T10:37:49.930694+0000","last_active":"2024-04-26T10:37:49.930540+0000","last_peered":"2024-04-26T10:37:49.930540+0000","last_clean":"2024-04-26T10:37:49.930540+0000","last_became_active":"2024-04-26T10:37:23.272039+0000","last_became_peered":"2024-04-26T10:37:23.272039+0000","last_unstale":"2024-04-26T10:37:49.930540+0000","last_undegraded":"2024-04-26T10:37:49.930540+0000","last_fullsized":"2024-04-26T10:37:49.930540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:49.930517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:49.930517+0000","last_clean_scrub_stamp":"2024-04-26T10:37:49.930517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:31.070842+0000","scrub_duration":0.046350850999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"82'3","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:45.911007+0000","last_change":"2024-04-26T10:38:45.911112+0000","last_active":"2024-04-26T10:38:45.911007+0000","last_peered":"2024-04-26T10:38:45.911007+0000","last_clean":"2024-04-26T10:38:45.911007+0000","last_became_active":"2024-04-26T10:37:23.273253+0000","last_became_peered":"2024-04-26T10:37:23.273253+0000","last_unstale":"2024-04-26T10:38:45.911007+0000","last_undegraded":"2024-04-26T10:38:45.911007+0000","last_fullsized":"2024-04-26T10:38:45.911007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:38:45.910980+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:38:45.910980+0000","last_clean_scrub_stamp":"2024-04-26T10:38:45.910980+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:39.494680+0000","scrub_duration":0.0033169100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:01.936983+0000","last_change":"2024-04-26T10:39:01.937087+0000","last_active":"2024-04-26T10:39:01.936983+0000","last_peered":"2024-04-26T10:39:01.936983+0000","last_clean":"2024-04-26T10:39:01.936983+0000","last_became_active":"2024-04-26T10:37:23.267434+0000","last_became_peered":"2024-04-26T10:37:23.267434+0000","last_unstale":"2024-04-26T10:39:01.936983+0000","last_undegraded":"2024-04-26T10:39:01.936983+0000","last_fullsized":"2024-04-26T10:39:01.936983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:01.936961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:01.936961+0000","last_clean_scrub_stamp":"2024-04-26T10:39:01.936961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:24.275039+0000","scrub_duration":0.0019342369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:11.578515+0000","last_change":"2024-04-26T10:38:11.578515+0000","last_active":"2024-04-26T10:38:11.578515+0000","last_peered":"2024-04-26T10:38:11.578515+0000","last_clean":"2024-04-26T10:38:11.578515+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:38:11.578515+0000","last_undegraded":"2024-04-26T10:38:11.578515+0000","last_fullsized":"2024-04-26T10:38:11.578515+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:38:11.578322+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:38:11.578322+0000","last_clean_scrub_stamp":"2024-04-26T10:38:11.578322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:12.780448+0000","scrub_duration":0.0019376879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.786701+0000","last_change":"2024-04-26T10:34:14.507263+0000","last_active":"2024-04-26T10:37:36.786701+0000","last_peered":"2024-04-26T10:37:36.786701+0000","last_clean":"2024-04-26T10:37:36.786701+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:37:36.786701+0000","last_undegraded":"2024-04-26T10:37:36.786701+0000","last_fullsized":"2024-04-26T10:37:36.786701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:32:51.566457+0000","last_clean_scrub_stamp":"2024-04-26T10:32:51.566457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:04.517785+0000","last_change":"2024-04-26T10:38:04.517785+0000","last_active":"2024-04-26T10:38:04.517785+0000","last_peered":"2024-04-26T10:38:04.517785+0000","last_clean":"2024-04-26T10:38:04.517785+0000","last_became_active":"2024-04-26T10:37:23.271663+0000","last_became_peered":"2024-04-26T10:37:23.271663+0000","last_unstale":"2024-04-26T10:38:04.517785+0000","last_undegraded":"2024-04-26T10:38:04.517785+0000","last_fullsized":"2024-04-26T10:38:04.517785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-26T10:38:04.517652+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-26T10:38:04.517652+0000","last_clean_scrub_stamp":"2024-04-26T10:38:04.517652+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:57.558254+0000","scrub_duration":0.0039017489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:06.954934+0000","last_change":"2024-04-26T10:38:06.955074+0000","last_active":"2024-04-26T10:38:06.954934+0000","last_peered":"2024-04-26T10:38:06.954934+0000","last_clean":"2024-04-26T10:38:06.954934+0000","last_became_active":"2024-04-26T10:37:23.266624+0000","last_became_peered":"2024-04-26T10:37:23.266624+0000","last_unstale":"2024-04-26T10:38:06.954934+0000","last_undegraded":"2024-04-26T10:38:06.954934+0000","last_fullsized":"2024-04-26T10:38:06.954934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:06.954911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:06.954911+0000","last_clean_scrub_stamp":"2024-04-26T10:38:06.954911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:18.063497+0000","scrub_duration":0.0021816610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:25.969625+0000","last_change":"2024-04-26T10:38:25.969756+0000","last_active":"2024-04-26T10:38:25.969625+0000","last_peered":"2024-04-26T10:38:25.969625+0000","last_clean":"2024-04-26T10:38:25.969625+0000","last_became_active":"2024-04-26T10:37:23.266063+0000","last_became_peered":"2024-04-26T10:37:23.266063+0000","last_unstale":"2024-04-26T10:38:25.969625+0000","last_undegraded":"2024-04-26T10:38:25.969625+0000","last_fullsized":"2024-04-26T10:38:25.969625+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:25.969600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:25.969600+0000","last_clean_scrub_stamp":"2024-04-26T10:38:25.969600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:03.988066+0000","scrub_duration":0.001770282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":99,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:07.371858+0000","last_change":"2024-04-26T10:39:07.371966+0000","last_active":"2024-04-26T10:39:07.371858+0000","last_peered":"2024-04-26T10:39:07.371858+0000","last_clean":"2024-04-26T10:39:07.371858+0000","last_became_active":"2024-04-26T10:37:28.281541+0000","last_became_peered":"2024-04-26T10:37:28.281541+0000","last_unstale":"2024-04-26T10:39:07.371858+0000","last_undegraded":"2024-04-26T10:39:07.371858+0000","last_fullsized":"2024-04-26T10:39:07.371858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:07.371835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:07.371835+0000","last_clean_scrub_stamp":"2024-04-26T10:39:07.371835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:37.739119+0000","scrub_duration":0.0023571460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:06.997233+0000","last_change":"2024-04-26T10:38:06.997233+0000","last_active":"2024-04-26T10:38:06.997233+0000","last_peered":"2024-04-26T10:38:06.997233+0000","last_clean":"2024-04-26T10:38:06.997233+0000","last_became_active":"2024-04-26T10:37:23.267644+0000","last_became_peered":"2024-04-26T10:37:23.267644+0000","last_unstale":"2024-04-26T10:38:06.997233+0000","last_undegraded":"2024-04-26T10:38:06.997233+0000","last_fullsized":"2024-04-26T10:38:06.997233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:06.997106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:06.997106+0000","last_clean_scrub_stamp":"2024-04-26T10:38:06.997106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:56:00.253043+0000","scrub_duration":0.001652953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:22.504052+0000","last_change":"2024-04-26T10:38:22.504052+0000","last_active":"2024-04-26T10:38:22.504052+0000","last_peered":"2024-04-26T10:38:22.504052+0000","last_clean":"2024-04-26T10:38:22.504052+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:38:22.504052+0000","last_undegraded":"2024-04-26T10:38:22.504052+0000","last_fullsized":"2024-04-26T10:38:22.504052+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:22.503891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:22.503891+0000","last_clean_scrub_stamp":"2024-04-26T10:38:22.503891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:15.301897+0000","scrub_duration":0.027299981000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:16.025759+0000","last_change":"2024-04-26T10:38:16.025759+0000","last_active":"2024-04-26T10:38:16.025759+0000","last_peered":"2024-04-26T10:38:16.025759+0000","last_clean":"2024-04-26T10:38:16.025759+0000","last_became_active":"2024-04-26T10:37:23.273023+0000","last_became_peered":"2024-04-26T10:37:23.273023+0000","last_unstale":"2024-04-26T10:38:16.025759+0000","last_undegraded":"2024-04-26T10:38:16.025759+0000","last_fullsized":"2024-04-26T10:38:16.025759+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:16.025616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:16.025616+0000","last_clean_scrub_stamp":"2024-04-26T10:38:16.025616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:37.698478+0000","scrub_duration":0.0018282789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1766,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738450,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":338824,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":94033016,"statfs":{"total":96636764160,"available":96289808384,"internally_reserved":0,"allocated":917504,"data_stored":359527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346028486},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:38:22 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.503},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.48699999999999999}]},{"osd":1,"last update":"Fri Apr 26 10:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.498,"15min":0.40000000000000002},"min":{"1min":0.26800000000000002,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.59999999999999998,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.432},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.65300000000000002,"15min":0.501},"min":{"1min":0.31900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.59199999999999997,"5min":12.206,"15min":12.206},"last":0.36199999999999999}]}]},{"osd":0,"up_from":75,"seq":322122547225,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55012,"kb_used_data":1500,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94316828,"statfs":{"total":96636764160,"available":96580431872,"internally_reserved":0,"allocated":1536000,"data_stored":951641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7111,"internal_metadata":54780985},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:38:22 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Apr 26 10:38:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.436}]}]},{"osd":1,"up_from":8,"seq":34359738449,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257368,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":255870,"kb_avail":94114472,"statfs":{"total":96636764160,"available":96373219328,"internally_reserved":0,"allocated":1523712,"data_stored":948912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262011334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:38:23 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Apr 26 10:38:54 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48199999999999998,"15min":0.376},"min":{"1min":0.38400000000000001,"5min":0.17499999999999999,"15min":0.17199999999999999},"max":{"1min":0.55300000000000005,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.499,"15min":0.45700000000000002},"min":{"1min":0.40500000000000003,"5min":0.183,"15min":0.183},"max":{"1min":0.63500000000000001,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.47299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:39:19.676 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:39:19.676 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:39:19.676 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:39:19.676 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:39:19.677 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:39:19.677 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:39:19.677 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:39:19.677 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T10:32:50.561227+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=50, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:39:19.678 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T10:32:51.566457+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=32, tm_sec=51, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=37, tm_sec=34, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:39:19.678 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:39:39.679 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:39:40.041 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:39:40.043 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-04-26T10:39:40.052 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-04-26T10:39:39.090131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":592134,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":651204,"kb_used_data":3884,"kb_used_omap":10,"kb_used_meta":647285,"kb_avail":282464316,"statfs":{"total":289910292480,"available":289243459584,"internally_reserved":0,"allocated":3977216,"data_stored":2260080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10299,"internal_metadata":662820805},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003091"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:10.940281+0000","last_change":"2024-04-26T10:39:10.940404+0000","last_active":"2024-04-26T10:39:10.940281+0000","last_peered":"2024-04-26T10:39:10.940281+0000","last_clean":"2024-04-26T10:39:10.940281+0000","last_became_active":"2024-04-26T10:34:14.506108+0000","last_became_peered":"2024-04-26T10:34:14.506108+0000","last_unstale":"2024-04-26T10:39:10.940281+0000","last_undegraded":"2024-04-26T10:39:10.940281+0000","last_fullsized":"2024-04-26T10:39:10.940281+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:10.940256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:10.940256+0000","last_clean_scrub_stamp":"2024-04-26T10:39:10.940256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:12.142382+0000","scrub_duration":0.075448575000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:46.090713+0000","last_change":"2024-04-26T10:37:46.090713+0000","last_active":"2024-04-26T10:37:46.090713+0000","last_peered":"2024-04-26T10:37:46.090713+0000","last_clean":"2024-04-26T10:37:46.090713+0000","last_became_active":"2024-04-26T10:32:52.000273+0000","last_became_peered":"2024-04-26T10:32:52.000273+0000","last_unstale":"2024-04-26T10:37:46.090713+0000","last_undegraded":"2024-04-26T10:37:46.090713+0000","last_fullsized":"2024-04-26T10:37:46.090713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:46.090545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:46.090545+0000","last_clean_scrub_stamp":"2024-04-26T10:37:46.090545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:42.129201+0000","scrub_duration":0.001738082,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:36.946374+0000","last_change":"2024-04-26T10:37:36.946374+0000","last_active":"2024-04-26T10:37:36.946374+0000","last_peered":"2024-04-26T10:37:36.946374+0000","last_clean":"2024-04-26T10:37:36.946374+0000","last_became_active":"2024-04-26T10:37:23.272107+0000","last_became_peered":"2024-04-26T10:37:23.272107+0000","last_unstale":"2024-04-26T10:37:36.946374+0000","last_undegraded":"2024-04-26T10:37:36.946374+0000","last_fullsized":"2024-04-26T10:37:36.946374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:36.946219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:36.946219+0000","last_clean_scrub_stamp":"2024-04-26T10:37:36.946219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:56.583737+0000","scrub_duration":0.0019495529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:54.913778+0000","last_change":"2024-04-26T10:37:54.913778+0000","last_active":"2024-04-26T10:37:54.913778+0000","last_peered":"2024-04-26T10:37:54.913778+0000","last_clean":"2024-04-26T10:37:54.913778+0000","last_became_active":"2024-04-26T10:37:23.269752+0000","last_became_peered":"2024-04-26T10:37:23.269752+0000","last_unstale":"2024-04-26T10:37:54.913778+0000","last_undegraded":"2024-04-26T10:37:54.913778+0000","last_fullsized":"2024-04-26T10:37:54.913778+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:54.913640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:54.913640+0000","last_clean_scrub_stamp":"2024-04-26T10:37:54.913640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:45.220783+0000","scrub_duration":0.0019585140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:44.056524+0000","last_change":"2024-04-26T10:37:44.056524+0000","last_active":"2024-04-26T10:37:44.056524+0000","last_peered":"2024-04-26T10:37:44.056524+0000","last_clean":"2024-04-26T10:37:44.056524+0000","last_became_active":"2024-04-26T10:34:14.506561+0000","last_became_peered":"2024-04-26T10:34:14.506561+0000","last_unstale":"2024-04-26T10:37:44.056524+0000","last_undegraded":"2024-04-26T10:37:44.056524+0000","last_fullsized":"2024-04-26T10:37:44.056524+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:44.056381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:44.056381+0000","last_clean_scrub_stamp":"2024-04-26T10:37:44.056381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:42:26.047330+0000","scrub_duration":0.016160926999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.015997+0000","last_change":"2024-04-26T10:38:03.016124+0000","last_active":"2024-04-26T10:38:03.015997+0000","last_peered":"2024-04-26T10:38:03.015997+0000","last_clean":"2024-04-26T10:38:03.015997+0000","last_became_active":"2024-04-26T10:37:23.270593+0000","last_became_peered":"2024-04-26T10:37:23.270593+0000","last_unstale":"2024-04-26T10:38:03.015997+0000","last_undegraded":"2024-04-26T10:38:03.015997+0000","last_fullsized":"2024-04-26T10:38:03.015997+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.015972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.015972+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.015972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:42.504031+0000","scrub_duration":0.001820241,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:22.072251+0000","last_change":"2024-04-26T10:38:22.072368+0000","last_active":"2024-04-26T10:38:22.072251+0000","last_peered":"2024-04-26T10:38:22.072251+0000","last_clean":"2024-04-26T10:38:22.072251+0000","last_became_active":"2024-04-26T10:37:23.270393+0000","last_became_peered":"2024-04-26T10:37:23.270393+0000","last_unstale":"2024-04-26T10:38:22.072251+0000","last_undegraded":"2024-04-26T10:38:22.072251+0000","last_fullsized":"2024-04-26T10:38:22.072251+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:22.072225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:22.072225+0000","last_clean_scrub_stamp":"2024-04-26T10:38:22.072225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:16.925527+0000","scrub_duration":0.016661415999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:35.066777+0000","last_change":"2024-04-26T10:38:35.066914+0000","last_active":"2024-04-26T10:38:35.066777+0000","last_peered":"2024-04-26T10:38:35.066777+0000","last_clean":"2024-04-26T10:38:35.066777+0000","last_became_active":"2024-04-26T10:37:23.267296+0000","last_became_peered":"2024-04-26T10:37:23.267296+0000","last_unstale":"2024-04-26T10:38:35.066777+0000","last_undegraded":"2024-04-26T10:38:35.066777+0000","last_fullsized":"2024-04-26T10:38:35.066777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:35.066756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:35.066756+0000","last_clean_scrub_stamp":"2024-04-26T10:38:35.066756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:14.500147+0000","scrub_duration":0.0017231670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:59.368145+0000","last_change":"2024-04-26T10:38:59.368277+0000","last_active":"2024-04-26T10:38:59.368145+0000","last_peered":"2024-04-26T10:38:59.368145+0000","last_clean":"2024-04-26T10:38:59.368145+0000","last_became_active":"2024-04-26T10:32:52.007982+0000","last_became_peered":"2024-04-26T10:32:52.007982+0000","last_unstale":"2024-04-26T10:38:59.368145+0000","last_undegraded":"2024-04-26T10:38:59.368145+0000","last_fullsized":"2024-04-26T10:38:59.368145+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:59.368120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:59.368120+0000","last_clean_scrub_stamp":"2024-04-26T10:38:59.368120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:31:01.115562+0000","scrub_duration":0.028461620999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:45.073164+0000","last_change":"2024-04-26T10:37:45.073164+0000","last_active":"2024-04-26T10:37:45.073164+0000","last_peered":"2024-04-26T10:37:45.073164+0000","last_clean":"2024-04-26T10:37:45.073164+0000","last_became_active":"2024-04-26T10:34:14.506558+0000","last_became_peered":"2024-04-26T10:34:14.506558+0000","last_unstale":"2024-04-26T10:37:45.073164+0000","last_undegraded":"2024-04-26T10:37:45.073164+0000","last_fullsized":"2024-04-26T10:37:45.073164+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:45.073006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:45.073006+0000","last_clean_scrub_stamp":"2024-04-26T10:37:45.073006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:23.891265+0000","scrub_duration":0.001902131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:48.878670+0000","last_change":"2024-04-26T10:37:48.878771+0000","last_active":"2024-04-26T10:37:48.878670+0000","last_peered":"2024-04-26T10:37:48.878670+0000","last_clean":"2024-04-26T10:37:48.878670+0000","last_became_active":"2024-04-26T10:37:23.273996+0000","last_became_peered":"2024-04-26T10:37:23.273996+0000","last_unstale":"2024-04-26T10:37:48.878670+0000","last_undegraded":"2024-04-26T10:37:48.878670+0000","last_fullsized":"2024-04-26T10:37:48.878670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:48.878645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:48.878645+0000","last_clean_scrub_stamp":"2024-04-26T10:37:48.878645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:14.620591+0000","scrub_duration":0.017302161999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:02.964860+0000","last_change":"2024-04-26T10:38:02.964962+0000","last_active":"2024-04-26T10:38:02.964860+0000","last_peered":"2024-04-26T10:38:02.964860+0000","last_clean":"2024-04-26T10:38:02.964860+0000","last_became_active":"2024-04-26T10:37:23.273290+0000","last_became_peered":"2024-04-26T10:37:23.273290+0000","last_unstale":"2024-04-26T10:38:02.964860+0000","last_undegraded":"2024-04-26T10:38:02.964860+0000","last_fullsized":"2024-04-26T10:38:02.964860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:02.964836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:02.964836+0000","last_clean_scrub_stamp":"2024-04-26T10:38:02.964836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:19.028065+0000","scrub_duration":0.0018081550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:28.062652+0000","last_change":"2024-04-26T10:38:28.062652+0000","last_active":"2024-04-26T10:38:28.062652+0000","last_peered":"2024-04-26T10:38:28.062652+0000","last_clean":"2024-04-26T10:38:28.062652+0000","last_became_active":"2024-04-26T10:34:14.507340+0000","last_became_peered":"2024-04-26T10:34:14.507340+0000","last_unstale":"2024-04-26T10:38:28.062652+0000","last_undegraded":"2024-04-26T10:38:28.062652+0000","last_fullsized":"2024-04-26T10:38:28.062652+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:28.062510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:28.062510+0000","last_clean_scrub_stamp":"2024-04-26T10:38:28.062510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:26.115949+0000","scrub_duration":0.016455943000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:17.121016+0000","last_change":"2024-04-26T10:38:17.121111+0000","last_active":"2024-04-26T10:38:17.121016+0000","last_peered":"2024-04-26T10:38:17.121016+0000","last_clean":"2024-04-26T10:38:17.121016+0000","last_became_active":"2024-04-26T10:37:23.269722+0000","last_became_peered":"2024-04-26T10:37:23.269722+0000","last_unstale":"2024-04-26T10:38:17.121016+0000","last_undegraded":"2024-04-26T10:38:17.121016+0000","last_fullsized":"2024-04-26T10:38:17.121016+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:17.120993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:17.120993+0000","last_clean_scrub_stamp":"2024-04-26T10:38:17.120993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:25.421013+0000","scrub_duration":0.001930906,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:13.078246+0000","last_change":"2024-04-26T10:38:13.078391+0000","last_active":"2024-04-26T10:38:13.078246+0000","last_peered":"2024-04-26T10:38:13.078246+0000","last_clean":"2024-04-26T10:38:13.078246+0000","last_became_active":"2024-04-26T10:37:23.270852+0000","last_became_peered":"2024-04-26T10:37:23.270852+0000","last_unstale":"2024-04-26T10:38:13.078246+0000","last_undegraded":"2024-04-26T10:38:13.078246+0000","last_fullsized":"2024-04-26T10:38:13.078246+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:13.078224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:13.078224+0000","last_clean_scrub_stamp":"2024-04-26T10:38:13.078224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:09.840624+0000","scrub_duration":0.0018370000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:38.963069+0000","last_change":"2024-04-26T10:37:38.963200+0000","last_active":"2024-04-26T10:37:38.963069+0000","last_peered":"2024-04-26T10:37:38.963069+0000","last_clean":"2024-04-26T10:37:38.963069+0000","last_became_active":"2024-04-26T10:37:23.268640+0000","last_became_peered":"2024-04-26T10:37:23.268640+0000","last_unstale":"2024-04-26T10:37:38.963069+0000","last_undegraded":"2024-04-26T10:37:38.963069+0000","last_fullsized":"2024-04-26T10:37:38.963069+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:38.963045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:38.963045+0000","last_clean_scrub_stamp":"2024-04-26T10:37:38.963045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:26:17.672777+0000","scrub_duration":0.0018662049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:13.519570+0000","last_change":"2024-04-26T10:39:13.519717+0000","last_active":"2024-04-26T10:39:13.519570+0000","last_peered":"2024-04-26T10:39:13.519570+0000","last_clean":"2024-04-26T10:39:13.519570+0000","last_became_active":"2024-04-26T10:37:28.281510+0000","last_became_peered":"2024-04-26T10:37:28.281510+0000","last_unstale":"2024-04-26T10:39:13.519570+0000","last_undegraded":"2024-04-26T10:39:13.519570+0000","last_fullsized":"2024-04-26T10:39:13.519570+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:13.519547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:13.519547+0000","last_clean_scrub_stamp":"2024-04-26T10:39:13.519547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:02:48.445502+0000","scrub_duration":0.080097699999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:07.970813+0000","last_change":"2024-04-26T10:38:07.970813+0000","last_active":"2024-04-26T10:38:07.970813+0000","last_peered":"2024-04-26T10:38:07.970813+0000","last_clean":"2024-04-26T10:38:07.970813+0000","last_became_active":"2024-04-26T10:34:14.506180+0000","last_became_peered":"2024-04-26T10:34:14.506180+0000","last_unstale":"2024-04-26T10:38:07.970813+0000","last_undegraded":"2024-04-26T10:38:07.970813+0000","last_fullsized":"2024-04-26T10:38:07.970813+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:07.970664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:07.970664+0000","last_clean_scrub_stamp":"2024-04-26T10:38:07.970664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:55.346373+0000","scrub_duration":0.001805283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:38.715625+0000","last_change":"2024-04-26T10:37:38.715778+0000","last_active":"2024-04-26T10:37:38.715625+0000","last_peered":"2024-04-26T10:37:38.715625+0000","last_clean":"2024-04-26T10:37:38.715625+0000","last_became_active":"2024-04-26T10:32:52.007446+0000","last_became_peered":"2024-04-26T10:32:52.007446+0000","last_unstale":"2024-04-26T10:37:38.715625+0000","last_undegraded":"2024-04-26T10:37:38.715625+0000","last_fullsized":"2024-04-26T10:37:38.715625+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:38.715602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:38.715602+0000","last_clean_scrub_stamp":"2024-04-26T10:37:38.715602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:47:48.931629+0000","scrub_duration":0.028191391,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:25.827747+0000","last_change":"2024-04-26T10:39:25.827747+0000","last_active":"2024-04-26T10:39:25.827747+0000","last_peered":"2024-04-26T10:39:25.827747+0000","last_clean":"2024-04-26T10:39:25.827747+0000","last_became_active":"2024-04-26T10:37:23.272964+0000","last_became_peered":"2024-04-26T10:37:23.272964+0000","last_unstale":"2024-04-26T10:39:25.827747+0000","last_undegraded":"2024-04-26T10:39:25.827747+0000","last_fullsized":"2024-04-26T10:39:25.827747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:25.827591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:25.827591+0000","last_clean_scrub_stamp":"2024-04-26T10:39:25.827591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:07.748807+0000","scrub_duration":0.0020956939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:30.097185+0000","last_change":"2024-04-26T10:38:30.097185+0000","last_active":"2024-04-26T10:38:30.097185+0000","last_peered":"2024-04-26T10:38:30.097185+0000","last_clean":"2024-04-26T10:38:30.097185+0000","last_became_active":"2024-04-26T10:37:23.271967+0000","last_became_peered":"2024-04-26T10:37:23.271967+0000","last_unstale":"2024-04-26T10:38:30.097185+0000","last_undegraded":"2024-04-26T10:38:30.097185+0000","last_fullsized":"2024-04-26T10:38:30.097185+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:30.096999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:30.096999+0000","last_clean_scrub_stamp":"2024-04-26T10:38:30.096999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:19.434538+0000","scrub_duration":0.028246974000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:35.081996+0000","last_change":"2024-04-26T10:38:35.082140+0000","last_active":"2024-04-26T10:38:35.081996+0000","last_peered":"2024-04-26T10:38:35.081996+0000","last_clean":"2024-04-26T10:38:35.081996+0000","last_became_active":"2024-04-26T10:37:23.267766+0000","last_became_peered":"2024-04-26T10:37:23.267766+0000","last_unstale":"2024-04-26T10:38:35.081996+0000","last_undegraded":"2024-04-26T10:38:35.081996+0000","last_fullsized":"2024-04-26T10:38:35.081996+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:35.081966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:35.081966+0000","last_clean_scrub_stamp":"2024-04-26T10:38:35.081966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:40.239398+0000","scrub_duration":0.0016982189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:13.618361+0000","last_change":"2024-04-26T10:38:13.618466+0000","last_active":"2024-04-26T10:38:13.618361+0000","last_peered":"2024-04-26T10:38:13.618361+0000","last_clean":"2024-04-26T10:38:13.618361+0000","last_became_active":"2024-04-26T10:37:23.269861+0000","last_became_peered":"2024-04-26T10:37:23.269861+0000","last_unstale":"2024-04-26T10:38:13.618361+0000","last_undegraded":"2024-04-26T10:38:13.618361+0000","last_fullsized":"2024-04-26T10:38:13.618361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:13.618337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:13.618337+0000","last_clean_scrub_stamp":"2024-04-26T10:38:13.618337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:51.339204+0000","scrub_duration":0.0019172900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:04.833140+0000","last_change":"2024-04-26T10:39:04.833140+0000","last_active":"2024-04-26T10:39:04.833140+0000","last_peered":"2024-04-26T10:39:04.833140+0000","last_clean":"2024-04-26T10:39:04.833140+0000","last_became_active":"2024-04-26T10:32:51.998395+0000","last_became_peered":"2024-04-26T10:32:51.998395+0000","last_unstale":"2024-04-26T10:39:04.833140+0000","last_undegraded":"2024-04-26T10:39:04.833140+0000","last_fullsized":"2024-04-26T10:39:04.833140+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:04.832978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:04.832978+0000","last_clean_scrub_stamp":"2024-04-26T10:39:04.832978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:17.381581+0000","scrub_duration":0.001713902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:16.988617+0000","last_change":"2024-04-26T10:39:16.988731+0000","last_active":"2024-04-26T10:39:16.988617+0000","last_peered":"2024-04-26T10:39:16.988617+0000","last_clean":"2024-04-26T10:39:16.988617+0000","last_became_active":"2024-04-26T10:37:23.272218+0000","last_became_peered":"2024-04-26T10:37:23.272218+0000","last_unstale":"2024-04-26T10:39:16.988617+0000","last_undegraded":"2024-04-26T10:39:16.988617+0000","last_fullsized":"2024-04-26T10:39:16.988617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:16.988593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:16.988593+0000","last_clean_scrub_stamp":"2024-04-26T10:39:16.988593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:16.992828+0000","scrub_duration":0.036983875999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:58.343289+0000","last_change":"2024-04-26T10:38:58.343289+0000","last_active":"2024-04-26T10:38:58.343289+0000","last_peered":"2024-04-26T10:38:58.343289+0000","last_clean":"2024-04-26T10:38:58.343289+0000","last_became_active":"2024-04-26T10:37:23.270919+0000","last_became_peered":"2024-04-26T10:37:23.270919+0000","last_unstale":"2024-04-26T10:38:58.343289+0000","last_undegraded":"2024-04-26T10:38:58.343289+0000","last_fullsized":"2024-04-26T10:38:58.343289+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:58.343155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:58.343155+0000","last_clean_scrub_stamp":"2024-04-26T10:38:58.343155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:30.695486+0000","scrub_duration":0.002179009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:17.925078+0000","last_change":"2024-04-26T10:39:17.925078+0000","last_active":"2024-04-26T10:39:17.925078+0000","last_peered":"2024-04-26T10:39:17.925078+0000","last_clean":"2024-04-26T10:39:17.925078+0000","last_became_active":"2024-04-26T10:37:23.273821+0000","last_became_peered":"2024-04-26T10:37:23.273821+0000","last_unstale":"2024-04-26T10:39:17.925078+0000","last_undegraded":"2024-04-26T10:39:17.925078+0000","last_fullsized":"2024-04-26T10:39:17.925078+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:17.924954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:17.924954+0000","last_clean_scrub_stamp":"2024-04-26T10:39:17.924954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:43.670179+0000","scrub_duration":0.001875062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:41.921825+0000","last_change":"2024-04-26T10:38:41.921932+0000","last_active":"2024-04-26T10:38:41.921825+0000","last_peered":"2024-04-26T10:38:41.921825+0000","last_clean":"2024-04-26T10:38:41.921825+0000","last_became_active":"2024-04-26T10:32:51.584095+0000","last_became_peered":"2024-04-26T10:32:51.584095+0000","last_unstale":"2024-04-26T10:38:41.921825+0000","last_undegraded":"2024-04-26T10:38:41.921825+0000","last_fullsized":"2024-04-26T10:38:41.921825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:38:41.921800+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:38:41.921800+0000","last_clean_scrub_stamp":"2024-04-26T10:38:41.921800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:13.776029+0000","scrub_duration":0.0017811509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:27.028396+0000","last_change":"2024-04-26T10:38:27.028530+0000","last_active":"2024-04-26T10:38:27.028396+0000","last_peered":"2024-04-26T10:38:27.028396+0000","last_clean":"2024-04-26T10:38:27.028396+0000","last_became_active":"2024-04-26T10:37:23.272837+0000","last_became_peered":"2024-04-26T10:37:23.272837+0000","last_unstale":"2024-04-26T10:38:27.028396+0000","last_undegraded":"2024-04-26T10:38:27.028396+0000","last_fullsized":"2024-04-26T10:38:27.028396+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:27.028373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:27.028373+0000","last_clean_scrub_stamp":"2024-04-26T10:38:27.028373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:37.281488+0000","scrub_duration":0.001773223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:20.440926+0000","last_change":"2024-04-26T10:38:20.441032+0000","last_active":"2024-04-26T10:38:20.440926+0000","last_peered":"2024-04-26T10:38:20.440926+0000","last_clean":"2024-04-26T10:38:20.440926+0000","last_became_active":"2024-04-26T10:37:23.269197+0000","last_became_peered":"2024-04-26T10:37:23.269197+0000","last_unstale":"2024-04-26T10:38:20.440926+0000","last_undegraded":"2024-04-26T10:38:20.440926+0000","last_fullsized":"2024-04-26T10:38:20.440926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:20.440901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:20.440901+0000","last_clean_scrub_stamp":"2024-04-26T10:38:20.440901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:56.822074+0000","scrub_duration":0.0016497720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:37.675146+0000","last_change":"2024-04-26T10:37:37.675146+0000","last_active":"2024-04-26T10:37:37.675146+0000","last_peered":"2024-04-26T10:37:37.675146+0000","last_clean":"2024-04-26T10:37:37.675146+0000","last_became_active":"2024-04-26T10:37:28.283421+0000","last_became_peered":"2024-04-26T10:37:28.283421+0000","last_unstale":"2024-04-26T10:37:37.675146+0000","last_undegraded":"2024-04-26T10:37:37.675146+0000","last_fullsized":"2024-04-26T10:37:37.675146+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:37.674937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:37.674937+0000","last_clean_scrub_stamp":"2024-04-26T10:37:37.674937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:45.188074+0000","scrub_duration":0.0017282650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:44.382264+0000","last_change":"2024-04-26T10:38:44.382369+0000","last_active":"2024-04-26T10:38:44.382264+0000","last_peered":"2024-04-26T10:38:44.382264+0000","last_clean":"2024-04-26T10:38:44.382264+0000","last_became_active":"2024-04-26T10:34:14.510854+0000","last_became_peered":"2024-04-26T10:34:14.510854+0000","last_unstale":"2024-04-26T10:38:44.382264+0000","last_undegraded":"2024-04-26T10:38:44.382264+0000","last_fullsized":"2024-04-26T10:38:44.382264+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:44.382241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:44.382241+0000","last_clean_scrub_stamp":"2024-04-26T10:38:44.382241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:32.405178+0000","scrub_duration":0.001690446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:03.932199+0000","last_change":"2024-04-26T10:39:03.932199+0000","last_active":"2024-04-26T10:39:03.932199+0000","last_peered":"2024-04-26T10:39:03.932199+0000","last_clean":"2024-04-26T10:39:03.932199+0000","last_became_active":"2024-04-26T10:37:23.272666+0000","last_became_peered":"2024-04-26T10:37:23.272666+0000","last_unstale":"2024-04-26T10:39:03.932199+0000","last_undegraded":"2024-04-26T10:39:03.932199+0000","last_fullsized":"2024-04-26T10:39:03.932199+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:03.932009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:03.932009+0000","last_clean_scrub_stamp":"2024-04-26T10:39:03.932009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:50.159326+0000","scrub_duration":0.066783158999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:03.293880+0000","last_change":"2024-04-26T10:39:03.293991+0000","last_active":"2024-04-26T10:39:03.293880+0000","last_peered":"2024-04-26T10:39:03.293880+0000","last_clean":"2024-04-26T10:39:03.293880+0000","last_became_active":"2024-04-26T10:37:23.270725+0000","last_became_peered":"2024-04-26T10:37:23.270725+0000","last_unstale":"2024-04-26T10:39:03.293880+0000","last_undegraded":"2024-04-26T10:39:03.293880+0000","last_fullsized":"2024-04-26T10:39:03.293880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:03.293855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:03.293855+0000","last_clean_scrub_stamp":"2024-04-26T10:39:03.293855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:24.779313+0000","scrub_duration":0.00178167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.478595+0000","last_change":"2024-04-26T10:38:03.478731+0000","last_active":"2024-04-26T10:38:03.478595+0000","last_peered":"2024-04-26T10:38:03.478595+0000","last_clean":"2024-04-26T10:38:03.478595+0000","last_became_active":"2024-04-26T10:34:14.510999+0000","last_became_peered":"2024-04-26T10:34:14.510999+0000","last_unstale":"2024-04-26T10:38:03.478595+0000","last_undegraded":"2024-04-26T10:38:03.478595+0000","last_fullsized":"2024-04-26T10:38:03.478595+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.478570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.478570+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.478570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:49.705887+0000","scrub_duration":0.00149917,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:55.908127+0000","last_change":"2024-04-26T10:37:55.908269+0000","last_active":"2024-04-26T10:37:55.908127+0000","last_peered":"2024-04-26T10:37:55.908127+0000","last_clean":"2024-04-26T10:37:55.908127+0000","last_became_active":"2024-04-26T10:37:23.269371+0000","last_became_peered":"2024-04-26T10:37:23.269371+0000","last_unstale":"2024-04-26T10:37:55.908127+0000","last_undegraded":"2024-04-26T10:37:55.908127+0000","last_fullsized":"2024-04-26T10:37:55.908127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:55.908102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:55.908102+0000","last_clean_scrub_stamp":"2024-04-26T10:37:55.908102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:31:11.319524+0000","scrub_duration":0.0019603670000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:49.354912+0000","last_change":"2024-04-26T10:38:49.355019+0000","last_active":"2024-04-26T10:38:49.354912+0000","last_peered":"2024-04-26T10:38:49.354912+0000","last_clean":"2024-04-26T10:38:49.354912+0000","last_became_active":"2024-04-26T10:37:23.269344+0000","last_became_peered":"2024-04-26T10:37:23.269344+0000","last_unstale":"2024-04-26T10:38:49.354912+0000","last_undegraded":"2024-04-26T10:38:49.354912+0000","last_fullsized":"2024-04-26T10:38:49.354912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:49.354889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:49.354889+0000","last_clean_scrub_stamp":"2024-04-26T10:38:49.354889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:19.945433+0000","scrub_duration":0.0018868769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"82'5","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:12.930508+0000","last_change":"2024-04-26T10:39:12.930619+0000","last_active":"2024-04-26T10:39:12.930508+0000","last_peered":"2024-04-26T10:39:12.930508+0000","last_clean":"2024-04-26T10:39:12.930508+0000","last_became_active":"2024-04-26T10:37:23.272731+0000","last_became_peered":"2024-04-26T10:37:23.272731+0000","last_unstale":"2024-04-26T10:39:12.930508+0000","last_undegraded":"2024-04-26T10:39:12.930508+0000","last_fullsized":"2024-04-26T10:39:12.930508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'5","last_scrub_stamp":"2024-04-26T10:39:12.930481+0000","last_deep_scrub":"82'5","last_deep_scrub_stamp":"2024-04-26T10:39:12.930481+0000","last_clean_scrub_stamp":"2024-04-26T10:39:12.930481+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:46.358869+0000","scrub_duration":0.003845785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":104,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:46.569879+0000","last_change":"2024-04-26T10:37:46.570003+0000","last_active":"2024-04-26T10:37:46.569879+0000","last_peered":"2024-04-26T10:37:46.569879+0000","last_clean":"2024-04-26T10:37:46.569879+0000","last_became_active":"2024-04-26T10:34:14.509061+0000","last_became_peered":"2024-04-26T10:34:14.509061+0000","last_unstale":"2024-04-26T10:37:46.569879+0000","last_undegraded":"2024-04-26T10:37:46.569879+0000","last_fullsized":"2024-04-26T10:37:46.569879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:46.569855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:46.569855+0000","last_clean_scrub_stamp":"2024-04-26T10:37:46.569855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:12.891140+0000","scrub_duration":0.00144177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"82'10","reported_seq":114,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:24.870927+0000","last_change":"2024-04-26T10:39:24.871036+0000","last_active":"2024-04-26T10:39:24.870927+0000","last_peered":"2024-04-26T10:39:24.870927+0000","last_clean":"2024-04-26T10:39:24.870927+0000","last_became_active":"2024-04-26T10:37:23.269968+0000","last_became_peered":"2024-04-26T10:37:23.269968+0000","last_unstale":"2024-04-26T10:39:24.870927+0000","last_undegraded":"2024-04-26T10:39:24.870927+0000","last_fullsized":"2024-04-26T10:39:24.870927+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'10","last_scrub_stamp":"2024-04-26T10:39:24.870900+0000","last_deep_scrub":"82'10","last_deep_scrub_stamp":"2024-04-26T10:39:24.870900+0000","last_clean_scrub_stamp":"2024-04-26T10:39:24.870900+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:17.796104+0000","scrub_duration":0.0051616680000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1564,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:39.919590+0000","last_change":"2024-04-26T10:37:39.919719+0000","last_active":"2024-04-26T10:37:39.919590+0000","last_peered":"2024-04-26T10:37:39.919590+0000","last_clean":"2024-04-26T10:37:39.919590+0000","last_became_active":"2024-04-26T10:37:23.274045+0000","last_became_peered":"2024-04-26T10:37:23.274045+0000","last_unstale":"2024-04-26T10:37:39.919590+0000","last_undegraded":"2024-04-26T10:37:39.919590+0000","last_fullsized":"2024-04-26T10:37:39.919590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:39.919570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:39.919570+0000","last_clean_scrub_stamp":"2024-04-26T10:37:39.919570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:19:44.433055+0000","scrub_duration":0.001537217,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"82'4","reported_seq":86,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:56.905128+0000","last_change":"2024-04-26T10:38:56.905236+0000","last_active":"2024-04-26T10:38:56.905128+0000","last_peered":"2024-04-26T10:38:56.905128+0000","last_clean":"2024-04-26T10:38:56.905128+0000","last_became_active":"2024-04-26T10:37:23.269775+0000","last_became_peered":"2024-04-26T10:37:23.269775+0000","last_unstale":"2024-04-26T10:38:56.905128+0000","last_undegraded":"2024-04-26T10:38:56.905128+0000","last_fullsized":"2024-04-26T10:38:56.905128+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-26T10:38:56.905096+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-26T10:38:56.905096+0000","last_clean_scrub_stamp":"2024-04-26T10:38:56.905096+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:16:49.759461+0000","scrub_duration":0.0040721890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:04.000953+0000","last_change":"2024-04-26T10:38:04.000953+0000","last_active":"2024-04-26T10:38:04.000953+0000","last_peered":"2024-04-26T10:38:04.000953+0000","last_clean":"2024-04-26T10:38:04.000953+0000","last_became_active":"2024-04-26T10:34:14.507524+0000","last_became_peered":"2024-04-26T10:34:14.507524+0000","last_unstale":"2024-04-26T10:38:04.000953+0000","last_undegraded":"2024-04-26T10:38:04.000953+0000","last_fullsized":"2024-04-26T10:38:04.000953+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:04.000827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:04.000827+0000","last_clean_scrub_stamp":"2024-04-26T10:38:04.000827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:34.824818+0000","scrub_duration":0.0020431870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:32.456176+0000","last_change":"2024-04-26T10:38:32.456289+0000","last_active":"2024-04-26T10:38:32.456176+0000","last_peered":"2024-04-26T10:38:32.456176+0000","last_clean":"2024-04-26T10:38:32.456176+0000","last_became_active":"2024-04-26T10:37:23.269537+0000","last_became_peered":"2024-04-26T10:37:23.269537+0000","last_unstale":"2024-04-26T10:38:32.456176+0000","last_undegraded":"2024-04-26T10:38:32.456176+0000","last_fullsized":"2024-04-26T10:38:32.456176+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:32.456150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:32.456150+0000","last_clean_scrub_stamp":"2024-04-26T10:38:32.456150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:21:05.179342+0000","scrub_duration":0.001825459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:05.884205+0000","last_change":"2024-04-26T10:39:05.884302+0000","last_active":"2024-04-26T10:39:05.884205+0000","last_peered":"2024-04-26T10:39:05.884205+0000","last_clean":"2024-04-26T10:39:05.884205+0000","last_became_active":"2024-04-26T10:34:14.505990+0000","last_became_peered":"2024-04-26T10:34:14.505990+0000","last_unstale":"2024-04-26T10:39:05.884205+0000","last_undegraded":"2024-04-26T10:39:05.884205+0000","last_fullsized":"2024-04-26T10:39:05.884205+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:05.884182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:05.884182+0000","last_clean_scrub_stamp":"2024-04-26T10:39:05.884182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:20:17.563813+0000","scrub_duration":0.017044677000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:18.889835+0000","last_change":"2024-04-26T10:39:18.889933+0000","last_active":"2024-04-26T10:39:18.889835+0000","last_peered":"2024-04-26T10:39:18.889835+0000","last_clean":"2024-04-26T10:39:18.889835+0000","last_became_active":"2024-04-26T10:37:23.267121+0000","last_became_peered":"2024-04-26T10:37:23.267121+0000","last_unstale":"2024-04-26T10:39:18.889835+0000","last_undegraded":"2024-04-26T10:39:18.889835+0000","last_fullsized":"2024-04-26T10:39:18.889835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:18.889813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:18.889813+0000","last_clean_scrub_stamp":"2024-04-26T10:39:18.889813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:55.270985+0000","scrub_duration":0.0021722820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":96,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:09.576502+0000","last_change":"2024-04-26T10:38:09.576610+0000","last_active":"2024-04-26T10:38:09.576502+0000","last_peered":"2024-04-26T10:38:09.576502+0000","last_clean":"2024-04-26T10:38:09.576502+0000","last_became_active":"2024-04-26T10:37:28.281512+0000","last_became_peered":"2024-04-26T10:37:28.281512+0000","last_unstale":"2024-04-26T10:38:09.576502+0000","last_undegraded":"2024-04-26T10:38:09.576502+0000","last_fullsized":"2024-04-26T10:38:09.576502+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:09.576479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:09.576479+0000","last_clean_scrub_stamp":"2024-04-26T10:38:09.576479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:58.472401+0000","scrub_duration":0.0016694769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"82'12","reported_seq":116,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:58.841362+0000","last_change":"2024-04-26T10:38:58.841466+0000","last_active":"2024-04-26T10:38:58.841362+0000","last_peered":"2024-04-26T10:38:58.841362+0000","last_clean":"2024-04-26T10:38:58.841362+0000","last_became_active":"2024-04-26T10:37:23.266377+0000","last_became_peered":"2024-04-26T10:37:23.266377+0000","last_unstale":"2024-04-26T10:38:58.841362+0000","last_undegraded":"2024-04-26T10:38:58.841362+0000","last_fullsized":"2024-04-26T10:38:58.841362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'12","last_scrub_stamp":"2024-04-26T10:38:58.841336+0000","last_deep_scrub":"82'12","last_deep_scrub_stamp":"2024-04-26T10:38:58.841336+0000","last_clean_scrub_stamp":"2024-04-26T10:38:58.841336+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:39:26.881942+0000","scrub_duration":0.0042506749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:00.539928+0000","last_change":"2024-04-26T10:38:00.540104+0000","last_active":"2024-04-26T10:38:00.539928+0000","last_peered":"2024-04-26T10:38:00.539928+0000","last_clean":"2024-04-26T10:38:00.539928+0000","last_became_active":"2024-04-26T10:37:23.271752+0000","last_became_peered":"2024-04-26T10:37:23.271752+0000","last_unstale":"2024-04-26T10:38:00.539928+0000","last_undegraded":"2024-04-26T10:38:00.539928+0000","last_fullsized":"2024-04-26T10:38:00.539928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:00.539869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:00.539869+0000","last_clean_scrub_stamp":"2024-04-26T10:38:00.539869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:46.107019+0000","scrub_duration":0.052375984,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"82'2","reported_seq":95,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:18.965690+0000","last_change":"2024-04-26T10:39:18.965690+0000","last_active":"2024-04-26T10:39:18.965690+0000","last_peered":"2024-04-26T10:39:18.965690+0000","last_clean":"2024-04-26T10:39:18.965690+0000","last_became_active":"2024-04-26T10:37:23.272156+0000","last_became_peered":"2024-04-26T10:37:23.272156+0000","last_unstale":"2024-04-26T10:39:18.965690+0000","last_undegraded":"2024-04-26T10:39:18.965690+0000","last_fullsized":"2024-04-26T10:39:18.965690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T10:39:18.965538+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T10:39:18.965538+0000","last_clean_scrub_stamp":"2024-04-26T10:39:18.965538+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:12:59.014458+0000","scrub_duration":0.0031458609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:09.993498+0000","last_change":"2024-04-26T10:38:09.993498+0000","last_active":"2024-04-26T10:38:09.993498+0000","last_peered":"2024-04-26T10:38:09.993498+0000","last_clean":"2024-04-26T10:38:09.993498+0000","last_became_active":"2024-04-26T10:37:23.267717+0000","last_became_peered":"2024-04-26T10:37:23.267717+0000","last_unstale":"2024-04-26T10:38:09.993498+0000","last_undegraded":"2024-04-26T10:38:09.993498+0000","last_fullsized":"2024-04-26T10:38:09.993498+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:09.993363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:09.993363+0000","last_clean_scrub_stamp":"2024-04-26T10:38:09.993363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:57.793706+0000","scrub_duration":0.0019586830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"82'3","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:42.942776+0000","last_change":"2024-04-26T10:38:42.942922+0000","last_active":"2024-04-26T10:38:42.942776+0000","last_peered":"2024-04-26T10:38:42.942776+0000","last_clean":"2024-04-26T10:38:42.942776+0000","last_became_active":"2024-04-26T10:37:23.272260+0000","last_became_peered":"2024-04-26T10:37:23.272260+0000","last_unstale":"2024-04-26T10:38:42.942776+0000","last_undegraded":"2024-04-26T10:38:42.942776+0000","last_fullsized":"2024-04-26T10:38:42.942776+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:38:42.942735+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:38:42.942735+0000","last_clean_scrub_stamp":"2024-04-26T10:38:42.942735+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:46:00.597213+0000","scrub_duration":0.0033171590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:22.996504+0000","last_change":"2024-04-26T10:38:22.996504+0000","last_active":"2024-04-26T10:38:22.996504+0000","last_peered":"2024-04-26T10:38:22.996504+0000","last_clean":"2024-04-26T10:38:22.996504+0000","last_became_active":"2024-04-26T10:34:14.505254+0000","last_became_peered":"2024-04-26T10:34:14.505254+0000","last_unstale":"2024-04-26T10:38:22.996504+0000","last_undegraded":"2024-04-26T10:38:22.996504+0000","last_fullsized":"2024-04-26T10:38:22.996504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:22.996344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:22.996344+0000","last_clean_scrub_stamp":"2024-04-26T10:38:22.996344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:42.025260+0000","scrub_duration":0.001643909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"82'2","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:15.087778+0000","last_change":"2024-04-26T10:38:15.087778+0000","last_active":"2024-04-26T10:38:15.087778+0000","last_peered":"2024-04-26T10:38:15.087778+0000","last_clean":"2024-04-26T10:38:15.087778+0000","last_became_active":"2024-04-26T10:37:23.268441+0000","last_became_peered":"2024-04-26T10:37:23.268441+0000","last_unstale":"2024-04-26T10:38:15.087778+0000","last_undegraded":"2024-04-26T10:38:15.087778+0000","last_fullsized":"2024-04-26T10:38:15.087778+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T10:38:15.087643+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T10:38:15.087643+0000","last_clean_scrub_stamp":"2024-04-26T10:38:15.087643+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:32:42.284590+0000","scrub_duration":0.003756396,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:12.046827+0000","last_change":"2024-04-26T10:38:12.046827+0000","last_active":"2024-04-26T10:38:12.046827+0000","last_peered":"2024-04-26T10:38:12.046827+0000","last_clean":"2024-04-26T10:38:12.046827+0000","last_became_active":"2024-04-26T10:37:23.268451+0000","last_became_peered":"2024-04-26T10:37:23.268451+0000","last_unstale":"2024-04-26T10:38:12.046827+0000","last_undegraded":"2024-04-26T10:38:12.046827+0000","last_fullsized":"2024-04-26T10:38:12.046827+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:12.046640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:12.046640+0000","last_clean_scrub_stamp":"2024-04-26T10:38:12.046640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:03:04.521493+0000","scrub_duration":0.002019739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:27.817940+0000","last_change":"2024-04-26T10:39:27.817940+0000","last_active":"2024-04-26T10:39:27.817940+0000","last_peered":"2024-04-26T10:39:27.817940+0000","last_clean":"2024-04-26T10:39:27.817940+0000","last_became_active":"2024-04-26T10:37:23.272938+0000","last_became_peered":"2024-04-26T10:37:23.272938+0000","last_unstale":"2024-04-26T10:39:27.817940+0000","last_undegraded":"2024-04-26T10:39:27.817940+0000","last_fullsized":"2024-04-26T10:39:27.817940+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:27.817770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:27.817770+0000","last_clean_scrub_stamp":"2024-04-26T10:39:27.817770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:03.246249+0000","scrub_duration":0.001700048,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:42.638376+0000","last_change":"2024-04-26T10:37:42.638539+0000","last_active":"2024-04-26T10:37:42.638376+0000","last_peered":"2024-04-26T10:37:42.638376+0000","last_clean":"2024-04-26T10:37:42.638376+0000","last_became_active":"2024-04-26T10:37:23.276957+0000","last_became_peered":"2024-04-26T10:37:23.276957+0000","last_unstale":"2024-04-26T10:37:42.638376+0000","last_undegraded":"2024-04-26T10:37:42.638376+0000","last_fullsized":"2024-04-26T10:37:42.638376+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:42.638352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:42.638352+0000","last_clean_scrub_stamp":"2024-04-26T10:37:42.638352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:15.896041+0000","scrub_duration":0.027944383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'3","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:43.378881+0000","last_change":"2024-04-26T10:38:43.379010+0000","last_active":"2024-04-26T10:38:43.378881+0000","last_peered":"2024-04-26T10:38:43.378881+0000","last_clean":"2024-04-26T10:38:43.378881+0000","last_became_active":"2024-04-26T10:37:23.277037+0000","last_became_peered":"2024-04-26T10:37:23.277037+0000","last_unstale":"2024-04-26T10:38:43.378881+0000","last_undegraded":"2024-04-26T10:38:43.378881+0000","last_fullsized":"2024-04-26T10:38:43.378881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:38:43.378855+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:38:43.378855+0000","last_clean_scrub_stamp":"2024-04-26T10:38:43.378855+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:48:09.102845+0000","scrub_duration":0.0033491789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:57.882169+0000","last_change":"2024-04-26T10:38:57.882169+0000","last_active":"2024-04-26T10:38:57.882169+0000","last_peered":"2024-04-26T10:38:57.882169+0000","last_clean":"2024-04-26T10:38:57.882169+0000","last_became_active":"2024-04-26T10:37:23.269473+0000","last_became_peered":"2024-04-26T10:37:23.269473+0000","last_unstale":"2024-04-26T10:38:57.882169+0000","last_undegraded":"2024-04-26T10:38:57.882169+0000","last_fullsized":"2024-04-26T10:38:57.882169+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:57.882050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:57.882050+0000","last_clean_scrub_stamp":"2024-04-26T10:38:57.882050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:57:32.397616+0000","scrub_duration":0.0018123760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:51.892365+0000","last_change":"2024-04-26T10:38:51.892365+0000","last_active":"2024-04-26T10:38:51.892365+0000","last_peered":"2024-04-26T10:38:51.892365+0000","last_clean":"2024-04-26T10:38:51.892365+0000","last_became_active":"2024-04-26T10:37:23.267235+0000","last_became_peered":"2024-04-26T10:37:23.267235+0000","last_unstale":"2024-04-26T10:38:51.892365+0000","last_undegraded":"2024-04-26T10:38:51.892365+0000","last_fullsized":"2024-04-26T10:38:51.892365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:51.892239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:51.892239+0000","last_clean_scrub_stamp":"2024-04-26T10:38:51.892239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:47.035824+0000","scrub_duration":0.001868951,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:10.973799+0000","last_change":"2024-04-26T10:39:10.973799+0000","last_active":"2024-04-26T10:39:10.973799+0000","last_peered":"2024-04-26T10:39:10.973799+0000","last_clean":"2024-04-26T10:39:10.973799+0000","last_became_active":"2024-04-26T10:37:23.272111+0000","last_became_peered":"2024-04-26T10:37:23.272111+0000","last_unstale":"2024-04-26T10:39:10.973799+0000","last_undegraded":"2024-04-26T10:39:10.973799+0000","last_fullsized":"2024-04-26T10:39:10.973799+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:10.973665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:10.973665+0000","last_clean_scrub_stamp":"2024-04-26T10:39:10.973665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:08.698313+0000","scrub_duration":0.0016713710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:37.059303+0000","last_change":"2024-04-26T10:38:37.059303+0000","last_active":"2024-04-26T10:38:37.059303+0000","last_peered":"2024-04-26T10:38:37.059303+0000","last_clean":"2024-04-26T10:38:37.059303+0000","last_became_active":"2024-04-26T10:37:23.273867+0000","last_became_peered":"2024-04-26T10:37:23.273867+0000","last_unstale":"2024-04-26T10:38:37.059303+0000","last_undegraded":"2024-04-26T10:38:37.059303+0000","last_fullsized":"2024-04-26T10:38:37.059303+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:37.059156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:37.059156+0000","last_clean_scrub_stamp":"2024-04-26T10:38:37.059156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:44.572293+0000","scrub_duration":0.001855294,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:57.879044+0000","last_change":"2024-04-26T10:37:57.879044+0000","last_active":"2024-04-26T10:37:57.879044+0000","last_peered":"2024-04-26T10:37:57.879044+0000","last_clean":"2024-04-26T10:37:57.879044+0000","last_became_active":"2024-04-26T10:37:23.272569+0000","last_became_peered":"2024-04-26T10:37:23.272569+0000","last_unstale":"2024-04-26T10:37:57.879044+0000","last_undegraded":"2024-04-26T10:37:57.879044+0000","last_fullsized":"2024-04-26T10:37:57.879044+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:57.878919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:57.878919+0000","last_clean_scrub_stamp":"2024-04-26T10:37:57.878919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:02.166486+0000","scrub_duration":0.0020039089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:29.992871+0000","last_change":"2024-04-26T10:38:29.992871+0000","last_active":"2024-04-26T10:38:29.992871+0000","last_peered":"2024-04-26T10:38:29.992871+0000","last_clean":"2024-04-26T10:38:29.992871+0000","last_became_active":"2024-04-26T10:34:14.505831+0000","last_became_peered":"2024-04-26T10:34:14.505831+0000","last_unstale":"2024-04-26T10:38:29.992871+0000","last_undegraded":"2024-04-26T10:38:29.992871+0000","last_fullsized":"2024-04-26T10:38:29.992871+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:29.992711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:29.992711+0000","last_clean_scrub_stamp":"2024-04-26T10:38:29.992711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:30:32.502846+0000","scrub_duration":0.0017064700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:54.397113+0000","last_change":"2024-04-26T10:38:54.397244+0000","last_active":"2024-04-26T10:38:54.397113+0000","last_peered":"2024-04-26T10:38:54.397113+0000","last_clean":"2024-04-26T10:38:54.397113+0000","last_became_active":"2024-04-26T10:32:52.007921+0000","last_became_peered":"2024-04-26T10:32:52.007921+0000","last_unstale":"2024-04-26T10:38:54.397113+0000","last_undegraded":"2024-04-26T10:38:54.397113+0000","last_fullsized":"2024-04-26T10:38:54.397113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:54.397088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:54.397088+0000","last_clean_scrub_stamp":"2024-04-26T10:38:54.397088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:15.372732+0000","scrub_duration":0.054218492,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:10.379603+0000","last_change":"2024-04-26T10:39:10.379603+0000","last_active":"2024-04-26T10:39:10.379603+0000","last_peered":"2024-04-26T10:39:10.379603+0000","last_clean":"2024-04-26T10:39:10.379603+0000","last_became_active":"2024-04-26T10:37:28.282419+0000","last_became_peered":"2024-04-26T10:37:28.282419+0000","last_unstale":"2024-04-26T10:39:10.379603+0000","last_undegraded":"2024-04-26T10:39:10.379603+0000","last_fullsized":"2024-04-26T10:39:10.379603+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:10.379484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:10.379484+0000","last_clean_scrub_stamp":"2024-04-26T10:39:10.379484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:00.294598+0000","scrub_duration":0.001681498,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:47.889608+0000","last_change":"2024-04-26T10:37:47.889608+0000","last_active":"2024-04-26T10:37:47.889608+0000","last_peered":"2024-04-26T10:37:47.889608+0000","last_clean":"2024-04-26T10:37:47.889608+0000","last_became_active":"2024-04-26T10:37:23.273114+0000","last_became_peered":"2024-04-26T10:37:23.273114+0000","last_unstale":"2024-04-26T10:37:47.889608+0000","last_undegraded":"2024-04-26T10:37:47.889608+0000","last_fullsized":"2024-04-26T10:37:47.889608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:47.889480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:47.889480+0000","last_clean_scrub_stamp":"2024-04-26T10:37:47.889480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:38.351949+0000","scrub_duration":0.0018432660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:00.037320+0000","last_change":"2024-04-26T10:38:00.037320+0000","last_active":"2024-04-26T10:38:00.037320+0000","last_peered":"2024-04-26T10:38:00.037320+0000","last_clean":"2024-04-26T10:38:00.037320+0000","last_became_active":"2024-04-26T10:37:23.267319+0000","last_became_peered":"2024-04-26T10:37:23.267319+0000","last_unstale":"2024-04-26T10:38:00.037320+0000","last_undegraded":"2024-04-26T10:38:00.037320+0000","last_fullsized":"2024-04-26T10:38:00.037320+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:00.037154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:00.037154+0000","last_clean_scrub_stamp":"2024-04-26T10:38:00.037154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:01.442829+0000","scrub_duration":0.0020604550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:38.002661+0000","last_change":"2024-04-26T10:38:38.002661+0000","last_active":"2024-04-26T10:38:38.002661+0000","last_peered":"2024-04-26T10:38:38.002661+0000","last_clean":"2024-04-26T10:38:38.002661+0000","last_became_active":"2024-04-26T10:37:23.266332+0000","last_became_peered":"2024-04-26T10:37:23.266332+0000","last_unstale":"2024-04-26T10:38:38.002661+0000","last_undegraded":"2024-04-26T10:38:38.002661+0000","last_fullsized":"2024-04-26T10:38:38.002661+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:38.002497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:38.002497+0000","last_clean_scrub_stamp":"2024-04-26T10:38:38.002497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:04.953996+0000","scrub_duration":0.0019267080000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:32.115967+0000","last_change":"2024-04-26T10:38:32.115967+0000","last_active":"2024-04-26T10:38:32.115967+0000","last_peered":"2024-04-26T10:38:32.115967+0000","last_clean":"2024-04-26T10:38:32.115967+0000","last_became_active":"2024-04-26T10:37:23.269657+0000","last_became_peered":"2024-04-26T10:37:23.269657+0000","last_unstale":"2024-04-26T10:38:32.115967+0000","last_undegraded":"2024-04-26T10:38:32.115967+0000","last_fullsized":"2024-04-26T10:38:32.115967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:32.115807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:32.115807+0000","last_clean_scrub_stamp":"2024-04-26T10:38:32.115807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:12.148163+0000","scrub_duration":0.0016869439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:41.612919+0000","last_change":"2024-04-26T10:37:41.612919+0000","last_active":"2024-04-26T10:37:41.612919+0000","last_peered":"2024-04-26T10:37:41.612919+0000","last_clean":"2024-04-26T10:37:41.612919+0000","last_became_active":"2024-04-26T10:34:14.512924+0000","last_became_peered":"2024-04-26T10:34:14.512924+0000","last_unstale":"2024-04-26T10:37:41.612919+0000","last_undegraded":"2024-04-26T10:37:41.612919+0000","last_fullsized":"2024-04-26T10:37:41.612919+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:41.612787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:41.612787+0000","last_clean_scrub_stamp":"2024-04-26T10:37:41.612787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:08:15.886238+0000","scrub_duration":0.001521445,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:34.428825+0000","last_change":"2024-04-26T10:38:34.428825+0000","last_active":"2024-04-26T10:38:34.428825+0000","last_peered":"2024-04-26T10:38:34.428825+0000","last_clean":"2024-04-26T10:38:34.428825+0000","last_became_active":"2024-04-26T10:32:46.554964+0000","last_became_peered":"2024-04-26T10:32:46.554964+0000","last_unstale":"2024-04-26T10:38:34.428825+0000","last_undegraded":"2024-04-26T10:38:34.428825+0000","last_fullsized":"2024-04-26T10:38:34.428825+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:34.428529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:34.428529+0000","last_clean_scrub_stamp":"2024-04-26T10:38:34.428529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:41.415399+0000","scrub_duration":0.0019058580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:38.035356+0000","last_change":"2024-04-26T10:38:38.035356+0000","last_active":"2024-04-26T10:38:38.035356+0000","last_peered":"2024-04-26T10:38:38.035356+0000","last_clean":"2024-04-26T10:38:38.035356+0000","last_became_active":"2024-04-26T10:37:23.267595+0000","last_became_peered":"2024-04-26T10:37:23.267595+0000","last_unstale":"2024-04-26T10:38:38.035356+0000","last_undegraded":"2024-04-26T10:38:38.035356+0000","last_fullsized":"2024-04-26T10:38:38.035356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:38.035219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:38.035219+0000","last_clean_scrub_stamp":"2024-04-26T10:38:38.035219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:48:48.251247+0000","scrub_duration":0.0018318849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:18.553915+0000","last_change":"2024-04-26T10:38:18.553915+0000","last_active":"2024-04-26T10:38:18.553915+0000","last_peered":"2024-04-26T10:38:18.553915+0000","last_clean":"2024-04-26T10:38:18.553915+0000","last_became_active":"2024-04-26T10:34:14.511091+0000","last_became_peered":"2024-04-26T10:34:14.511091+0000","last_unstale":"2024-04-26T10:38:18.553915+0000","last_undegraded":"2024-04-26T10:38:18.553915+0000","last_fullsized":"2024-04-26T10:38:18.553915+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:18.553758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:18.553758+0000","last_clean_scrub_stamp":"2024-04-26T10:38:18.553758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:18.557993+0000","scrub_duration":0.028014801999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:46.963949+0000","last_change":"2024-04-26T10:38:46.963949+0000","last_active":"2024-04-26T10:38:46.963949+0000","last_peered":"2024-04-26T10:38:46.963949+0000","last_clean":"2024-04-26T10:38:46.963949+0000","last_became_active":"2024-04-26T10:37:23.270451+0000","last_became_peered":"2024-04-26T10:37:23.270451+0000","last_unstale":"2024-04-26T10:38:46.963949+0000","last_undegraded":"2024-04-26T10:38:46.963949+0000","last_fullsized":"2024-04-26T10:38:46.963949+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:46.963811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:46.963811+0000","last_clean_scrub_stamp":"2024-04-26T10:38:46.963811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:51:33.953521+0000","scrub_duration":0.0018432749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"82'159","reported_seq":315,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:06.016552+0000","last_change":"2024-04-26T10:39:06.016552+0000","last_active":"2024-04-26T10:39:06.016552+0000","last_peered":"2024-04-26T10:39:06.016552+0000","last_clean":"2024-04-26T10:39:06.016552+0000","last_became_active":"2024-04-26T10:37:23.268665+0000","last_became_peered":"2024-04-26T10:37:23.268665+0000","last_unstale":"2024-04-26T10:39:06.016552+0000","last_undegraded":"2024-04-26T10:39:06.016552+0000","last_fullsized":"2024-04-26T10:39:06.016552+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'159","last_scrub_stamp":"2024-04-26T10:39:06.016391+0000","last_deep_scrub":"82'159","last_deep_scrub_stamp":"2024-04-26T10:39:06.016391+0000","last_clean_scrub_stamp":"2024-04-26T10:39:06.016391+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:24.559177+0000","scrub_duration":0.0052622959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:38.410149+0000","last_change":"2024-04-26T10:38:38.410149+0000","last_active":"2024-04-26T10:38:38.410149+0000","last_peered":"2024-04-26T10:38:38.410149+0000","last_clean":"2024-04-26T10:38:38.410149+0000","last_became_active":"2024-04-26T10:32:51.587990+0000","last_became_peered":"2024-04-26T10:32:51.587990+0000","last_unstale":"2024-04-26T10:38:38.410149+0000","last_undegraded":"2024-04-26T10:38:38.410149+0000","last_fullsized":"2024-04-26T10:38:38.410149+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:38.409993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:38.409993+0000","last_clean_scrub_stamp":"2024-04-26T10:38:38.409993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:52:26.451120+0000","scrub_duration":0.0018049819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":84,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:58.886319+0000","last_change":"2024-04-26T10:37:58.886319+0000","last_active":"2024-04-26T10:37:58.886319+0000","last_peered":"2024-04-26T10:37:58.886319+0000","last_clean":"2024-04-26T10:37:58.886319+0000","last_became_active":"2024-04-26T10:37:23.269736+0000","last_became_peered":"2024-04-26T10:37:23.269736+0000","last_unstale":"2024-04-26T10:37:58.886319+0000","last_undegraded":"2024-04-26T10:37:58.886319+0000","last_fullsized":"2024-04-26T10:37:58.886319+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:58.886177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:58.886177+0000","last_clean_scrub_stamp":"2024-04-26T10:37:58.886177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:12:36.789200+0000","scrub_duration":0.002025603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:23.996208+0000","last_change":"2024-04-26T10:38:23.996208+0000","last_active":"2024-04-26T10:38:23.996208+0000","last_peered":"2024-04-26T10:38:23.996208+0000","last_clean":"2024-04-26T10:38:23.996208+0000","last_became_active":"2024-04-26T10:37:23.265317+0000","last_became_peered":"2024-04-26T10:37:23.265317+0000","last_unstale":"2024-04-26T10:38:23.996208+0000","last_undegraded":"2024-04-26T10:38:23.996208+0000","last_fullsized":"2024-04-26T10:38:23.996208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:23.996042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:23.996042+0000","last_clean_scrub_stamp":"2024-04-26T10:38:23.996042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:27:33.504025+0000","scrub_duration":0.001878865,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":103,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:36.367763+0000","last_change":"2024-04-26T10:38:36.367763+0000","last_active":"2024-04-26T10:38:36.367763+0000","last_peered":"2024-04-26T10:38:36.367763+0000","last_clean":"2024-04-26T10:38:36.367763+0000","last_became_active":"2024-04-26T10:37:23.276151+0000","last_became_peered":"2024-04-26T10:37:23.276151+0000","last_unstale":"2024-04-26T10:38:36.367763+0000","last_undegraded":"2024-04-26T10:38:36.367763+0000","last_fullsized":"2024-04-26T10:38:36.367763+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:36.367587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:36.367587+0000","last_clean_scrub_stamp":"2024-04-26T10:38:36.367587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:44.437172+0000","scrub_duration":0.001787358,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:20.029638+0000","last_change":"2024-04-26T10:38:20.029638+0000","last_active":"2024-04-26T10:38:20.029638+0000","last_peered":"2024-04-26T10:38:20.029638+0000","last_clean":"2024-04-26T10:38:20.029638+0000","last_became_active":"2024-04-26T10:32:51.998848+0000","last_became_peered":"2024-04-26T10:32:51.998848+0000","last_unstale":"2024-04-26T10:38:20.029638+0000","last_undegraded":"2024-04-26T10:38:20.029638+0000","last_fullsized":"2024-04-26T10:38:20.029638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:20.029457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:20.029457+0000","last_clean_scrub_stamp":"2024-04-26T10:38:20.029457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:05:12.454711+0000","scrub_duration":0.0017301249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:08.834615+0000","last_change":"2024-04-26T10:39:08.834740+0000","last_active":"2024-04-26T10:39:08.834615+0000","last_peered":"2024-04-26T10:39:08.834615+0000","last_clean":"2024-04-26T10:39:08.834615+0000","last_became_active":"2024-04-26T10:34:14.508652+0000","last_became_peered":"2024-04-26T10:34:14.508652+0000","last_unstale":"2024-04-26T10:39:08.834615+0000","last_undegraded":"2024-04-26T10:39:08.834615+0000","last_fullsized":"2024-04-26T10:39:08.834615+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:08.834593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:08.834593+0000","last_clean_scrub_stamp":"2024-04-26T10:39:08.834593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:57.730514+0000","scrub_duration":0.0015217340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":106,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:40.389685+0000","last_change":"2024-04-26T10:38:40.389685+0000","last_active":"2024-04-26T10:38:40.389685+0000","last_peered":"2024-04-26T10:38:40.389685+0000","last_clean":"2024-04-26T10:38:40.389685+0000","last_became_active":"2024-04-26T10:34:14.509275+0000","last_became_peered":"2024-04-26T10:34:14.509275+0000","last_unstale":"2024-04-26T10:38:40.389685+0000","last_undegraded":"2024-04-26T10:38:40.389685+0000","last_fullsized":"2024-04-26T10:38:40.389685+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:40.389519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:40.389519+0000","last_clean_scrub_stamp":"2024-04-26T10:38:40.389519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:20:12.790737+0000","scrub_duration":0.001581514,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:58.907760+0000","last_change":"2024-04-26T10:38:58.907760+0000","last_active":"2024-04-26T10:38:58.907760+0000","last_peered":"2024-04-26T10:38:58.907760+0000","last_clean":"2024-04-26T10:38:58.907760+0000","last_became_active":"2024-04-26T10:37:23.277309+0000","last_became_peered":"2024-04-26T10:37:23.277309+0000","last_unstale":"2024-04-26T10:38:58.907760+0000","last_undegraded":"2024-04-26T10:38:58.907760+0000","last_fullsized":"2024-04-26T10:38:58.907760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:58.907634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:58.907634+0000","last_clean_scrub_stamp":"2024-04-26T10:38:58.907634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:44.474784+0000","scrub_duration":0.0017121739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"82'3","reported_seq":93,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:15.552856+0000","last_change":"2024-04-26T10:38:15.552856+0000","last_active":"2024-04-26T10:38:15.552856+0000","last_peered":"2024-04-26T10:38:15.552856+0000","last_clean":"2024-04-26T10:38:15.552856+0000","last_became_active":"2024-04-26T10:32:51.588537+0000","last_became_peered":"2024-04-26T10:32:51.588537+0000","last_unstale":"2024-04-26T10:38:15.552856+0000","last_undegraded":"2024-04-26T10:38:15.552856+0000","last_fullsized":"2024-04-26T10:38:15.552856+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:38:15.552692+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:38:15.552692+0000","last_clean_scrub_stamp":"2024-04-26T10:38:15.552692+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:15.123234+0000","scrub_duration":0.0030682249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:35.393460+0000","last_change":"2024-04-26T10:38:35.393460+0000","last_active":"2024-04-26T10:38:35.393460+0000","last_peered":"2024-04-26T10:38:35.393460+0000","last_clean":"2024-04-26T10:38:35.393460+0000","last_became_active":"2024-04-26T10:34:14.509186+0000","last_became_peered":"2024-04-26T10:34:14.509186+0000","last_unstale":"2024-04-26T10:38:35.393460+0000","last_undegraded":"2024-04-26T10:38:35.393460+0000","last_fullsized":"2024-04-26T10:38:35.393460+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:35.393312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:35.393312+0000","last_clean_scrub_stamp":"2024-04-26T10:38:35.393312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:07.081724+0000","scrub_duration":0.001855916,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":97,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:01.537057+0000","last_change":"2024-04-26T10:38:01.537057+0000","last_active":"2024-04-26T10:38:01.537057+0000","last_peered":"2024-04-26T10:38:01.537057+0000","last_clean":"2024-04-26T10:38:01.537057+0000","last_became_active":"2024-04-26T10:37:28.281669+0000","last_became_peered":"2024-04-26T10:37:28.281669+0000","last_unstale":"2024-04-26T10:38:01.537057+0000","last_undegraded":"2024-04-26T10:38:01.537057+0000","last_fullsized":"2024-04-26T10:38:01.537057+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:01.536922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:01.536922+0000","last_clean_scrub_stamp":"2024-04-26T10:38:01.536922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:55:18.958300+0000","scrub_duration":0.0019935619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:03.992792+0000","last_change":"2024-04-26T10:38:03.992792+0000","last_active":"2024-04-26T10:38:03.992792+0000","last_peered":"2024-04-26T10:38:03.992792+0000","last_clean":"2024-04-26T10:38:03.992792+0000","last_became_active":"2024-04-26T10:37:23.268673+0000","last_became_peered":"2024-04-26T10:37:23.268673+0000","last_unstale":"2024-04-26T10:38:03.992792+0000","last_undegraded":"2024-04-26T10:38:03.992792+0000","last_fullsized":"2024-04-26T10:38:03.992792+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:03.992656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:03.992656+0000","last_clean_scrub_stamp":"2024-04-26T10:38:03.992656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:36:06.482083+0000","scrub_duration":0.0019801340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"82'2","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:48.393779+0000","last_change":"2024-04-26T10:38:48.393779+0000","last_active":"2024-04-26T10:38:48.393779+0000","last_peered":"2024-04-26T10:38:48.393779+0000","last_clean":"2024-04-26T10:38:48.393779+0000","last_became_active":"2024-04-26T10:37:23.277001+0000","last_became_peered":"2024-04-26T10:37:23.277001+0000","last_unstale":"2024-04-26T10:38:48.393779+0000","last_undegraded":"2024-04-26T10:38:48.393779+0000","last_fullsized":"2024-04-26T10:38:48.393779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-26T10:38:48.393591+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-26T10:38:48.393591+0000","last_clean_scrub_stamp":"2024-04-26T10:38:48.393591+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:30:47.295722+0000","scrub_duration":0.0033183689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:14.919416+0000","last_change":"2024-04-26T10:39:14.919552+0000","last_active":"2024-04-26T10:39:14.919416+0000","last_peered":"2024-04-26T10:39:14.919416+0000","last_clean":"2024-04-26T10:39:14.919416+0000","last_became_active":"2024-04-26T10:37:23.266912+0000","last_became_peered":"2024-04-26T10:37:23.266912+0000","last_unstale":"2024-04-26T10:39:14.919416+0000","last_undegraded":"2024-04-26T10:39:14.919416+0000","last_fullsized":"2024-04-26T10:39:14.919416+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:14.919390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:14.919390+0000","last_clean_scrub_stamp":"2024-04-26T10:39:14.919390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.489932+0000","scrub_duration":0.0021573389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:39.091234+0000","last_change":"2024-04-26T10:37:39.091234+0000","last_active":"2024-04-26T10:37:39.091234+0000","last_peered":"2024-04-26T10:37:39.091234+0000","last_clean":"2024-04-26T10:37:39.091234+0000","last_became_active":"2024-04-26T10:37:23.277303+0000","last_became_peered":"2024-04-26T10:37:23.277303+0000","last_unstale":"2024-04-26T10:37:39.091234+0000","last_undegraded":"2024-04-26T10:37:39.091234+0000","last_fullsized":"2024-04-26T10:37:39.091234+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:37:39.091052+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:37:39.091052+0000","last_clean_scrub_stamp":"2024-04-26T10:37:39.091052+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:34.281919+0000","scrub_duration":0.0021606110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:29.028179+0000","last_change":"2024-04-26T10:38:29.028282+0000","last_active":"2024-04-26T10:38:29.028179+0000","last_peered":"2024-04-26T10:38:29.028179+0000","last_clean":"2024-04-26T10:38:29.028179+0000","last_became_active":"2024-04-26T10:32:51.998974+0000","last_became_peered":"2024-04-26T10:32:51.998974+0000","last_unstale":"2024-04-26T10:38:29.028179+0000","last_undegraded":"2024-04-26T10:38:29.028179+0000","last_fullsized":"2024-04-26T10:38:29.028179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:29.028154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:29.028154+0000","last_clean_scrub_stamp":"2024-04-26T10:38:29.028154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:06:33.111156+0000","scrub_duration":0.001813516,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"82'3","reported_seq":85,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:21.919404+0000","last_change":"2024-04-26T10:39:21.919498+0000","last_active":"2024-04-26T10:39:21.919404+0000","last_peered":"2024-04-26T10:39:21.919404+0000","last_clean":"2024-04-26T10:39:21.919404+0000","last_became_active":"2024-04-26T10:37:23.266295+0000","last_became_peered":"2024-04-26T10:37:23.266295+0000","last_unstale":"2024-04-26T10:39:21.919404+0000","last_undegraded":"2024-04-26T10:39:21.919404+0000","last_fullsized":"2024-04-26T10:39:21.919404+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:39:21.919380+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:39:21.919380+0000","last_clean_scrub_stamp":"2024-04-26T10:39:21.919380+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:18.095708+0000","scrub_duration":0.003345046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:37:49.930540+0000","last_change":"2024-04-26T10:37:49.930694+0000","last_active":"2024-04-26T10:37:49.930540+0000","last_peered":"2024-04-26T10:37:49.930540+0000","last_clean":"2024-04-26T10:37:49.930540+0000","last_became_active":"2024-04-26T10:37:23.272039+0000","last_became_peered":"2024-04-26T10:37:23.272039+0000","last_unstale":"2024-04-26T10:37:49.930540+0000","last_undegraded":"2024-04-26T10:37:49.930540+0000","last_fullsized":"2024-04-26T10:37:49.930540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:37:49.930517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:37:49.930517+0000","last_clean_scrub_stamp":"2024-04-26T10:37:49.930517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:31.070842+0000","scrub_duration":0.046350850999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"82'3","reported_seq":108,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:45.911007+0000","last_change":"2024-04-26T10:38:45.911112+0000","last_active":"2024-04-26T10:38:45.911007+0000","last_peered":"2024-04-26T10:38:45.911007+0000","last_clean":"2024-04-26T10:38:45.911007+0000","last_became_active":"2024-04-26T10:37:23.273253+0000","last_became_peered":"2024-04-26T10:37:23.273253+0000","last_unstale":"2024-04-26T10:38:45.911007+0000","last_undegraded":"2024-04-26T10:38:45.911007+0000","last_fullsized":"2024-04-26T10:38:45.911007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-26T10:38:45.910980+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-26T10:38:45.910980+0000","last_clean_scrub_stamp":"2024-04-26T10:38:45.910980+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:11:39.494680+0000","scrub_duration":0.0033169100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:01.936983+0000","last_change":"2024-04-26T10:39:01.937087+0000","last_active":"2024-04-26T10:39:01.936983+0000","last_peered":"2024-04-26T10:39:01.936983+0000","last_clean":"2024-04-26T10:39:01.936983+0000","last_became_active":"2024-04-26T10:37:23.267434+0000","last_became_peered":"2024-04-26T10:37:23.267434+0000","last_unstale":"2024-04-26T10:39:01.936983+0000","last_undegraded":"2024-04-26T10:39:01.936983+0000","last_fullsized":"2024-04-26T10:39:01.936983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:01.936961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:01.936961+0000","last_clean_scrub_stamp":"2024-04-26T10:39:01.936961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:24.275039+0000","scrub_duration":0.0019342369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":91,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:11.578515+0000","last_change":"2024-04-26T10:38:11.578515+0000","last_active":"2024-04-26T10:38:11.578515+0000","last_peered":"2024-04-26T10:38:11.578515+0000","last_clean":"2024-04-26T10:38:11.578515+0000","last_became_active":"2024-04-26T10:32:51.588699+0000","last_became_peered":"2024-04-26T10:32:51.588699+0000","last_unstale":"2024-04-26T10:38:11.578515+0000","last_undegraded":"2024-04-26T10:38:11.578515+0000","last_fullsized":"2024-04-26T10:38:11.578515+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'1","last_scrub_stamp":"2024-04-26T10:38:11.578322+0000","last_deep_scrub":"14'1","last_deep_scrub_stamp":"2024-04-26T10:38:11.578322+0000","last_clean_scrub_stamp":"2024-04-26T10:38:11.578322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:28:12.780448+0000","scrub_duration":0.0019376879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:20.962916+0000","last_change":"2024-04-26T10:39:20.963036+0000","last_active":"2024-04-26T10:39:20.962916+0000","last_peered":"2024-04-26T10:39:20.962916+0000","last_clean":"2024-04-26T10:39:20.962916+0000","last_became_active":"2024-04-26T10:34:14.506314+0000","last_became_peered":"2024-04-26T10:34:14.506314+0000","last_unstale":"2024-04-26T10:39:20.962916+0000","last_undegraded":"2024-04-26T10:39:20.962916+0000","last_fullsized":"2024-04-26T10:39:20.962916+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:20.962892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:20.962892+0000","last_clean_scrub_stamp":"2024-04-26T10:39:20.962892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:13.760898+0000","scrub_duration":0.015954963999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:04.517785+0000","last_change":"2024-04-26T10:38:04.517785+0000","last_active":"2024-04-26T10:38:04.517785+0000","last_peered":"2024-04-26T10:38:04.517785+0000","last_clean":"2024-04-26T10:38:04.517785+0000","last_became_active":"2024-04-26T10:37:23.271663+0000","last_became_peered":"2024-04-26T10:37:23.271663+0000","last_unstale":"2024-04-26T10:38:04.517785+0000","last_undegraded":"2024-04-26T10:38:04.517785+0000","last_fullsized":"2024-04-26T10:38:04.517785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-26T10:38:04.517652+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-26T10:38:04.517652+0000","last_clean_scrub_stamp":"2024-04-26T10:38:04.517652+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:57.558254+0000","scrub_duration":0.0039017489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:06.954934+0000","last_change":"2024-04-26T10:38:06.955074+0000","last_active":"2024-04-26T10:38:06.954934+0000","last_peered":"2024-04-26T10:38:06.954934+0000","last_clean":"2024-04-26T10:38:06.954934+0000","last_became_active":"2024-04-26T10:37:23.266624+0000","last_became_peered":"2024-04-26T10:37:23.266624+0000","last_unstale":"2024-04-26T10:38:06.954934+0000","last_undegraded":"2024-04-26T10:38:06.954934+0000","last_fullsized":"2024-04-26T10:38:06.954934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:06.954911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:06.954911+0000","last_clean_scrub_stamp":"2024-04-26T10:38:06.954911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:18.063497+0000","scrub_duration":0.0021816610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":82,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:25.969756+0000","last_change":"2024-04-26T10:38:25.969756+0000","last_active":"2024-04-26T10:38:25.969756+0000","last_peered":"2024-04-26T10:38:25.969756+0000","last_clean":"2024-04-26T10:38:25.969756+0000","last_became_active":"2024-04-26T10:37:23.266063+0000","last_became_peered":"2024-04-26T10:37:23.266063+0000","last_unstale":"2024-04-26T10:38:25.969756+0000","last_undegraded":"2024-04-26T10:38:25.969756+0000","last_fullsized":"2024-04-26T10:38:25.969756+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:25.969600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:25.969600+0000","last_clean_scrub_stamp":"2024-04-26T10:38:25.969600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:03.988066+0000","scrub_duration":0.001770282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:39:07.371966+0000","last_change":"2024-04-26T10:39:07.371966+0000","last_active":"2024-04-26T10:39:07.371966+0000","last_peered":"2024-04-26T10:39:07.371966+0000","last_clean":"2024-04-26T10:39:07.371966+0000","last_became_active":"2024-04-26T10:37:28.281541+0000","last_became_peered":"2024-04-26T10:37:28.281541+0000","last_unstale":"2024-04-26T10:39:07.371966+0000","last_undegraded":"2024-04-26T10:39:07.371966+0000","last_fullsized":"2024-04-26T10:39:07.371966+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:39:07.371835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:39:07.371835+0000","last_clean_scrub_stamp":"2024-04-26T10:39:07.371835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:37.739119+0000","scrub_duration":0.0023571460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:06.997233+0000","last_change":"2024-04-26T10:38:06.997233+0000","last_active":"2024-04-26T10:38:06.997233+0000","last_peered":"2024-04-26T10:38:06.997233+0000","last_clean":"2024-04-26T10:38:06.997233+0000","last_became_active":"2024-04-26T10:37:23.267644+0000","last_became_peered":"2024-04-26T10:37:23.267644+0000","last_unstale":"2024-04-26T10:38:06.997233+0000","last_undegraded":"2024-04-26T10:38:06.997233+0000","last_fullsized":"2024-04-26T10:38:06.997233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:06.997106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:06.997106+0000","last_clean_scrub_stamp":"2024-04-26T10:38:06.997106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:56:00.253043+0000","scrub_duration":0.001652953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":105,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:22.504052+0000","last_change":"2024-04-26T10:38:22.504052+0000","last_active":"2024-04-26T10:38:22.504052+0000","last_peered":"2024-04-26T10:38:22.504052+0000","last_clean":"2024-04-26T10:38:22.504052+0000","last_became_active":"2024-04-26T10:34:14.515915+0000","last_became_peered":"2024-04-26T10:34:14.515915+0000","last_unstale":"2024-04-26T10:38:22.504052+0000","last_undegraded":"2024-04-26T10:38:22.504052+0000","last_fullsized":"2024-04-26T10:38:22.504052+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:22.503891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:22.503891+0000","last_clean_scrub_stamp":"2024-04-26T10:38:22.503891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:15.301897+0000","scrub_duration":0.027299981000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T10:38:16.025759+0000","last_change":"2024-04-26T10:38:16.025759+0000","last_active":"2024-04-26T10:38:16.025759+0000","last_peered":"2024-04-26T10:38:16.025759+0000","last_clean":"2024-04-26T10:38:16.025759+0000","last_became_active":"2024-04-26T10:37:23.273023+0000","last_became_peered":"2024-04-26T10:37:23.273023+0000","last_unstale":"2024-04-26T10:38:16.025759+0000","last_undegraded":"2024-04-26T10:38:16.025759+0000","last_fullsized":"2024-04-26T10:38:16.025759+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:38:16.025616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:38:16.025616+0000","last_clean_scrub_stamp":"2024-04-26T10:38:16.025616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:37.698478+0000","scrub_duration":0.0018282789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1766,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738454,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":338824,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":337918,"kb_avail":94033016,"statfs":{"total":96636764160,"available":96289808384,"internally_reserved":0,"allocated":917504,"data_stored":359527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":346028486},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:39:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48899999999999999,"15min":0.49199999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.55300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.59599999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.51000000000000001}]},{"osd":1,"last update":"Fri Apr 26 10:38:53 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.498,"15min":0.40000000000000002},"min":{"1min":0.26800000000000002,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.59999999999999998,"5min":4.7069999999999999,"15min":4.7069999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.65300000000000002,"15min":0.501},"min":{"1min":0.31900000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.59199999999999997,"5min":12.206,"15min":12.206},"last":0.49199999999999999}]}]},{"osd":0,"up_from":75,"seq":322122547229,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55012,"kb_used_data":1500,"kb_used_omap":6,"kb_used_meta":53497,"kb_avail":94316828,"statfs":{"total":96636764160,"available":96580431872,"internally_reserved":0,"allocated":1536000,"data_stored":951641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7111,"internal_metadata":54780985},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:39:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.495,"15min":0.499},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.628,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.5,"15min":0.504},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Apr 26 10:39:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52900000000000003,"15min":0.53100000000000003},"min":{"1min":0.36299999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.53300000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738453,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257368,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":255870,"kb_avail":94114472,"statfs":{"total":96636764160,"available":96373219328,"internally_reserved":0,"allocated":1523712,"data_stored":948912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262011334},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:39:23 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45200000000000001,"15min":0.45100000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.45700000000000002,"15min":0.45200000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.47199999999999998}]},{"osd":2,"last update":"Fri Apr 26 10:38:54 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48199999999999998,"15min":0.376},"min":{"1min":0.38400000000000001,"5min":0.17499999999999999,"15min":0.17199999999999999},"max":{"1min":0.55300000000000005,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.499,"15min":0.45700000000000002},"min":{"1min":0.40500000000000003,"5min":0.183,"15min":0.183},"max":{"1min":0.63500000000000001,"5min":5.8280000000000003,"15min":5.8280000000000003},"last":0.42899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5517,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:39:40.059 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T10:39:40.446 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T10:39:40.446 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:39:40.827 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:39:40.827 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:32:51.988112+0000","modified":"2024-04-26T10:32:54.993485+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6803/3548002075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3548002075},{"type":"v1","addr":"172.21.15.43:6803","nonce":3548002075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:39:40.830 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-26T10:39:40.841 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:39:41.228 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:39:41.228 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:32:51.988112+0000","modified":"2024-04-26T10:32:54.993485+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4186},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4186":{"gid":4186,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.43:6803/3548002075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3548002075},{"type":"v1","addr":"172.21.15.43:6803","nonce":3548002075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:39:41.231 INFO:teuthology.orchestra.run.smithi043.stderr:dumped fsmap epoch 6 2024-04-26T10:39:41.242 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:39:41.583 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-04-26T10:39:41.584 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":82,"fsid":"6d35b773-83ef-4e54-be62-89cec0b09327","created":"2024-04-26T10:32:36.651799+0000","modified":"2024-04-26T10:37:29.279779+0000","last_up_change":"2024-04-26T10:37:22.247952+0000","last_in_change":"2024-04-26T10:32:37.588200+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:32:45.037545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:32:45.393201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:32:49.859710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:32:50.968196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"32399f03-8160-43f7-a69f-1db73f105676","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":58,"up_from":75,"up_thru":75,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":6175},{"type":"v1","addr":"172.21.15.112:6801","nonce":6175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":6175},{"type":"v1","addr":"172.21.15.112:6803","nonce":6175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":6175},{"type":"v1","addr":"172.21.15.112:6807","nonce":6175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":6175},{"type":"v1","addr":"172.21.15.112:6805","nonce":6175}]},"public_addr":"172.21.15.112:6801/6175","cluster_addr":"172.21.15.112:6803/6175","heartbeat_back_addr":"172.21.15.112:6807/6175","heartbeat_front_addr":"172.21.15.112:6805/6175","state":["exists","up"]},{"osd":1,"uuid":"89e46a83-bfff-458f-bbac-258edb6ddad2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":41804},{"type":"v1","addr":"172.21.15.186:6801","nonce":41804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":41804},{"type":"v1","addr":"172.21.15.186:6803","nonce":41804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":41804},{"type":"v1","addr":"172.21.15.186:6807","nonce":41804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":41804},{"type":"v1","addr":"172.21.15.186:6805","nonce":41804}]},"public_addr":"172.21.15.186:6801/41804","cluster_addr":"172.21.15.186:6803/41804","heartbeat_back_addr":"172.21.15.186:6807/41804","heartbeat_front_addr":"172.21.15.186:6805/41804","state":["exists","up"]},{"osd":2,"uuid":"24c9e06d-1386-4075-b64e-d6c1d57c57bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":41919},{"type":"v1","addr":"172.21.15.187:6801","nonce":41919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":41919},{"type":"v1","addr":"172.21.15.187:6803","nonce":41919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":41919},{"type":"v1","addr":"172.21.15.187:6807","nonce":41919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":41919},{"type":"v1","addr":"172.21.15.187:6805","nonce":41919}]},"public_addr":"172.21.15.187:6801/41919","cluster_addr":"172.21.15.187:6803/41919","heartbeat_back_addr":"172.21.15.187:6807/41919","heartbeat_front_addr":"172.21.15.187:6805/41919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.579572+0000","dead_epoch":58},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.596783+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:32:42.632883+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:39:41.598 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T10:39:41.992 INFO:tasks.ceph.mds.a.smithi043.stderr: -2150> 2024-04-26T10:32:56.679+0000 7f122f14a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T10:39:41.996 INFO:teuthology.orchestra.run.smithi043.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T10:39:42.009 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T10:39:42.020 INFO:tasks.ceph.mds.a.smithi043.stdout:starting mds.a at 2024-04-26T10:39:43.012 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T10:39:44.004 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_metadata' removed 2024-04-26T10:39:44.018 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T10:39:45.006 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'cephfs_data' removed 2024-04-26T10:39:45.020 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T10:39:45.020 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T10:39:45.020 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:39:45.029 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T10:39:45.029 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T10:39:45.030 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T10:39:45.030 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:39:45.072 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T10:39:45.072 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T10:39:45.073 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:39:45.118 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T10:39:45.119 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T10:39:45.119 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:39:45.167 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T10:39:45.167 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T10:39:45.168 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T10:39:45.168 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:39:45.197 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T10:39:45.198 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T10:39:45.198 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:39:45.268 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T10:39:45.268 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T10:39:45.268 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T10:39:45.268 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:39:45.320 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T10:39:45.321 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T10:39:45.321 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:39:45.372 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T10:39:45.373 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T10:39:45.373 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:39:45.425 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T10:39:45.425 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T10:39:45.425 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-26T10:39:45.505 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T10:39:45.505 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T10:39:45.633 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-26T10:39:45.633 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T10:39:45.783 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi187.front.sepia.ceph.com 2024-04-26T10:39:45.783 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T10:39:45.936 INFO:tasks.ceph:Archiving mon data... 2024-04-26T10:39:45.937 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/data/mon.a.tgz 2024-04-26T10:39:45.937 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-04-26T10:39:45.959 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.8RLlEgbv0G 2024-04-26T10:39:45.960 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.8RLlEgbv0G 2024-04-26T10:39:46.124 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.8RLlEgbv0G 2024-04-26T10:39:46.214 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.8RLlEgbv0G is 394KB 2024-04-26T10:39:46.312 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.8RLlEgbv0G 2024-04-26T10:39:46.330 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/data/mon.b.tgz 2024-04-26T10:39:46.330 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-04-26T10:39:46.388 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.B0YK85ZfDP 2024-04-26T10:39:46.389 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.B0YK85ZfDP 2024-04-26T10:39:46.567 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.B0YK85ZfDP 2024-04-26T10:39:46.656 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.B0YK85ZfDP is 538KB 2024-04-26T10:39:46.753 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.B0YK85ZfDP 2024-04-26T10:39:46.771 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/data/mon.c.tgz 2024-04-26T10:39:46.772 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-04-26T10:39:46.828 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.N8AQ1la0ff 2024-04-26T10:39:46.829 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.N8AQ1la0ff 2024-04-26T10:39:47.010 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.N8AQ1la0ff 2024-04-26T10:39:47.099 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.N8AQ1la0ff is 539KB 2024-04-26T10:39:47.196 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.N8AQ1la0ff 2024-04-26T10:39:47.214 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T10:39:47.214 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T10:39:47.259 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T10:39:47.262 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T10:39:47.266 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T10:39:47.407 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-26T10:39:47.408 DEBUG:teuthology.orchestra.run.smithi043:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T10:39:47.410 DEBUG:teuthology.orchestra.run.smithi112:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T10:39:47.414 DEBUG:teuthology.orchestra.run.smithi186:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T10:39:47.416 DEBUG:teuthology.orchestra.run.smithi187:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T10:39:47.437 INFO:teuthology.orchestra.run.smithi043.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T10:39:47.448 INFO:teuthology.orchestra.run.smithi186.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T10:39:47.449 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T10:39:47.457 INFO:teuthology.orchestra.run.smithi112.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T10:39:47.464 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T10:39:47.466 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/remote/smithi043/crash 2024-04-26T10:39:47.467 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T10:39:47.511 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/remote/smithi112/crash 2024-04-26T10:39:47.512 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T10:39:47.562 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/remote/smithi186/crash 2024-04-26T10:39:47.563 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T10:39:47.623 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/remote/smithi187/crash 2024-04-26T10:39:47.624 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T10:39:47.672 INFO:tasks.ceph:Compressing logs... 2024-04-26T10:39:47.673 DEBUG:teuthology.orchestra.run.smithi043:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:39:47.676 DEBUG:teuthology.orchestra.run.smithi112:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:39:47.678 DEBUG:teuthology.orchestra.run.smithi186:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:39:47.680 DEBUG:teuthology.orchestra.run.smithi187:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:40:25.061 INFO:tasks.ceph:Archiving logs... 2024-04-26T10:40:25.062 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/remote/smithi043/log 2024-04-26T10:40:25.063 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T10:40:25.419 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/remote/smithi112/log 2024-04-26T10:40:25.420 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T10:40:28.682 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/remote/smithi186/log 2024-04-26T10:40:28.683 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T10:40:32.504 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/remote/smithi187/log 2024-04-26T10:40:32.505 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T10:40:37.428 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T10:40:37.442 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T10:40:37.442 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T10:40:37.446 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T10:40:37.448 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T10:40:37.451 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T10:40:37.620 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T10:40:37.630 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T10:40:37.630 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:40:37.633 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:40:37.635 DEBUG:teuthology.orchestra.run.smithi186:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:40:37.641 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:40:37.651 INFO:teuthology.orchestra.run.smithi043.stderr:bash: ntpq: command not found 2024-04-26T10:40:37.653 INFO:teuthology.orchestra.run.smithi112.stderr:bash: ntpq: command not found 2024-04-26T10:40:37.656 INFO:teuthology.orchestra.run.smithi186.stderr:bash: ntpq: command not found 2024-04-26T10:40:37.656 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T10:40:37.657 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-04-26T10:40:37.657 INFO:teuthology.orchestra.run.smithi043.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 +1091us[+1075us] +/- 53ms 2024-04-26T10:40:37.657 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -1846us[-1846us] +/- 53ms 2024-04-26T10:40:37.657 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 138 +717us[ +457us] +/- 92ms 2024-04-26T10:40:37.657 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:37.658 INFO:teuthology.orchestra.run.smithi112.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T10:40:37.659 INFO:teuthology.orchestra.run.smithi112.stdout:=============================================================================== 2024-04-26T10:40:37.659 INFO:teuthology.orchestra.run.smithi112.stdout:^* hv01.front.sepia.ceph.com 3 6 177 14 +1240us[+1230us] +/- 53ms 2024-04-26T10:40:37.659 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 13 -1654us[-1654us] +/- 52ms 2024-04-26T10:40:37.659 INFO:teuthology.orchestra.run.smithi112.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 15 +826us[ +816us] +/- 94ms 2024-04-26T10:40:37.659 INFO:teuthology.orchestra.run.smithi112.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:37.660 INFO:teuthology.orchestra.run.smithi187.stderr:bash: ntpq: command not found 2024-04-26T10:40:37.661 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T10:40:37.661 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-04-26T10:40:37.661 INFO:teuthology.orchestra.run.smithi186.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +1228us[+1223us] +/- 53ms 2024-04-26T10:40:37.661 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 -1710us[-1716us] +/- 53ms 2024-04-26T10:40:37.661 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +823us[ +817us] +/- 94ms 2024-04-26T10:40:37.661 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:37.665 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T10:40:37.665 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2024-04-26T10:40:37.665 INFO:teuthology.orchestra.run.smithi187.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +1203us[+1166us] +/- 53ms 2024-04-26T10:40:37.665 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 -1733us[-1770us] +/- 53ms 2024-04-26T10:40:37.665 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +800us[ +763us] +/- 94ms 2024-04-26T10:40:37.666 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T10:40:37.666 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T10:40:37.678 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T10:40:37.678 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T10:40:37.717 DEBUG:teuthology.orchestra.run.smithi043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T10:40:37.792 DEBUG:teuthology.orchestra.run.smithi112:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T10:40:37.919 DEBUG:teuthology.orchestra.run.smithi186:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T10:40:37.991 DEBUG:teuthology.orchestra.run.smithi187:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T10:40:38.062 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T10:40:38.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:40:38.097 DEBUG:teuthology.orchestra.run.smithi112:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T10:40:38.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:40:38.133 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T10:40:38.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:40:38.167 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-26T10:40:38.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:40:38.199 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T10:40:38.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T10:40:38.247 INFO:teuthology.task.internal:Duration was 3261.790818 seconds 2024-04-26T10:40:38.248 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T10:40:38.300 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T10:40:38.300 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T10:40:38.303 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T10:40:38.305 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T10:40:38.308 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T10:40:38.354 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T10:40:38.357 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T10:40:38.359 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T10:40:38.389 INFO:teuthology.orchestra.run.smithi112.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T10:40:38.825 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T10:40:38.825 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-04-26T10:40:38.826 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T10:40:38.854 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-04-26T10:40:38.854 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T10:40:38.881 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi186.front.sepia.ceph.com 2024-04-26T10:40:38.881 DEBUG:teuthology.orchestra.run.smithi186:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T10:40:38.908 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2024-04-26T10:40:38.909 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T10:40:38.936 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T10:40:38.937 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:40:38.940 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:40:38.942 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:40:38.951 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:40:39.024 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T10:40:39.024 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T10:40:39.026 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T10:40:39.029 DEBUG:teuthology.orchestra.run.smithi186:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T10:40:39.032 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T10:40:39.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T10:40:39.116 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T10:40:39.116 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T10:40:39.144 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T10:40:39.174 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T10:40:39.202 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T10:40:39.230 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T10:40:39.246 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:40:39.249 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:40:39.251 DEBUG:teuthology.orchestra.run.smithi186:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:40:39.254 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:40:39.274 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-04-26T10:40:39.278 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-04-26T10:40:39.279 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = core 2024-04-26T10:40:39.296 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2024-04-26T10:40:39.318 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:40:39.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:40:39.362 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:40:39.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:40:39.379 DEBUG:teuthology.orchestra.run.smithi186:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:40:39.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:40:39.397 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:40:39.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:40:39.414 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T10:40:39.427 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T10:40:39.428 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/remote/smithi043 2024-04-26T10:40:39.428 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T10:40:39.470 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/remote/smithi112 2024-04-26T10:40:39.471 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T10:40:39.511 DEBUG:teuthology.misc:Transferring archived files from smithi186:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/remote/smithi186 2024-04-26T10:40:39.512 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T10:40:39.553 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674084/remote/smithi187 2024-04-26T10:40:39.553 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T10:40:39.593 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T10:40:39.594 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T10:40:39.596 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T10:40:39.598 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T10:40:39.601 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T10:40:39.645 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T10:40:39.658 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T10:40:39.658 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T10:40:39.709 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T10:40:39.710 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T10:40:39.712 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T10:40:39.714 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T10:40:39.716 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T10:40:39.728 INFO:teuthology.orchestra.run.smithi043.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 10:40 /home/ubuntu/cephtest 2024-04-26T10:40:39.730 INFO:teuthology.orchestra.run.smithi112.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 10:40 /home/ubuntu/cephtest 2024-04-26T10:40:39.732 INFO:teuthology.orchestra.run.smithi186.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 10:40 /home/ubuntu/cephtest 2024-04-26T10:40:39.733 INFO:teuthology.orchestra.run.smithi187.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 10:40 /home/ubuntu/cephtest 2024-04-26T10:40:39.735 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T10:40:39.760 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T10:40:39.862 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health} duration: 3261.790818452835 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-26T10:40:39.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T10:40:39.984 INFO:teuthology.run:pass